In this paper we answer the question of how evaluation should be by proposing a good evaluation of research practices. A good evaluation of research practices, intended as social practices à la MacIntyre, should take into account the stable motivations and the traits of the characters (i.e. the virtues) of researchers. We also show that a good evaluation is also just, beyond the sense of fairness, as working on good research practices implies keep into account a broader sense of justice. After that, we propose the development of a knowl- edge base for the assessment of “good” evaluations of research practices to implement a questionnaire for the assessment of researchers’ virtues. Although the latter is a challeng- ing task, the use of ontologies and taxonomic knowledge, and the reasoning algorithms that can draw inferences on the basis of such knowledge represents a way for testing the consistency of the information reported in the questionnaire and to analyse correctly and coherently how the data is gathered through it. Finally, we describe the potential applica- tion usefulness of our proposal for the reform of current research assessment systems.
How should evaluation be? Is a good evaluation of research also just? Towards the implementation of good evaluation / Daraio, Cinzia; Vaccari, Alessio. - In: SCIENTOMETRICS. - ISSN 1588-2861. - (2022). [10.1007/s11192-022-04329-2]
How should evaluation be? Is a good evaluation of research also just? Towards the implementation of good evaluation
Cinzia Daraio;Alessio Vaccari
2022
Abstract
In this paper we answer the question of how evaluation should be by proposing a good evaluation of research practices. A good evaluation of research practices, intended as social practices à la MacIntyre, should take into account the stable motivations and the traits of the characters (i.e. the virtues) of researchers. We also show that a good evaluation is also just, beyond the sense of fairness, as working on good research practices implies keep into account a broader sense of justice. After that, we propose the development of a knowl- edge base for the assessment of “good” evaluations of research practices to implement a questionnaire for the assessment of researchers’ virtues. Although the latter is a challeng- ing task, the use of ontologies and taxonomic knowledge, and the reasoning algorithms that can draw inferences on the basis of such knowledge represents a way for testing the consistency of the information reported in the questionnaire and to analyse correctly and coherently how the data is gathered through it. Finally, we describe the potential applica- tion usefulness of our proposal for the reform of current research assessment systems.File | Dimensione | Formato | |
---|---|---|---|
Vaccari_Evaluation_2022.pdf
solo gestori archivio
Tipologia:
Versione editoriale (versione pubblicata con il layout dell'editore)
Licenza:
Tutti i diritti riservati (All rights reserved)
Dimensione
635.49 kB
Formato
Adobe PDF
|
635.49 kB | Adobe PDF | Contatta l'autore |
I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.