Research assessment exercises have enjoyed ever-increasing popularity in many countries in recent years, both as a method to guide public funds allocation and as a validation tool for adopted research support policies. Italy’s most recently completed evaluation effort (VQR 2011–14) required each university to submit to the Ministry for Education, University, and Research (MIUR) 2 research products per author (3 in the case of other research institutions), chosen in such a way that the same product is not assigned to two authors belonging to the same institution. This constraint suggests that larger institutions, where collaborations among colleagues may be more frequent, could suffer a size-related bias in their evaluation scores. To validate our claim, we investigate the outcome of artificially splitting Sapienza University of Rome, one of the largest universities in Europe, in a number of separate partitions, according to several criteria, noting significant score increases for several partitioning scenarios.

Are Italian research assessment exercises size-biased? / Demetrescu, C.; Ribichini, A.; Schaerf, M.. - In: SCIENTOMETRICS. - ISSN 0138-9130. - 125:1(2020), pp. 533-549. [10.1007/s11192-020-03643-x]

Are Italian research assessment exercises size-biased?

Demetrescu C.;Ribichini A.;Schaerf M.
2020

Abstract

Research assessment exercises have enjoyed ever-increasing popularity in many countries in recent years, both as a method to guide public funds allocation and as a validation tool for adopted research support policies. Italy’s most recently completed evaluation effort (VQR 2011–14) required each university to submit to the Ministry for Education, University, and Research (MIUR) 2 research products per author (3 in the case of other research institutions), chosen in such a way that the same product is not assigned to two authors belonging to the same institution. This constraint suggests that larger institutions, where collaborations among colleagues may be more frequent, could suffer a size-related bias in their evaluation scores. To validate our claim, we investigate the outcome of artificially splitting Sapienza University of Rome, one of the largest universities in Europe, in a number of separate partitions, according to several criteria, noting significant score increases for several partitioning scenarios.
2020
bibliometrics; graph partitioning; national evaluations; research assessment
01 Pubblicazione su rivista::01a Articolo in rivista
Are Italian research assessment exercises size-biased? / Demetrescu, C.; Ribichini, A.; Schaerf, M.. - In: SCIENTOMETRICS. - ISSN 0138-9130. - 125:1(2020), pp. 533-549. [10.1007/s11192-020-03643-x]
File allegati a questo prodotto
File Dimensione Formato  
Demetrescu_Are-Italian-Research-Assessment_2020.pdf

accesso aperto

Tipologia: Versione editoriale (versione pubblicata con il layout dell'editore)
Licenza: Creative commons
Dimensione 988.57 kB
Formato Adobe PDF
988.57 kB Adobe PDF

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11573/1464349
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 3
  • ???jsp.display-item.citation.isi??? 3
social impact