The aim of this paper is to assess the quality of the ranking of institutions obtained with multilevel techniques in presence of different model misspecifications and data structures. Through a Monte Carlo simulation study, we find that it is quite hard to obtain a reliable ranking of the whole effectiveness distribution, while, under various experimental conditions, it is possible to identify institutions with extreme performances. Ranking quality increases with increasing Intra Class Correlation coefficient and/or overall sample size. Furthermore, multilevel models where the between and within cluster components of first-level covariates are distinguished, perform significantly better than both multilevel models where the two effects are set to be equal and the fixed effect models.

Assessing the quality of institutions rankings obtained through multilevel linear regression models / Arpino, B.; Varriale, R.. - In: JOURNAL OF APPLIED ECONOMIC SCIENCES. - ISSN 1843-6110. - 5:1(2010), pp. 7-22.

Assessing the quality of institutions rankings obtained through multilevel linear regression models

Varriale R.
2010

Abstract

The aim of this paper is to assess the quality of the ranking of institutions obtained with multilevel techniques in presence of different model misspecifications and data structures. Through a Monte Carlo simulation study, we find that it is quite hard to obtain a reliable ranking of the whole effectiveness distribution, while, under various experimental conditions, it is possible to identify institutions with extreme performances. Ranking quality increases with increasing Intra Class Correlation coefficient and/or overall sample size. Furthermore, multilevel models where the between and within cluster components of first-level covariates are distinguished, perform significantly better than both multilevel models where the two effects are set to be equal and the fixed effect models.
2010
effectiveness; multilevel models; ranking of institutions; second-level residuals distribution
01 Pubblicazione su rivista::01a Articolo in rivista
Assessing the quality of institutions rankings obtained through multilevel linear regression models / Arpino, B.; Varriale, R.. - In: JOURNAL OF APPLIED ECONOMIC SCIENCES. - ISSN 1843-6110. - 5:1(2010), pp. 7-22.
File allegati a questo prodotto
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11573/1683700
 Attenzione

Attenzione! I dati visualizzati non sono stati sottoposti a validazione da parte dell'ateneo

Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 5
  • ???jsp.display-item.citation.isi??? ND
social impact