The cognitive reflection test (CRT) is a short measure of a person's ability to resist intuitive response tendencies and to produce a normatively correct response, which is based on effortful reasoning. Although the CRT is a very popular measure, its psychometric properties have not been extensively investigated. A major limitation of the CRT is the difficulty of the items, which can lead to floor effects in populations other than highly educated adults. The present study aimed at investigating the psychometric properties of the CRT applying item response theory analyses (a two-parameter logistic model) and at developing a new version of the scale (the CRT-long), which is appropriate for participants with both lower and higher levels of cognitive reflection. The results demonstrated the good psychometric properties of the original, as well as the new scale. The validity of the new scale was also assessed by measuring correlations with various indicators of intelligence, numeracy, reasoning and decision-making skills, and thinking dispositions. Moreover, we present evidence for the suitability of the new scale to be used with developmental samples. Finally, by comparing the performance of adolescents and young adults on the CRT and CRT-long, we report the first investigation into the development of cognitive reflection. Copyright (C) 2015 John Wiley & Sons, Ltd.

The development and testing of a new version of the cognitive reflection test applying Item Response Theory (IRT) / Primi, Caterina; Morsanyi, Kinga; Chiesi, Francesca; Donati, Maria Anna; Hamilton, Jayne. - In: JOURNAL OF BEHAVIORAL DECISION MAKING. - ISSN 0894-3257. - 29:5(2016), pp. 453-469. [10.1002/bdm.1883]

The development and testing of a new version of the cognitive reflection test applying Item Response Theory (IRT)

Donati, Maria Anna;
2016

Abstract

The cognitive reflection test (CRT) is a short measure of a person's ability to resist intuitive response tendencies and to produce a normatively correct response, which is based on effortful reasoning. Although the CRT is a very popular measure, its psychometric properties have not been extensively investigated. A major limitation of the CRT is the difficulty of the items, which can lead to floor effects in populations other than highly educated adults. The present study aimed at investigating the psychometric properties of the CRT applying item response theory analyses (a two-parameter logistic model) and at developing a new version of the scale (the CRT-long), which is appropriate for participants with both lower and higher levels of cognitive reflection. The results demonstrated the good psychometric properties of the original, as well as the new scale. The validity of the new scale was also assessed by measuring correlations with various indicators of intelligence, numeracy, reasoning and decision-making skills, and thinking dispositions. Moreover, we present evidence for the suitability of the new scale to be used with developmental samples. Finally, by comparing the performance of adolescents and young adults on the CRT and CRT-long, we report the first investigation into the development of cognitive reflection. Copyright (C) 2015 John Wiley & Sons, Ltd.
2016
cognitive reflection; decision making; heuristics; item response theory; individual differences; test information function; validity
01 Pubblicazione su rivista::01a Articolo in rivista
The development and testing of a new version of the cognitive reflection test applying Item Response Theory (IRT) / Primi, Caterina; Morsanyi, Kinga; Chiesi, Francesca; Donati, Maria Anna; Hamilton, Jayne. - In: JOURNAL OF BEHAVIORAL DECISION MAKING. - ISSN 0894-3257. - 29:5(2016), pp. 453-469. [10.1002/bdm.1883]
File allegati a questo prodotto
File Dimensione Formato  
Primi_IRT_2016.pdf

solo gestori archivio

Tipologia: Versione editoriale (versione pubblicata con il layout dell'editore)
Licenza: Tutti i diritti riservati (All rights reserved)
Dimensione 471.47 kB
Formato Adobe PDF
471.47 kB Adobe PDF   Contatta l'autore

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11573/1273949
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 179
  • ???jsp.display-item.citation.isi??? 161
social impact