The article describes the process of constructing an item bank aimed at implementing a computer-based multistage adaptive test (MST) for the estimation of the mathematical ability of second-grade secondary school students. The multilevel adaptive tests are briefly introduced and the main steps of the bank construction process are described: the definition of the object of the test, the selection of the items downstream of the pretest operations, assuming that the data are adapted to a IRT model with one parameter, and the verification of the uni-dimensionality of the bank as a whole. The article also highlights some of the difficulties that can be encountered, such as being able to obtain adequate coverage of the test’s object or the range of the ability. The process described was overall successful and sufficiently general to be able to adapt to different needs, such as the construction of parallel linear tests or traditional adaptive tests (CAT, Computer based Adaptive Test), aimed not only at summative or system assessment, but also, if the dimensions of the bank allow it to formative evaluation.
L’articolo descrive nel dettaglio il processo di costruzione di una banca di item finalizzata all’implementazione di una prova adattativa multilivello computer based (MST, MultiStage Test) per la stima dell’abilità in matematica degli studenti del grado 10. Si introducono brevemente i test adattativi multilivello e si descrivono e le fasi principali del processo di costruzione della banca: la definizione del costrutto oggetto della prova, la selezione degli item a valle delle operazioni di pre-test, nell’ipotesi che i dati si adattino a un modello IRT a un parametro, e la verifica dell’unidimensionalità della banca nel suo insieme. Nell’articolo si mettono in luce anche alcune delle difficoltà che si possono incontrare, come il riuscire a ottenere un’adeguata copertura del costrutto o del continuo dell’abilità. Il processo descritto è risultato ben riuscito e sufficientemente generale da potersi adattare a esigenze diverse, quali la costruzione di prove lineari parallele o di prove adattative item per item (CAT, Computer based Adaptive Test), finalizzate non solo alla valutazione sommativa o di sistema, ma anche, se le dimensioni della banca lo consentono alla valutazione formativa.
Costruzione di una banca di item per la stima dell'abilità in matematica con prove adattative multilivello / Botta, Emanuela. - In: JOURNAL OF EDUCATIONAL, CULTURAL AND PSYCHOLOGICAL STUDIES. - ISSN 2037-7932. - (2018), pp. 215-240.
Costruzione di una banca di item per la stima dell'abilità in matematica con prove adattative multilivello
Emanuela Botta
2018
Abstract
The article describes the process of constructing an item bank aimed at implementing a computer-based multistage adaptive test (MST) for the estimation of the mathematical ability of second-grade secondary school students. The multilevel adaptive tests are briefly introduced and the main steps of the bank construction process are described: the definition of the object of the test, the selection of the items downstream of the pretest operations, assuming that the data are adapted to a IRT model with one parameter, and the verification of the uni-dimensionality of the bank as a whole. The article also highlights some of the difficulties that can be encountered, such as being able to obtain adequate coverage of the test’s object or the range of the ability. The process described was overall successful and sufficiently general to be able to adapt to different needs, such as the construction of parallel linear tests or traditional adaptive tests (CAT, Computer based Adaptive Test), aimed not only at summative or system assessment, but also, if the dimensions of the bank allow it to formative evaluation.I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.