Impact of Test Design, Item Quality, and Item Bank Size on the Psychometric Properties of Computer-Based Credentialing Examinations.

A study was conducted to investigate three computer-based credentialing test designs—the Linear Parallel-Forms Test, multistage (MST), and the Computer Adaptive Test (CAT)—under common examination conditions. Findings indicated that item bank size and item quality had a practically significant infl...

Descripción completa

Detalles Bibliográficos
Publicado en:Educational & Psychological Measurement Vol. 64; no. 1; pp. 5 - 22
Autores principales: Xing, Dehui, Hambleton, Ronald K.
Formato: Artículo
Publicado: Sage Publications Inc. Feb2004
Acceso en línea:Ver este registro en EBSCOhost
Descripción
Sumario:A study was conducted to investigate three computer-based credentialing test designs—the Linear Parallel-Forms Test, multistage (MST), and the Computer Adaptive Test (CAT)—under common examination conditions. Findings indicated that item bank size and item quality had a practically significant influence on decision consistency and accuracy; and that the choice of test design was not a factor in the results, even in almost ideal situations. It was concluded that more time and resources should be committed to expanding the size and quality of item banks; and that designs that individualize an exam administration, such as MST and CAT, may not be helpful when the primary role of the examination is to make pass-fail decisions and when conditions suit using parallel forms with a target information function that can be centered on the passing score.