Item Selection Criteria With Practical Constraints in Cognitive Diagnostic Computerized Adaptive Testing.

For item selection in cognitive diagnostic computerized adaptive testing (CD-CAT), ideally, a single item selection index should be created to simultaneously regulate precision, exposure status, and attribute balancing. For this purpose, in this study, we first proposed an attribute-balanced item se...

Full description

Bibliographic Details
Published in:Educational & Psychological Measurement Vol. 79; no. 2; pp. 335 - 358
Main Authors: Lin, Chuan-Ju, Chang, Hua-Hua
Format: Article
Published: Sage Publications Inc. Apr2019
Subjects:
Online Access:View this record in EBSCOhost
Description
Summary:For item selection in cognitive diagnostic computerized adaptive testing (CD-CAT), ideally, a single item selection index should be created to simultaneously regulate precision, exposure status, and attribute balancing. For this purpose, in this study, we first proposed an attribute-balanced item selection criterion, namely, the standardized weighted deviation global discrimination index (SWDGDI), and subsequently formulated the constrained progressive index (CP_SWDGDI) by casting the SWDGDI in a progressive algorithm. A simulation study revealed that the SWDGDI method was effective in balancing attribute coverage and the CP_SWDGDI method was able to simultaneously balance attribute coverage and item pool usage while maintaining acceptable estimation precision. This research also demonstrates the advantage of a relatively low number of attributes in CD-CAT applications.