Quality of Item Pool (QIP) Index: A Novel Approach to Evaluating CAT Item Pool Adequacy.
This article introduces the Quality of Item Pool (QIP) Index, a novel approach to quantifying the adequacy of an item pool of a computerized adaptive test for a given set of test specifications and examinee population. This index ranges from 0 to 1, with values close to 1 indicating the item pool pr...
| Publicado en: | Educational & Psychological Measurement Vol. 79; no. 6; pp. 1133 - 1156 |
|---|---|
| Autor principal: | |
| Formato: | Artículo |
| Publicado: |
Sage Publications Inc.
Dec2019
|
| Materias: | |
| Acceso en línea: | Ver este registro en EBSCOhost |
| fields | @attributes: recordID: 1 pdfLink: plink: https://search.ebscohost.com/login.aspx?direct=true&db=ssf&AN=138482500&site=ehost-live header: @attributes: shortDbName: ssf uiTerm: 138482500 longDbName: Social Sciences Full Text (H.W. Wilson) uiTag: AN controlInfo: bkinfo: jinfo: jid: 00131644 EPM jtl: Educational & Psychological Measurement issn: 00131644 maglogo: Y pubinfo: dt: Dec2019 vid: 79 iid: 6 pid: 344 pub: Sage Publications Inc. artinfo: ui: 138482500 10.1177/0013164419842215 ppf: 1133 ppct: 23 formats: tig: atl: Quality of Item Pool (QIP) Index: A Novel Approach to Evaluating CAT Item Pool Adequacy. aug: au: Gönülateş, Emre affil: University of Cincinnati, Cincinnati, OH, USA su: Educational tests & measurements Algorithms Computer adaptive testing Mathematics Research bias Research methodology evaluation Descriptive statistics Evaluation sug: subj: Educational tests & measurements Algorithms Computer adaptive testing Mathematics Research bias Research methodology evaluation Descriptive statistics Evaluation keyword: computerized adaptive testing item pool design item pool evaluation computerized adaptive testing item pool design item pool evaluation ab: This article introduces the Quality of Item Pool (QIP) Index, a novel approach to quantifying the adequacy of an item pool of a computerized adaptive test for a given set of test specifications and examinee population. This index ranges from 0 to 1, with values close to 1 indicating the item pool presents optimum items to examinees throughout the test. This index can be used to compare different item pools or diagnose the deficiencies of a given item pool by quantifying the amount of deviation from a perfect item pool. Simulation studies were conducted to evaluate the capacity of this index for detecting the inadequacies of two simulated item pools. The value of this index was compared with the existing methods of evaluating the quality of computerized adaptive tests (CAT). Results of the study showed that the QIP Index can detect even slight deviations between a proposed item pool and an optimal item pool. It can also uncover shortcomings of an item pool that other outcomes of CAT cannot detect. CAT developers can use the QIP Index to diagnose the weaknesses of the item pool and as a guide for improving item pools. pubtype: Academic Journal doctype: Article src: R language: English refInfo: copyright: @attributes: flag: N holdings: @attributes: islocal: N |
|---|