Impact of test design, item quality, and item bank size on the psychometric properties of computer-based credentialing examinations.

Computer-based testing by credentialing agencies has become common; however, selecting a test design is difficult because several good ones are available--parallel forms, computer adaptive (CAT), and multistage (MST). In this study, three computer-based test designs under some common examination con...

Descripción completa

Detalles Bibliográficos
Publicado en:Educational & Psychological Measurement Vol. 64; no. 1; pp. 5 - 22
Autores principales: Xing D, Hambleton RK
Formato: research tables/charts Journal Article
Publicado: Sage Publications Inc. Feb2004
Acceso en línea:Ver este registro en EBSCOhost
fields @attributes:
  recordID: 1
pdfLink:
plink: https://search.ebscohost.com/login.aspx?direct=true&db=ccm&AN=106684962&site=ehost-live
header:
  @attributes:
    shortDbName: ccm
    uiTerm: 106684962
    longDbName: CINAHL Complete
    uiTag: AN
  controlInfo:
    bkinfo:
    dissinfo:
    jinfo:
      jid:
        00131644
        EPM
      jtl: Educational & Psychological Measurement
      issn: 00131644
      maglogo: Y
    pubinfo:
      dt: Feb2004
      vid: 64
      iid: 1
      pid: 344
      pub: Sage Publications Inc.
      place: Thousand Oaks, California
    artinfo:
      ui:
        106684962
        12214509
        2004203354
        10.1177/0013164403258393
        106684962
      ppf: 5
      ppct: 17
      formats:
      tig:
        atl: Impact of test design, item quality, and item bank size on the psychometric properties of computer-based credentialing examinations.
      aug:
        au:
          Xing D
          Hambleton RK
        affil: Ministry of Education, British Columbia
      sug:
        subj:
          Credentialing Examinations Evaluation
          Psychometrics Evaluation
          Comparative Studies
          Computerized Educational Testing
          Human
      ab: Computer-based testing by credentialing agencies has become common; however, selecting a test design is difficult because several good ones are available--parallel forms, computer adaptive (CAT), and multistage (MST). In this study, three computer-based test designs under some common examination conditions were investigated. Item bank size and item quality had a practically significant impact on decision consistency and accuracy. Even in nearly ideal situations, the choice of test design was not a factor in the results. Two conclusions follow from the findings: (a) More time and resources should be committed to expanding the size and quality of item banks, and (b) designs that individualize an exam administration such as MST and CAT may not be helpful when the primary purpose of the examination is to make pass-fail decisions and conditions are present for using parallel forms with a target information function that can be centered on the passing score.
      pubtype: Academic Journal
      doctype:
        research
        tables/charts
        Journal Article
      ougenre: Article
    language: English
    refInfo:
    holdings:
      @attributes:
        islocal: N