Comparing Countdown- and IRT-Based Approaches to Computerized Adaptive Personality Testing.
Computerized adaptive testing (CAT) is an emerging technology in the personality assessment literature given the greater efficiency it affords compared with traditional methods. However, few studies have directly compared the efficiency and validity of 2 competing methods for personality CAT: (a) me...
| Published in: | Psychological Assessment Vol. 25; no. 3; pp. 769 - 780 |
|---|---|
| Main Authors: | , , |
| Format: | Article |
| Published: |
American Psychological Association
Sep2013
|
| Subjects: | |
| Online Access: | View this record in EBSCOhost |
| fields | @attributes: recordID: 1 pdfLink: plink: https://search.ebscohost.com/login.aspx?direct=true&db=ssf&AN=90112963&site=ehost-live header: @attributes: shortDbName: ssf uiTerm: 90112963 longDbName: Social Sciences Full Text (H.W. Wilson) uiTag: AN controlInfo: bkinfo: jinfo: jid: 10403590 POL jtl: Psychological Assessment issn: 10403590 maglogo: N pubinfo: dt: Sep2013 vid: 25 iid: 3 pid: 34 pub: American Psychological Association artinfo: ui: 90112963 10.1037/a0032541 ppf: 769 ppct: 11 formats: tig: atl: Comparing Countdown- and IRT-Based Approaches to Computerized Adaptive Personality Testing. aug: au: Rudick, Monica M. Wern How Yam Simms, Leonard J. affil: University at Buffalo, State University of New York su: Item response theory Psychometrics Computer adaptive testing Personality assessment research Psychodiagnostics sug: subj: Item response theory Psychometrics Computer adaptive testing Personality assessment research Psychodiagnostics keyword: computerized adaptive testing countdown method item response theory personality assessment Schedule for Nonadaptive and Adaptive Personality computerized adaptive testing countdown method item response theory personality assessment Schedule for Nonadaptive and Adaptive Personality ab: Computerized adaptive testing (CAT) is an emerging technology in the personality assessment literature given the greater efficiency it affords compared with traditional methods. However, few studies have directly compared the efficiency and validity of 2 competing methods for personality CAT: (a) methods based on item response theory (IRT-CAT) versus (b) methods based on the countdown method (CM-CAT). To that end, we conducted real-data simulations with previously collected responses (N = 8,690) to the Schedule for Nonadaptive and Adaptive Personality (SNAP). Three CAT algorithms (IRT-CAT, IRT-CAT with 5-item minimum, CM-CAT) were evaluated for item savings, classification accuracy, and convergent/discriminant validity. All CATs yielded lower classification accuracy and validity than traditional testing but required 18%-86% fewer items. Ultimately, the IRT-CAT, with minimum 5-item requirement, struck the most ideal balance of highest item savings, and generally fewer costs to validity and accuracy. These results confirm findings regarding item savings trends from previous CAT studies. In addition, this study provides a model for how the validity and precision of CATs may be compared across personality assessments. pubtype: Academic Journal doctype: Article src: R language: English refInfo: copyright: @attributes: flag: N holdings: @attributes: islocal: N |
|---|