Multidimensional Forced-Choice CAT With Dominance Items: An Empirical Comparison With Optimal Static Testing Under Different Desirability Matching.
Several forced-choice (FC) computerized adaptive tests (CATs) have emerged in the field of organizational psychology, all of them employing ideal-point items. However, despite most items developed historically follow dominance response models, research on FC CAT using dominance items is limited. Exi...
| Publicado en: | Educational & Psychological Measurement Vol. 83; no. 2; pp. 322 - 351 |
|---|---|
| Autores principales: | , , |
| Formato: | Artículo |
| Publicado: |
Sage Publications Inc.
Apr2023
|
| Materias: | |
| Acceso en línea: | Ver este registro en EBSCOhost |
| fields | @attributes: recordID: 1 pdfLink: plink: https://search.ebscohost.com/login.aspx?direct=true&db=ssf&AN=162054938&site=ehost-live header: @attributes: shortDbName: ssf uiTerm: 162054938 longDbName: Social Sciences Full Text (H.W. Wilson) uiTag: AN controlInfo: bkinfo: jinfo: jid: 00131644 EPM jtl: Educational & Psychological Measurement issn: 00131644 maglogo: Y pubinfo: dt: Apr2023 vid: 83 iid: 2 pid: 344 pub: Sage Publications Inc. artinfo: ui: 162054938 10.1177/00131644221077637 ppf: 322 ppct: 29 formats: tig: atl: Multidimensional Forced-Choice CAT With Dominance Items: An Empirical Comparison With Optimal Static Testing Under Different Desirability Matching. aug: au: Lin, Yin Brown, Anna Williams, Paul affil: University of Kent, Canterbury, UK SHL, Thames Ditton, Surrey, UK Independent Researcher su: Analysis of variance Honesty Consumer attitudes Psychology Psychometrics Conscience Empirical research Emotions Personality assessment Computer adaptive testing Kruskal-Wallis Test Research methodology Simulation methods in education Accuracy Comparative studies Conceptual models Research funding Questionnaires Descriptive statistics sug: subj: Analysis of variance Honesty Consumer attitudes Psychology Psychometrics Conscience Empirical research Emotions Personality assessment Computer adaptive testing Kruskal-Wallis Test Research methodology Simulation methods in education Accuracy Comparative studies Conceptual models Research funding Questionnaires Descriptive statistics keyword: computerized adaptive testing forced choice multidimensional item response theory personality Thurstonian IRT model computerized adaptive testing forced choice multidimensional item response theory personality Thurstonian IRT model ab: Several forced-choice (FC) computerized adaptive tests (CATs) have emerged in the field of organizational psychology, all of them employing ideal-point items. However, despite most items developed historically follow dominance response models, research on FC CAT using dominance items is limited. Existing research is heavily dominated by simulations and lacking in empirical deployment. This empirical study trialed a FC CAT with dominance items described by the Thurstonian Item Response Theory model with research participants. This study investigated important practical issues such as the implications of adaptive item selection and social desirability balancing criteria on score distributions, measurement accuracy and participant perceptions. Moreover, nonadaptive but optimal tests of similar design were trialed alongside the CATs to provide a baseline for comparison, helping to quantify the return on investment when converting an otherwise-optimized static assessment into an adaptive one. Although the benefit of adaptive item selection in improving measurement precision was confirmed, results also indicated that at shorter test lengths CAT had no notable advantage compared with optimal static tests. Taking a holistic view incorporating both psychometric and operational considerations, implications for the design and deployment of FC assessments in research and practice are discussed. pubtype: Academic Journal doctype: Article src: R language: English refInfo: copyright: @attributes: flag: N holdings: @attributes: islocal: N |
|---|