Ensuring content validity of patient-reported outcomes: a shadow-test approach to their adaptive measurement.

Purpose: Most computerized adaptive testing (CAT) applications in patient-reported outcomes (PRO) measurement to date are reliability-centric, with a primary objective of maximizing measurement efficiency. A key concern and a potential threat to validity is that, when left unconstrained, individual...

Descripción completa

Detalles Bibliográficos
Publicado en:Quality of Life Research Vol. 27; no. 7; pp. 1683 - 1694
Autores principales: Choi, Seung W., van der Linden, Wim J.
Formato: equations & formulas research tables/charts Journal Article
Publicado: Springer Nature Jul2018
Acceso en línea:Ver este registro en EBSCOhost
fields @attributes:
  recordID: 1
pdfLink:
plink: https://search.ebscohost.com/login.aspx?direct=true&db=ccm&AN=130126172&site=ehost-live
header:
  @attributes:
    shortDbName: ccm
    uiTerm: 130126172
    longDbName: CINAHL Complete
    uiTag: AN
  controlInfo:
    bkinfo:
    dissinfo:
    jinfo:
      jid:
        09629343
        GPQ
      jtl: Quality of Life Research
      issn: 09629343
      maglogo: N
    pubinfo:
      dt: Jul2018
      vid: 27
      iid: 7
      pid: 237
      pub: Springer Nature
      place: New York, New York
    artinfo:
      ui:
        130126172
        130126172
        NLM28710673
        130126172
        10.1007/s11136-017-1650-1
        NLM28710673
        130126172
      ppf: 1683
      ppct: 11
      formats:
        fmt:
          – @attributes:
              type: T
          – @attributes:
              type: P
      tig:
        atl: Ensuring content validity of patient-reported outcomes: a shadow-test approach to their adaptive measurement.
      aug:
        au:
          Choi, Seung W.
          van der Linden, Wim J.
        affil: Pacific Metrics Corporation, 1 Lower Ragsdale Drive, 93940, Monterey, CA, USA
      sug:
        subj:
          Content Validity Evaluation
          Computerized Adaptive Testing Utilization
          Patient-Reported Outcomes
          Human
          Case Studies
          Conceptual Framework
          Performance Measurement Systems
          Psychometrics
          Quality of Life
          Scales
          Descriptive Statistics
      ab: Purpose: Most computerized adaptive testing (CAT) applications in patient-reported outcomes (PRO) measurement to date are reliability-centric, with a primary objective of maximizing measurement efficiency. A key concern and a potential threat to validity is that, when left unconstrained, individual CAT administrations could have items with systematically different attributes, e.g., sub-domain coverage. This paper aims to provide a solution to the problem from an optimal test design framework using the shadow-test approach to CAT.Methods: Following the approach, a case study was conducted using the PROMIS® (Patient-Reported Outcomes Measurement Information System) fatigue item bank both with empirical and simulated response data. Comparisons between CAT administrations without and with the enforcement of content and item pool usage constraints were examined.Results: The unconstrained CAT exhibited a high degree of variation in items selected from different substrata of the item bank. Contrastingly, the shadow-test approach delivered CAT administrations conforming to all specifications with a minimal loss in measurement efficiency.Conclusions: The optimal test design and shadow-test approach to CAT provide a flexible framework for solving complex test-assembly problems with better control of their domain coverage than for the conventional use of CAT in PRO measurement. Applications in a wide array of PRO domains are expected to lead to more controlled and balanced use of CAT in the field.
      pubtype: Academic Journal
      doctype:
        equations & formulas
        research
        tables/charts
        Journal Article
      ougenre: Article
    language: English
    refInfo:
    holdings:
      @attributes:
        islocal: N