Grooming a CAT: customizing CAT administration rules to increase response efficiency in specific research and clinical settings.
Purpose: To evaluate the degree to which applying alternative stopping rules would reduce response burden while maintaining score precision in the context of computer adaptive testing (CAT).Data: Analyses were conducted on secondary data comprised of CATs administered in a clinical setting at multip...
| Publicado en: | Quality of Life Research Vol. 27; no. 9; pp. 2403 - 2414 |
|---|---|
| Autores principales: | , , , , |
| Formato: | Journal Article |
| Publicado: |
Springer Nature
Sep2018
|
| Acceso en línea: | Ver este registro en EBSCOhost |
| fields | @attributes: recordID: 1 pdfLink: plink: https://search.ebscohost.com/login.aspx?direct=true&db=ccm&AN=131455360&site=ehost-live header: @attributes: shortDbName: ccm uiTerm: 131455360 longDbName: CINAHL Complete uiTag: AN controlInfo: bkinfo: dissinfo: jinfo: jid: 09629343 GPQ jtl: Quality of Life Research issn: 09629343 maglogo: N pubinfo: dt: Sep2018 vid: 27 iid: 9 pid: 237 pub: Springer Nature place: New York, New York artinfo: ui: 131455360 131455360 NLM29730850 10.1007/s11136-018-1870-z NLM29730850 131455360 ppf: 2403 ppct: 11 formats: fmt: – @attributes: type: T – @attributes: type: P tig: atl: Grooming a CAT: customizing CAT administration rules to increase response efficiency in specific research and clinical settings. aug: au: Kallen, Michael A. Cook, Karon F. Amtmann, Dagmar Knowlton, Elizabeth Gershon, Richard C. affil: Department of Medical Social Sciences, Feinberg School of Medicine, Northwestern University, Chicago, IL, USA sug: subj: Research Equipment and Supplies Computers and Computerization Utilization Psychometrics Methods Quality of Life Psychosocial Factors Young Adult Reproducibility of Results Aged Middle Age Male Adolescence Female Adult Aged, 80 and Over Scales Aged: 65+ years Middle Aged: 45-64 years Adolescent: 13-18 years Adult: 19-44 years Aged, 80 & over Male Female ab: Purpose: To evaluate the degree to which applying alternative stopping rules would reduce response burden while maintaining score precision in the context of computer adaptive testing (CAT).Data: Analyses were conducted on secondary data comprised of CATs administered in a clinical setting at multiple time points (baseline and up to two follow ups) to 417 study participants who had back pain (51.3%) and/or depression (47.0%). Participant mean age was 51.3 years (SD = 17.2) and ranged from 18 to 86. Participants tended to be white (84.7%), relatively well educated (77% with at least some college), female (63.9%), and married or living in a committed relationship (57.4%). The unit of analysis was individual assessment histories (i.e., CAT item response histories) from the parent study. Data were first aggregated across all individuals, domains, and time points in an omnibus dataset of assessment histories and then were disaggregated by measure for domain-specific analyses. Finally, assessment histories within a "clinically relevant range" (score ≥ 1 SD from the mean in direction of poorer health) were analyzed separately to explore score level-specific findings.Method: Two different sets of CAT administration rules were compared. The original CAT (CATORIG) rules required at least four and no more than 12 items be administered. If the score standard error (SE) reached a value < 3 points (T score metric) before 12 items were administered, the CAT was stopped. We simulated applying alternative stopping rules (CATALT), removing the requirement that a minimum four items be administered, and stopped a CAT if responses to the first two items were both associated with best health, if the SE was < 3, if SE change < 0.1 (T score metric), or if 12 items were administered. We then compared score fidelity and response burden, defined as number of items administered, between CATORIG and CATALT.Results: CATORIG and CATALT scores varied little, especially within the clinically relevant range, and response burden was substantially lower under CATALT (e.g., 41.2% savings in omnibus dataset).Conclusions: Alternate stopping rules result in substantial reductions in response burden with minimal sacrifice in score precision. pubtype: Academic Journal doctype: Journal Article ougenre: Article language: English refInfo: holdings: @attributes: islocal: N |
|---|