Item Response Theory Modeling of the Verb Naming Test.
Purpose: Item response theory (IRT) is a modern psychometric framework with several advantageous properties as compared with classical test theory. IRT has been successfully used to model performance on anomia tests in individuals with aphasia; however, all efforts to date have focused on noun produ...
| Published in: | Journal of Speech, Language & Hearing Research Vol. 66; pp. 1718 - 1740 |
|---|---|
| Main Authors: | , , , , , , , |
| Format: | Article |
| Published: |
American Speech-Language-Hearing Association
May2023
|
| Subjects: | |
| Online Access: | View this record in EBSCOhost |
| fields | @attributes: recordID: 1 pdfLink: plink: https://search.ebscohost.com/login.aspx?direct=true&db=ssf&AN=163674962&site=ehost-live header: @attributes: shortDbName: ssf uiTerm: 163674962 longDbName: Social Sciences Full Text (H.W. Wilson) uiTag: AN controlInfo: bkinfo: jinfo: jid: 10924388 1SM jtl: Journal of Speech, Language & Hearing Research issn: 10924388 maglogo: N pubinfo: dt: May2023 vid: 66 pid: 42 pub: American Speech-Language-Hearing Association artinfo: ui: 163674962 10.1044/2023_JSLHR-22-00458 ppf: 1718 ppct: 22 formats: fmt: @attributes: type: P size: 1.7MB tig: atl: Item Response Theory Modeling of the Verb Naming Test. aug: au: Fergadiotis, Gerasimos Casilio, Marianne Dickey, Michael Walsh Steel, Stacey Nicholson, Hannele Fleegle, Mikala Swiderski, Alexander Hula, William D. affil: Department of Speech & Hearing Sciences, Portland State University, OR. Department of Hearing and Speech Sciences, Vanderbilt University Medical Center, Nashville, TN. Department of Communication Science and Disorders, University of Pittsburgh, PA. VA Pittsburgh Healthcare System, PA. U.S. Department of Veterans Affairs, VA Minneapolis Healthcare System, MN. su: Comparative grammar Psychometrics Psychological tests Terms & phrases Diagnosis of aphasia Research evaluation Confidence intervals Mathematical models Research methodology evaluation Research methodology Speech evaluation Multitrait multimethod techniques Inter-observer reliability Theory Anomia Research funding Factor analysis Descriptive statistics Chi-squared test Statistical models sug: subj: Comparative grammar Psychometrics Psychological tests Terms & phrases Diagnosis of aphasia Research evaluation Confidence intervals Mathematical models Research methodology evaluation Research methodology Speech evaluation Multitrait multimethod techniques Inter-observer reliability Theory Anomia Research funding Factor analysis Descriptive statistics Chi-squared test Statistical models ab: Purpose: Item response theory (IRT) is a modern psychometric framework with several advantageous properties as compared with classical test theory. IRT has been successfully used to model performance on anomia tests in individuals with aphasia; however, all efforts to date have focused on noun production accuracy. The purpose of this study is to evaluate whether the Verb Naming Test (VNT), a prominent test of action naming, can be successfully modeled under IRT and evaluate its reliability. Method: We used responses on the VNT from 107 individuals with chronic aphasia from AphasiaBank. Unidimensionality and local independence, two assumptions prerequisite to IRT modeling, were evaluated using factor analysis and Yen’s Q statistic (Yen, 1984), respectively. The assumption of equal discrimination among test items was evaluated statistically via nested model comparisons and practically by using correlations of resulting IRT-derived scores. Finally, internal consistency, marginal and empirical reliability, and conditional reliability were evaluated. Results: The VNT was found to be sufficiently unidimensional with the majority of item pairs demonstrating adequate local independence. An IRT model in which item discriminations are constrained to be equal demonstrated fit equivalent to a model in which unique discrimination parameters were estimated for each item. All forms of reliability were strong across the majority of IRT ability estimates. Conclusions: Modeling the VNT using IRT is feasible, yielding ability estimates that are both informative and reliable. Future efforts are needed to quantify the validity of the VNT under IRT and determine the extent to which it measures the same construct as other anomia tests. pubtype: Academic Journal doctype: Article src: R language: English refInfo: copyright: @attributes: flag: N holdings: @attributes: islocal: N |
|---|