Generalizability Theory I: Assessing Reliability of Observational Data in the Communication Sciences.
Perceptual rating scales can be valid, reliable, and convenient tools for evaluating speech outcomes in research and clinical practice. However, they depend on the perceptions of observers. Too few raters may compromise accuracy, whereas too many would be inefficient. There is therefore a need to de...
| Published in: | Journal of Speech, Language & Hearing Research Vol. 46; no. 3; pp. 711 - 718 |
|---|---|
| Main Authors: | , , |
| Format: | Article |
| Published: |
American Speech-Language-Hearing Association
June 2003
|
| Subjects: | |
| Online Access: | View this record in EBSCOhost |
| fields | @attributes: recordID: 1 pdfLink: plink: https://search.ebscohost.com/login.aspx?direct=true&db=ssf&AN=507834313&site=ehost-live header: @attributes: shortDbName: ssf uiTerm: 507834313 longDbName: Social Sciences Full Text (H.W. Wilson) uiTag: AN controlInfo: bkinfo: jinfo: jid: 10924388 1SM jtl: Journal of Speech, Language & Hearing Research issn: 10924388 maglogo: N pubinfo: dt: June 2003 vid: 46 iid: 3 pid: 42 pub: American Speech-Language-Hearing Association artinfo: ui: 507834313 10.1044/1092-4388(2003/056) ppf: 711 ppct: 7 formats: fmt: – @attributes: type: T – @attributes: type: P size: 105KB tig: atl: Generalizability Theory I: Assessing Reliability of Observational Data in the Communication Sciences. aug: au: O'Brian, Nigel O'Brian, Sue Packman, Ann su: Test reliability Speech Rating Stuttering Observation (Psychology) sug: subj: Test reliability Speech Rating Stuttering Observation (Psychology) ab: Perceptual rating scales can be valid, reliable, and convenient tools for evaluating speech outcomes in research and clinical practice. However, they depend on the perceptions of observers. Too few raters may compromise accuracy, whereas too many would be inefficient. There is therefore a need to determine the minimum number of raters required for a reliable result. In this context, the ideas of Generalizability Theory have become increasingly popular in the behavioral sciences; suggestions have been made for their application to the assessment of speech-language disorders. Here we review the concepts involved, which are applied in a companion article dealing with speech naturalness data obtained from clients who recently completed treatment for their stuttering. We pay particular attention to the statistical requirements of the theory, including some cautions about possible inappropriate use of these techniques. We also offer a new interpretation of the results of the analysis that aims to be more meaningful to most speech-language pathologists. Reprinted by permission of the publisher. pubtype: Academic Journal doctype: Article src: R language: English refInfo: copyright: @attributes: flag: N holdings: @attributes: islocal: N |
|---|