Inter-rater reliability for scoring children's dichotic words test responses.
Objective:To determine whether rater agreement is randomly distributed or varies importantly with test-taker characteristics, test words, or rater experience with the dichotic words test (DWT).Design:DWT was administered to 34 children in 1st–4th grade and responses scored by two raters. The proport...
| Publicado en: | International Journal of Audiology Vol. 54; no. 10; pp. 751 - 758 |
|---|---|
| Autores principales: | , |
| Formato: | research tables/charts Journal Article |
| Publicado: |
Taylor & Francis Ltd
Oct2015
|
| Acceso en línea: | Ver este registro en EBSCOhost |
| fields | @attributes: recordID: 1 pdfLink: plink: https://search.ebscohost.com/login.aspx?direct=true&db=ccm&AN=109540991&site=ehost-live header: @attributes: shortDbName: ccm uiTerm: 109540991 longDbName: CINAHL Complete uiTag: AN controlInfo: bkinfo: dissinfo: jinfo: jid: 14992027 JW2 jtl: International Journal of Audiology issn: 14992027 maglogo: Y pubinfo: dt: Oct2015 vid: 54 iid: 10 pid: 377 pub: Taylor & Francis Ltd place: Philadelphia, Pennsylvania artinfo: ui: 109540991 109540991 109540991 10.3109/14992027.2015.1052103 NLM26097981 109540991 ppf: 751 ppct: 7 formats: fmt: – @attributes: type: T – @attributes: type: P tig: atl: Inter-rater reliability for scoring children's dichotic words test responses. aug: au: Kelley, Kairn Stetler Littenberg, Benjamin affil: Clinical and Translational Science, University of Vermont, Burlington, USA sug: subj: Interrater Reliability Evaluation Dichotic Listening Tests Evaluation Audiometry, Speech Human Child Male Female Spearman's Rank Correlation Coefficient Linear Regression Chi Square Test Two-Tailed Test Mann-Whitney U Test Wilcoxon Rank Sum Test Protocols Reproducibility of Results Students, Elementary Funding Source Child: 6-12 years Male Female ab: Objective:To determine whether rater agreement is randomly distributed or varies importantly with test-taker characteristics, test words, or rater experience with the dichotic words test (DWT).Design:DWT was administered to 34 children in 1st–4th grade and responses scored by two raters. The proportion of rater agreement was calculated for each child and for each word. Correlates of inter-rater agreement were explored.Study sample:Two raters judged 6686 total responses from 34 children.Results:Overall agreement between the two raters was 0.97. Test-taker scores ranged from 35%–91% (mean = 81%). Agreement was associated with score but not with test-taker age or sex. Test words spanned the full range of difficulty (pass proportion 0.06–1.00). Rater agreement was not randomly distributed among the words. Inter-rater agreement for test words ranged from 0.82–1.00 and was associated with pass proportion (Spearman's ρ = 0.28;p <0.0001). However, there were words at all pass proportions with perfect or near-perfect agreement. Rater agreement improved from 0.94 on the first day of data collection to 0.98 on the fifth day (p =0.026).Conclusions:Inter-rater reliability should be considered along with test item difficulty when developing speech audiometry materials, scoring protocols, and rater training. pubtype: Academic Journal doctype: research tables/charts Journal Article ougenre: Article language: English refInfo: holdings: @attributes: islocal: N |
|---|