A Tutorial on Reliability Testing in AAC Language Sample Transcription and Analysis.

Establishing reliability is an essential step in language sample transcription and analysis. This tutorial provides an illustration of replicable procedures for reliability testing during transcription and analysis of language samples generated by people who use augmentative and alternative communic...

Descripción completa

Detalles Bibliográficos
Publicado en:AAC: Augmentative & Alternative Communication Vol. 31; no. 2; pp. 159 - 170
Autores principales: Kovacs, Thomas, Hill, Katya
Formato: equations & formulas research tables/charts Journal Article
Publicado: Taylor & Francis Ltd Jun2015
Acceso en línea:Ver este registro en EBSCOhost
Descripción
Sumario:Establishing reliability is an essential step in language sample transcription and analysis. This tutorial provides an illustration of replicable procedures for reliability testing during transcription and analysis of language samples generated by people who use augmentative and alternative communication (AAC) systems. Statistical measures used for testing agreement between raters coding categorical data are summarized. Detailed procedures for reliability testing in AAC language sample transcription and analysis are provided, beginning with the collection of raw language sample data. Procedures include guidelines for (a) establishing inter-judge agreement during the transcription process, and (b) using Cohen's kappa to establish inter-rater reliability during deeper analysis of transcribed utterances. All procedures are demonstrated in a case example using language samples from children who use AAC.