Reliability Issues and Solutions for Coding Social Communication Performance in Classroom Settings.
Purpose: To explore the utility of time-interval analysis for documenting the reliability of coding social communication performance of children in classroom settings. Of particular interest was finding a method for determining whether independent observers could reliably judge both occurrence and d...
| Publicado en: | Journal of Speech, Language & Hearing Research Vol. 49; no. 5; pp. 1058 - 1072 |
|---|---|
| Autores principales: | , , |
| Formato: | Artículo |
| Publicado: |
American Speech-Language-Hearing Association
October 2006
|
| Materias: | |
| Acceso en línea: | Ver este registro en EBSCOhost |
| fields | @attributes: recordID: 1 pdfLink: plink: https://search.ebscohost.com/login.aspx?direct=true&db=ssf&AN=507919998&site=ehost-live header: @attributes: shortDbName: ssf uiTerm: 507919998 longDbName: Social Sciences Full Text (H.W. Wilson) uiTag: AN controlInfo: bkinfo: jinfo: jid: 10924388 1SM jtl: Journal of Speech, Language & Hearing Research issn: 10924388 maglogo: N pubinfo: dt: October 2006 vid: 49 iid: 5 pid: 42 pub: American Speech-Language-Hearing Association artinfo: ui: 507919998 10.1044/1092-4388(2006/075) ppf: 1058 ppct: 14 formats: fmt: – @attributes: type: T – @attributes: type: P size: 255KB tig: atl: Reliability Issues and Solutions for Coding Social Communication Performance in Classroom Settings. aug: au: Olswang, Lesley B. Svensson, Liselotte Coggins, Truman E. su: Verbal behavior Inter-observer reliability Child behavior Psychology of school children Child psychology methodology Observation (Psychology) Interpersonal communication sug: subj: Verbal behavior Inter-observer reliability Child behavior Psychology of school children Child psychology methodology Observation (Psychology) Interpersonal communication ab: Purpose: To explore the utility of time-interval analysis for documenting the reliability of coding social communication performance of children in classroom settings. Of particular interest was finding a method for determining whether independent observers could reliably judge both occurrence and duration of ongoing behavioral dimensions for describing social communication performance. Method: Four coders participated in this study. They observed and independently coded 6 social communication behavioral dimensions using handheld computers. The dimensions were mutually exclusive and accounted for all verbal and nonverbal productions during a specified time frame. The technology allowed for coding frequency and duration for each entered code. Data were collected from 20 different 2-min video segments of children in kindergarten through 3rd-grade classrooms. Data were analyzed for interobserverand intraobserver agreements using time-interval sorting and Cohen's kappa. Further, interval size and total observation length were manipulated to determine their influence on reliability. Results: The data revealed interval sorting and kappa to be a suitable method for examining reliability of occurrence and duration of ongoing social communication behavioral dimensions. Nearly all comparisons yielded medium to large kappa values; interval size and length of observation minimally affected results. Implications: The analysis procedure described in this research solves a challenge in reliability: comparing coding by independent observers of both occurrence and duration of behaviors. Results indicate the utility of a new coding taxonomy and technology for application in online observations of social communication in a classroom setting. Reprinted by permission of the publisher. pubtype: Academic Journal doctype: Article src: R language: English refInfo: copyright: @attributes: flag: N holdings: @attributes: islocal: N |
|---|