Interrater reliability for the Four Habits Coding Scheme as part of a randomized controlled trial.
OBJECTIVE: To describe the process for developing interrater reliability (IRR) for the Four Habits Coding Scheme (4HCS) for a heterogeneous material as part of a randomized controlled trial. METHODS: Videotapes from 497 hospital encounters involving 71 doctors from most clinical specialties were col...
| Publicado en: | Patient Education & Counseling Vol. 80; no. 3; pp. 405 - 410 |
|---|---|
| Autores principales: | , , , , , |
| Formato: | research Journal Article |
| Publicado: |
Elsevier B.V.
Sep2010
|
| Acceso en línea: | Ver este registro en EBSCOhost |
| fields | @attributes: recordID: 1 pdfLink: plink: https://search.ebscohost.com/login.aspx?direct=true&db=ccm&AN=104917394&site=ehost-live header: @attributes: shortDbName: ccm uiTerm: 104917394 longDbName: CINAHL Complete uiTag: AN controlInfo: bkinfo: dissinfo: jinfo: jid: 07383991 3RX jtl: Patient Education & Counseling issn: 07383991 maglogo: N pubinfo: dt: Sep2010 vid: 80 iid: 3 pid: 1004 pub: Elsevier B.V. artinfo: ui: 104917394 2010759356 10.1016/j.pec.2010.06.032 NLM20685066 104917394 ppf: 405 ppct: 5 formats: tig: atl: Interrater reliability for the Four Habits Coding Scheme as part of a randomized controlled trial. aug: au: Fossli Jensen B Gulbrandsen P Benth JS Dahl FA Krupat E Finset A affil: HøKH, Research Centre, Akershus University Hospital, Lørenskog, Norway. b.f.jensen@medisin.uio.no sug: subj: Coding Standards Communication Habits Physician-Patient Relations Professional Competence Standards Adolescence Adult Aged Aged, 80 and Over Child Child, Preschool Crossover Design Female Hospitals Human Infant Infant, Newborn Male Middle Age Norway Observer Bias Physician's Role Questionnaires Random Assignment Randomized Controlled Trials Reproducibility of Results Videorecording Young Adult Adolescent: 13-18 years Adult: 19-44 years Aged: 65+ years Aged, 80 & over Child: 6-12 years Child, Preschool: 2-5 years Infant: 1-23 months Infant, Newborn: birth-1 month Middle Aged: 45-64 years Female Male ab: OBJECTIVE: To describe the process for developing interrater reliability (IRR) for the Four Habits Coding Scheme (4HCS) for a heterogeneous material as part of a randomized controlled trial. METHODS: Videotapes from 497 hospital encounters involving 71 doctors from most clinical specialties were collected. Four experienced psychology students were trained as raters. We calculated Pearson's r and the intraclass correlation (ICC) on the total score across consecutive samples of twenty videos, and Pearson's r on single videos across items in the initial coding phase. RESULTS: After 18h of training and one rating session, the total score Pearson's r and ICC exceeded .70 for all pairs of raters. Across items within single videos, the Pearson's r was never below 0.60 after the first 50 videos. At item and habit level Pearson's r remained unsatisfactory for some rater pairs mostly due to low variance on some items. CONCLUSION: Based on the evaluation of the effect of communication skills training via a total score, IRR was satisfactory for the 4HCS as applied to heterogeneous material. However, good reliability at item level was difficult to achieve. PRACTICE IMPLICATIONS: 4HCS may be used as an outcome measure for clinical communication skills in randomized controlled trials. pubtype: Academic Journal doctype: research Journal Article ougenre: Article language: English refInfo: holdings: @attributes: islocal: N |
|---|