In-training evaluations: developing an automated screening tool to measure report quality.
Objectives In-training evaluation ( ITE) is used to assess resident competencies in clinical settings. This assessment is documented on an evaluation report (In-Training Evaluation Report [ ITER]). Unfortunately, the quality of these reports can be questionable. Therefore, training programmes to imp...
| Publicado en: | Medical Education Vol. 48; no. 7; pp. 724 - 733 |
|---|---|
| Autores principales: | , , |
| Formato: | research tables/charts Journal Article |
| Publicado: |
Wiley-Blackwell
Jul2014
|
| Acceso en línea: | Ver este registro en EBSCOhost |
| fields | @attributes: recordID: 1 pdfLink: plink: https://search.ebscohost.com/login.aspx?direct=true&db=ccm&AN=103959907&site=ehost-live header: @attributes: shortDbName: ccm uiTerm: 103959907 longDbName: CINAHL Complete uiTag: AN controlInfo: bkinfo: dissinfo: jinfo: jid: 03080110 ESF jtl: Medical Education issn: 03080110 maglogo: Y pubinfo: dt: Jul2014 vid: 48 iid: 7 pid: 480 pub: Wiley-Blackwell place: Malden, Massachusetts artinfo: ui: 103959907 96383582 10.1111/medu.12490 NLM24909534 103959907 ppf: 724 ppct: 9 formats: fmt: @attributes: type: P tig: atl: In-training evaluations: developing an automated screening tool to measure report quality. aug: au: Bismil, Ramprasad Dudek, Nancy L Wood, Timothy J affil: Department of Psychiatry, University of Ottawa sug: subj: Education, Medical Interns and Residents Clinical Competence Evaluation Reports Standards Reports Evaluation Instrument Construction Human Descriptive Statistics Multiple Regression Retrospective Design Intraclass Correlation Coefficient Models, Statistical Funding Source ab: Objectives In-training evaluation ( ITE) is used to assess resident competencies in clinical settings. This assessment is documented on an evaluation report (In-Training Evaluation Report [ ITER]). Unfortunately, the quality of these reports can be questionable. Therefore, training programmes to improve report quality are common. The Completed Clinical Evaluation Report Rating ( CCERR) was developed to assess completed report quality and has been shown to do so in a reliable manner, thus enabling the evaluation of these programmes. The CCERR is a resource-intensive instrument, which may limit its use. The purpose of this study was to create a screening measure (Proxy- CCERR) that can predict the CCERR outcome in a less resource-intensive manner. Methods Using multiple regression, the authors analysed a dataset of 269 ITERs to create a model that can predict the associated CCERR scores. The resulting predictive model was tested on the CCERR scores for an additional sample of 300 ITERs. Results The quality of an ITER, as measured by the CCERR, can be predicted using a model involving only three variables ( R2 = 0.61). The predictive variables included the total number of words in the comments, the variability of the ratings and the proportion of comment boxes completed on the form. Conclusions It is possible to model CCERR scores in a highly predictive manner. The predictive variables can be easily extracted in an automated process. Because this model is less resource-intensive than the CCERR, it makes it possible to provide feedback from ITER training programmes to large groups of supervisors and institutions, and even to create automated feedback systems using Proxy- CCERR scores. pubtype: Academic Journal doctype: research tables/charts Journal Article ougenre: Article language: English refInfo: holdings: @attributes: islocal: N |
|---|