Evaluation of an intelligent tutoring system in pathology: effects of external representation on performance gains, metacognition, and acceptance.
Objective: Determine effects of computer-based tutoring on diagnostic performance gains, meta-cognition, and acceptance using two different problem representations. Describe impact of tutoring on spectrum of diagnostic skills required for task performance. Identify key features of student-tutor inte...
| Published in: | Journal of the American Medical Informatics Association Vol. 14; no. 2; pp. 182 - 191 |
|---|---|
| Main Authors: | , , , , , , , , , , , |
| Format: | research Journal Article |
| Published: |
Oxford University Press / USA
Mar/Apr2007
|
| Online Access: | View this record in EBSCOhost |
| fields | @attributes: recordID: 1 pdfLink: plink: https://search.ebscohost.com/login.aspx?direct=true&db=ccm&AN=105963125&site=ehost-live header: @attributes: shortDbName: ccm uiTerm: 105963125 longDbName: CINAHL Complete uiTag: AN controlInfo: bkinfo: dissinfo: jinfo: jid: 10675027 FZ9 jtl: Journal of the American Medical Informatics Association issn: 10675027 maglogo: N pubinfo: dt: Mar/Apr2007 vid: 14 iid: 2 pid: 622 pub: Oxford University Press / USA artinfo: ui: 105963125 105963125 NLM17213494 2009553469 10.1197/jamia.m2241 NLM17213494 PMC2213473 105963125 ppf: 182 ppct: 9 formats: tig: atl: Evaluation of an intelligent tutoring system in pathology: effects of external representation on performance gains, metacognition, and acceptance. aug: au: Crowley RS Legowski E Medvedeva O Tseytlin E Roh E Jukic D Crowley, Rebecca S Legowski, Elizabeth Medvedeva, Olga Tseytlin, Eugene Roh, Ellen Jukic, Drazen affil: Department of Biomedical Informatics, University of Pittsburgh School of Medicine, UPMC Shadyside Cancer Pavilion, Room 307, 5230 Centre Avenue, Pittsburgh, PA 15232, USA sug: subj: Attitude to Computers Computer-Assisted Instruction Pathology Education Cognition Data Collection Diagnosis Problem-Based Learning Students User-Computer Interface Human ab: Objective: Determine effects of computer-based tutoring on diagnostic performance gains, meta-cognition, and acceptance using two different problem representations. Describe impact of tutoring on spectrum of diagnostic skills required for task performance. Identify key features of student-tutor interaction contributing to learning gains.Design: Prospective, between-subjects study, controlled for participant level of training. Resident physicians in two academic pathology programs spent four hours using one of two interfaces which differed mainly in external problem representation. The case-focused representation provided an open-learning environment in which students were free to explore evidence-hypothesis relationships within a case, but could not visualize the entire diagnostic space. The knowledge-focused representation provided an interactive representation of the entire diagnostic space, which more tightly constrained student actions.Measurements: Metrics included results of pretest, post-test and retention-test for multiple choice and case diagnosis tests, ratios of performance to student reported certainty, results of participant survey, learning curves, and interaction behaviors during tutoring.Results: Students had highly significant learning gains after one tutoring session. Learning was retained at one week. There were no differences between the two interfaces in learning gains on post-test or retention test. Only students in the knowledge-focused interface exhibited significant metacognitive gains from pretest to post-test and pretest to retention test. Students rated the knowledge-focused interface significantly higher than the case-focused interface.Conclusions: Cognitive tutoring is associated with improved diagnostic performance in a complex medical domain. The effect is retained at one-week post-training. Knowledge-focused external problem representation shows an advantage over case-focused representation for metacognitive effects and user acceptance. pubtype: Academic Journal doctype: research Journal Article ougenre: Article language: English refInfo: holdings: @attributes: islocal: N |
|---|