A natural language intelligent tutoring system for training pathologists: implementation and evaluation.
Introduction: We developed and evaluated a Natural Language Interface (NLI) for an Intelligent Tutoring System (ITS) in Diagnostic Pathology. The system teaches residents to examine pathologic slides and write accurate pathology reports while providing immediate feedback on errors they make in their...
| Publicado en: | Advances in Health Sciences Education Vol. 13; no. 5; pp. 709 - 723 |
|---|---|
| Autores principales: | , , , , , , , , , , , , , , , |
| Formato: | Journal Article |
| Publicado: |
Springer Nature
Dec2008
|
| Acceso en línea: | Ver este registro en EBSCOhost |
| fields | @attributes: recordID: 1 pdfLink: plink: https://search.ebscohost.com/login.aspx?direct=true&db=ccm&AN=105619012&site=ehost-live header: @attributes: shortDbName: ccm uiTerm: 105619012 longDbName: CINAHL Complete uiTag: AN controlInfo: bkinfo: dissinfo: jinfo: jid: 13824996 OAK jtl: Advances in Health Sciences Education issn: 13824996 maglogo: N pubinfo: dt: Dec2008 vid: 13 iid: 5 pid: 237 pub: Springer Nature place: New York, New York artinfo: ui: 105619012 NLM17934789 2010161049 NLM17934789 PMC2753375 105619012 ppf: 709 ppct: 14 formats: tig: atl: A natural language intelligent tutoring system for training pathologists: implementation and evaluation. aug: au: El Saadawi GM Tseytlin E Legowski E Jukic D Castine M Fine J Gormley R Crowley RS El Saadawi, Gilan M Tseytlin, Eugene Legowski, Elizabeth Jukic, Drazen Castine, Melissa Fine, Jeffrey Gormley, Robert Crowley, Rebecca S affil: Department of Biomedical Informatics, University of Pittsburgh School of Medicine, Pittsburgh, USA sug: subj: Computer-Assisted Instruction Natural Language Processing Pathology Education Adaptation, Psychological Computer-Assisted Instruction Standards Internship and Residency Models, Educational Problem-Based Learning Methods Program Evaluation Self Assessment User-Computer Interface Writing Standards ab: Introduction: We developed and evaluated a Natural Language Interface (NLI) for an Intelligent Tutoring System (ITS) in Diagnostic Pathology. The system teaches residents to examine pathologic slides and write accurate pathology reports while providing immediate feedback on errors they make in their slide review and diagnostic reports. Residents can ask for help at any point in the case, and will receive context-specific feedback.Research Questions: We evaluated (1) the performance of our natural language system, (2) the effect of the system on learning (3) the effect of feedback timing on learning gains and (4) the effect of ReportTutor on performance to self-assessment correlations.Methods: The study uses a crossover 2 x 2 factorial design. We recruited 20 subjects from 4 academic programs. Subjects were randomly assigned to one of the four conditions--two conditions for the immediate interface, and two for the delayed interface. An expert dermatopathologist created a reference standard and 2 board certified AP/CP pathology fellows manually coded the residents' assessment reports. Subjects were given the opportunity to self grade their performance and we used a survey to determine student response to both interfaces.Results: Our results show a highly significant improvement in report writing after one tutoring session with 4-fold increase in the learning gains with both interfaces but no effect of feedback timing on performance gains. Residents who used the immediate feedback interface first experienced a feature learning gain that is correlated with the number of cases they viewed. There was no correlation between performance and self-assessment in either condition. pubtype: Academic Journal doctype: Journal Article ougenre: Article language: English refInfo: holdings: @attributes: islocal: N |
|---|