Automated annotation and classification of BI-RADS assessment from radiology reports.
The Breast Imaging Reporting and Data System (BI-RADS) was developed to reduce variation in the descriptions of findings. Manual analysis of breast radiology report data is challenging but is necessary for clinical and healthcare quality assurance activities. The objective of this study is to develo...
| Published in: | Journal of Biomedical Informatics Vol. 69; pp. 177 - 188 |
|---|---|
| Main Authors: | , , , , , , |
| Format: | research Journal Article |
| Published: |
Academic Press Inc.
May2017
|
| Online Access: | View this record in EBSCOhost |
| fields | @attributes: recordID: 1 pdfLink: plink: https://search.ebscohost.com/login.aspx?direct=true&db=ccm&AN=122882462&site=ehost-live header: @attributes: shortDbName: ccm uiTerm: 122882462 longDbName: CINAHL Complete uiTag: AN controlInfo: bkinfo: dissinfo: jinfo: jid: 15320464 OMB jtl: Journal of Biomedical Informatics issn: 15320464 maglogo: N pubinfo: dt: May2017 vid: 69 pid: 735 pub: Academic Press Inc. place: Burlington, Massachusetts artinfo: ui: 122882462 122882462 NLM28428140 122882462 10.1016/j.jbi.2017.04.011 NLM28428140 122882462 ppf: 177 ppct: 11 formats: tig: atl: Automated annotation and classification of BI-RADS assessment from radiology reports. aug: au: Castro, Sergio M. Tseytlin, Eugene Medvedeva, Olga Mitchell, Kevin Visweswaran, Shyam Bekhuis, Tanja Jacobson, Rebecca S. affil: Department of Biomedical Informatics, University of Pittsburgh School of Medicine, The Offices at Baum, 5607 Baum Boulevard, BAUM 423, Pittsburgh, PA 15206-3701, USA sug: subj: Breast Neoplasms Data Curation Radiology Information Systems Mammography Probability Breast Female Human Funding Source Female ab: The Breast Imaging Reporting and Data System (BI-RADS) was developed to reduce variation in the descriptions of findings. Manual analysis of breast radiology report data is challenging but is necessary for clinical and healthcare quality assurance activities. The objective of this study is to develop a natural language processing (NLP) system for automated BI-RADS categories extraction from breast radiology reports. We evaluated an existing rule-based NLP algorithm, and then we developed and evaluated our own method using a supervised machine learning approach. We divided the BI-RADS category extraction task into two specific tasks: (1) annotation of all BI-RADS category values within a report, (2) classification of the laterality of each BI-RADS category value. We used one algorithm for task 1 and evaluated three algorithms for task 2. Across all evaluations and model training, we used a total of 2159 radiology reports from 18 hospitals, from 2003 to 2015. Performance with the existing rule-based algorithm was not satisfactory. Conditional random fields showed a high performance for task 1 with an F-1 measure of 0.95. Rules from partial decision trees (PART) algorithm showed the best performance across classes for task 2 with a weighted F-1 measure of 0.91 for BIRADS 0-6, and 0.93 for BIRADS 3-5. Classification performance by class showed that performance improved for all classes from Naïve Bayes to Support Vector Machine (SVM), and also from SVM to PART. Our system is able to annotate and classify all BI-RADS mentions present in a single radiology report and can serve as the foundation for future studies that will leverage automated BI-RADS annotation, to provide feedback to radiologists as part of a learning health system loop. pubtype: Academic Journal doctype: research Journal Article ougenre: Article language: English refInfo: holdings: @attributes: islocal: N |
|---|