Creation of a simple natural language processing tool to support an imaging utilization quality dashboard.
Background: Testing for venous thromboembolism (VTE) is associated with cost and risk to patients (e.g. radiation). To assess the appropriateness of imaging utilization at the provider level, it is important to know that provider's diagnostic yield (percentage of tests positive for the diagnostic en...
| Publicado en: | International Journal of Medical Informatics Vol. 101; pp. 93 - 100 |
|---|---|
| Autores principales: | , , , , |
| Formato: | research Journal Article |
| Publicado: |
Elsevier B.V.
May2017
|
| Acceso en línea: | Ver este registro en EBSCOhost |
| fields | @attributes: recordID: 1 pdfLink: plink: https://search.ebscohost.com/login.aspx?direct=true&db=ccm&AN=122087533&site=ehost-live header: @attributes: shortDbName: ccm uiTerm: 122087533 longDbName: CINAHL Complete uiTag: AN controlInfo: bkinfo: dissinfo: jinfo: jid: 13865056 JR4 jtl: International Journal of Medical Informatics issn: 13865056 maglogo: N pubinfo: dt: May2017 vid: 101 pid: 467 pub: Elsevier B.V. place: New York, New York artinfo: ui: 122087533 122087533 NLM28347453 122087533 10.1016/j.ijmedinf.2017.02.011 NLM28347453 122087533 ppf: 93 ppct: 7 formats: tig: atl: Creation of a simple natural language processing tool to support an imaging utilization quality dashboard. aug: au: Swartz, Jordan Koziatek, Christian Theobald, Jason Smith, Silas Iturrate, Eduardo affil: New York University School of Medicine, Ronald O. Perelman Department of Emergency Medicine, New York, NY, United States sug: subj: Venous Thromboembolism Natural Language Processing Image Processing, Computer Assisted Standards Tomography, X-Ray Computed Methods ab: Background: Testing for venous thromboembolism (VTE) is associated with cost and risk to patients (e.g. radiation). To assess the appropriateness of imaging utilization at the provider level, it is important to know that provider's diagnostic yield (percentage of tests positive for the diagnostic entity of interest). However, determining diagnostic yield typically requires either time-consuming, manual review of radiology reports or the use of complex and/or proprietary natural language processing software.Objectives: The objectives of this study were twofold: 1) to develop and implement a simple, user-configurable, and open-source natural language processing tool to classify radiology reports with high accuracy and 2) to use the results of the tool to design a provider-specific VTE imaging dashboard, consisting of both utilization rate and diagnostic yield.Methods: Two physicians reviewed a training set of 400 lower extremity ultrasound (UTZ) and computed tomography pulmonary angiogram (CTPA) reports to understand the language used in VTE-positive and VTE-negative reports. The insights from this review informed the arguments to the five modifiable parameters of the NLP tool. A validation set of 2,000 studies was then independently classified by the reviewers and by the tool; the classifications were compared and the performance of the tool was calculated.Results: The tool was highly accurate in classifying the presence and absence of VTE for both the UTZ (sensitivity 95.7%; 95% CI 91.5-99.8, specificity 100%; 95% CI 100-100) and CTPA reports (sensitivity 97.1%; 95% CI 94.3-99.9, specificity 98.6%; 95% CI 97.8-99.4). The diagnostic yield was then calculated at the individual provider level and the imaging dashboard was created.Conclusions: We have created a novel NLP tool designed for users without a background in computer programming, which has been used to classify venous thromboembolism reports with a high degree of accuracy. The tool is open-source and available for download at http://iturrate.com/simpleNLP. Results obtained using this tool can be applied to enhance quality by presenting information about utilization and yield to providers via an imaging dashboard. pubtype: Academic Journal doctype: research Journal Article ougenre: Article language: English refInfo: holdings: @attributes: islocal: N |
|---|