Combining an Expert-Based Medical Entity Recognizer to a Machine-Learning System: Methods and a Case Study.
Medical entity recognition is currently generally performed by data-driven methods based on supervised machine learning. Expert-based systems, where linguistic and domain expertise are directly provided to the system are often combined with data-driven systems. We present here a case study where an...
| Published in: | Biomedical Informatics Insights no. 6; pp. 51 - 63 |
|---|---|
| Main Authors: | , , , , , |
| Format: | research tables/charts Journal Article |
| Published: |
Sage Publications Inc.
2013 Supplement
|
| Online Access: | View this record in EBSCOhost |
| fields | @attributes: recordID: 1 pdfLink: plink: https://search.ebscohost.com/login.aspx?direct=true&db=ccm&AN=104050031&site=ehost-live header: @attributes: shortDbName: ccm uiTerm: 104050031 longDbName: CINAHL Complete uiTag: AN controlInfo: bkinfo: dissinfo: jinfo: jid: 11782226 B077 jtl: Biomedical Informatics Insights issn: 11782226 maglogo: Y pubinfo: dt: 2013 Supplement iid: 6 pid: 344 pub: Sage Publications Inc. place: Thousand Oaks, California artinfo: ui: 104050031 95028410 10.4137/BII.S11770 104050031 ppf: 51 ppct: 12 formats: fmt: @attributes: type: P tig: atl: Combining an Expert-Based Medical Entity Recognizer to a Machine-Learning System: Methods and a Case Study. aug: au: Zweigenbaum, Pierre Lavergne, Thomas Grabar, Natalia Hamon, Thierry Rosset, Sophie Grouin, Cyril affil: LIMSI-CNS, Orsay, France sug: subj: Natural Language Processing Medical Records Nomenclature Artificial Intelligence Human Data Mining Unified Medical Language System Funding Source ab: Medical entity recognition is currently generally performed by data-driven methods based on supervised machine learning. Expert-based systems, where linguistic and domain expertise are directly provided to the system are often combined with data-driven systems. We present here a case study where an existing expert-based medical entity recognition system, Ogmios, is combined with a data-driven system, Caramba, based on a linear-chain Conditional Random Field (CRF) classifier. Our case study specifically highlights the risk of overfitting incurred by an expert-based system. We observe that it prevents the combination of the 2 systems from obtaining improvements in precision, recall, or F-measure, and analyze the underlying mechanisms through a post-hoc feature-level analysis. Wrapping the expert-based system alone as attributes input to a CRF classifier does boost its F-measure from 0.603 to 0.710, bringing it on par with the data-driven system. The generalization of this method remains to be further investigated. pubtype: Academic Journal doctype: research tables/charts Journal Article ougenre: Article language: English refInfo: holdings: @attributes: islocal: N |
|---|