Combining an Expert-Based Medical Entity Recognizer to a Machine-Learning System: Methods and a Case Study.

Medical entity recognition is currently generally performed by data-driven methods based on supervised machine learning. Expert-based systems, where linguistic and domain expertise are directly provided to the system are often combined with data-driven systems. We present here a case study where an...

Full description

Bibliographic Details
Published in:Biomedical Informatics Insights no. 6; pp. 51 - 63
Main Authors: Zweigenbaum, Pierre, Lavergne, Thomas, Grabar, Natalia, Hamon, Thierry, Rosset, Sophie, Grouin, Cyril
Format: research tables/charts Journal Article
Published: Sage Publications Inc. 2013 Supplement
Online Access:View this record in EBSCOhost
fields @attributes:
  recordID: 1
pdfLink:
plink: https://search.ebscohost.com/login.aspx?direct=true&db=ccm&AN=104050031&site=ehost-live
header:
  @attributes:
    shortDbName: ccm
    uiTerm: 104050031
    longDbName: CINAHL Complete
    uiTag: AN
  controlInfo:
    bkinfo:
    dissinfo:
    jinfo:
      jid:
        11782226
        B077
      jtl: Biomedical Informatics Insights
      issn: 11782226
      maglogo: Y
    pubinfo:
      dt: 2013 Supplement
      iid: 6
      pid: 344
      pub: Sage Publications Inc.
      place: Thousand Oaks, California
    artinfo:
      ui:
        104050031
        95028410
        10.4137/BII.S11770
        104050031
      ppf: 51
      ppct: 12
      formats:
        fmt:
          @attributes:
            type: P
      tig:
        atl: Combining an Expert-Based Medical Entity Recognizer to a Machine-Learning System: Methods and a Case Study.
      aug:
        au:
          Zweigenbaum, Pierre
          Lavergne, Thomas
          Grabar, Natalia
          Hamon, Thierry
          Rosset, Sophie
          Grouin, Cyril
        affil: LIMSI-CNS, Orsay, France
      sug:
        subj:
          Natural Language Processing
          Medical Records
          Nomenclature
          Artificial Intelligence
          Human
          Data Mining
          Unified Medical Language System
          Funding Source
      ab: Medical entity recognition is currently generally performed by data-driven methods based on supervised machine learning. Expert-based systems, where linguistic and domain expertise are directly provided to the system are often combined with data-driven systems. We present here a case study where an existing expert-based medical entity recognition system, Ogmios, is combined with a data-driven system, Caramba, based on a linear-chain Conditional Random Field (CRF) classifier. Our case study specifically highlights the risk of overfitting incurred by an expert-based system. We observe that it prevents the combination of the 2 systems from obtaining improvements in precision, recall, or F-measure, and analyze the underlying mechanisms through a post-hoc feature-level analysis. Wrapping the expert-based system alone as attributes input to a CRF classifier does boost its F-measure from 0.603 to 0.710, bringing it on par with the data-driven system. The generalization of this method remains to be further investigated.
      pubtype: Academic Journal
      doctype:
        research
        tables/charts
        Journal Article
      ougenre: Article
    language: English
    refInfo:
    holdings:
      @attributes:
        islocal: N