Developing an Analytical Pipeline to Classify Patient Safety Event Reports Using Optimized Predictive Algorithms.

Background: Patient safety event reports provide valuable insight into systemic safety issues but deriving insights from these reports requires computational tools to efficiently parse through large volumes of qualitative data. Natural language processing (NLP) combined with predictive learning prov...

Descripción completa

Detalles Bibliográficos
Publicado en:Methods of Information in Medicine Vol. 60; no. 5/6; pp. 147 - 162
Autores principales: Adadey, Asa, Giannini, Robert, Possanza, Lorraine B.
Formato: research Journal Article
Publicado: Thieme Medical Publishing Inc. 2021
Acceso en línea:Ver este registro en EBSCOhost
fields @attributes:
  recordID: 1
pdfLink:
plink: https://search.ebscohost.com/login.aspx?direct=true&db=ccm&AN=154309853&site=ehost-live
header:
  @attributes:
    shortDbName: ccm
    uiTerm: 154309853
    longDbName: CINAHL Complete
    uiTag: AN
  controlInfo:
    bkinfo:
    dissinfo:
    jinfo:
      jid:
        00261270
        W7M
      jtl: Methods of Information in Medicine
      issn: 00261270
      maglogo: N
    pubinfo:
      dt: 2021
      vid: 60
      iid: 5/6
      pid: 2811
      pub: Thieme Medical Publishing Inc.
      place: New York, New York
    artinfo:
      ui:
        154309853
        154309853
        NLM34719010
        154309853
        10.1055/s-0041-1735620
        NLM34719010
        154309853
      ppf: 147
      ppct: 15
      formats:
      tig:
        atl: Developing an Analytical Pipeline to Classify Patient Safety Event Reports Using Optimized Predictive Algorithms.
      aug:
        au:
          Adadey, Asa
          Giannini, Robert
          Possanza, Lorraine B.
        affil: Partnership for Health IT Patient Safety, ECRI, Plymouth Meeting, Pennsylvania, United States
      sug:
        subj:
          Natural Language Processing
          Patient Safety
          Probability
          Human
          Algorithms
          Comparative Studies
          Multicenter Studies
          Evaluation Research
          Validation Studies
          Ferrans and Powers Quality of Life Index
      ab: Background: Patient safety event reports provide valuable insight into systemic safety issues but deriving insights from these reports requires computational tools to efficiently parse through large volumes of qualitative data. Natural language processing (NLP) combined with predictive learning provides an automated approach to evaluating these data and supporting the work of patient safety analysts.Objectives: The objective of this study was to use NLP and machine learning techniques to develop a generalizable, scalable, and reliable approach to classifying event reports for the purpose of driving improvements in the safety and quality of patient care.Methods: Datasets for 14 different labels (themes) were vectorized using a bag-of-words, tf-idf, or document embeddings approach and then applied to a series of classification algorithms via a hyperparameter grid search to derive an optimized model. Reports were also analyzed for terms strongly associated with each theme using an adjusted F-score calculation.Results: F1 score for each optimized model ranged from 0.951 ("Fall") to 0.544 ("Environment"). The bag-of-words approach proved optimal for 12 of 14 labels, and the naïve Bayes algorithm performed best for nine labels. Linear support vector machine was demonstrated as optimal for three labels and XGBoost for four of the 14 labels. Labels with more distinctly associated terms performed better than less distinct themes, as shown by a Pearson's correlation coefficient of 0.634.Conclusions: We were able to demonstrate an analytical pipeline that broadly applies NLP and predictive modeling to categorize patient safety reports from multiple facilities. This pipeline allows analysts to more rapidly identify and structure information contained in patient safety data, which can enhance the evaluation and the use of this information over time.
      pubtype: Academic Journal
      doctype:
        research
        Journal Article
      ougenre: Article
    language: English
    refInfo:
    holdings:
      @attributes:
        islocal: N