Identifying protected health information by transformers-based deep learning approach in Chinese medical text.

Purpose: In the context of Chinese clinical texts, this paper aims to propose a deep learning algorithm based on Bidirectional Encoder Representation from Transformers (BERT) to identify privacy information and to verify the feasibility of our method for privacy protection in the Chinese clinical co...

Full description

Bibliographic Details
Published in:Health Informatics Journal Vol. 31; no. 1; pp. 1 - 17
Main Authors: Xu, Kun, Song, Yang, Ma, Jingdong
Format: equations & formulas pictorial research tables/charts Journal Article
Published: Sage Publications Inc. Jan-Mar2025
Online Access:View this record in EBSCOhost
fields @attributes:
  recordID: 1
pdfLink:
plink: https://search.ebscohost.com/login.aspx?direct=true&db=ccm&AN=183028807&site=ehost-live
header:
  @attributes:
    shortDbName: ccm
    uiTerm: 183028807
    longDbName: CINAHL Complete
    uiTag: AN
  controlInfo:
    bkinfo:
    dissinfo:
    jinfo:
      jid:
        14604582
        EJK
      jtl: Health Informatics Journal
      issn: 14604582
      maglogo: Y
    pubinfo:
      dt: Jan-Mar2025
      vid: 31
      iid: 1
      pid: 344
      pub: Sage Publications Inc.
      place: Thousand Oaks, California
    artinfo:
      ui:
        183028807
        183028807
        183028807
        10.1177/14604582251315594
        183028807
      ppf: 1
      ppct: 16
      formats:
      tig:
        atl: Identifying protected health information by transformers-based deep learning approach in Chinese medical text.
      aug:
        au:
          Xu, Kun
          Song, Yang
          Ma, Jingdong
        affil: 571341 School of Medicine and Health Management in Huazhong University of Science and Technology, Wuhan, China
      sug:
        subj:
          Deep Learning
          Algorithms
          Data Security Standards
          Privacy and Confidentiality
          China
          Neural Networks (Computer)
          Human
          Electronic Health Records
          Memory
          Funding Source
      ab: Purpose: In the context of Chinese clinical texts, this paper aims to propose a deep learning algorithm based on Bidirectional Encoder Representation from Transformers (BERT) to identify privacy information and to verify the feasibility of our method for privacy protection in the Chinese clinical context. Methods: We collected and double-annotated 33,017 discharge summaries from 151 medical institutions on a municipal regional health information platform, developed a BERT-based Bidirectional Long Short-Term Memory Model (BiLSTM) and Conditional Random Field (CRF) model, and tested the performance of privacy identification on the dataset. To explore the performance of different substructures of the neural network, we created five additional baseline models and evaluated the impact of different models on performance. Results: Based on the annotated data, the BERT model pre-trained with the medical corpus showed a significant performance improvement to the BiLSTM-CRF model with a micro-recall of 0.979 and an F1 value of 0.976, which indicates that the model has promising performance in identifying private information in Chinese clinical texts. Conclusions: The BERT-based BiLSTM-CRF model excels in identifying privacy information in Chinese clinical texts, and the application of this model is very effective in protecting patient privacy and facilitating data sharing.
      pubtype: Academic Journal
      doctype:
        equations & formulas
        pictorial
        research
        tables/charts
        Journal Article
      ougenre: Article
    language: English
    refInfo:
    holdings:
      @attributes:
        islocal: N