Calibrating predictive model estimates in a distributed network of patient data.
Background: Protecting the privacy of patient data is an important issue. Patient data are typically protected in local health systems, but this makes integration of data from different healthcare systems difficult. To build high-performance predictive models, a large number of samples are needed, a...
| Publicado en: | Journal of Biomedical Informatics Vol. 117 |
|---|---|
| Autores principales: | , , , |
| Formato: | research Journal Article |
| Publicado: |
Academic Press Inc.
May2021
|
| Acceso en línea: | Ver este registro en EBSCOhost |
| fields | @attributes: recordID: 1 pdfLink: plink: https://search.ebscohost.com/login.aspx?direct=true&db=ccm&AN=150298457&site=ehost-live header: @attributes: shortDbName: ccm uiTerm: 150298457 longDbName: CINAHL Complete uiTag: AN controlInfo: bkinfo: dissinfo: jinfo: jid: 15320464 OMB jtl: Journal of Biomedical Informatics issn: 15320464 maglogo: N pubinfo: dt: May2021 vid: 117 pid: 735 pub: Academic Press Inc. place: Burlington, Massachusetts artinfo: ui: 150298457 150298457 NLM33811986 150298457 10.1016/j.jbi.2021.103758 NLM33811986 150298457 ppct: 1 formats: tig: atl: Calibrating predictive model estimates in a distributed network of patient data. aug: au: Huang, Yingxiang Jiang, Xiaoqian Gabriel, Rodney A. Ohno-Machado, Lucila affil: UC San Diego Health Department of Biomedical Informatics, University of California San Diego, La Jolla, CA, USA sug: subj: Algorithms Privacy and Confidentiality Calibration Human Funding Source ab: Background: Protecting the privacy of patient data is an important issue. Patient data are typically protected in local health systems, but this makes integration of data from different healthcare systems difficult. To build high-performance predictive models, a large number of samples are needed, and performance measures such as calibration and discrimination are essential. While distributed algorithms for building models and measuring discrimination have been published, distributed algorithms to measure calibration and recalibrate models have not been proposed.Objective: Recalibration models have been shown to improve calibration, but they have not been proposed for data that are distributed in various health systems, or "sites". Our goal is to measure calibration performance and build a global recalibration model using data from multiple health systems, without sharing patient-level data.Materials and Methods: We developed a distributed smooth isotonic regression recalibration model and extended established calibration measures, such as Hosmer-Lemeshow Tests, Expected Calibration Error, and Maximum Calibration Error in a distributed manner.Results: Experiments on both simulated and clinical data were conducted, and the recalibration results produced by a traditional (ie, centralized) versus a distributed smooth isotonic regression were compared. The results were exactly the same.Discussion: Our algorithms demonstrated that calibration can be improved and measured in a distributed manner while protecting data privacy, albeit at some cost in terms of computational efficiency. It also gives researchers who may have too few instances in their own institutions a method to construct robust recalibration models.Conclusion: Preserving data privacy and improving model calibration are both important to advancing predictive analysis in clinical informatics. The algorithms alleviate the difficulties in model building across sites. pubtype: Academic Journal doctype: research Journal Article ougenre: Article language: English refInfo: holdings: @attributes: islocal: N |
|---|