RIbench: A Proposed Benchmark for the Standardized Evaluation of Indirect Methods for Reference Interval Estimation.
BACKGROUND: Indirect methods leverage real-world data for the estimation of reference intervals. These constitute an active field of research, and several methods have been developed recently. So far, no standardized tool for evaluation and comparison of indirect methods exists. METHODS: We provide...
| Publicado en: | Clinical Chemistry Vol. 68; no. 11; pp. 1410 - 1425 |
|---|---|
| Autores principales: | , , |
| Formato: | Journal Article |
| Publicado: |
Oxford University Press / USA
Nov2022
|
| Acceso en línea: | Ver este registro en EBSCOhost |
| fields | @attributes: recordID: 1 pdfLink: plink: https://search.ebscohost.com/login.aspx?direct=true&db=ccm&AN=160117598&site=ehost-live header: @attributes: shortDbName: ccm uiTerm: 160117598 longDbName: CINAHL Complete uiTag: AN controlInfo: bkinfo: dissinfo: jinfo: jid: 00099147 10CS jtl: Clinical Chemistry issn: 00099147 maglogo: N pubinfo: dt: Nov2022 vid: 68 iid: 11 pid: 622 pub: Oxford University Press / USA artinfo: ui: 160117598 10.1093/clinchem/hvac142 160117598 ppf: 1410 ppct: 15 formats: fmt: @attributes: type: P tig: atl: RIbench: A Proposed Benchmark for the Standardized Evaluation of Indirect Methods for Reference Interval Estimation. aug: au: Ammer, Tatjana Schützenmeister, André Prokosch, Hans-Ulrich affil: Friedrich-Alexander-Universität Erlangen-Nürnberg, Chair of Medical Informatics, Erlangen, Germany sug: ab: BACKGROUND: Indirect methods leverage real-world data for the estimation of reference intervals. These constitute an active field of research, and several methods have been developed recently. So far, no standardized tool for evaluation and comparison of indirect methods exists. METHODS: We provide RIbench, a benchmarking suite for quantitative evaluation of any existing or novel indirect method. The benchmark contains simulated test sets for 10 biomarkers mimicking routine measurements of a mixed distribution of non-pathological (reference) values and pathological values. The non-pathological distributions represent 4 common distribution types: normal, skewed, heavily skewed, and skewed-and-shifted. To identify strengths and weaknesses of indirect methods, test sets have varying sample sizes and pathological distributions differ in location, extent of overlap, and fraction. For performance evaluation, we use an overall benchmark score and sub-scores derived from absolute z-score deviations between estimated and true reference limits. We illustrate the application of RIbench by evaluating and comparing the Hoffmann method and 4 modern indirect methods -- TML (Truncated-Maximum-Likelihood), kosmic, TMC (Truncated-Minimum-Chi-Square), and refineR-- against one another and against a nonparametric direct method (n=120). RESULTS: For the modern indirect methods, pathological fraction and sample size had a strong influence on the results: With a pathological fraction up to 20% and a minimum sample size of 5000, most methods achieved results comparable or superior to the direct method. CONCLUSIONS: We present RIbench, an open-source Rpackage, for the systematic evaluation of existing and novel indirect methods. RIbench can serve as a tool for enhancement of indirect methods, improving the estimation of reference intervals. pubtype: Academic Journal doctype: Journal Article ougenre: Article language: English refInfo: holdings: @attributes: islocal: N |
|---|