Comparative statistical properties of expected utility and area under the ROC curve for laboratory studies of observer performance in screening mammography.
Rationale and Objectives: Our objective is to determine whether expected utility (EU) and the area under the receiver operator characteristic (AUC) are consistent with one another as endpoints of observer performance studies in mammography. These two measures characterize receiver operator character...
| Publicado en: | Academic Radiology Vol. 21; no. 4; pp. 481 - 491 |
|---|---|
| Autores principales: | , , , , , , |
| Formato: | case study research Journal Article |
| Publicado: |
Elsevier B.V.
Apr2014
|
| Acceso en línea: | Ver este registro en EBSCOhost |
| fields | @attributes: recordID: 1 pdfLink: plink: https://search.ebscohost.com/login.aspx?direct=true&db=ccm&AN=104037596&site=ehost-live header: @attributes: shortDbName: ccm uiTerm: 104037596 longDbName: CINAHL Complete uiTag: AN controlInfo: bkinfo: dissinfo: jinfo: jid: 10766332 T4X jtl: Academic Radiology issn: 10766332 maglogo: N pubinfo: dt: Apr2014 vid: 21 iid: 4 pid: 467 pub: Elsevier B.V. place: New York, New York artinfo: ui: 104037596 NLM24594418 2012498879 10.1016/j.acra.2013.12.011 NLM24594418 PMC3952000 104037596 ppf: 481 ppct: 10 formats: tig: atl: Comparative statistical properties of expected utility and area under the ROC curve for laboratory studies of observer performance in screening mammography. aug: au: Abbey, Craig K Gallas, Brandon D Boone, John M Niklason, Loren T Hadjiiski, Lubomir M Sahiner, Berkman Samuelson, Frank W affil: Department of Psychological and Brain Sciences, University of California, Santa Barbara, CA 93106. Electronic address: abbey@psych.ucsb.edu. sug: subj: Breast Neoplasms Radiography Clinical Competence Statistics and Numerical Data Mammography Statistics and Numerical Data Health Screening Statistics and Numerical Data ROC Curve Radiographic Image Interpretation, Computer-Assisted Methods Diagnosis, Laboratory Statistics and Numerical Data Data Analysis, Statistical Female Human Observer Bias Reproducibility of Results Sensitivity and Specificity Female ab: Rationale and Objectives: Our objective is to determine whether expected utility (EU) and the area under the receiver operator characteristic (AUC) are consistent with one another as endpoints of observer performance studies in mammography. These two measures characterize receiver operator characteristic performance somewhat differently. We compare these two study endpoints at the level of individual reader effects, statistical inference, and components of variance across readers and cases.Materials and Methods: We reanalyze three previously published laboratory observer performance studies that investigate various x-ray breast imaging modalities using EU and AUC. The EU measure is based on recent estimates of relative utility for screening mammography.Results: The AUC and EU measures are correlated across readers for individual modalities (r = 0.93) and differences in modalities (r = 0.94 to 0.98). Statistical inference for modality effects based on multi-reader multi-case analysis is very similar, with significant results (P < .05) in exactly the same conditions. Power analyses show mixed results across studies, with a small increase in power on average for EU that corresponds to approximately a 7% reduction in the number of readers. Despite a large number of crossing receiver operator characteristic curves (59% of readers), modality effects only rarely have opposite signs for EU and AUC (6%).Conclusions: We do not find any evidence of systematic differences between EU and AUC in screening mammography observer studies. Thus, when utility approaches are viable (i.e., an appropriate value of relative utility exists), practical effects such as statistical efficiency may be used to choose study endpoints. pubtype: Academic Journal doctype: case study research Journal Article ougenre: Article language: English refInfo: holdings: @attributes: islocal: N |
|---|