Profiling provider outcome quality for pay-for-performance in the presence of missing data: a simulation approach.

Objective: Provider profiling of outcome performance has become increasingly common in pay-for-performance programs. For chronic conditions, a substantial proportion of patients eligible for outcome measures may be lost to follow-up, potentially compromising outcome profiling. In the context of prim...

Descripción completa

Detalles Bibliográficos
Publicado en:Health Services Research Vol. 48; no. 2pt1; pp. 810 - 826
Autores principales: Ryan, Andrew M, Bao, Yuhua
Formato: research Journal Article
Publicado: Wiley-Blackwell Apr2013
Acceso en línea:Ver este registro en EBSCOhost
fields @attributes:
  recordID: 1
pdfLink:
plink: https://search.ebscohost.com/login.aspx?direct=true&db=ccm&AN=104251354&site=ehost-live
header:
  @attributes:
    shortDbName: ccm
    uiTerm: 104251354
    longDbName: CINAHL Complete
    uiTag: AN
  controlInfo:
    bkinfo:
    dissinfo:
    jinfo:
      jid:
        00179124
        HSR
      jtl: Health Services Research
      issn: 00179124
      maglogo: Y
    pubinfo:
      dt: Apr2013
      vid: 48
      iid: 2pt1
      pid: 480
      pub: Wiley-Blackwell
      place: Malden, Massachusetts
    artinfo:
      ui:
        104251354
        104251354
        NLM23398455
        2012046277
        10.1111/1475-6773.12038
        NLM23398455
        PMC3626329
        104251354
      ppf: 810
      ppct: 16
      formats:
      tig:
        atl: Profiling provider outcome quality for pay-for-performance in the presence of missing data: a simulation approach.
      aug:
        au:
          Ryan, Andrew M
          Bao, Yuhua
        affil: Department of Public Health, Weill Cornell Medical College, New York, NY.
      sug:
        subj:
          Depression Economics
          Depression Therapy
          Physician Incentive Plans Economics
          Quality Improvement Economics
          Reimbursement Mechanisms Economics
          Human
          Mental Health Services Economics
          Minnesota
          Models, Statistical
          Systems Analysis
          Outcome Assessment
          Quality of Health Care Economics
          United States
      ab: Objective: Provider profiling of outcome performance has become increasingly common in pay-for-performance programs. For chronic conditions, a substantial proportion of patients eligible for outcome measures may be lost to follow-up, potentially compromising outcome profiling. In the context of primary care depression treatment, we assess the implications of missing data for the accuracy of alternative approaches to provider outcome profiling.Data: We used data from the Improving Mood-Promoting Access to Collaborative Treatment trial and the Depression Improvement across Minnesota, Offering a New Direction initiative to generate parameters for a Monte Carlo simulation experiment.Study Design: The patient outcome of interest is the rate of remission of depressive symptoms at 6 months among a panel of patients with major depression at baseline. We considered two alternative approaches to profiling this outcome: (1) a relative, or tournament style threshold, set at the 80th percentile of remission rate among all providers, and (2) an absolute threshold, evaluating whether providers exceed a specified remission rate (30 percent). We performed a Monte Carlo simulation experiment to evaluate the total error rate (proportion of providers who were incorrectly classified) under each profiling approach. The total error rate was partitioned into error from random sampling variability and error resulting from missing data. We then evaluated the accuracy of alternative profiling approaches under different assumptions about the relationship between missing data and depression remission.Principal Findings: Over a range of scenarios, relative profiling approaches had total error rates that were approximately 20 percent lower than absolute profiling approaches, and error due to missing data was approximately 50 percent lower for relative profiling. Most of the profiling error in the simulations was a result of random sampling variability, not missing data: between 11 and 21 percent of total error was attributable to missing data for relative profiling, while between 16 and 33 percent of total error was attributable to missing data for absolute profiling. Finally, compared with relative profiling, absolute profiling was much more sensitive to missing data that was correlated with the remission outcome.Conclusions: Relative profiling approaches for pay-for-performance were more accurate and more robust to missing data than absolute profiling approaches.
      pubtype: Academic Journal
      doctype:
        research
        Journal Article
      ougenre: Article
    language: English
    refInfo:
    holdings:
      @attributes:
        islocal: N