A simulation-approximation approach to sample size planning for high-dimensional classification studies.

Classification studies with high-dimensional measurements and relatively small sample sizes are increasingly common. Prospective analysis of the role of sample sizes in the performance of such studies is important for study design and interpretation of results, but the complexity of typical pattern...

Descripción completa

Detalles Bibliográficos
Publicado en:Biostatistics Vol. 10; no. 3; pp. 424 - 436
Autores principales: de Valpine P, Bitter HM, Brown MP, Heller J, de Valpine, Perry, Bitter, Hans-Marcus, Brown, Michael P S, Heller, Jonathan
Formato: research Journal Article
Publicado: Oxford University Press / USA Jul2009
Acceso en línea:Ver este registro en EBSCOhost
fields @attributes:
  recordID: 1
pdfLink:
plink: https://search.ebscohost.com/login.aspx?direct=true&db=ccm&AN=105369575&site=ehost-live
header:
  @attributes:
    shortDbName: ccm
    uiTerm: 105369575
    longDbName: CINAHL Complete
    uiTag: AN
  controlInfo:
    bkinfo:
    dissinfo:
    jinfo:
      jid:
        14654644
        N58
      jtl: Biostatistics
      issn: 14654644
      maglogo: N
    pubinfo:
      dt: Jul2009
      vid: 10
      iid: 3
      pid: 622
      pub: Oxford University Press / USA
    artinfo:
      ui:
        105369575
        105369575
        NLM19234308
        2010328494
        10.1093/biostatistics/kxp001
        NLM19234308
        105369575
      ppf: 424
      ppct: 12
      formats:
      tig:
        atl: A simulation-approximation approach to sample size planning for high-dimensional classification studies.
      aug:
        au:
          de Valpine P
          Bitter HM
          Brown MP
          Heller J
          de Valpine, Perry
          Bitter, Hans-Marcus
          Brown, Michael P S
          Heller, Jonathan
        affil: Department of Environmental Science, Policy, & Management, University of California, 137 Hilgard Hall No. 3114, Berkeley, CA 94720-3114, USA
      sug:
        subj:
          Biometrics Methods
          Classification Methods
          Sample Size
          Algorithms
          Genomics Statistics and Numerical Data
          Linear Regression
          Multivariate Analysis
          Proteomics Statistics and Numerical Data
          Systems Analysis
          Human
      ab: Classification studies with high-dimensional measurements and relatively small sample sizes are increasingly common. Prospective analysis of the role of sample sizes in the performance of such studies is important for study design and interpretation of results, but the complexity of typical pattern discovery methods makes this problem challenging. The approach developed here combines Monte Carlo methods and new approximations for linear discriminant analysis, assuming multivariate normal distributions. Monte Carlo methods are used to sample the distribution of which features are selected for a classifier and the mean and variance of features given that they are selected. Given selected features, the linear discriminant problem involves different distributions of training data and generalization data, for which 2 approximations are compared: one based on Taylor series approximation of the generalization error and the other on approximating the discriminant scores as normally distributed. Combining the Monte Carlo and approximation approaches to different aspects of the problem allows efficient estimation of expected generalization error without full simulations of the entire sampling and analysis process. To evaluate the method and investigate realistic study design questions, full simulations are used to ask how validation error rate depends on the strength and number of informative features, the number of noninformative features, the sample size, and the number of features allowed into the pattern. Both approximation methods perform well for most cases but only the normal discriminant score approximation performs well for cases of very many weakly informative or uninformative dimensions. The simulated cases show that many realistic study designs will typically estimate substantially suboptimal patterns and may have low probability of statistically significant validation results.
      pubtype: Academic Journal
      doctype:
        research
        Journal Article
      ougenre: Article
    language: English
    refInfo:
    holdings:
      @attributes:
        islocal: N