What type of Type I error? Contrasting the Neyman–Pearson and Fisherian approaches in the context of exact and direct replications.

The replication crisis has caused researchers to distinguish between exact replications, which duplicate all aspects of a study that could potentially affect the results, and direct replications, which duplicate only those aspects of the study that are thought to be theoretically essential to reprod...

Descripción completa

Detalles Bibliográficos
Publicado en:Synthese Vol. 198; no. 6; pp. 5809 - 5835
Autor principal: Rubin, Mark
Formato: Artículo
Publicado: Springer Nature Jun2021
Materias:
Acceso en línea:Ver este registro en EBSCOhost
fields @attributes:
  recordID: 1
pdfLink:
plink: https://search.ebscohost.com/login.aspx?direct=true&db=hlh&AN=150669276&site=ehost-live
header:
  @attributes:
    shortDbName: hlh
    uiTerm: 150669276
    longDbName: Humanities International Complete
    uiTag: AN
  controlInfo:
    bkinfo:
    jinfo:
      jid:
        00397857
        4LI
      jtl: Synthese
      issn: 00397857
      maglogo: N
    pubinfo:
      dt: Jun2021
      vid: 198
      iid: 6
      pid: 237
      pub: Springer Nature
    artinfo:
      ui:
        150669276
        10.1007/s11229-019-02433-0
      ppf: 5809
      ppct: 26
      formats:
        fmt:
          – @attributes:
              type: T
          – @attributes:
              type: P
              size: 629KB
      tig:
        atl: What type of Type I error? Contrasting the Neyman–Pearson and Fisherian approaches in the context of exact and direct replications.
      aug:
        au: Rubin, Mark
        affil: School of Psychology, Behavioural Sciences Building, The University of Newcastle, 2308, Callaghan, NSW, Australia
      su:
        False positive error
        Error probability
        Error rates
        Social systems
        Null hypothesis
        Social groups
      sug:
        subj:
          False positive error
          Error probability
          Error rates
          Social systems
          Null hypothesis
          Social groups
      keyword:
        Direct replication
        Exact replication
        Fisher
        Neyman–Pearson
        Replication crisis
        Type I error
      ab: The replication crisis has caused researchers to distinguish between exact replications, which duplicate all aspects of a study that could potentially affect the results, and direct replications, which duplicate only those aspects of the study that are thought to be theoretically essential to reproduce the original effect. The replication crisis has also prompted researchers to think more carefully about the possibility of making Type I errors when rejecting null hypotheses. In this context, the present article considers the utility of two types of Type I error probability: the Neyman–Pearson long run Type I error rate and the Fisherian sample-specific Type I error probability. It is argued that the Neyman–Pearson Type I error rate is inapplicable in social science because it refers to a long run of exact replications, and social science deals with irreversible units (people, social groups, and social systems) that make exact replications impossible. Instead, the Fisherian sample-specific Type I error probability is recommended as a more meaningful way to conceptualize false positive results in social science because it can be applied to each sample-specific decision about rejecting the same substantive null hypothesis in a series of direct replications. It is concluded that the replication crisis may be partly (not wholly) due to researchers' unrealistic expectations about replicability based on their consideration of the Neyman–Pearson Type I error rate across a long run of exact replications.
      pubtype: Academic Journal
      doctype: Article
      src: R
    language: English
    refInfo:
    copyright:
      @attributes:
        flag: Y
      custom: Synthese is a copyright of Springer, 2021. All Rights Reserved.
      item: Synthese
      holder: Springer Nature
      dt:
        @attributes:
          year: 2021
    holdings:
      @attributes:
        islocal: N