RUM leads to noise: the significance of finding the sources of variability between experimental runs.

Scientists typically run experiments many times to find general patterns over multiple specific runs. The results of those runs vary, and the variance is often simply referred to as “noise”. We claim that it is highly important to separate the components that contribute to noise and to recognize to...

Descripción completa

Detalles Bibliográficos
Publicado en:Synthese Vol. 204; no. 5; pp. 1 - 14
Autores principales: Vogrin, Michael, Koten, Jan Willem
Formato: Artículo
Publicado: Springer Nature Nov2024
Acceso en línea:Ver este registro en EBSCOhost
fields @attributes:
  recordID: 1
pdfLink:
plink: https://search.ebscohost.com/login.aspx?direct=true&db=hlh&AN=180666451&site=ehost-live
header:
  @attributes:
    shortDbName: hlh
    uiTerm: 180666451
    longDbName: Humanities International Complete
    uiTag: AN
  controlInfo:
    bkinfo:
    jinfo:
      jid:
        00397857
        4LI
      jtl: Synthese
      issn: 00397857
      maglogo: N
    pubinfo:
      dt: Nov2024
      vid: 204
      iid: 5
      pid: 237
      pub: Springer Nature
    artinfo:
      ui:
        180666451
        10.1007/s11229-024-04798-3
      ppf: 1
      ppct: 13
      formats:
        fmt:
          – @attributes:
              type: T
          – @attributes:
              type: P
              size: 1.7MB
      tig:
        atl: RUM leads to noise: the significance of finding the sources of variability between experimental runs.
      aug:
        au:
          Vogrin, Michael
          Koten, Jan Willem
        affil: https://ror.org/01faaaf77 Institute of Psychology, University of Graz, Graz, Austria
      sug:
      keyword:
        Epistemology
        Noise
        Philosophy of science
        Reproducibility
        Variability
      ab: Scientists typically run experiments many times to find general patterns over multiple specific runs. The results of those runs vary, and the variance is often simply referred to as “noise”. We claim that it is highly important to separate the components that contribute to noise and to recognize to which degree they contribute to it. Consideration of the relative contributions of R (randomness), U (uncontrolled variables), and M (measurement error) helps to interpret data and can help to improve experimental designs. We explain this using a hypothetical example and point out that assumptions of what causes variability in the results of experiments are often made implicitly. Further, we demonstrate our point by showing how it can change the interpretation of real data. Because of a lack of explicit discussion of underlying assumptions, it is possible that sources of noise are misidentified to be either existent or non-existent. This can happen if, for example, measurement error is assumed when there is none, an assumption that would mask a real effect that could deserve further study. Despite these factors, the contribution of different factors to the overall noise is rarely considered, hampering scientific progress.
      pubtype: Academic Journal
      doctype: Article
      src: R
    language: English
    refInfo:
    copyright:
      @attributes:
        flag: Y
      custom: Synthese is a copyright of Springer, 2024. All Rights Reserved.
      item: Synthese
      holder: Springer Nature
      dt:
        @attributes:
          year: 2024
    holdings:
      @attributes:
        islocal: N