With Great Power Comes Great Responsibility: Common Errors in Meta-Analyses and Meta-Regressions in Strength & Conditioning Research.

Background and Objective: Meta-analysis and meta-regression are often highly cited and may influence practice. Unfortunately, statistical errors in meta-analyses are widespread and can lead to flawed conclusions. The purpose of this article was to review common statistical errors in meta-analyses an...

Descripción completa

Detalles Bibliográficos
Publicado en:Sports Medicine Vol. 53; no. 2; pp. 313 - 326
Autores principales: Kadlec, Daniel, Sainani, Kristin L., Nimphius, Sophia
Formato: equations & formulas review tables/charts Journal Article
Publicado: Springer Nature Feb2023
Acceso en línea:Ver este registro en EBSCOhost
fields @attributes:
  recordID: 1
pdfLink:
plink: https://search.ebscohost.com/login.aspx?direct=true&db=ccm&AN=161516782&site=ehost-live
header:
  @attributes:
    shortDbName: ccm
    uiTerm: 161516782
    longDbName: CINAHL Complete
    uiTag: AN
  controlInfo:
    bkinfo:
    dissinfo:
    jinfo:
      jid:
        01121642
        C5H
      jtl: Sports Medicine
      issn: 01121642
      maglogo: N
    pubinfo:
      dt: Feb2023
      vid: 53
      iid: 2
      pid: 237
      pub: Springer Nature
      place: New York, New York
    artinfo:
      ui:
        161516782
        159528264
        161516782
        161516782
        10.1007/s40279-022-01766-0
        161516782
      ppf: 313
      ppct: 13
      formats:
      tig:
        atl: With Great Power Comes Great Responsibility: Common Errors in Meta-Analyses and Meta-Regressions in Strength & Conditioning Research.
      aug:
        au:
          Kadlec, Daniel
          Sainani, Kristin L.
          Nimphius, Sophia
        affil: School of Medical and Health Sciences, Centre for Human Performance, Edith Cowan University, 270 Joondalup Drive, 6027, Joondalup, WA, Australia
      sug:
        subj:
          Bias (Research)
          Muscle Strengthening
          Athletic Training
          Meta Analysis
          Systematic Review
          Effect Size
          Descriptive Statistics
      ab: Background and Objective: Meta-analysis and meta-regression are often highly cited and may influence practice. Unfortunately, statistical errors in meta-analyses are widespread and can lead to flawed conclusions. The purpose of this article was to review common statistical errors in meta-analyses and to document their frequency in highly cited meta-analyses from strength and conditioning research. Methods: We identified five errors in one highly cited meta-regression from strength and conditioning research: implausible outliers; overestimated effect sizes that arise from confusing standard deviation with standard error; failure to account for correlated observations; failure to account for within-study variance; and a focus on within-group rather than between-group results. We then quantified the frequency of these errors in 20 of the most highly cited meta-analyses in the field of strength and conditioning research from the past 20 years. Results: We found that 85% of the 20 most highly cited meta-analyses in strength and conditioning research contained statistical errors. Almost half (45%) contained at least one effect size that was mistakenly calculated using standard error rather than standard deviation. In several cases, this resulted in obviously wrong effect sizes, for example, effect sizes of 11 or 14 standard deviations. Additionally, 45% failed to account for correlated observations despite including numerous effect sizes from the same study and often from the same group within the same study. Conclusions: Statistical errors in meta-analysis and meta-regression are common in strength and conditioning research. We highlight five errors that authors, editors, and readers should check for when preparing or critically reviewing meta-analyses.
      pubtype: Academic Journal
      doctype:
        equations & formulas
        review
        tables/charts
        Journal Article
      ougenre: Article
    language: English
    refInfo:
    holdings:
      @attributes:
        islocal: N