A framework for evaluating reproducibility and replicability in economics.

We propose a framework for evaluating reproducibility and replicability in economics. Reproducibility is defined as testing if the results of an original study can be reproduced using the same data and replicability is defined as testing if the results of an original study hold in new data. We furth...

Descripción completa

Detalles Bibliográficos
Publicado en:Economic Inquiry Vol. 63; no. 2; pp. 338 - 357
Autores principales: Dreber, Anna, Johannesson, Magnus
Formato: Artículo
Publicado: Wiley-Blackwell Apr2025
Acceso en línea:Ver este registro en EBSCOhost
Descripción
Sumario:We propose a framework for evaluating reproducibility and replicability in economics. Reproducibility is defined as testing if the results of an original study can be reproduced using the same data and replicability is defined as testing if the results of an original study hold in new data. We further divide reproducibility and replicability studies into five types: computational reproducibility, recreate reproducibility, robustness reproducibility, direct replicability and conceptual replicability. In addition to this typology we propose indicators to measure the degree of reproducibility and replicability in both individual studies and for a group of studies.