Handbook on Conducting Reproduction and Replication Studies

Lukas Röseler; Lukas Wallrich; Helena Hartmann; Luisa Altegoer; Veronica Boyce; Sarahanne M. Field; Janik Goltermann; Joachim Hüffmeier; Charlotte R. Pennington; Merle-Marie Pittelkow; Priya Silverstein; Don van Ravenzwaaij; Flavio Azevedo

doi:10.5281/zenodo.16990114

Handbook on Conducting Reproduction and Replication Studies

Lukas Röseler, Lukas Wallrich, Helena Hartmann, Luisa Altegoer, Veronica Boyce, Sarahanne M. Field, Janik Goltermann, Joachim Hüffmeier, Charlotte R. Pennington, Merle-Marie Pittelkow, Priya Silverstein, Don van Ravenzwaaij, Flavio Azevedo

Research output: Book/Report › Book

97 Downloads (Pure)

Abstract

The practice of repeatedly testing published results with the same data (reproduction) or new data (replication) is currently gaining traction in the social sciences, owing to multiple failures to reproduce and replicate published findings. Along with increased skepticism have come guidelines for the repeated testing of hypotheses from various disciplines and fields. This guide aims to enable researchers to conduct high-quality reproductions and replications across social science disciplines. First we summarize recent developments, then provide a comprehensive guide to carrying out reproductions and replications, and finally present an example for how guidance needs to be tailored for specific fields. Our guide covers the entire research process: choosing a target study, deciding between different types of reproductions and replications, planning and running the new study, analyzing the results, discussing outcomes in the light of potential differences, and publishing a report.

Original language	English
Number of pages	99
Edition	1.0
DOIs	https://doi.org/10.5281/zenodo.16990114
Publication status	Published - 2 Sept 2025

Bibliographical note

This work is licensed under a Creative Commons Attribution 4.0 International License (https://creativecommons.org/licenses/by/4.0/).

Keywords

replication
repetitive research
reproducibility
meta-science
meta-research
open science
open research
open scholarship

Access to Document

10.5281/zenodo.16990114Licence: CC BY 4.0

Handbook-for-Reproduction-and-Replication-Studies v1.0
This work is licensed under a Creative Commons Attribution 4.0 International License (https://creativecommons.org/licenses/by/4.0/).
Final published version, 2.6 MBLicence: CC BY 4.0

Cite this

@book{0162979fbb2a4da4aa5784d363ffca03,

title = "Handbook on Conducting Reproduction and Replication Studies",

abstract = "The practice of repeatedly testing published results with the same data (reproduction) or new data (replication) is currently gaining traction in the social sciences, owing to multiple failures to reproduce and replicate published findings. Along with increased skepticism have come guidelines for the repeated testing of hypotheses from various disciplines and fields. This guide aims to enable researchers to conduct high-quality reproductions and replications across social science disciplines. First we summarize recent developments, then provide a comprehensive guide to carrying out reproductions and replications, and finally present an example for how guidance needs to be tailored for specific fields. Our guide covers the entire research process: choosing a target study, deciding between different types of reproductions and replications, planning and running the new study, analyzing the results, discussing outcomes in the light of potential differences, and publishing a report.",

keywords = "replication, repetitive research, reproducibility, meta-science, meta-research, open science, open research, open scholarship",

author = "Lukas R{\"o}seler and Lukas Wallrich and Helena Hartmann and Luisa Altegoer and Veronica Boyce and Field, {Sarahanne M.} and Janik Goltermann and Joachim H{\"u}ffmeier and Pennington, {Charlotte R.} and Merle-Marie Pittelkow and Priya Silverstein and {van Ravenzwaaij}, Don and Flavio Azevedo",

note = "This work is licensed under a Creative Commons Attribution 4.0 International License (https://creativecommons.org/licenses/by/4.0/).",

year = "2025",

month = sep,

day = "2",

doi = "10.5281/zenodo.16990114",

language = "English",

edition = "1.0",

}

TY - BOOK

T1 - Handbook on Conducting Reproduction and Replication Studies

AU - Röseler, Lukas

AU - Wallrich, Lukas

AU - Hartmann, Helena

AU - Altegoer, Luisa

AU - Boyce, Veronica

AU - Field, Sarahanne M.

AU - Goltermann, Janik

AU - Hüffmeier, Joachim

AU - Pennington, Charlotte R.

AU - Pittelkow, Merle-Marie

AU - Silverstein, Priya

AU - van Ravenzwaaij, Don

AU - Azevedo, Flavio

N1 - This work is licensed under a Creative Commons Attribution 4.0 International License (https://creativecommons.org/licenses/by/4.0/).

PY - 2025/9/2

Y1 - 2025/9/2

N2 - The practice of repeatedly testing published results with the same data (reproduction) or new data (replication) is currently gaining traction in the social sciences, owing to multiple failures to reproduce and replicate published findings. Along with increased skepticism have come guidelines for the repeated testing of hypotheses from various disciplines and fields. This guide aims to enable researchers to conduct high-quality reproductions and replications across social science disciplines. First we summarize recent developments, then provide a comprehensive guide to carrying out reproductions and replications, and finally present an example for how guidance needs to be tailored for specific fields. Our guide covers the entire research process: choosing a target study, deciding between different types of reproductions and replications, planning and running the new study, analyzing the results, discussing outcomes in the light of potential differences, and publishing a report.

AB - The practice of repeatedly testing published results with the same data (reproduction) or new data (replication) is currently gaining traction in the social sciences, owing to multiple failures to reproduce and replicate published findings. Along with increased skepticism have come guidelines for the repeated testing of hypotheses from various disciplines and fields. This guide aims to enable researchers to conduct high-quality reproductions and replications across social science disciplines. First we summarize recent developments, then provide a comprehensive guide to carrying out reproductions and replications, and finally present an example for how guidance needs to be tailored for specific fields. Our guide covers the entire research process: choosing a target study, deciding between different types of reproductions and replications, planning and running the new study, analyzing the results, discussing outcomes in the light of potential differences, and publishing a report.

KW - replication

KW - repetitive research

KW - reproducibility

KW - meta-science

KW - meta-research

KW - open science

KW - open research

KW - open scholarship

UR - https://zenodo.org/records/17035186

U2 - 10.5281/zenodo.16990114

DO - 10.5281/zenodo.16990114

M3 - Book

BT - Handbook on Conducting Reproduction and Replication Studies

ER -

Handbook on Conducting Reproduction and Replication Studies

Abstract

Bibliographical note

Keywords

Access to Document

Other files and links

Fingerprint

Cite this