The Replication Database: Documenting the Replicability of Psychological Science

Lukas Röseler; Leonard Kaiser; Christopher Doetsch; Noah Klett; Christian Seida; Astrid Schütz; Balazs Aczel; Nadia Adelina; Valeria Agostini; Samuel Alarie; Nihan Albayrak-Aydemir; Alaa Aldoh; Ali H. Al-Hoorie; Flavio Azevedo; Bradley J. Baker; Charlotte Lilian Barth; Julia Beitner; Cameron Brick; Hilmar Brohmer; Subramanya Prasad Chandrashekar; Kai Li Chung; Jamie P. Cockcroft; Jamie Cummins; Veronica Diveica; Tsvetomira Dumbalska; Emir Efendic; Mahmoud Elsherif; Thomas Evans; Gilad Feldman; Adrien Fillon; Nico Förster; Joris Frese; Oliver Genschow; Vaitsa Giannouli; Biljana Gjoneska; Timo Gnambs; Amélie Gourdon-Kanhukamwe; Christopher J. Graham; Helena Hartmann; Clove Haviva; Alina Herderich; Leon P. Hilbert; Darías Holgado; Ian Hussey; Zlatomira G. Ilchovska; Tamara Kalandadze; Veli-Matti Karhulahti; Leon Kasseckert; Maren Klingelhöfer-Jens; Alina Koppold; Max Korbmacher; Louisa Kulke; Niclas Kuper; Annalise Laplume; Gavin Leech; Feline Lohkamp; Nigel Mantou Lou; Dermot Lynott; Maximilian Maier; Maria Meier; Maria Montefinese; David Moreau; Kellen Mrkva; Monika Nemcova; Danna Oomen; Julian Packheiser; Shubham Pandey; Frank Papenmeier; Mariola Paruzel-Czachura; Yuri G. Pavlov; Zoran Pavlović; Charlotte R. Pennington; Merle-Marie Pittelkow; Willemijn Plomp; Paul E. Plonski; Ekaterina Pronizius; Andrew Adrian Pua; Katarzyna Pypno-Blajda; Manuel Rausch; Tobias R. Rebholz; Elena Richert; Jan Philipp Röer; Robert Ross; Kathleen Schmidt; Aleksandrina Skvortsova; Matthias F. J. Sperl; Alvin W. M. Tan; J. Lukas Thürmer; Aleksandra Tołopiło; Wolf Vanpaemel; Leigh Ann Vaughn; Steven Verheyen; Lukas Wallrich; Lucia Weber; Julia K. Wolska; Mirela Zaneva; Yikang Zhang

doi:10.5334/jopd.101

The Replication Database: Documenting the Replicability of Psychological Science

Lukas Röseler, Leonard Kaiser, Christopher Doetsch, Noah Klett, Christian Seida, Astrid Schütz, Balazs Aczel, Nadia Adelina, Valeria Agostini, Samuel Alarie, Nihan Albayrak-Aydemir, Alaa Aldoh, Ali H. Al-Hoorie, Flavio Azevedo, Bradley J. Baker, Charlotte Lilian Barth, Julia Beitner, Cameron Brick, Hilmar Brohmer, Subramanya Prasad ChandrashekarKai Li Chung, Jamie P. Cockcroft, Jamie Cummins, Veronica Diveica, Tsvetomira Dumbalska, Emir Efendic, Mahmoud Elsherif, Thomas Evans, Gilad Feldman, Adrien Fillon, Nico Förster, Joris Frese, Oliver Genschow, Vaitsa Giannouli, Biljana Gjoneska, Timo Gnambs, Amélie Gourdon-Kanhukamwe, Christopher J. Graham, Helena Hartmann, Clove Haviva, Alina Herderich, Leon P. Hilbert, Darías Holgado, Ian Hussey, Zlatomira G. Ilchovska, Tamara Kalandadze, Veli-Matti Karhulahti, Leon Kasseckert, Maren Klingelhöfer-Jens, Alina Koppold, Max Korbmacher, Louisa Kulke, Niclas Kuper, Annalise Laplume, Gavin Leech, Feline Lohkamp, Nigel Mantou Lou, Dermot Lynott, Maximilian Maier, Maria Meier, Maria Montefinese, David Moreau, Kellen Mrkva, Monika Nemcova, Danna Oomen, Julian Packheiser, Shubham Pandey, Frank Papenmeier, Mariola Paruzel-Czachura, Yuri G. Pavlov, Zoran Pavlović, Charlotte R. Pennington, Merle-Marie Pittelkow, Willemijn Plomp, Paul E. Plonski, Ekaterina Pronizius, Andrew Adrian Pua, Katarzyna Pypno-Blajda, Manuel Rausch, Tobias R. Rebholz, Elena Richert, Jan Philipp Röer, Robert Ross, Kathleen Schmidt, Aleksandrina Skvortsova, Matthias F. J. Sperl, Alvin W. M. Tan, J. Lukas Thürmer, Aleksandra Tołopiło, Wolf Vanpaemel, Leigh Ann Vaughn, Steven Verheyen, Lukas Wallrich, Lucia Weber, Julia K. Wolska, Mirela Zaneva, Yikang Zhang

Research output: Contribution to journal › Article › peer-review

Abstract

In psychological science, replicability—repeating a study with a new sample achieving consistent results (Parsons et al., 2022)—is critical for affirming the validity of scientific findings. Despite its importance, replication efforts are few and far between in psychological science with many attempts failing to corroborate past findings. This scarcity, compounded by the difficulty in accessing replication data, jeopardizes the efficient allocation of research resources and impedes scientific advancement. Addressing this crucial gap, we present the Replication Database (https://forrt-replications.shinyapps.io/fred_explorer), a novel platform hosting 1,239 original findings paired with replication findings. The infrastructure of this database allows researchers to submit, access, and engage with replication findings. The database makes replications visible, easily findable via a graphical user interface, and tracks replication rates across various factors, such as publication year or journal. This will facilitate future efforts to evaluate the robustness of psychological research.

Original language	English
Article number	8
Number of pages	23
Journal	Journal of Open Psychology Data
Volume	12
Issue number	1
Early online date	11 Sept 2024
DOIs	https://doi.org/10.5334/jopd.101
Publication status	Published - 11 Sept 2024

Bibliographical note

Copyright © 2024 The Author(s). This is an open-access article distributed under the terms of the Creative Commons Attribution 4.0
International License (CC-BY 4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original
author and source are credited. See https://creativecommons.org/licenses/by/4.0/

Keywords

replication
open science
open research
replication database
meta science
meta research
replication crisis
credibility revolution
credibility

Access to Document

10.5334/jopd.101Licence: CC BY 4.0

L Roeseler et al_The Replication Database_Documenting the Replicability of Psychological Science
Copyright © 2024 The Author(s). This is an open-access article distributed under the terms of the Creative Commons Attribution 4.0 International License (CC-BY 4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited. See https://creativecommons.org/licenses/by/4.0/
Final published version, 4.35 MBLicence: CC BY 4.0

Cite this

Röseler, L., Kaiser, L., Doetsch, C., Klett, N., Seida, C., Schütz, A., Aczel, B., Adelina, N., Agostini, V., Alarie, S., Albayrak-Aydemir, N., Aldoh, A., Al-Hoorie, A. H., Azevedo, F., Baker, B. J., Barth, C. L., Beitner, J., Brick, C., Brohmer, H., ... Zhang, Y. (2024). The Replication Database: Documenting the Replicability of Psychological Science. Journal of Open Psychology Data, 12(1), Article 8. https://doi.org/10.5334/jopd.101

@article{0497c45f1ab84a9193028035be26fe1e,

title = "The Replication Database: Documenting the Replicability of Psychological Science",

abstract = "In psychological science, replicability—repeating a study with a new sample achieving consistent results (Parsons et al., 2022)—is critical for affirming the validity of scientific findings. Despite its importance, replication efforts are few and far between in psychological science with many attempts failing to corroborate past findings. This scarcity, compounded by the difficulty in accessing replication data, jeopardizes the efficient allocation of research resources and impedes scientific advancement. Addressing this crucial gap, we present the Replication Database (https://forrt-replications.shinyapps.io/fred_explorer), a novel platform hosting 1,239 original findings paired with replication findings. The infrastructure of this database allows researchers to submit, access, and engage with replication findings. The database makes replications visible, easily findable via a graphical user interface, and tracks replication rates across various factors, such as publication year or journal. This will facilitate future efforts to evaluate the robustness of psychological research.",

keywords = "replication, open science, open research, replication database, meta science, meta research, replication crisis, credibility revolution, credibility",

author = "Lukas R{\"o}seler and Leonard Kaiser and Christopher Doetsch and Noah Klett and Christian Seida and Astrid Sch{\"u}tz and Balazs Aczel and Nadia Adelina and Valeria Agostini and Samuel Alarie and Nihan Albayrak-Aydemir and Alaa Aldoh and Al-Hoorie, {Ali H.} and Flavio Azevedo and Baker, {Bradley J.} and Barth, {Charlotte Lilian} and Julia Beitner and Cameron Brick and Hilmar Brohmer and Chandrashekar, {Subramanya Prasad} and Chung, {Kai Li} and Cockcroft, {Jamie P.} and Jamie Cummins and Veronica Diveica and Tsvetomira Dumbalska and Emir Efendic and Mahmoud Elsherif and Thomas Evans and Gilad Feldman and Adrien Fillon and Nico F{\"o}rster and Joris Frese and Oliver Genschow and Vaitsa Giannouli and Biljana Gjoneska and Timo Gnambs and Am{\'e}lie Gourdon-Kanhukamwe and Graham, {Christopher J.} and Helena Hartmann and Clove Haviva and Alina Herderich and Hilbert, {Leon P.} and Dar{\'i}as Holgado and Ian Hussey and Ilchovska, {Zlatomira G.} and Tamara Kalandadze and Veli-Matti Karhulahti and Leon Kasseckert and Maren Klingelh{\"o}fer-Jens and Alina Koppold and Max Korbmacher and Louisa Kulke and Niclas Kuper and Annalise Laplume and Gavin Leech and Feline Lohkamp and Lou, {Nigel Mantou} and Dermot Lynott and Maximilian Maier and Maria Meier and Maria Montefinese and David Moreau and Kellen Mrkva and Monika Nemcova and Danna Oomen and Julian Packheiser and Shubham Pandey and Frank Papenmeier and Mariola Paruzel-Czachura and Pavlov, {Yuri G.} and Zoran Pavlovi{\'c} and Pennington, {Charlotte R.} and Merle-Marie Pittelkow and Willemijn Plomp and Plonski, {Paul E.} and Ekaterina Pronizius and Pua, {Andrew Adrian} and Katarzyna Pypno-Blajda and Manuel Rausch and Rebholz, {Tobias R.} and Elena Richert and R{\"o}er, {Jan Philipp} and Robert Ross and Kathleen Schmidt and Aleksandrina Skvortsova and Sperl, {Matthias F. J.} and Tan, {Alvin W. M.} and Th{\"u}rmer, {J. Lukas} and Aleksandra To{\l}opi{\l}o and Wolf Vanpaemel and Vaughn, {Leigh Ann} and Steven Verheyen and Lukas Wallrich and Lucia Weber and Wolska, {Julia K.} and Mirela Zaneva and Yikang Zhang",

note = "Copyright {\textcopyright} 2024 The Author(s). This is an open-access article distributed under the terms of the Creative Commons Attribution 4.0 International License (CC-BY 4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited. See https://creativecommons.org/licenses/by/4.0/",

year = "2024",

month = sep,

day = "11",

doi = "10.5334/jopd.101",

language = "English",

volume = "12",

number = "1",

}

Röseler, L, Kaiser, L, Doetsch, C, Klett, N, Seida, C, Schütz, A, Aczel, B, Adelina, N, Agostini, V, Alarie, S, Albayrak-Aydemir, N, Aldoh, A, Al-Hoorie, AH, Azevedo, F, Baker, BJ, Barth, CL, Beitner, J, Brick, C, Brohmer, H, Chandrashekar, SP, Chung, KL, Cockcroft, JP, Cummins, J, Diveica, V, Dumbalska, T, Efendic, E, Elsherif, M, Evans, T, Feldman, G, Fillon, A, Förster, N, Frese, J, Genschow, O, Giannouli, V, Gjoneska, B, Gnambs, T, Gourdon-Kanhukamwe, A, Graham, CJ, Hartmann, H, Haviva, C, Herderich, A, Hilbert, LP, Holgado, D, Hussey, I, Ilchovska, ZG, Kalandadze, T, Karhulahti, V-M, Kasseckert, L, Klingelhöfer-Jens, M, Koppold, A, Korbmacher, M, Kulke, L, Kuper, N, Laplume, A, Leech, G, Lohkamp, F, Lou, NM, Lynott, D, Maier, M, Meier, M, Montefinese, M, Moreau, D, Mrkva, K, Nemcova, M, Oomen, D, Packheiser, J, Pandey, S, Papenmeier, F, Paruzel-Czachura, M, Pavlov, YG, Pavlović, Z, Pennington, CR, Pittelkow, M-M, Plomp, W, Plonski, PE, Pronizius, E, Pua, AA, Pypno-Blajda, K, Rausch, M, Rebholz, TR, Richert, E, Röer, JP, Ross, R, Schmidt, K, Skvortsova, A, Sperl, MFJ, Tan, AWM, Thürmer, JL, Tołopiło, A, Vanpaemel, W, Vaughn, LA, Verheyen, S, Wallrich, L, Weber, L, Wolska, JK, Zaneva, M & Zhang, Y 2024, 'The Replication Database: Documenting the Replicability of Psychological Science', Journal of Open Psychology Data, vol. 12, no. 1, 8. https://doi.org/10.5334/jopd.101

TY - JOUR

T1 - The Replication Database: Documenting the Replicability of Psychological Science

AU - Röseler, Lukas

AU - Kaiser, Leonard

AU - Doetsch, Christopher

AU - Klett, Noah

AU - Seida, Christian

AU - Schütz, Astrid

AU - Aczel, Balazs

AU - Adelina, Nadia

AU - Agostini, Valeria

AU - Alarie, Samuel

AU - Albayrak-Aydemir, Nihan

AU - Aldoh, Alaa

AU - Al-Hoorie, Ali H.

AU - Azevedo, Flavio

AU - Baker, Bradley J.

AU - Barth, Charlotte Lilian

AU - Beitner, Julia

AU - Brick, Cameron

AU - Brohmer, Hilmar

AU - Chandrashekar, Subramanya Prasad

AU - Chung, Kai Li

AU - Cockcroft, Jamie P.

AU - Cummins, Jamie

AU - Diveica, Veronica

AU - Dumbalska, Tsvetomira

AU - Efendic, Emir

AU - Elsherif, Mahmoud

AU - Evans, Thomas

AU - Feldman, Gilad

AU - Fillon, Adrien

AU - Förster, Nico

AU - Frese, Joris

AU - Genschow, Oliver

AU - Giannouli, Vaitsa

AU - Gjoneska, Biljana

AU - Gnambs, Timo

AU - Gourdon-Kanhukamwe, Amélie

AU - Graham, Christopher J.

AU - Hartmann, Helena

AU - Haviva, Clove

AU - Herderich, Alina

AU - Hilbert, Leon P.

AU - Holgado, Darías

AU - Hussey, Ian

AU - Ilchovska, Zlatomira G.

AU - Kalandadze, Tamara

AU - Karhulahti, Veli-Matti

AU - Kasseckert, Leon

AU - Klingelhöfer-Jens, Maren

AU - Koppold, Alina

AU - Korbmacher, Max

AU - Kulke, Louisa

AU - Kuper, Niclas

AU - Laplume, Annalise

AU - Leech, Gavin

AU - Lohkamp, Feline

AU - Lou, Nigel Mantou

AU - Lynott, Dermot

AU - Maier, Maximilian

AU - Meier, Maria

AU - Montefinese, Maria

AU - Moreau, David

AU - Mrkva, Kellen

AU - Nemcova, Monika

AU - Oomen, Danna

AU - Packheiser, Julian

AU - Pandey, Shubham

AU - Papenmeier, Frank

AU - Paruzel-Czachura, Mariola

AU - Pavlov, Yuri G.

AU - Pavlović, Zoran

AU - Pennington, Charlotte R.

AU - Pittelkow, Merle-Marie

AU - Plomp, Willemijn

AU - Plonski, Paul E.

AU - Pronizius, Ekaterina

AU - Pua, Andrew Adrian

AU - Pypno-Blajda, Katarzyna

AU - Rausch, Manuel

AU - Rebholz, Tobias R.

AU - Richert, Elena

AU - Röer, Jan Philipp

AU - Ross, Robert

AU - Schmidt, Kathleen

AU - Skvortsova, Aleksandrina

AU - Sperl, Matthias F. J.

AU - Tan, Alvin W. M.

AU - Thürmer, J. Lukas

AU - Tołopiło, Aleksandra

AU - Vanpaemel, Wolf

AU - Vaughn, Leigh Ann

AU - Verheyen, Steven

AU - Wallrich, Lukas

AU - Weber, Lucia

AU - Wolska, Julia K.

AU - Zaneva, Mirela

AU - Zhang, Yikang

N1 - Copyright © 2024 The Author(s). This is an open-access article distributed under the terms of the Creative Commons Attribution 4.0 International License (CC-BY 4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited. See https://creativecommons.org/licenses/by/4.0/

PY - 2024/9/11

Y1 - 2024/9/11

N2 - In psychological science, replicability—repeating a study with a new sample achieving consistent results (Parsons et al., 2022)—is critical for affirming the validity of scientific findings. Despite its importance, replication efforts are few and far between in psychological science with many attempts failing to corroborate past findings. This scarcity, compounded by the difficulty in accessing replication data, jeopardizes the efficient allocation of research resources and impedes scientific advancement. Addressing this crucial gap, we present the Replication Database (https://forrt-replications.shinyapps.io/fred_explorer), a novel platform hosting 1,239 original findings paired with replication findings. The infrastructure of this database allows researchers to submit, access, and engage with replication findings. The database makes replications visible, easily findable via a graphical user interface, and tracks replication rates across various factors, such as publication year or journal. This will facilitate future efforts to evaluate the robustness of psychological research.

AB - In psychological science, replicability—repeating a study with a new sample achieving consistent results (Parsons et al., 2022)—is critical for affirming the validity of scientific findings. Despite its importance, replication efforts are few and far between in psychological science with many attempts failing to corroborate past findings. This scarcity, compounded by the difficulty in accessing replication data, jeopardizes the efficient allocation of research resources and impedes scientific advancement. Addressing this crucial gap, we present the Replication Database (https://forrt-replications.shinyapps.io/fred_explorer), a novel platform hosting 1,239 original findings paired with replication findings. The infrastructure of this database allows researchers to submit, access, and engage with replication findings. The database makes replications visible, easily findable via a graphical user interface, and tracks replication rates across various factors, such as publication year or journal. This will facilitate future efforts to evaluate the robustness of psychological research.

KW - replication

KW - open science

KW - open research

KW - replication database

KW - meta science

KW - meta research

KW - replication crisis

KW - credibility revolution

KW - credibility

UR - https://openpsychologydata.metajnl.com/articles/10.5334/jopd.101

U2 - 10.5334/jopd.101

DO - 10.5334/jopd.101

M3 - Article

VL - 12

JO - Journal of Open Psychology Data

JF - Journal of Open Psychology Data

IS - 1

M1 - 8

ER -

The Replication Database: Documenting the Replicability of Psychological Science

Abstract

Bibliographical note

Keywords

Access to Document

Other files and links

Fingerprint

Cite this