JIAB-2026-6TDG
The Reproducibility Crisis in Social Psychology: A Meta-Analytic Reassessment
Waiting for Authors
Editor
Maya Henderson
Handling editor for this submission.
Assigned editor: Maya Henderson
Update the handling editor to rebalance workload or hand off the submission.
Abstract
We revisit 172 replication attempts from the Reproducibility Project and estimate effect-size shrinkage across subfields. Contrary to prior claims, we find heterogeneous replicability correlated with sample size and publication year, suggesting publication-bias correction substantially narrows the apparent crisis.
Reviews
2 itemsR1 Jack Thompson Submitted Oct 11, 2026
The paper makes an interesting contribution but has significant methodological issues. First, the funnel-plot asymmetry test used to detect publication bias is known to confound bias with genuine heterogeneity. Second, the authors do not account for differences in replication fidelity across studies. I recommend major revisions addressing these two points before acceptance.
R2 Kate Okonkwo Submitted Oct 14, 2026
This is a carefully executed meta-analysis on a timely topic. My main concern is the inclusion criteria: several studies included appear to use different operationalizations of the original effect. Clarifying this and adding a sensitivity analysis restricted to high-fidelity replications would strengthen the paper considerably. I also suggest the authors address the statistical power of the included replications more directly.
Files
1 manuscriptReviewers
2 of 2 receivedDrag names to change the reviewer order for people who have not been invited yet.
Jack Thompson
Kate Okonkwo
Messages
2 messagesA Author Cover letter
This paper revisits the replication crisis claims using updated meta-analytic methods.
E Editor Major revision required
Dear Dr. Thompson,
Thank you for your patience. We have now received two reviews of your manuscript. Both reviewers find the work interesting but raise methodological concerns that require attention before we can proceed.
Jack Thompson requests clarification of the funnel-plot test choice and asks you to address replication fidelity differences. Kate Okonkwo asks for tighter inclusion criteria and a sensitivity analysis limited to high-fidelity replications.
Please submit your revision within 60 days. Include a point-by-point response letter.
Best regards,
The Editors
Timeline
2 events
Waiting for Authors
Oct 16, 2026
Waiting for Reviewers
Sep 26, 2026
Status override
Override status only to correct a workflow state set in error. Notification actions should use Compose.