DOI or URL of the report: 10.31234/osf.io/a4zmj
Version of the report: https://psyarxiv.com/a4zmj
The two reviewers from Stage 1 kindly returned to evaluate your completed Stage 2 submission. Both are positive about your manuscript -- a sentiment with which I concur; this is a fine example of a rigorous, RR-based meta-analysis. The enclosed comments focus almost entirely on additional points to consider in the Discussion. Please address all points comprehensively in a revision and response. I anticipate then being able to issue a final Stage 2 recommendation without further in-depth review.
2A. Whether the data are able to test the authors’ proposed hypotheses (or answer the proposed research question) by passing the approved outcome-neutral criteria, such as absence of floor and ceiling effects or success of positive controls or other quality checks.
This criterion is not really applicable to meta-analyses.
2B. Whether the introduction, rationale and stated hypotheses (where applicable) are the same as the approved Stage 1 submission. This can be readily assessed by referring to the tracked-changes manuscript supplied by the authors.
Yes.
2C. Whether the authors adhered precisely to the registered study procedures.
Yes.
2D. Where applicable, whether any unregistered exploratory analyses are justified, methodologically sound, and informative.
They are.
2E. Whether the authors’ conclusions are justified given the evidence.
Yes, they are justified. In fact, this is one of the most methodologically sound meta-analyses I have read so far.
I just stumbled across one sentence, on p. 13: "After all, large samples have large expected sampling variability, leading to imprecise results". Shouldn't that be the other way round?
Felix Schönbrodt
(signed review)
Please see attached file.
Download the review