DOI or URL of the report: https://osf.io/preprints/psyarxiv/gy7sj?view_only=
Version of the report: 1
Dear Dr. Fillon,
thank you for your comments and for organizing the peer-review of our Stage-2 RR.
We followed your guidance and the suggestions of the reviewer and included deviations from Stage-1 in the supplements. Specifically, we moved the table deatiling pre-registered analyses/inferences to supplements (as all of the information in this table is in the main text anyway) and added a column to this table detailing our deviations for each analytical/inferential step. Since the deviations were minor, we did not included all of the columns from the table you suggested, but within this one column in our table, we address all the questions posed by the columns in the table you suggested (I hope this makes sense).
We further moved the pilot results into the supplements and added an overview of our results in a table as suggested by the reviewer. We also adressed the reviewer's comment that we did not predict the effect would be different in the reversed scenario (in the 4.1. discussion section). Finally, based on the feedback from our colleagues, we added one more caveat to the limitations section in the discussion (4.3), namely that we did not manipulate rationalization as another potential way to test between the two theories. As a result of this addition, we re-ordered the flow of the argument in this subsection such that the addition would naturally fit there.
We hope this changes improved the manuscript and thank again for your help.
Best wishes,
Martin Lang.
Dear authors,
Thank you for sending back the manuscript. I am very happy to see the stage 2 of this particularly interesting project.
I sent the manuscript to one reviewer and reviewed it myself and found that we both agreed that the manuscript could be improved with a few minors enhancements, one being mandatory by PCI-RR.
This modification is the inclusion of a deviation from stage 1 text or table to help the reader understand if you could follow perfectly the stage 1 procedure or had to made few modifications. If you want to do it quickly, you can reuse the table page 82 in the following: https://osf.io/z2brs (table named SX). I also agree with all the reviewer's points that you will need to address, especially that you can put the pilot study in a supplementary, maybe directly in the OSF to improve the flow of the manuscript.
Further, the analysis plan beginning page 12 reads as “we plan to do x”, please rephrase as “we did X”.
Minor typos:
Design page 8 “Participants were be blind”
Page 22 the title “Conclusion” needs to be a higher level that it is (it is at the same level as a subtitle of the discussion at this moment).
Best regards,
Adrien Fillon