I went over the reply to my comments and find those satisfactory. Thank you for making it easy for us to see the changes and the careful revision. The manuscript and accompanying materials have greatly improved. To me, this already makes for very interesting research, regardless of the results, and this is what I really like about Registered Reports and the two stage process.
I also ran the Rmd code. Aside from minor issues (author appearing twice preventing from knitting, and the t-test's paired = FALSE needing to be removed, possibly because of multiple packages I have installed having that function), I was able to run it and understand the output. I appreciate that.
I especially appreciate you addressing my request to simulate code and add that to the manuscript. Well done. I really hope this will become common practice in Registered Reports.
What I would recommend and ask is for upcoming submissions for you to also provide the knitted HTML output alongside the Rmd code, it would make sure that anyone with your version of R would be able to see the code alongside the output.
I look forward to the IPA and seeing the results following the data collection.
The authors have significantly improved the manuscript. I have a few minor comments, which I have included in the manuscript. I only have one suggestion for the authors:
Please be cautious about interpreting the effects since they are highly contested in the recent literature. This is all the more reason we need this research to show the validity/boundary conditions of the effect.
Download the reviewDOI or URL of the report: https://osf.io/py9xs?view_only=60348d468d8949aab31e9304128ec76a
Version of the report: 1
The is a well written, well-designed study that has the potential to be an important contribution to the literature. I have invited two expert in the field to review the manuscript and they have both provided very useful and important comments. I outline below the comments that I view as most important, along with a few of my own suggestions.
Both reviewers expressed concern with the way the victim identifiability findings were summarized on p. 5. I suggest you consider both reviewers comments and then revise this section to address the publication bias in the metanalysis, which may help explain why victim identifiability did not replicate. I also suggest that you address what this means for the importance of the topic.
Like Dr Feldman, I wondered about how you chose the features of identifiability. Why might including a photo, name and age matter, out of all the ways an offender could be identified? I see that you will control for gender. Will you also control for race or any other features?
I thought that H1 could have been written more clearly. By “weaker intention to punish” do you mean a smaller effect or a reversed effect where identified would be punished less than unidentified in the 3rd party condition?
Both reviewers mentioned that you might want to revise the way you treat the mediation analysis. I agree with them (especially concerns about power for the mediation analysis), but I also see the mediation analysis as a valuable way to investigate how these factors might contribute differently. Your hypotheses are all very similar, in that victims will judge the offender more negatively than third parties. If these DV are each uniquely useful to building a theory, it would be helpful to show how that they go beyond more or less negative attitudes. Your 5th hypothesis might shed light on how these factors differ if you predicted or explored more specific effects. My suggestion is to use the mediation analysis as an exploratory test.
There is only one trial to test the effect, despite that you note that context is likely to have an effect on judgments. I wonder why you chose pickpocketing and what features of pickpocketing might differ from other crimes in ways that could impact punishment and other relate judgments. I suggest you add more justification for selecting that particular crime, and later consider discussing how different crime might differ (which could be in the future-discussion).
Check the language of a “hard treatment.” I am a native English speaker and I agree with Dr Feldman that a “hard treatment” does not sound right. I do think you can say wither “angry at” or “angry with” or at least both sound correct to me.
The other suggestions from the reviewers were also very useful, and I hope they will be helpful to you. Please note that I am transitioning into a new role, and so I can’t be sure that I will be available to act as a recommender for future manuscripts. Therefore, even more than usual, please do consider my suggestions as suggestions and not requirements.
Please see attached.
Download the review