The effect of public exposure and moral beliefs on feelings of shame and guilt
Revisiting the role of public exposure and moral beliefs on feelings of shame and guilt: Replication Registered Report of Smith et al. (2002)’s Study 1
Abstract
Recommendation: posted 21 March 2023, validated 23 March 2023
Chambers, C. (2023) The effect of public exposure and moral beliefs on feelings of shame and guilt. Peer Community in Registered Reports, 100396. 10.24072/pci.rr.100396
This is a stage 2 based on:
Yikang Zhang, Fung Chit (Jack) Cheung, Hei Tung (Patrina) Wong, Lok Yee (Noel) Yuen, Hui Ching (Rachel) Sin, Hiu Tang (Kristy) Chow, Gilad Feldman
Scheduled submission: 2022-04-15
Recommendation
The recommender in charge of the evaluation of the article and the reviewers declared that they have no conflict of interest (as defined in the code of conduct of PCI) with the authors or with the content of the article.
Evaluation round #1
DOI or URL of the report: https://osf.io/3uj6d
Version of the report: 3
Author's Reply, 08 Mar 2023
Revised manuscript: https://osf.io/jf2nc
All revised materials uploaded to: https://osf.io/j3ue4/ , updated manuscript under sub-directory "PCIRR Stage 2\PCIRR-S2 submission following R&R"
Decision by Chris Chambers, posted 02 Mar 2023, validated 02 Mar 2023
One of the original Stage 1 reviewers returned to evaluate your Stage 2 submission, and I have decided that we can proceed on the basis of this review and my own reading of the manuscript. The reviewer is broadly positive about your submission while also noting two areas needing attention: whether the exploratory analyses are completely justified, and whether the conclusions are as focused as they should be on the core outcomes. I am interested to see your response to these concerns, but in my own reading, I think addressing the second point may well neutralise the first without needing major changes. I will consider your response/revision at desk, and provided you are able to respond thoroughly, full acceptance should be forthcoming without requiring further in-depth review.
Reviewed by Uriel Haran, 15 Feb 2023
Are the data able to test the hypotheses?
Certainly. The sample size is large enough, the manipulation check seems to suggest the manipulation worked and everything else is consistent with the original study the current one is replicating.
Are the introduction, rationale and stated hypotheses the same as in Stage 1?
Yes, with the exception of the addition of a passage discussing the difference between shame and guilt in focusing on the self vs. on one’s behavior. This discussion was suggested in the review of Stage 1, and I think it improves the paper.
Have the authors adhered precisely to the registered study procedures?
As far as I can tell, yes. There are many exploratory analyses, but they are clearly labeled as such.
Are the unregistered exploratory analyses justified, methodologically sound, and informative?
Not all of them are, in my opinion. For example, the comparison of correlations between shame/guilt reactions and explicit shame/guilt is something I would have moved to an appendix, and in any case would not devote three pages to in the main text. Same for the scenario interactions on pp. 35-36. These results do not teach us anything substantive about the hypotheses or the replicated study.
Are the authors’ conclusions justified given the evidence?
Yes. But the conclusions need to be presented more clearly. The key analysis of the replication is the interaction between exposure and emotion. Failing to replicate the result of this analysis from the original paper makes for a failed replication of the entire research. All the numerous other results did replicate but they are not material to the current test. Therefore, the key analysis should be given special emphasis in the presentation of the results and the discussion, so that it stands out from the other replicated findings. Currently, the paper reads more like a series of successful replications (and many, many exploratory analyses), followed by a conclusion that the replication attempt failed, which may surprise less attentive readers.