Replicating the relationship between emotions and judgments of risk
Associations of fear, anger, happiness, and hope with risk judgments: Revisiting appraisal-tendency framework with a replication and extensions of Lerner and Keltner (2001)
Recommendation: posted 11 June 2022, validated 13 June 2022
URL to the preregistered Stage 1 protocol: https://osf.io/8yu2x
List of eligible PCI RR-friendly journals:
- Advances in Cognitive Psychology
- Journal of Cognition
- Peer Community Journal
- Royal Society Open Science
- Swiss Psychology Open
5. Lu, S. & Feldman, G. (2022). Associations of fear, anger, happiness, and hope with risk judgments: Revisiting appraisal-tendency framework with a replication and extensions of Lerner and Keltner (2001), in principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/8yu2x
Chris Chambers (2022) Replicating the relationship between emotions and judgments of risk. Peer Community in Registered Reports, . https://rr.peercommunityin.org/articles/rec?id=162
The recommender in charge of the evaluation of the article and the reviewers declared that they have no conflict of interest (as defined in the code of conduct of PCI) with the authors or with the content of the article.
Evaluation round #2
DOI or URL of the report: https://osf.io/w7n6z/
Version of the report: v2
Author's Reply, 10 Jun 2022
Decision by Chris Chambers, posted 06 Jun 2022
Three of the four reviewers kindly returned to evaluate your revised manuscript. The reviews are broadly promising, with a few outstanding issues concerning the rationale for the replication, the determination of the SESOI, and whether a pilot study may be required (although I am personally cautious about the use of pilots in establishing effect size estimates). I would like see your response to these points before issuing a final decision.
Reviewed by Max Primbs, 16 May 2022
Reviewed by Kelly Wolfe, 30 May 2022
Reviewed by Karolina Scigala, 06 Jun 2022
Evaluation round #1
DOI or URL of the report: https://osf.io/v46fw/
Author's Reply, 13 May 2022
Decision by Chris Chambers, posted 29 Mar 2022
Four reviewers have now completed their evaluations of the Stage 1 manuscript. Overall, I would judge their reviews to be critical but cautiously optimistic -- and highly detailed and constructive. All highlight the value of this replication attempt while also noting a range of areas that would benefit from improvement or clarification in order to meet the Stage 1 criteria.
Across the four sets of evaluations, some of the major issues to address include (in no particular order): strengthening the justification for a replication (see below for my view on this point), considering the pros and cons of a pre-test, including contingent analyses in light of potential failure of statistical assumptions, clarifying conditions under which hypotheses will be deemed unsupported, strengthening the justification of the SESOI, consideration of equivalance testing to provide positive evidence of absence, clarifying the rationale for studying framing effects, confirmation of ethics approval, tackling major methodological deviations from the original study (e.g. such as as the sampling method, and strategies to address it), clarification of study materials to match the original methods, and overall clarity of presentation in key areas.
Considering the the first point above -- strengthening the justification for conducting a replication -- under the PCI RR criteria, replications require no additional justification over and above any other kind of research, and unlike some journals, we do not evaluate Stage 1 RRs on the basis of the perceived importance or value of a research question (but rather, the scientific validity of that question). For this reason, there is no risk of rejection on the grounds that a replication may be unnecessary. That said, I think it would be very much in your interest to address this point constructively in revision because it will make the presentation more compelling for readers, and the reviewer who raised it offers some useful ideas on how to do so.
This list of issues is not exhaustive and you will find that the reviews provide a wide range of additional points. On the basis of their assessments, and my own reading of the manuscript, I am happy to offer the opportunity to submit a major revision.