Submit a report

Announcements

We are recruiting recommenders (editors) from all research fields!

Your feedback matters! If you have authored or reviewed a Registered Report at Peer Community in Registered Reports, then please take 5 minutes to leave anonymous feedback about your experience, and view community ratings.


 

Latest recommendationsrssmastodon

IdTitleAuthorsAbstractPictureThematic fieldsRecommender▲ReviewersSubmission date
25 Sep 2023
STAGE 1
toto

Effects of Auditory Stimuli During Submaximal Exercise on Cerebral Oxygenation

Does listening to music alter prefrontal cortical activity during exercise?

Recommended by ORCID_LOGO based on reviews by David Mehler and 1 anonymous reviewer
The relationship between music and exercise has been studied for over a century, with implications for our understanding of biomechanics, physiology, brain function, and psychology. Listening to music while exercising is associated with a wide range of benefits, from increasing motivation, to reducing perceived exertion, inhibiting awareness of negative bodily signals, boosting mood, and ultimately improving physical performance. But while these ergogenic benefits of music are well documented, much remains to be discovered about how music alters brain function during exercise. One reason for this gap in understanding is the technical difficulty in recording brain activity during realistic exercise, as neuroimaging methods such as fMRI, EEG or MEG typically require participants to remain as still as possible.
 
In the current study, Guérin et al. (2023) will use the optical brain imaging technique of functional near infrared spectroscopy (fNIRS) to measure oxygenation of key brain areas during exercise. Unlike other neuroimaging methods, fNIRS has a high tolerance for motion artefacts, making it the ideal method of choice for the current investigation. The authors propose a series of hypotheses based on previous studies that observed a decrease in cerebral oxygenation during intense exercise, particularly within the medial prefrontal cortex (mPFC) and dorsolateral prefrontal cortex (dlPFC). If, as suggested, the prefrontal cortex is important for regulation of cognition and emotion during exercise, then the benefits of listening to music might arise by delaying or reducing this drop in prefrontal oxygenation.
 
Using a within-subject designs, Guérin et al. will combine an incremental exercise protocol involving a cycling task with three auditory conditions: asynchronous music (the active condition), listening to an audiobook (an auditory control) or silence (baseline control). Compared to the two control conditions, they predict that music exposure will increase oxygenation in prefrontal and parietal regions and will also delay the drop in oxygenation associated with intense exercise (specifically within dlPFC and mPFC). To test whether any such changes are specific for prefrontal and parietal cortex, they will also compare the haemodynamic responses of the occipital cortex between the auditory conditions, predicting no difference.
 
The Stage 1 manuscript was evaluated over two rounds of in-depth review. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
 
URL to the preregistered Stage 1 protocol: https://osf.io/52aeb
 
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.
 
List of eligible PCI RR-friendly journals:
 

 

 

References
 
1. Guérin, S. M. R., Karageorghis, C. I., Coeugnet, M. R., Bigliassi, M. & Delevoye-Turrell, Y. N. (2023). Effects of Auditory Stimuli During Submaximal Exercise on Cerebral Oxygenation. In principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/52aeb

Effects of Auditory Stimuli During Submaximal Exercise on Cerebral OxygenationDr Ségolène M. R. Guérin, Professor Costas I. Karageorghis, Marine R. Coeugnet, Dr Marcelo Bigliassi and Professor Yvonne N. Delevoye-Turrell<p>Asynchronous music has been commonly used to reduce perceived exertion and render the exercise experience more pleasant. Research has indicated that in-task asynchronous music can reallocate an individual’s attentional focus to task-unrelated s...Life SciencesChris Chambers2023-01-24 12:06:32 View
11 Apr 2023
STAGE 1
toto

The link between Empathy and Forgiveness: Replication and extensions of McCullough et al. (1997)'s Study 1

Is empathy important for forgiveness?

Recommended by ORCID_LOGO based on reviews by Wenrui Cao, James Bartlett and Saleh Shuqair
Forgiveness is a core feature of human psychology in which a person makes a deliberate decision to cease negative emotions or attitudes toward an offender who has done them harm. The concept of interpersonal forgiveness is deeply embedded across societies, but much remains to be understood about how it actually works. What are its key ingredients and why does it occur in the first place? Research in social psychology has demonstrated a range of personal and social benefits of forgiveness, giving rise to two dominant mechanistic accounts – one that positions empathy as the driving factor and another that centres motivated reasoning (Donovan & Priester, 2017).
 
In the current study, Chan and Feldman (2023) seek to replicate a formative study by McCullough et al (1997) that led to the so-called Empathy Model of forgiveness. According to this theory, forgiving is a motivational change facilitated (crucially) by empathy, promoting constructive over destructive behaviour toward the offender. Chan and Feldman will replicate Study 1 from McCullough et al., measuring the correlational relationship between apology, forgiving, and empathy for offenders, and exploring whether forgiving is associated with increased conciliation and decreased avoidance motivation. As well as closely replicating the original study, the authors will extend it to test the more severe hypothesis that empathy causally influences forgiveness. To achieve this, they will experimentally manipulate empathy by adding two groups to the design: one in which participants are asked to recall hurtful past experiences in which they were not empathetic to the offender, and another in which they were highly empathetic.
 
The Stage 1 manuscript was evaluated over two rounds of in-depth review. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
 
URL to the preregistered Stage 1 protocol: https://osf.io/q78fs
 
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA. 
 
List of eligible PCI RR-friendly journals:
 
References
 
1. Donovan, L. A. N., & Priester, J. R. (2017). Exploring the psychological processes underlying interpersonal forgiveness: The superiority of motivated reasoning over empathy. Journal of Experimental Social Psychology, 71, 16-30. https://doi.org/10.1016/j.jesp.2017.02.005
 
2. Chan, C. F. & Feldman, G. (2023). The link between Empathy and Forgiveness: Replication and extensions of McCullough et al. (1997)'s Study 1, in principle acceptance of Version 2 by Peer Community in Registered Reports. https://osf.io/q78fs
The link between Empathy and Forgiveness: Replication and extensions of McCullough et al. (1997)'s Study 1Chan Chi Fung, Gilad Feldman <p>[IMPORTANT: Abstract, method, and results were written using a randomized dataset produced by Qualtrics to simulate what these sections will look like after data collection. These will be updated following the data collection. For the purpose o...Social sciencesChris Chambers Wenrui Cao, James Bartlett2023-01-25 11:15:13 View
23 May 2023
STAGE 1
toto

Does Brooding Meaningfully Increase the Likelihood of Believing in a Conspiracy? A Registered Report

Does brooding increase conspiracy beliefs?

Recommended by ORCID_LOGO based on reviews by Matt Williams and 1 anonymous reviewer
The world is seemingly awash with conspiracy theories – from well-trodden examples such as fake Moon landings, the 9/11 truth movement, and Holocaust denial, to relative newcomers including COVID as a bioweapon, QAnon, and the belief that the science of climate change has been invented or falsified. While there is a public perception that conspiracy theories are becoming more prevalent, recent evidence suggests that the rate of conspiracism is relatively stable over time (Uscinski et al., 2022). At any point in history, it seems that a certain proportion of people find themselves vulnerable to conspiracy beliefs, but what distinguishes those who do from those who don’t, and what are the causal factors?
 
In the current study, Liekefett et al. (2023) investigate the critical role of rumination – a perseverative and repetitive focus on negative content leading to emotional distress. In particular, the authors ask whether one component of rumination referred to as brooding (dwelling on one’s worries and distressing emotions) has a specific causal role in the formation of conspiracy beliefs. In a series of preliminary experiments, the authors first established a procedure for successfully inducing rumination, identifying various boundary conditions and requirements for a successful design. In the proposed study (of up to N=1,638), they will then ask whether the induction of brooding causes a significant increase in conspiracy beliefs. Manipulation checks will be included to confirm intervention fidelity (independently of this hypothesis), and exploratory analyses will test the effect of various moderators, as well as the causal role of a complementary manipulation of reflection – a component of rumination in which attention is focused on the issue at hand rather than one’s emotions.
 
The Stage 1 manuscript was evaluated over two rounds of in-depth review. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
 
URL to the preregistered Stage 1 protocol: https://osf.io/y82bs
 
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.
 
List of eligible PCI RR-friendly journals:
 
 
References
 
1. Uscinski, J., Enders, A., Klofstad, C., Seelig, M., Drochon, H., Premaratne, K. & Murthi, M. (2022) Have beliefs in conspiracy theories increased over time? PLOS ONE 17: e0270429. https://doi.org/10.1371/journal.pone.0270429

2. Liekefett, L. Sebben, S. & Becker, J. C. (2023). Does Brooding Meaningfully Increase the Likelihood of Believing in a Conspiracy? Stage 1 Registered Report, in principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/y82bs
Does Brooding Meaningfully Increase the Likelihood of Believing in a Conspiracy? A Registered ReportLuisa Liekefett, Simone Sebben, Julia C. Becker<p>This project aims to investigate the relationship between rumination and conspiracy beliefs. It<br>involves four pilot studies, including one observational and three experimental studies, but the<br>results were inconclusive. We suggest that ru...Humanities, Social sciencesChris Chambers2023-02-01 14:47:09 View
25 Jun 2023
STAGE 1
toto

Reference points and decision-making: Impact of status quo and defaults in a conceptual replication and extensions Registered Report of Dinner et al. (2011)

Understanding the impact of status quo bias and the default effect on decision-making

Recommended by ORCID_LOGO based on reviews by Laurens van Gestel, Julia Nolte and Sylvain Chabé-Ferret
Everyday decisions can often be biased by how different options are presented and which choices were made previously, over and above whichever option is rationally preferable. Two such major biases in judgment and decision-masking are status quo bias and the default effect. The status quo bias reflects a tendency for people to choose an option that has already been implemented or represents the current state of affairs (for instance, choosing to remain with a current energy supplier rather than switching to a different one, even when the current supplier provides less value for money), while the default effect is a bias toward taking a course of action that would occur automatically in the absence of an active choice (such as the pre-selected energy supplier in questionnaire). Status quo bias and default effects can overlap or diverge: the status quo option will often be the same as the default, while on other occasions the default option in a choice set will be determined by other factors and differ from the option that was already implemented.
 
In the current study, Yam and Feldman (2023) propose a replication and extension of an influential study by Dinner et al. (2011) that purported to examine default effects but, arguably, actually studied its nearby cousin, status quo bias. Using a large online sample, the authors will independently test for the existence of both status quo bias and the default effect, before then asking whether (and if so how) status quo bias and default effects interact and how they are related to several potential explanatory variables, including perceived effort (which may be lower for the status quo or default) and endorsements (whether through direct recommendations or indirectly through perceived norms). The authors also build in additional manipulation checks and comprehension checks, in addition to exploratory analyses examining (among other variables), the political orientation of participants.
 
The Stage 1 manuscript was evaluated over two rounds of in-depth review. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
 
URL to the preregistered Stage 1 protocol: https://osf.io/ep3jh
 
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.
 
List of eligible PCI RR-friendly journals:
 
References
 
1. Dinner, I., Johnson, E. J., Goldstein, D. G., & Liu, K. (2011). Partitioning default effects: Why people choose not to choose. Journal of Experimental Psychology: Applied, 17, 332– 341. https://doi.org/10.1037/a0024354

2. Yam, M. L. M.  & Feldman, G. (2023). Reference points and decision-making: Impact of status quo and defaults in a conceptual replication and extensions Registered Report of Dinner et al. (2011), in principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/ep3jh
Reference points and decision-making: Impact of status quo and defaults in a conceptual replication and extensions Registered Report of Dinner et al. (2011)Monique Moon Ling YAM, Gilad Feldman <p>This is a scheduled PCI-RR snap shot for a planned project: "Default, status quo, and past behavior effects: Examining impact of reference points on decisions in a replication and extensions of Dinner et al. (2011)"</p>Social sciencesChris Chambers2023-02-02 06:02:29 View
11 Apr 2023
STAGE 2
(Go to stage 1)
toto

Does childhood adversity alter opioid drug reward? A conceptual replication in outpatients before surgery

Is childhood adversity associated with a heightened response to opioids?

Recommended by ORCID_LOGO based on reviews by Zoltan Dienes, Yuki Yamada and 1 anonymous reviewer
A convergence of evidence suggests that early life adversity may cause dysfunction in opioid-sensitive reward systems. Childhood adversity is associated with opioid use, potentially by altering reward and motivation networks, and experimental models in animals have found that early life adversity increases and consolidates opioid seeking behaviours. Further, in a recent controlled experiment, Carlyle et al. (2021) found that opioid administration produced stronger positive responses, and weaker negative responses, in adults with a history of childhood abuse and neglect.
 
In the current study, Carlyle et al. (2023) tested the generalisability of these previous findings in a pre-operative clinical setting. Using partially observed data from an existing cohort study (N=155), the authors asked whether patients with greater experience of childhood trauma in turn exhibit a larger mood boost and express greater subjective pleasure following opioid administration.
 
In contrast to previous findings, the results did not support the hypotheses that more experiences of childhood adversity would heighten ratings of drug liking and feeling good following opioid administration. Regression analyses instead revealed a statistically significant negative association between childhood adversity and post-opioid liking and no significant relationship with feeling good. The authors suggest that the discrepancy between the current and previous results may be due to stress related to the pre-surgical setting, the brief duration of drug exposure, and the relatively limited levels of high childhood adversity in the study sample. Nevertheless, these findings cast some doubt on the theory that adversity elevates risk of opioid addiction by altering sensitivity to subjectively pleasurable effects.
 
Following one round of in-depth review, the recommender judged that the manuscript met the Stage 2 criteria and awarded a positive recommendation.
 
URL to the preregistered Stage 1 protocol: https://osf.io/7ymts
 
Level of bias control achieved: Level 2. At least some data/evidence that was used to answer the research question had been accessed and partially observed by the authors prior to IPA, but the authors certify that they had not yet observed the key variables within the data that were used to answer the research question AND they took additional steps to maximise bias control and rigour. 
 
List of eligible PCI RR-friendly journals:
 
References
 
1. Carlyle M., Broomby R., Simpson G., Hannon R., Fawaz L., Mollaahmetoglu O.M., Drain, J., Mostazir, M., & Morgan C. (2021). A randomised, double‐blind study investigating the relationship between early childhood trauma and the rewarding effects of morphine. Addiction Biology, 26(6):e13047. https://doi.org/10.1111/adb.13047
 
2. Carlyle, M., Kvande, M., Meier, I. M., Trøstheim, M., Buen, K., Jensen, E. N., Ernst, G. & Leknes, S. & Eikemo, M. (2023). Does childhood adversity alter opioid drug reward? A conceptual replication in outpatients before surgery, acceptance of Version 2 by Peer Community in Registered Reports. https://osf.io/9kt3a?view_only=4238d2ee3d654c4f908a94efea82a027
Does childhood adversity alter opioid drug reward? A conceptual replication in outpatients before surgeryMolly Carlyle1*, Malin Kvande*, Isabell M. Meier, Martin Trøstheim, Kaja Buen, Eira Nordeng Jensen, Gernot Ernst, Siri Leknes, Marie Eikemo (*denotes equal contribution)<p><strong>Introduction</strong>: Opioid analgesic treatment during surgery entails risk of persistent use. Experiences of childhood adversity have been shown to increase opioid reward in preclinical models, a finding recently extended to healthy ...Medical Sciences, Social sciencesChris Chambers2023-02-02 08:29:18 View
15 Jun 2023
STAGE 1
toto

Revisiting the impact of affection on insurance purchase and claim decision-making: Replication and extensions Registered Report of Hsee and Kunreuther (2000)

Understanding how object-oriented emotional attachment influences economic response to loss

Recommended by ORCID_LOGO based on reviews by Bence Palfi, Rima-Maria Rahal and Fausto Gonzalez
Emotion is a well-established mediator of decision-making, including prospective economic decisions, but does it affect the way we respond economically to loss? According to classic economic theories, when an object is lost and cannot be recovered, our emotional attachment to that object should be irrelevant for decisions such as choosing whether to claim insurance or compensation. Intriguingly, however, this does not appear to be the case: in a series of experiments, Hsee and Kunreuther (2000) found that when people have higher affection towards an object, they are more sensitive to its loss and are more willing to claim compensation or purchase insurance for the object. They explained these findings according to an influential “consolation hypothesis” in which people see insurance compensation as means to mitigate against the emotional distress associated with property loss.
 
Using a large online sample (N=1000), Law and Feldman (2023) propose to replicate four of six studies from Hsee and Kunreuther (2000), each asking (primarily) whether people with higher affection towards an object are more willing to claim compensation or purchase insurance for that object. In each experiment, participants are randomly assigned to either a high affection group or a low affection group and then given a scenario in which the level of affection to an object is correspondingly manipulated while the monetary value is held constant. For example, for high affection: “You liked the now-damaged painting very much and you fell in love with it at first sight. Although you paid only $100, it was worth a lot more to you”, and for low affection: “You were not particularly crazy about the now-damaged painting. You paid $100 for it, and that’s about how much you think it was worth.” A range of dependent measures are then collected, including the maximum hours participants would be willing to spend driving to claim compensation, the maximum amount participants would be willing to pay for insurance, and how likely participants would be to claim compensation or purchase insurance. As part of the replication, the authors have also built in manipulation checks to confirm that the scenarios influenced participants' (imagined) level of affection for the object, and a range of exploratory analyses.
 
The Stage 1 manuscript was evaluated over two rounds of in-depth review. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
 
URL to the preregistered Stage 1 protocol: https://osf.io/b7y5z
 
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.
 
List of eligible PCI RR-friendly journals:
 
 
References
 
1. Hsee, C. K., & Kunreuther, H. C. (2000). The affection effect in insurance decisions. Journal of Risk and Uncertainty, 20, 141-159. https://doi.org/10.1023/A:1007876907268

2. Law, Y. Y. & Feldman, G. (2023). Revisiting the impact of affection on insurance purchase and claim decision-making: Replication and extensions Registered Report of Hsee and Kunreuther (2000), in principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/b7y5z
Revisiting the impact of affection on insurance purchase and claim decision-making: Replication and extensions Registered Report of Hsee and Kunreuther (2000)Yan Yi (Veronica) Law, Gilad Feldman<p>This is a scheduled PCI-RR snap shot for a planned project: "Revisiting the impact of affection on insurance purchase and claim decision-making: Replication and extensions of Hsee and Kunreuther (2000)"</p>Social sciencesChris Chambers2023-02-02 11:02:51 View
23 Mar 2023
STAGE 2
(Go to stage 1)
toto

Revisiting the role of public exposure and moral beliefs on feelings of shame and guilt: Replication Registered Report of Smith et al. (2002)’s Study 1

The effect of public exposure and moral beliefs on feelings of shame and guilt

Recommended by ORCID_LOGO based on reviews by Uriel Haran
Shame and guilt are powerful negative emotions that are notable for their external vs. internal focus: while shame is generally experienced in response to public scrutiny, guilt arises from a self-directed, private evaluation. In a formative study, Smith et al. (2002) asked whether the level of public exposure influenced levels of shame and guilt arising from one's transgressions, and found that, compared to private situations, public exposure was more strongly associated with shame than with guilt. Since then, these findings have had significant implications for theories and applications of moral psychology.
 
In the current study, Zhang et al. (2023) directly replicated Smith et al. (2002) in a large online sample, revisiting two critical questions from Study 1: (a) whether public exposure affects the magnitude of shame and guilt over one’s misconduct, and (b) whether stronger moral belief increases guilt and shame over one’s misconduct. The results fail to confirm the original conclusions: both public exposure and manipulation of moral beliefs were found to influence shame and guilt, with no reliable evidence that shame was influenced more strongly than guilt. These findings thus constitute a non-replication and offer a challenge to theoretical models that hinge on the separability of shame and guilt as separate constructs.
 
The Stage 2 manuscript was evaluated over one round of in-depth review. Based on detailed responses to the reviewer's comments, the recommender judged that the manuscript met the Stage 2 criteria and awarded a positive recommendation.
 
URL to the preregistered Stage 1 protocol: https://osf.io/j7kt2
 
Level of bias control achieved: Level 6. No part of the data or evidence that was used to answer the research question was generated until after IPA. 
 
List of eligible PCI RR-friendly journals:
 
References
 
1. Smith, R. H., Webster, J. M., Parrott, W. G., & Eyre, H. L. (2002). The role of public exposure in moral and nonmoral shame and guilt. Journal of Personality and Social Psychology, 83, 138-159. https://doi.apa.org/doi/10.1037/0022-3514.83.1.138
 
2. Zhang, Y., Cheung, F. C., Wong, H.T., Yuen, L. Y., Sin, H. C., Chow, H. T. & Feldman, G. (2023). Revisiting the role of public exposure and moral beliefs on feelings of shame and guilt: Replication Registered Report of Smith et al. (2002)’s Study 1. Acceptance of Version 5 by Peer Community in Registered Reports. https://osf.io/jpx87
Revisiting the role of public exposure and moral beliefs on feelings of shame and guilt: Replication Registered Report of Smith et al. (2002)’s Study 1 Yikang Zhang, Fung Chit (Jack) Cheung, Hei Tung (Patrina) Wong, Lok Yee (Noel) Yuen, Hui Ching (Rachel) Sin, Hiu Tung Kristy Chow, Gilad Feldman<p>Shame and guilt are unpleasant self-conscious emotions associated with negative evaluations of oneself or one’s behavior. Smith et al. (2002) demonstrated that shame and guilt are distinct and are impacted differently by public exposure, that i...Social sciencesChris Chambers2023-02-03 10:58:20 View
07 Mar 2023
STAGE 2
(Go to stage 1)
toto

Beneath the label: Unsatisfactory compliance with ESRB, PEGI, and IARC industry self-regulation requiring loot box presence warning labels by video game companies

Failure of industry self-regulation in loot box labelling

Recommended by ORCID_LOGO
Paid loot boxes – items bought for real-world money that offer randomised rewards – are a prevalent feature of contemporary video games (Zendle et al., 2020). Because they employ random chance to provide rewards after spending real money, loot boxes have been considered a form of gambling, raising concerns about risk of harm to children and other vulnerable users. In response, some countries have taken legal steps to regulate and even ban the use of loot boxes, with only limited success so far (Xiao, 2022). At the same time, the Entertainment Software Rating Board (ESRB) and PEGI (Pan-European Game Information) now expect games that contain loot boxes to be marked with warning labels that, in theory, will enable users (including parents) to make more informed decisions. These requirements by ESRB/PEGI are not legally binding and may be considered a form of industry self-regulation.
 
In the current study, Xiao (2023) investigated the effectiveness of self-regulation in the use of loot box labels. Study 1 examined the consistency of warning labels by the ESRB and PEGI, with the expectation that if self-regulation works as it should then these labels should always (or nearly always) co-occur. Study 2 established the compliance rate for labelling among popular games that are known to contain loot boxes, with a rate of ≥95% considered to be successful.
 
The results of both studies reveal deficiences in industry self-regulation. The consistency rate of warning labels by the ESRB and PEGI was just 39.4% in preregistered analyses, rising to 83.9% in an unregistered exploratory analysis that took into account industry responses to the findings. Even at this upper bound, this rate is lower than expected by complete (or near-complete) consistency. The results of Study 2 indicate that only 29% of games on the Google Play Store known to contain loot boxes were accurately labelled, indicating that 71% were non-compliant with industry requirements.
 
Following careful evaluation, the recommender judged that the manuscript met the Stage 2 criteria and awarded a positive recommendation.
 
URL to the preregistered Stage 1 protocol: https://osf.io/e6qbm
 
Level of bias control achieved: Level 3. At least some data/evidence that was used to the answer the research question had been previously accessed by the authors (e.g. downloaded or otherwise received), but the authors certifed that they had not yet observed ANY part of the data/evidence prior to in-principle-acceptance.
 
List of eligible PCI RR-friendly journals:
 
 
References
 
1. Zendle, D., Meyer, R., Cairns, P., Waters, S., & Ballou, N. (2020). The prevalence of loot boxes in mobile and desktop games. Addiction, 115(9), 1768-1772. https://doi.org/10.1111/add.14973

2. Xiao, L. Y. (2022). Breaking Ban: Belgium’s ineffective gambling law regulation of video game loot boxes. Stage 2 Registered Report, acceptance of Version 2 by Peer Community in Registered Reports. https://doi.org/10.31219/osf.io/hnd7w 
 
3. Xiao, L. Y. (2023). Beneath the label: Unsatisfactory compliance with ESRB, PEGI, and IARC industry self-regulation requiring loot box presence warning labels by video game companies, acceptance of Version 2 by Peer Community in Registered Reports. https://doi.org/10.31219/osf.io/asbcg
Beneath the label: Unsatisfactory compliance with ESRB, PEGI, and IARC industry self-regulation requiring loot box presence warning labels by video game companiesLeon Y. Xiao<p>Loot boxes in video games are a form of in-game transactions with randomised elements. Concerns have been raised about loot boxes’ similarities with gambling and their potential harms (e.g., overspending). Recognising players’ and parents’ conc...Humanities, Social sciencesChris Chambers Jim Sauer, Pete Etchells 2023-02-12 16:17:34 View
11 Sep 2023
STAGE 1
toto

Researcher Predictions of Effect Generalizability Across Global Samples

Can psychology researchers predict which effects will generalise across cultures?

Recommended by ORCID_LOGO based on reviews by Michèle Nuijten, Ian Hussey, Jim Grange and Matthias Stefan
Compared to the wealth of debate surrounding replicability and transparency, relatively little attention has been paid to the issue of generalisability – the extent to which research findings hold across different samples, cultures, and other parameters. Existing research suggests that researchers in psychology are prone to generalisation bias, relying on narrow samples (e.g. drawn predominantly from US or European undergraduate samples) to draw broad conclusions about the mind and behaviour. While recent attempts to address generalisability concerns have been made – such as journals requiring explicit statements acknowledging constraints on generality – addressing this bias at root, and developing truly generalisable methods and results, requires a deeper understanding of how researchers perceive generalisability in the first place.
 
In the current study, Schmidt et al. (2023) tackle the issue of cross-cultural generalisability using four large-scale international studies that are being conducted as part of the Psychological Science Accelerator (PSA) – a globally distributed network of researchers in psychology that coordinates crowdsourced research projects across six continents. Specifically, participants (who will be PSA research members) will estimate the probability that an expected focal effect will be observed both overall and within regional subsamples of the PSA studies. They will also predict the size of these focal effects overall and by region.
 
Using this methodology, the authors plan to ask two main questions: first whether researchers can accurately predict the generalisability of psychological phenomena in upcoming studies, and second whether certain researcher characteristics (including various measures of expertise, experience, and demographics) are associated with the accuracy of generalisability predictions. Based on previous evidence that scientists can successfully predict the outcomes of research studies, the authors expect to observe a positive association between predicted and actual outcomes and effect sizes. In secondary analyses, the authors will also test if researchers can predict when variables that capture relevant cultural differences will moderate the focal effects – if so, this would suggest that at least some researchers have a deeper understanding as to why the effects generalise (or not) across cultural contexts.
 
The Stage 1 manuscript was evaluated over two rounds of in-depth review. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
 
URL to the preregistered Stage 1 protocol: https://osf.io/vwqsa (under temporary private embargo)
 
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.
 
List of eligible PCI RR-friendly journals:
 
 
References
 
1. Schmidt, K., Silverstein, P. & Chartier, C. R. (2023). Registered Report: Researcher Predictions of Effect Generalizability Across Global Samples. In principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/vwqsa
Researcher Predictions of Effect Generalizability Across Global SamplesKathleen Schmidt, Priya Silverstein, & Christopher R. Chartier<p>The generalizability of effects is an increasing concern among researchers in psychological science. Traditionally, the field has relied on university samples from Europe and North America to make claims about humans writ large. The proposed re...Social sciencesChris Chambers2023-02-16 03:49:35 View
08 Jun 2023
STAGE 2
(Go to stage 1)
toto

Communicating Dynamic Norms With Visual Cues

No short-term benefit of a dynamic norm intervention on reducing indicators of meat consumption

Recommended by ORCID_LOGO based on reviews by Gabriela Jiga-Boy
Human meat consumption is associated with a variety of risks to health, animal welfare, sustainability, and the environment (including greenhouse gas emissions and loss of biodiversity), prompting a growing research effort to develop psychological interventions to reduce it and encourage alternative diets. At the same time, although meat consumption remains the majority choice in the UK, its prevalence is declining, with the proportion of vegetarians and vegans increasing substantially over the last two decades.
 
One potential tool to accelerate behaviour change is to expose people to “dynamic norm” messaging, which, rather than providing static descriptive information about the prevalence of a desired behaviour, emphasises how the desired behaviour is changing over time so that people can begin to conform to the emerging trend. Although promising in theory, previous research offers mixed evidence on the effectiveness of dynamic norms in encouraging a reduction in meat consumption, with some studies suggesting benefits and others showing no effect or even counterproductive effects. The methodological rigour of some studies is also in question.
 
In the present study, Aldoh et al. (2023) investigated the effectiveness of dynamic norm information (compared to static norms) on several indicators of meat consumption, including interest, attitudes, and intentions toward reducing meat consumption, as well as self-reported meat consumption itself. Using an online sample of ~1500 participants, the authors also tested the role of visual cues (including data trend graphics) in causing any effects and explored the potential longevity of the intervention over a period of 7 days. Results revealed moderate evidence for no net effect of dynamic (compared to static) norm information on meat consumption outcomes, nor any positive change over the 7-day period. However, the addition of visual cues enhanced the effect of dynamic norm messages, suggesting potential avenues for increasing the potency of future messaging interventions.
 
The Stage 2 manuscript was evaluated over one round of in-depth review, following which the recommender judged that the manuscript met the Stage 2 criteria and awarded a positive recommendation.
 
URL to the preregistered Stage 1 protocol: https://osf.io/txzvm
 
Level of bias control achieved: Level 6. No part of the data or evidence that was used to answer the research question was generated until after IPA. 
 
List of eligible PCI RR-friendly journals:
 
References
  
1. Aldoh, A., Sparks, P. & Harris, P. R. (2023). Communicating dynamic norm information [Stage 2]. Acceptance of Version 1 by Peer Community in Registered Reports. https://doi.org/10.31234/osf.io/tac3j
Communicating Dynamic Norms With Visual CuesAlaa Aldoh, Paul Sparks, Peter R. Harris<p>While decreasing their meat consumption is one of the most impactful behaviours an individual may carry out to reduce their carbon emissions, it is still a minority behaviour in many parts of the world. Research suggests that communicating info...Social sciencesChris Chambers Gabriela Jiga-Boy, Wendy Van Lippevelde2023-03-15 12:58:28 View