PCI Registered Reports

CHAMBERS Chris

CUBRIC, School of Psychology, Cardiff University, Cardiff, United Kingdom
Life Sciences, Social sciences
administrator, manager, recommender, developer

Recommendations: 84

Reviews: 8

Website https://scholar.google.com/citations?user=I-S_hs0AAAAJ&hl=en

Areas of expertise

I co-founded Registered Reports, Exploratory Reports, Verification Reports, the Transparency and Openness Promotion guidelines, the Royal Society Replications initiative, the UK network of open research working groups, the Peer Reviewers' Openness Initiative, the UK Reproducibility Network (UKRN), the GW4 Undergraduate Psychology Consortium programme for promoting reproducible science, the Royal Society Rapid Review Network for COVID-19 Registered Reports, and the Peer Community in Registered Reports. I currently chair the Registered Reports committee supported by the Center for Open Science and I serve on the UKRN steering committee. I also sit on the Advisory Board of Nature Human Behaviour and on the British Neuroscience Association's Credibility Advisory Board. I am author of the Seven Deadly Sins of Psychology: A Manifesto for Reforming the Culture of Scientific Practice, which won the 2018 British Psychological Society Book Award (Best Academic Monograph) and the 2018 PROSE Award from the Association of American Publishers. From 2013-2018 I was a freelancer writer at the Guardian where I co-hosted the psychology blog, Head Quarters.

Recommendations: 84

27 Nov 2024

STAGE 1

Does Truth Pay? Investigating the Effectiveness of the Bayesian Truth Serum with an Interim Payment: A Registered Report

Claire M. Neville, Matt N. Williams https://osf.io/cyf39

Do interim payments promote honesty in self-report? A test of the Bayesian Truth Serum

Recommended by Romain Espinosa and Chris Chambers based on reviews by Philipp Schoenegger, Sarahanne Miranda Field and Martin Schnuerch

Surveys that measure self-report are a workhorse in psychology and the social sciences, providing a vital window into beliefs, attitudes and emotions, both at the level of groups and individuals. The validity of self-report data, however, is an enduring methodological concern, with self-reports vulnerable to a range of response biases, including (among others) the risk of social desirability bias in which, rather than responding honestly, participants answer questions in a way that they believe will be viewed favourably by others. One proposed solution to socially desirable responding is the so-called Bayesian Truth Serum (BTS), which aims to incentivise truthfulness by taking into account the relationship between an individual’s response and their belief about the dominant (or most likely) response given by other people, and then assigning a high truthfulness score to answers that are surprisingly common.

Although valid in theory (under a variety of assumptions), questions remain regarding the empirical utility of the BTS. One area of concern is participants’ uncertainty regarding incentives for truth-telling – if participants don’t understand the extent to which telling the truth is in their own interests (or they don’t believe that it matters) then the validity of the BTS is undermined. In the current study, Neville and Williams (2024) aim to test the role of clarifying incentives, particularly for addressing social desirability bias when answering sensitive questions. The authors will administer an experimental survey design including sensitive questions, curated from validated scales, that are relevant to current social attitudes and sensitivities (e.g. “Men are not particularly discriminated against”, “Younger people are usually more productive than older people at their jobs”). Three groups of participants will complete the survey under different incentive conditions: the BTS delivered alone in standard format, the BTS with an interim bonus payment that is awarded to participants (based on their BTS score) half-way through the survey to increase certainty in incentives, and a Regular Incentive control group in which participants receive payment without additional incentives.

The authors will then address two questions: whether the BTS overall effectively incentivises honesty (the contrast of BTS alone + BTS with interim payment vs the Regular Incentive group), and whether interim payments, specifically, further boost assumed honesty (the contrast of BTS alone vs BTS with interim payment). Regardless of how the results turn out, the study promises to shed light on the effectiveness of the BTS and its dependence on the visibility of incentives, with implications for survey design in psychology and beyond.

The Stage 1 manuscript was evaluated over two rounds of in-depth review. Based on detailed responses to reviewers’ and the recommender’s comments, the recommenders judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance.

URL to the preregistered Stage 1 protocol: https://osf.io/vuh8b

Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.

List of eligible PCI-RR-friendly journals:

Advances in Cognitive Psychology
Advances in Methods and Practices in Psychological Science *pending editorial consideration of disciplinary fit
Collabra: Psychology
Experimental Psychology *pending editorial consideration of disciplinary fit
In&Vertebrates
Meta-Psychology
Peer Community Journal
PeerJ
Royal Society Open Science
Social Psychological Bulletin
Studia Psychologica
Swiss Psychology Open

References

Neville, C. M & Williams, M. N. (2024). Does Truth Pay? Investigating the Effectiveness of the Bayesian
Truth Serum with an Interim Payment: A Registered Report. In principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/vuh8b

15 Nov 2024

STAGE 1

Attraction depending on the level of abstraction of the character descriptions

Hiyori Kuge, Kai Otsubo, Kaede Hattori, Mai Urakawa, Yuki Yamada https://osf.io/jmr2y

Does reducing abstractness increase attraction? A test of Uncertainty Reduction Theory

Recommended by Chris Chambers based on reviews by Zoltan Dienes and Florian Pargent

What determines levels of interpersonal attraction? A long history of research in social psychology has highlighted a range of important factors, such as physical attractiveness, similarity of attitudes and beliefs, reciprocity of feelings, self-disclosure of personal information, and familiarity. One theme that runs through several of these characteristics is the concept of uncertainty, and in particular how reducing uncertainty in knowledge about a person influences levels of attraction. According to the Uncertainty Reduction Theory (URT), as an individual’s uncertainty in a person diminishes, levels of attraction are expected to rise. Previous research, however, has reported a mixed and somewhat complicated relationship between uncertainty and attraction, possibly moderated by the current stage of the interpersonal relationship.

One limitation of this area of enquiry is that the methods used to reduce uncertainty have tended to focus on the amount of available information rather than its quality. This shortcoming has become increasingly salient with the rise of online social networking, where people have a wide range of strategies available to reduce uncertainty through passive (non-interactive) observation, for instance by studying profile details or other online information about a person. In the current study, Kuge et al. (2024) aim to partially fill this gap by examining the role of uncertainty reduction by altering the abstractness (or specificity) of available information, rather than its quantity, particularly in an observational, non-interactive setting. According to the tenets of URT, the authors predict firstly that participants will rate a person described in more concrete terms as more attractive than one described using abstract terms, and secondly that perceived uncertainty will mediate the effect of the abstractness on levels of attraction.

To test these hypotheses, the authors begin with an online survey (N=250) to select pairs of sentences with varying levels of abstractness while ensuring they are matched for favourability. Then in the main study (N=1000) they will test the effect of the selected abstract vs. concrete expressions on levels of attractiveness, in addition to control variables such as how confident the participant is in predicting the person’s behaviour, as well as a manipulation check to confirm the effectiveness of the abstractness manipulation. Confirmation of these hypotheses would add support for URT, while disconfirmation may indicate that the theory is inadequate at explaining the drivers of attraction in online unilateral communication.

URL to the preregistered Stage 1 protocol: https://osf.io/28f4q

Advances in Cognitive Psychology
Collabra: Psychology
Experimental Psychology *pending editorial consideration of disciplinary fit
International Review of Social Psychology
Peer Community Journal
PeerJ
Royal Society Open Science
Social Psychological Bulletin
Studia Psychologica
Swiss Psychology Open

References

Kuge, H., Otsubo, K., Hattori, K., Urakawa, M., & Yamada. Y (2024). Attraction depending on the level of abstraction of the character descriptions. In principle acceptance of Version 4 by Peer Community in Registered Reports. https://osf.io/28f4q

27 Oct 2024

STAGE 1

The role of semantic encoding in production-enhanced memory

Roembke, Tanja C; Brown, Rachel M https://osf.io/65jcm?view_only=e81e8f3256e84c8e9abb783b30879943

Does reading out loud influence semantic encoding?

Recommended by Chris Chambers based on reviews by Miguel Vadillo and 2 anonymous reviewers

The production effect is an intriguing memory phenomenon in which recall and recognition are improved when people read and study words aloud rather than silently. Although robust to a range of contexts, materials and manipulations, the underlying mechanisms that cause the production effect remain to be fully understood, largely due to the wide range of processes that are engaged during speaking compared to silent reading.

In the current study, Roembke and Brown (2024) ask whether semantic encoding – the encoding of new information based on its meaningful characteristics rather than sensory/perceptual characteristics – is a driving factor in production-enhanced memory. Across two carefully-controlled experiments in bilingual participants, the authors will test the hypothesis that the production effect should persist when items are matched in semantic but not other features at learning and recognition stages. If semantic encoding at least partially underpins the production effect, then they expect to observe it both when recognition items are presented as pictures or translations (their semantic recognition condition), and when recognition items match those at learning (their veridical recognition condition in which the same written words are presented at learning and recognition). Assuming also that the production effect does not rely exclusively on semantic encoding, the authors expect the production effect to be reduced in the semantic recognition conditions relative to veridical conditions in which words are matched on multiple linguistic features.

The results of these experiments hold important implications for theoretical models of production-enhanced memory. If the authors find that the production effect persists when studied words can be recognised on their semantic features then this would suggest that production influences semantic encoding, which would in turn support theoretical models proposing that speaking engages modality-independent associations with semantic features. On the other hand, if no production effect is observed when participants are asked to recognise pictures or translations, this would raise the possibility that production may have little or no influence on semantic encoding, which would instead support alternative theories suggesting that speaking adds only modality-dependent features to memory traces.

URL to the preregistered Stage 1 protocol: https://osf.io/qc6rz

Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.

List of eligible PCI RR-friendly journals:

Advances in Cognitive Psychology
Biolinguistics
Collabra: Psychology
Experimental Psychology *pending editorial consideration of disciplinary fit
Journal of Cognition
Peer Community Journal
PeerJ
Psychology of Consciousness: Theory, Research, and Practice *pending editorial consideration of disciplinary fit
Royal Society Open Science
Studia Psychologica
Swiss Psychology Open

References

Roembke, T. C. & Brown, R. M. (2024). The role of semantic encoding in production-enhanced memory: A registered report. In principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/qc6rz

24 Oct 2024

STAGE 2
(Go to stage 1)

When children can explain why they believe a claim, they suggest better empirical tests for those claims

Tone K. Hermansen, Kamilla F. Mathisen, Samuel Ronfard https://osf.io/6ket7?view_only=d86eb8b5296b4499801e052a6a22291f

The role of metacognition in how children test surprising claims

Recommended by Chris Chambers based on reviews by Elizabeth Lapidow and Amy Masnick

As children grow, their cognition develops alongside their metacognition – the awareness and understanding of their own thought processes. One important aspect of cognitive development is learning effective strategies for exploring new situations and testing surprising claims, prompting the question of how improvement in cognition and reasoning is related to metacognitive understanding of these processes. For example, as children develop more targeted and efficient exploration strategies to test a surprising claim (e.g. “of these three rocks, the smallest one is the heaviest”), metacognitive understanding of why they are uncertain or skeptical may be crucial to testing the claim effectively and, in the long run, developing more complex reasoning and logical skills.

In this lab-based study of 174 children, Hermansen et al. (2024) tested the role of metacognition in shaping how children search for information to test surprising claims. Using a series of measures – including an experimental task involving comparative claims (e.g. “this rubber duck sinks much faster than this metal button”) – the authors asked whether older (relative to younger) children express more uncertainty about surprising claims, propose more plausible reasons for their uncertainty, and are more likely to suggest specific empirical tests for a claim. Furthermore, they investigated whether prompting children to reflect on their uncertainty helps them devise an efficient test for the claim, and whether any such benefit of prompting is greater for younger children.

Results provided mixed support for the hypotheses. Contrary to expectations, older children were not more likely than younger children to express uncertainty about surprising claims -- although an exploratory analysis suggested that prior belief may moderate the relationship with age. Consistent with predictions, older children did, however, propose more plausible reasons for their uncertainty and were more likely to suggest specific empirical tests for a claim. Interestingly, prompting children to reflect on their uncertainty did not significantly increase the likelihood that they would generate an efficient test for a claim, although exploratory analysis again suggested that taking to account additional variables (in this case the type of explanation children provide when prompted) could moderate the effect. Taken together, these findings suggest that the development of children’s reasoning about their own beliefs influences their empirical evaluation of those beliefs. Overall, the study highlights the role of metacognition in the development of explicit scientific thinking and suggests a variety of promising avenues for future research.

The Stage 2 manuscript was evaluated over one round of in-depth review. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 2 criteria and awarded a positive recommendation.

URL to the preregistered Stage 1 protocol: https://osf.io/uq6dw

Level of bias control achieved: Level 6. No part of the data or evidence that was used to answer the research question was generated until after IPA.

List of eligible PCI RR-friendly journals:

*Note: Despite being listed as a PCI RR-friendly outlet at Stage 1 (in 2022), Infant and Child Development was removed from the above listing at Stage 2 due to the decision by the journal's publisher (Wiley) in 2024 to withdraw its journals from all PCIs, including PCI RR. As part of this withdrawal, Wiley chose to renege on previous commitments issued by Infant and Child Development to PCI RR authors.

References

1. Hermansen T. K., Mathisen, K. F., & Ronfard, S. (2024). When children can explain why they believe a claim, they suggest better empirical tests for those claims [Stage 2]. Acceptance of Version 2 by Peer Community in Registered Reports. https://osf.io/6ket7?view_only=d86eb8b5296b4499801e052a6a22291f

24 Oct 2024

STAGE 1

Knowing why: Children’s reflection on their own uncertainty about an adult’s surprising claim increases their tendency to test that claim

Tone Hermansen, Kamilla Mathisen, Samuel Ronfard https://osf.io/uq6dw

Does metacognition influence how children test surprising claims?

Recommended by Chris Chambers based on reviews by Elizabeth Lapidow and Amy Masnick

In this lab-based study of 175 children, Hermansen et al. (2022) will test the role of metacognition in shaping how children search for information to test surprising claims. Using a series of measures – including an experimental task involving comparative claims (e.g. “this rubber duck sinks much faster than this metal button”) – the authors will ask whether older (relative to younger) children express more uncertainty about surprising claims, propose more plausible reasons for their uncertainty, and are more likely to suggest specific empirical tests for a claim. Furthermore, they will investigate whether prompting children to reflect on their uncertainty helps them devise an efficient test for the claim, and whether any such benefit of prompting is greater for younger children.

URL to the preregistered Stage 1 protocol: https://osf.io/uq6dw

Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.

List of eligible PCI RR-friendly journals:

References

1. Hermansen T. K., Mathisen, K. F., & Ronfard, S. (2022). Knowing why: Children’s reflection on their own uncertainty about an adult’s surprising claim increases their tendency to test that claim, in principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/uq6dw

30 Sep 2024

STAGE 1

The effect of covert visual attention on pupil size during perceptual fading

Ana Vilotijević, Sebastiaan Mathôt https://osf.io/m2xr5?view_only=99e4cfe64c344980ae3a03324ef85eb1

Does pupil size track high-level attention?

Recommended by D. Samuel Schwarzkopf and Chris Chambers based on reviews by Sander Nieuwenhuis, Martin Rolfs and 1 anonymous reviewer

Previous research has shown that higher-level cognitive processes like attention, memory or mental imagery can produce pupil responses, without any actual difference in luminance of the visual stimulus. Interestingly, the inverse scenario remains untested: when a difference in luminance is perceptually eliminated from awareness, does pupil size still track cognitive factors? In this study, Vilotijević and Mathôt (2024) seek to test this experimentally using a perceptual fading phenomenon where two Gaussian patches with different luminances fade from consciousness and are thus perceived as mid-level uniform grey. The researchers will present this fading manipulation and a control condition where no fading occurs in separate blocks. Participants are instructed to covertly attend one of the patches. If pupil size reflects attentional selection, pupil responses should be reduced in the fading condition, and this should evolve with time as the stimuli are perceptually fading.

The Stage 1 manuscript was evaluated by three reviewers and the Recommender over three rounds of review. One reviewer advises conducting robustness checks to rule out eye movements confounds. This constitutes exploratory analyses at Stage 2 that probably require some flexibility. Despite this, the Recommender decided to grant in-principle acceptance of this study. While these robustness tests can put the eventual results in context, the general hypotheses and predictions specified in this version are clear and straightforward.

URL to the preregistered Stage 1 protocol: https://osf.io/bmtp6

Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.

List of eligible PCI RR-friendly journals:

References

1. Vilotijević, A. & Mathôt, S. (2024). The effect of covert visual attention on pupil size during perceptual fading. In principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/bmtp6

13 Sep 2024

STAGE 2
(Go to stage 1)

Appreciation of singing and speaking voices is highly idiosyncratic

Camila Bruder, Klaus Frieler, Pauline Larrouy-Maestri https://osf.io/rp5jx

Exploring the enjoyment of voices

Recommended by Chris Chambers based on reviews by Patrick Savage

Beyond the semantics communicated by speech, human vocalisations can convey a wealth of non-verbal information, including the speaker’s identity, body size, shape, health, age, intentions, emotional state, and personality characteristics. While much has been studied about the neurocognitive basis of voice processing and perception, the richness of vocalisations leaves open fundamental questions about the aesthetics of (and across) song and speech, including which factors determine our preference (liking) for different vocal styles.

In the current study, Bruder et al. (2024) examined the characteristics that determine the enjoyment of voices in different contexts and the extent to which these preferences are shared across different types of vocalisation. Sixty-two participants reported their degree of liking across a validated stimulus set of naturalistic and controlled vocal performances by female singers performing different melody excerpts as a lullaby, as a pop song and as opera aria, as well as reading the corresponding lyrics aloud as if speaking to an adult audience or to an infant. The authors then asked two main questions: first if there is a difference in the amount of shared taste (interrater agreement) across contrasting vocal styles, and second, as suggested by sexual selection accounts of voice attractiveness, whether the same performers are preferred across styles.

Support for the preregistered hypotheses was mixed. Shared taste differed significantly between singing styles, but contrary to the hypothesis that it would be higher for more “natural”/ universal styles (lullabies) than for more “artificial” (operatic) forms of singing (with pop singing in an intermediary position), it was found to be higher for operatic than pop singing. At the same time, the hypothesis of low consistency in preferences for singers across styles was confirmed, contradicting the notion that singing and speaking voices convey the same information about an individual's physical fitness. Overall, the results suggest that enjoyment of singing and speaking is idiosynchratic and prone to substantial individual differences. The authors conclude that a broader approach is needed to studying this question that traverses geographic, linguistic, and cultural contexts.

The Stage 2 manuscript was evaluated over one round of in-depth review. Based on detailed responses to the reviewer's comments, the recommender judged that the manuscript met the Stage 2 criteria and awarded a positive recommendation.

URL to the preregistered Stage 1 protocol: https://osf.io/7dvme

Level of bias control achieved: Level 6. No part of the data or evidence that was used to answer the research question was generated until after IPA.

List of eligible PCI RR-friendly journals:

References

1. Bruder, C., Frieler, K. and Larrouy-Maestri, P. (2024). Appreciation of singing and speaking voices is highly idiosyncratic [Stage 2]. Acceptance of Version 2 by Peer Community in Registered Reports. https://osf.io/rp5jx?view_only=506d243a6e7a4d3680c81e696ca81025

11 Sep 2024

STAGE 2
(Go to stage 1)

A Laboratory Experiment on Using Different Financial-Incentivization Schemes in Software-Engineering Experimentation

Dmitri Bershadskyy, Jacob Krüger, Gül Çalıklı, Siegmar Otto, Sarah Zabel, Jannik Greif, Robert Heyer https://arxiv.org/pdf/2202.10985

Bug detection in software engineering: which incentives work best?

Recommended by Chris Chambers based on reviews by Edson OliveiraJr

In the current study, Bershadskyy et al. (2024) undertook an experiment to evaluate how the pay-off functions associated with different financial incentives influence the performance of participants in identifying bugs during code review. The authors hypothesised that performance-based incentivisation would result in higher average performance, as defined using the F1-score, and that different incentivisation schemes may also differ in their effectiveness.

The results did not support the preregistered predictions, with no statistically significant differences in F1-score observed between groups that received performance-based incentives compared to a control group that received no incentive. Exploratory analyses suggested some potential trends of interest, but the main implication of this work is methodological: that experiments in this field require substantially larger sample sizes to provide definitive tests. The current work is valuable in providing a novel unbiased insight on the magnitude of this challenge, which is now primed for further investigation.

The Stage 2 manuscript was evaluated over one round of in-depth review. Based on detailed responses to the recommender and reviewer's comments, the recommender judged that the manuscript met the Stage 2 criteria and awarded a positive recommendation.

URL to the preregistered Stage 1 protocol: https://osf.io/s36c2

Level of bias control achieved: Level 6. No part of the data or evidence that was used to answer the research question was generated until after IPA.

List of eligible PCI RR-friendly journals:

References

Bershadskyy, D., Krüger, J., Çalıklı, G., Siegmar, O., Zabel, S., Greif, J. and Heyer, R. (2024). A Laboratory Experiment on Using Different Financial-Incentivization Schemes in Software-Engineering Experimentation. Acceptance of Version 8 by Peer Community in Registered Reports. https://arxiv.org/pdf/2202.10985

22 Jun 2024

STAGE 2
(Go to stage 1)

Insufficient evidence of a positive association between chronic loneliness and anthropomorphism: Replication and extension Registered Report of Epley et al. (2008)

Qinyu Xiao, Mahmoud Elsherif, Hoi Yan Chu, Ming Chun Tang, Ting Hin (Angus) Wong, Yiming Wu, Christina Pomareda, Gilad Feldman https://doi.org/10.17605/OSF.IO/2SB7X

Weak-to-no evidence for a positive link between loneliness and anthropomorphism

Recommended by Chris Chambers based on reviews by John Protzko

Anthropomorphism is a widespread phenomenon in which people instil non-human entities or objects with human-like characteristics, such as motivations, intentions, and goals. Although common, the tendency to anthropomorphise varies between people, and a growing body of psychological research has examined the importance of various individual differences. One major theoretical account of anthropomorphism (Epley et al. 2007) suggests that sociality motivation – the drive to establish social relationships – is a key moderator of the phenomenon. In support of this account, some evidence suggests that people who experience greater loneliness (a proposed marker of sociality motivation) are more likely to anthropomorphise. In an influential series of studies, Epley et al. (2008) found that anthropomorphism and loneliness were positively correlated and that inducing participants experimentally to feel more lonely led to greater anthropomorphism. Later studies, however, produced more mixed results, particularly concerning the effectiveness of the experimental interventions.

In the current study, Elsherif et al. (2024) undertook a partial replication of Epley et al. (2008), focusing on the correlational relationship between anthropomorphism and loneliness, with extensions to examine free will beliefs, anthropomorphism for supernatural beings (in addition to objects/gadgets), and the extent to which participants judged objects/gadgets to be controllable. The results revealed no reliable evidence for a positive relationship between anthropomorphism and loneliness. Analyses of the extended questions revealed that the perceived controllability of gadgets was associated negatively with anthropomorphism and that free will belief was associated positively with belief in anthropomorphism of supernatural beings. Broadly, the current findings constitute a non-replication of Epley et al. (2008). The authors conclude by calling for more direct and conceptual replications to establish the link (if any) between sociality motivation and anthropomorphism.

The Stage 2 manuscript was evaluated over one round of in-depth review. Based on detailed responses to the reviewer's and recommender's comments, the recommender judged that the manuscript met the Stage 2 criteria and awarded a positive recommendation.

URL to the preregistered Stage 1 protocol: https://osf.io/by89c

References

1. Epley, N., Waytz, A., & Cacioppo, J. T. (2007). On seeing human: A three-factor theory of anthropomorphism. Psychological Review, 114, 864–886. https://doi.org/10.1037/0033-295X.114.4.864

2. Epley, N., Akalis, S., Waytz, A., & Cacioppo, J. T. (2008). Creating social connection through inferential reproduction: Loneliness and perceived agency in gadgets, Gods, and greyhounds. Psychological Science, 19, 114–120. https://doi.org/10.1111/j.1467-9280.2008.02056.x

3. Elsherif, M., Pomareda, C., Xiao, Q., Chu, H. Y., Tang, M. C., Wong, T. H., Wu, Y. & Feldman, G. (2024). Insufficient evidence of a positive association between chronic loneliness and anthropomorphism: Replication and extension Registered Report of Epley et al. (2008) [Stage 2]. Acceptance of Version 6 by Peer Community in Registered Reports. https://osf.io/x96kn

06 Jun 2024

STAGE 2
(Go to stage 1)

Associations of fear, anger, happiness, and hope with risk judgments: Revisiting appraisal-tendency framework with a replication and extensions Registered Report of Lerner and Keltner (2001)

Sirui Lu; Emir Efendić; Gilad Feldman https://doi.org/10.17605/OSF.IO/T5KZ9

Mixed evidence for the Appraisal-Tendency Framework in explaining links between emotion and decision-making

Recommended by Chris Chambers based on reviews by Kelly Wolfe and Max Primbs

How do emotions interact with cognition? The last 40 years has witnessed the rise of cognitive-appraisal theories, which propose that emotions can be differentiated along an axis of cognitive dimensions such as certainty, pleasantness, attentional activity, control, anticipated effort, and responsibility (Smith and Ellsworth, 1985). Early tests of such theories focused especially on the impact of the valence – pleasantness/unpleasantness – of emotions on judgment and decision-making, finding, for instance, that negative mood induction can heighten pessimistic estimates of risk (Johnson & Tversky, 1983).

The Appraisal-Tendency Framework proposed by Lerner and Keltner (2000) refined cognitive-appraisal theory by proposing that specific emotions trigger a predisposition to appraise future (or hypothetical) events in line with the central appraisal dimensions that triggered the emotion, even when the emotion and the judgment are unrelated. For example, an individual who is triggered to become fearful of a heightened risk, such as nuclear war, may then exhibit heightened pessimism about risks unrelated to war. The Appraisal-Tendency Framework also predicts relationships between traits, such as fear, anger and risk-taking/risk-seeking tendencies. In an influential paper, Lerner and Keltner (2001) reported direct empirical support for the Appraisal-Tendency Framework, which aside from its influence in cognitive/affective psychology has had considerable impact in behavioural economics, moral psychology, and studies of consumer behaviour.

In the current study, Lu et al. (2024) replicated three key studies from Lerner and Keltner (2001) in a large online sample. Through a combination of replication and extension, the authors probed the relationship between various trait emotions (including fear, anger, happiness, and hope) and trait characteristics of risk seeking and optimistic risk assessment. The authors also examined how the ambiguity of triggering events moderates the relationship between specific emotions and risk judgments.

Overall, the results provide mixed support for the predictions of the Appraisal-Tendency Framework. Trait anger and trait happiness were positively associated with risk-seeking and optimistic risk estimates, while trait fear was negatively associated with optimistic risk assessment (although a reliable association between fear and risk-seeking was not observed). The original finding of Lerner and Keltner (2001) that the valence-based approach applied to risk optimism for unambiguous events was not supported. In addition, there was no reliable evidence for a positive relationship between hope and risk-seeking preference or optimistic risk estimates. The authors conclude that future research should consider a wider range of emotions to develop a more complete understanding of the link to risk-related judgment and decision-making.

References

1. Smith, C. A., & Ellsworth, P. C. (1985). Patterns of cognitive appraisal in emotion. Journal of Personality and Social Psychology, 48, 813-838. https://doi.org/10.1037/0022-3514.48.4.813

2. Johnson, E. J., & Tversky, A. (1983). Affect, generalization, and the perception of risk. Journal of Personality and Social Psychology, 45(1), 20–31. https://doi.org/10.1037/0022-3514.45.1.20

3. Lerner, J. S., & Keltner, D. (2000). Beyond valence: Toward a model of emotion-specific influences on judgment and choice. Cognition & Emotion, 14, 473-493. https://doi.org/10.1080/026999300402763

4. Lerner, J. S., & Keltner, D. (2001). Fear, anger, and risk. Journal of Personality and Social Psychology, 81, 146–159. https://doi.org/10.1037/0022-3514.81.1.146

5. Lu, S., Efendić, E., & Feldman, G. (2024). Associations of fear, anger, happiness, and hope with risk judgments: Revisiting appraisal-tendency framework with a replication and extensions Registered Report of Lerner and Keltner (2001) [Stage 2]. Acceptance of Version 2 by Peer Community in Registered Reports. https://osf.io/xytsw

06 Jun 2024

STAGE 1

Causal dynamics of task-relevant rule and stimulus processing in prefrontal cortex

Jade Buse Jackson Runhao Lu Alex Woolgar https://osf.io/7pxjz

Functional specificity of cognitive updating in human prefrontal cortex

Recommended by Chris Chambers based on reviews by Phivos Phylactou

One of the hallmarks of cognitive control is the ability to flexibly update attention and action when goals change. The prefrontal cortex has long been identified as important for such updating, but much remains to be understood about the anatomical and temporal mechanisms that support cognitive flexibility within prefrontal networks. In the current study, Jackson et al. (2024) build upon insights from recent transcranial magnetic stimulation (TMS) and neuroimaging studies to investigate the critical role of prefrontal cortex for updating goals and selecting behaviourally-relevant stimuli.

To measure updating, the authors deploy an attentional switching paradigm in which participants selectively attend to one feature of a novel object (colour or form) while ignoring the other feature. On each trial, a symbol (called a rule cue) indicates whether to attend to the colour (green or blue) or to the form (X or non-X) of the upcoming object. By mapping each stimulus response to a separate button press (two buttons for the two colours; two buttons for the two features), the authors can then categorise different types of behavioural errors – focusing especially on attending incorrectly to the task-irrelevant feature (rule error) vs. applying the correct rule but failing to correctly identify the task-relevant feature (stimulus error). If disruption of a specific cortical region causes a selective increase in one type of error, then this would indicate that the stimulated region is important for either rule processing or stimulus processing.

The proposal includes a number of key features that add depth and rigor to the investigation. First, to probe the anatomical specificity of cognitive control, the authors will contrast the effect of TMS delivered to different prefrontal regions that reside within different networks and may have divergent roles in cognitive control: the dorsolateral prefrontal cortex (dlPFC, part of the multiple-demand network) and dorsomedial prefrontal cortex (dmPFC, part of the default mode network). Moreover, unlike many previous TMS studies, the authors will use electric field modelling to normalise cortical stimulation strength between regions, enabling a more controlled anatomical comparison. Second, since the task involves responding to a rule cue and then selectively attending to a task-relevant feature, it is likely that a particular brain region could be selectively critical at a specific time – for instance, if dlPFC were important for rule processing then it should only be necessary shortly after (or around) presentation of the rule cue. To capture the temporal specificity of cortical involvement, the authors will apply a short burst of TMS at different times, beginning either +150ms after the cue or +700ms during stimulus processing. In a preliminary study, the authors used magnetoencephalography (MEG) in combination with the same behavioural task and multivariate pattern analysis (MVPA) to identify these epochs for TMS. Finally, the experiment includes a range of additional control conditions and quality checks to rule out alternative explanations of potential findings, such as TMS impairing perception of the rule cue rather than implementation of the rule, and the effect of peripheral TMS artefacts. Overall, the study promises to reveal a range of intriguing new insights into the timecourse and anatomical specificity of cognitive updating, with implications for theories of prefrontal cortical function.

The Stage 1 manuscript was evaluated over one round of in-depth review. Based on detailed responses to the reviewers' and recommender’s comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).

URL to the preregistered Stage 1 protocol: https://osf.io/7pxjz (under temporary private embargo)

Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.

List of eligible PCI RR-friendly journals:

References

Jackon, J. B, Runhao, L., & Woolgar, A. (2024). Causal dynamics of task-relevant rule and stimulus processing in prefrontal cortex. In principle acceptance of Version 2 by Peer Community in Registered Reports. https://osf.io/7pxjz

04 Jun 2024

STAGE 1

Voice preferences across contrasting singing and speaking styles

Camila Bruder, Klaus Frieler & Pauline Larrouy-Maestri https://osf.io/urkys?view_only=506d243a6e7a4d3680c81e696ca81025

Exploring the enjoyment of voices

Recommended by Chris Chambers based on reviews by Patrick Savage, Christina Vanden Bosch der Nederlanden, Christina Krumpholz and 1 anonymous reviewer

In the current study, Bruder et al. (2024) examine the characteristics that determine the enjoyment of voices in different contexts and the extent to which these preferences are shared across different types of vocalisation. Sixty participants will report their degree of liking across a validated stimulus set of naturalistic and controlled vocal performances by female singers performing different melody excerpts as a lullaby, as a pop song and as opera aria, as well as reading the corresponding lyrics aloud as if speaking to an adult audience or to an infant. The authors will then ask two main questions: first if there is a difference in the amount of shared taste (interrater agreement) across contrasting vocal styles, and second, as suggested by sexual selection accounts of voice attractiveness, whether the same performers are preferred across styles.

The Stage 1 manuscript was evaluated over three rounds of in-depth review. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).

URL to the preregistered Stage 1 protocol: https://osf.io/7dvme

Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.

List of eligible PCI RR-friendly journals:

References

1. Bruder, C., Frieler, K. & Larrouy-Maestri, P. (2024). Voice preferences across contrasting singing and speaking styles. In principle acceptance of Version 5 by Peer Community in Registered Reports. https://osf.io/7dvme

30 May 2024

STAGE 1

Gaming Disorder: A Qualitative Meta-synthesis of Case Studies

Tiina Auranen, Matúš Adamkovič, Veli-Matti Karhulahti, Marcel Martoncik, Yaewon Jin, Miia Siutila, Valtteri Kauraoja, Solip Park https://osf.io/sv2rm

What can qualitative research tell us about Gaming Disorder?

Recommended by Mateo Leganes-Fonteneau and Chris Chambers based on reviews by Simone Amendola, Gemma Lucy Smart and Ting Pan

How can qualitative research and case studies inform theoretical models of gaming disorder? Gaming Disorder has generated a large amount of research, with up to 95% of it focusing on quantitative studies. As a result, most of the meta-analyses and review studies focus on quantitative research and disregard qualitative approaches. However, studying the direct experiences of gamers can provide more detailed and direct evidence that can feed into theoretical models.

In this Stage 1 manuscript, Auranen et al. (2024) will perform a qualitative meta-analysis of gaming disorder case studies, case reports, and case series of treatment-seekers using a 3-phase approach. First, they will focus on examining the reported problems of participants, the reported reasons for seeking help to reduce their gaming, and the causal link between gaming and reported problems, including the context of these problematic behaviors. Second, thematic synthesis will generate construct themes regarding the contexts of the individuals and the reported problems. Lastly, the authors will examine the relevance of findings in regards to the coping model, value fulfillment theory and the theory of cultural dissonance.

The Stage 1 submission was evaluated by the recommender and three expert reviewers, one of which was recused due to conflicts of interest that emerged after the first round of revisions. The recommender and co-recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).

URL to the preregistered Stage 1 protocol: https://osf.io/hzc5a

Level of bias control achieved: Level 4. At least some of the data/evidence that will be used to answer the research question already exists AND is accessible in principle to the authors (e.g. residing in a public database or with a colleague), BUT the authors certify that they have not yet accessed any part of that data/evidence.

List of eligible PCI RR-friendly journals:

References

Auranen, T., Adamkovič, M., Martončik, M., Park, S., Kauraoja, V., Siutila, M., Jin, Y., & Karhulahti, V.-M. (2024). Gaming Disorder: A qualitative meta-synthesis of related case studies. In principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/hzc5a

30 Apr 2024

STAGE 1

A climate action intervention to boost individual and collective climate mitigation behaviors in young adults

Anna Castiglione, Cameron Brick, Gianluca Esposito, Andrea Bizzego https://osf.io/zh3w9

Putting climate action intervention to the test: Part 1

Recommended by Chris Chambers based on reviews by Helen Landmann, Jana Kesenheimer and 1 anonymous reviewer

It is increasingly recognised that resolving the climate crisis will require not only the reform of law and government policy but collective grassroots action to change individual behaviour and put public pressure on political leaders, companies and institutions to cut emissions. The capacity, however, for individual citizens to take such steps is limited by lack of knowledge/awareness of means and opportunities as well as psychological barriers that can make such actions seem impossible, fruitless or against the person's immediate self-interest. Interventions designed to overcome these obstacles and promote individual behaviour change have met with only limited success, with many based on weak psychological evidence and the outcome measures used to evaluate their success prone to error and bias.

In the current submission, Castiglione et al. (2024) propose a series of five studies to test, evaluate, and optimise a longitudinal intervention for engaging young adults (aged 18-35) in individual and collective climate action. Building on existing theory and evidence, the authors have designed an intensive 6-week educational intervention that draws on 12 psychological factors linked to pro-environmental behaviour, including emotional engagement, self-efficacy, collective efficacy, theory of change, cognitive alternatives, perceived behavioral control, implementation intentions, social norms, self-identity, collective identity, appraisal, and faith in institutions. Through the use of ecological momentary assessment (EMA), they plan to measure these targeted psychological correlates as well as individual and collective climate engagement of participants before and after the intervention (and in active groups vs. controls), and then again after a further three months.

The current submission is novel in being the first at PCI RR (and possibly the first RR anywhere) to propose an incremental programmatic workflow that combines two innovations: a single Stage 1 protocol leading to multiple Stage 2 outputs (under the PCI RR programmatic track) and a prespecification in which the design of the intervention in later studies is (for now) determined only broadly, with specific parameters to be shaped by the results of the first set of studies (under the PCI RR incremental registrations policy). This particular Stage 1 manuscript specifies the design of study 1 in two samples (high-school and university students in Italy; producing one Stage 2 output for each sample) and the general design of subsequent studies. The details of this later research in study 2 (in the same two populations) and study 3 (university students in the Netherlands) will be developed sequentially based on the results of the previous Stage 2 outputs and the state of the literature at that time.

The Stage 1 manuscript was evaluated over two rounds of in-depth review. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA). Following the completion of study 1, the authors will submit an updated Stage 1 manuscript for re-evaluation that updates the plans for later studies accordingly, hence the current recommendation is labelled "Part 1".

URL to the preregistered Stage 1 protocol: https://osf.io/zh3w9 (under temporary private embargo)

Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.

List of eligible PCI RR-friendly journals:

References

Castiglione, A., Brick, C., Esposito, G., & Bizzego, A. (2024). A climate action intervention to boost individual and collective climate mitigation behaviors in young adults. In principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/zh3w9

22 Apr 2024

STAGE 2
(Go to stage 1)

Progression of white matter hyperintensities is related to blood pressure increases and global cognitive decline – a registered report

Frauke Beyer, Laurenz Lammer, Markus Loeffler, Steffi Riedel-Heller, Stéphanie Debette, Arno Villringer, A. Veronica Witte https://doi.org/10.17605/OSF.IO/REA4W

White matter lessions are associated with increases in blood pressure and global cognitive decline

Recommended by Chris Chambers based on reviews by Isabel Garcia Garcia

Cerebral small vessel disease (CSVD) is a common and multi-faceted set of pathologies that affect the small arteries, arterioles, venules and capillaries of the brain. The disease manifests through a range of symptoms and conditions, including psychiatric disorders, abnormal gait, and urinary incontinence, while accounting for 25% of strokes and nearly 50% of dementia.

The presence of CSVD is associated with white matter lesions detected as white matter hyperintensities (WMH) using neuroimaging, which have in turn been shown to predict future stroke, cognitive decline and dementia. While vascular risk factors of CSVD (such as hypertension and obesity) are also associated with CSVD, a complete picture of the predictive relationship between WMH, cognitive decline, and blood pressure remains to be determined, as does the role of sex/gender. These inter-relationships are important to determine for improving the diagnosis and treatment of CSVD.

In the current study, Beyer et al. analysed a large emerging dataset from the LIFE-Adult project – a longitudinal, two-wave, population-based study – to ask whether higher blood pressure predicts a greater increase in WMH, and whether progression of WMH is associated with measures of memory and executive function. In addition, the authors explored the relationship between abdominal obesity and WMH progression, and the extent to which WMH progression, and its interaction with vascular risk factors, depends on sex/gender.

Results revealed no reliable association between baseline blood pressure with WMH progression. WMH progression significantly predicted global cognitive decline but not decline in executive function specifically. Exploratory analyses revealed that increases in diastolic blood pressure as well as baseline and systolic blood pressure were associated with WMH progression, specifically in frontal periventricular regions, but there was no association of waist-to-hip ratio (a proxy of abdominal fat deposits) with WMH progression nor any gender-specific associations. The authors conclude that strict control of blood pressure might confer a protective effect, limiting WMH progression and negative effects on global cognitive function in the middle-aged to older population.

The Stage 2 manuscript was evaluated over one round of in-depth review. Based on responses to the reviewer's comments, the recommender judged that the manuscript met the Stage 2 criteria and awarded a positive recommendation.

URL to the preregistered Stage 1 protocol: https://osf.io/qkbgj

Level of bias control achieved: Level 2. At least some data/evidence that was used to answer the research question had been accessed and partially observed by the authors prior to Stage 1 in-principle acceptance, but the authors certify that they had not yet observed the key variables within the data that were used to answer the research question.

List of eligible PCI RR-friendly journals:

References

1. Beyer, F., Lammer, L., Loeffler, M., Riedel-Heller, S., Debette, S., Villringer, A. & Witte, A. V. (2023). Progression of white matter hyperintensities is related to blood pressure increases and global cognitive decline – a registered report [Stage 2]. Acceptance of Version 2 by Peer Community in Registered Reports. https://osf.io/k24pm

11 Apr 2024

STAGE 2
(Go to stage 1)

Licensing via credentials: Replication Registered Report of Monin and Miller (2001) with extensions investigating the domain-specificity of moral credentials and associations with trait reputational concern

Qinyu Xiao, Lok Ching Li, Ying Lam Au, Wing Tung Chung, See Ngueh Tan, Gilad Feldman https://doi.org/10.17605/OSF.IO/PHYM3

No reliable evidence of a 'moral credential' effect

Recommended by Chris Chambers based on reviews by Marek Vranka and Štěpán Bahník

Does being good free people up to be bad? A large literature in social psychology suggests that it might, with evidence that moral licensing gives people a perception that actions deemed morally questionable, or socially undesirable, will be tolerated more readily if they have demonstrated a past history of praiseworthy, moral behaviour. In a formative study, Monin and Miller (2001) reported that having a track record of moral credentials as being nonprejudiced (e.g. non-sexist or non-racist) increased the willingness of participants to later express a prejudiced attitude. For example, in their Study 2 they found that participants who built up their moral credit by selecting a Black woman in a hypothetical recruitment task were then more willing to prefer a White man for a second job, compared to participants who did not have the opportunity to initially recommend a Black woman. These results have prompted a burgeoning literature on moral licensing, albeit one that is mixed and has been found to exhibit substantial publication bias.

In the current study, Xiao et al. (2024) undertook a large online replication of Study 2 in Monin and Miller (2001), asking whether previous moral behaviours that furnish participants with moral credentials make them more likely to then engage in morally questionable behaviours (N=932). The authors also extended earlier work by testing whether moral credentials license immoral behaviours more effectively in the same domain (e.g. within sex) than in a different domain (e.g. across sex and race), asking whether there is a negative relationship between expression of prejudice and trait reputational concern (fear of negative evaluation), and whether moral credentials attenuate any such observed relationship.

The results constitute a resounding non-replication, revealing no reliable evidence of a moral credential effect, no evidence that higher trait reputational concern predicts the expression of potentially problematic preferences, and no evidence that moral credentials moderate any such association. In discussing the implications of their findings, the authors call for further replication attempts and investigations of the effectiveness of experimental manipulations of moral licensing.

URL to the preregistered Stage 1 protocol: https://osf.io/uxgrk

Level of bias control achieved: Level 6. No part of the data or evidence that was used to answer the research question was generated until after IPA.

List of eligible PCI RR-friendly journals:

References

1. Monin, B., & Miller, D. T. (2001). Moral credentials and the expression of prejudice. Journal of Personality and Social Psychology, 81, 33-43. https://psycnet.apa.org/doi/10.1037/0022-3514.81.1.33

2. Xiao, Q., Ching Li, L., Au, Y. L., Chung, W. T., Tan, S. N. & Feldman, G. (2024). Licensing via credentials: Replication Registered Report of Monin and Miller (2001) with extensions investigating the domain-specificity of moral credentials and associations with trait reputational concern [Stage 2]. Acceptance of Version 7 by Peer Community in Registered Reports. https://osf.io/zgf8y

27 Mar 2024

STAGE 2
(Go to stage 1)

Registered Report: Are anticipatory auditory predictions enhanced in tinnitus and independent of hearing loss?

L. Reisinger, G. Demarchi, S. Rösch, E. Trinka, J. Obleser, N. Weisz https://osf.io/9wqjh

Evidence for the role of predictive coding in subjective tinnitus

Recommended by Chris Chambers based on reviews by Will Sedley, Pia Brinkmann and Emilie Cardon

Subjective tinnitus is a common disorder in which people experience a persistent sound in the absence of any external source. The underlying causes of tinnitus are debated – although the condition is strongly associated with hearing loss resulting from auditory damage, much remains to be understood about the neural processes that give rise to the phantom perception. Various classes of neurophysiological theories have been proposed, including the “altered gain” model – in which neurons in the auditory pathway increase their responsiveness to compensate for reduced auditory input following hearing loss – and the “noise cancellation” model – in which disrupted feedback connections from limbic regions are unable to tune out phantom signals. Although these theories account for much observed data, they have not been conclusively supported, and their ability to explain tinnitus is limited by the fact that hearing loss and tinnitus can arise independently and at different times.

In the current study, Reisinger et al. (2024) tested an emerging alternative theory based on a Bayesian predictive-coding framework (Sedley et al., 2016) in which the alteration of perceptual priors leads the auditory system to expect a sound that, if functioning normally, it should not expect. Using magnetoencephalography (MEG) in a sample of tinnitus patients (and carefully-matched controls for age, gender, and level of hearing loss), they asked whether tinnitus is associated with anticipatory brain activation, tuned to the carrier-frequency of an expected auditory stimulus. Specifically, the authors predicted that if the predictive-coding framework is correct then individuals with tinnitus should show different regularity-dependent pre-activations of carrier- frequency-specific information compared to the control group, while tone carrier-frequencies should be processed normally in tinnitus patients. They also predicted that any such pre-activations should not be related to levels of reported subjective tinnitus distress, as measured with the short version of the Tinnitus Questionnaire (mini-TQ).

The results broadly confirmed the hypotheses, with some caveats. Statistically significant differences in regularity-dependent pre-activations were observed between the tinnitus and control groups, however – curiously – the effects appear to be driven by below-chance decoding in the control group, complicating the interpretration. At the same time, consistent with expectations, frequency processing did not differ significantly between individuals with and without tinnitus, and the observed pre-activations were not significantly related to tinnitus distress. Overall, the findings cautiously support the conclusion that chronic tinnitus is associated with maladaptively upregulated predictive neural processing, and that this phenomenon is unlikely to be explained by either tinnitus distress or hearing loss.

URL to the preregistered Stage 1 protocol: https://osf.io/6gvpy

Level of bias control achieved: Level 3. At least some data/evidence that was used to the answer the research question had been previously accessed by the authors (e.g. downloaded or otherwise received), but the authors certify that they had yet observed any part of the data/evidence prior to Stage 1 IPA.

List of eligible PCI RR-friendly journals:

References

1. Reisinger, L., Demarchi, G., Rösch, , S., Trinka, E., Obleser, L., & Weisz, N. (2024). Registered Report: Are anticipatory auditory predictions enhanced in tinnitus and independent of hearing loss? [Stage 2] Acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/9wqjh

2. Sedley, W., Friston, K. J., Gander, P. E., Kumar, S., & Griffiths, T. D. (2016). An integrative tinnitus model based on sensory precision. Trends in Neurosciences, 39, 799-812. https://doi.org/10.1016/j.tins.2016.10.004

27 Mar 2024

STAGE 1

Registered Report: Are anticipatory predictions enhanced in tinnitus and independent of hearing loss?

L. Reisinger, G. Demarchi, S. Rösch, E. Trinka, J. Obleser, N. Weisz https://osf.io/t34p8

Can predictive coding explain subjective tinnitus?

Recommended by Chris Chambers based on reviews by Will Sedley, Pia Brinkmann and Emilie Cardon

In the current study, Reisinger et al. (2023) will test an emerging alternative theory based on a Bayesian predictive-coding framework (Sedley et al., 2016) in which the alteration of perceptual priors leads the auditory system to expect a sound that, if functioning normally, it should not expect. Using magnetoencephalography (MEG) in a sample of tinnitus patients (and carefully-matched controls for age, gender, and level of hearing loss), they will ask whether tinnitus is associated with anticipatory brain activation, tuned to the carrier-frequency of an expected auditory stimulus. Specifically, the authors predict that if the predictive-coding framework is correct then individuals with tinnitus should show different regularity-dependent pre-activations of carrier- frequency-specific information compared to the control group, while tone carrier-frequencies should be processed normally in tinnitus patients. They also predict that any such pre-activations should not be related to levels of reported subjective tinnitus distress, as measured with the short version of the Tinnitus Questionnaire (mini-TQ).

URL to the preregistered Stage 1 protocol: https://osf.io/6gvpy

Level of bias control achieved: Level 3. At least some data/evidence that will be used to the answer the research question has been previously accessed by the authors (e.g. downloaded or otherwise received), but the authors certify that they have not yet observed ANY part of the data/evidence.

List of eligible PCI RR-friendly journals:

References

Reisinger, L., Demarchi, G., Rösch, , S., Trinka, E., Obleser, L., & Weisz, N. (2023). Registered Report: Are anticipatory predictions enhanced in tinnitus and independent of hearing loss? In principle acceptance of Version 4 by Peer Community in Registered Reports. https://osf.io/6gvpy

Sedley, W., Friston, K. J., Gander, P. E., Kumar, S., & Griffiths, T. D. (2016). An integrative tinnitus model based on sensory precision. Trends in Neurosciences, 39, 799-812. https://doi.org/10.1016/j.tins.2016.10.004

28 Feb 2024

STAGE 2
(Go to stage 1)

Genetically-modified animals as models of neurodevelopmental conditions: a review of systematic review reporting quality

Emma Wilson, Gillian Currie, Malcolm Macleod, Peter Kind, and Emily S Sena https://doi.org/10.31222/osf.io/s5xd4

Evidence for mixed quality of systematic reviews in preclinical animal studies of neurodevelopmental conditions

Recommended by Chris Chambers based on reviews by Marietta Papadatou-Pastou

Single gene alterations have been estimated to account for nearly half of neurodevelopmental conditions (NDCs), providing a crucial opportunity for animal models to understand the underlying mechanisms, causes and potential treatments. The use of systematic reviews (SRs) can, in principle, provide a powerful means to synthesise this evidence-base; however, the reporting quality of previous SRs in preclinical animal research has been found lacking (Hunniford et al., 2021). In the current study, Wilson et al. (2023) will undertook a review of systematic reviews to assess the characteristics and reporting quality of SRs that, in turn, synthesise research in genetically-modified animals to model NDCs. In particular, the authors extracted key features of reviews (including, among others, the aim and primary research questions, relevant animal model, and number of studies in the SR), in addition to quality indicators such as risk of bias and completeness of reporting. In doing so, the authors aimed to enhance guidance on the conduct and reporting of systematic reviews in this area.

Of twelve publications that met the preregistered search criteria, the completeness and quality of reporting was variable. Among the better reported characteristics were search strategies (9 of 12 articles), reporting of funding sources (10 of 12 articles) and use of animal data (11 of 12 articles). In contrast, only two articles reported whether the study protocol was preregistered, only three articles reported methods for assessing risk of bias, and just one included methods to analyse publication bias. In addition, the authors identified 19 review registrations via PROSPERO, most of which remained unpublished after their anticipated end dates. Overall, the results highlight the importance of adherence to reporting guidelines for increasing the transparency and reproducibility of SRs in this field.

The Stage 2 manuscript was evaluated over one round of in-depth review. Based on detailed responses by the authors, the recommender judged that the manuscript met the Stage 2 criteria and awarded a positive recommendation.

URL to the preregistered Stage 1 protocol: https://osf.io/952qk

Level of bias control achieved: Level 4. At least some of the data/evidence that was used to answer the research question already existed prior to IPA and was accessible in principle to the authors, but the authors certify that they did not access any part of that data/evidence prior to IPA.

List of eligible PCI RR-friendly journals:

References

1. Hunniford V. T., Montroy J., Fergusson D. A., Avey M. T., Wever K. E., McCann S. K., Foster M., Fox G., Lafreniere M., Ghaly M., Mannell S., Godwinska K., Gentles A., Selim S., MacNeil J., Sikora L., Sena E. S., Page M. J., Macleod M., Moher D., & Lalu M. M. (2021). Epidemiology and reporting characteristics of preclinical systematic reviews. PLOS Biology, 19:e3001177. https://doi.org/10.1371/journal.pbio.3001177

2. Wilson, E., Currie, G., Macleod, M., Kind, P. & Sena, E. S. (2023). Genetically-modified animals as models of neurodevelopmental conditions: a review of systematic review reporting quality [Stage 2]. Acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/s5xd4

27 Feb 2024

STAGE 2
(Go to stage 1)

Revisiting the motivated denial of mind to animals used for food: Replication Registered Report of Bastian et al. (2012)

Tyler P. Jacobs, Meiying Wang, Stefan Leach, Ho Loong Siu, Mahika Khanna, Ka Wan Chan, Ho Ting Chau, Yuen Yan Tam, Gilad Feldman https://doi.org/10.17605/OSF.IO/H2PQU

Confirmatory evidence that the denial of animal minds explains the "meat paradox"

Recommended by Chris Chambers based on reviews by Brock Bastian, Ben De Groeve and Florian Lange

The psychology of meat-eating offers a fascinating window into moral reasoning, cognition and emotion, as well as applications in the shift toward more sustainable and ethical alternatives to meat consumption. One key observation in this field is the so-called “meat paradox” – the tendency for people to simultaneously eat meat while also caring about animals. One way to resolve this conflict and reduce cognitive dissonance is for people to separate the concept of meat from animals, mentally disengaging from the origins of meat in order to make the act of consumption more ethically acceptable. Another potential explanation is a motivated “denial of mind”, in which people believe that animals lack the mental capacity to experience suffering; therefore, eating an animal is not a harm that the animal will experience. In support of the latter hypothesis, Bastian et al (2012) found that animals judged to have greater mental capacities were also judged as less edible, and that simply reminding meat eaters that an animal was being raised for the purposes of meat consumption led to denial of its mental capacities.

Using a large-scale online design in 1000 participants, Jacobs et al. (2024) replicated two studies from Bastian et al. (2012): asking how the perceived mental capabilities of animals relates to both their perceived edibility and the degree of moral concern they elicit, and whether learning that an animal will be consumed influences perceptions of its mental capabilities. The original findings were successfully replicated. For study 1, attributions of mind were negatively related to animals’ edibility, positively related to negative affect towards eating animals, and positively related to moral concern for animals. For study 2, learning that an animal would be used for food led participants to attribute less mind to the animal. Overall, the results strengthen the conclusion that motivated denial of animal minds can be a mechanism for resolving the ‘meat paradox’.

References

1. Bastian, B., Loughnan, S., Haslam, N., & Radke, H. R. M. (2012). Don’t mind meat? The denial of mind to animals used for human consumption. Personality and Social Psychology Bulletin, 38, 247–256. https://doi.org/10.1177/0146167211424291

2. Jacobs, T. P., Wang, M., Leach, S., Loong, S. H., Khanna, M., Chan, K. W., Chau, H. T., Tam, Y. Y. & Feldman, G. (2024). Revisiting the motivated denial of mind to animals used for food: Replication and extension of Bastian et al. (2012) [Stage 2]. Acceptance of Version 2 by Peer Community in Registered Reports. https://osf.io/mwyde

08 Dec 2023

STAGE 1

An #EEGManyLabs study to test the role of the alpha phase on visual perception (a replication and new evidence)

Manuela Ruzzoli, Mireia Torralba Cuello, Nicola Molinaro, Christopher S.Y. Benwell, Daniel Berkowitz, Debora Brignani, Luca Falciati, Anthony M. Harris, Christian Keitel, Martina Kopčanová, Christopher R. Madan, Kyle Mathewson, Sudhakar Mishra, Piermatteo Morucci, Nicholas Myers, Francesca Nannetti, Sanjeev Nara, Jose Pérez-Navarro, Tony Ro, Natalie Schaworonkow, Joel S. Snyder, Salvador Soto-Faraco, Narayanan Srinivasan, Darinka Trübutschek, Agnese Zazio, Faisal Mushtaq, Yuri G. Pavlov, Domenic... https://osf.io/scqj8

Understanding the relationship between alpha oscillations and visual perception

Recommended by Chris Chambers based on reviews by Chris Allen, Luca Ronconi and Alexander Jones

For nearly a century, rhythmic patterns in electrical brain activity have been of major interest in neuroscience and electrophysiology, but much remains to be discovered about their causal contribution to cognition and behaviour. Low-frequency oscillations in the alpha band (~8-13 Hz) have been suggested to facilitate the organisation and delivery of visual information to higher-level systems, including those involved in perception and decision-making. If so, visual perception should also operate in cycles that are synchronous with – and determined by – the phase of ongoing low-frequency oscillatory activity.

In this #EEGManyLabs study, Ruzzoli et al. (2023) propose a large-scale, multi-lab investigation (9 labs; N=315 human participants) of the relationship between the phase of alpha oscillations and visual perception. The authors focus in particular on replicating a formative study by Mathewson et al. (2009) which reported that during high-amplitude alpha fluctuations, stimulus visibility depended on the time the stimulus was presented relative to the phase of the pre-stimulus alpha activity. In addition, the amplitude of visual evoked potentials recorded with EEG was larger when the target was presented at peaks in pre-stimulus alpha. To explain their findings, Mathewson proposed an influential pulsed inhibition hypothesis in which low alpha power boosts both cortical excitability and stimulus processing (and hence perception), while high alpha power makes stimulus processing dependent on the phase during the alpha cycle at which the stimulus is presented.

In the first of (up to) two studies, the authors will seek to directly replicate the key finding of Mathewson et al: that when alpha power is high, the oscillatory phase determines perceptual performance and event-related electrophysiological correlates in a masked visual detection task. Specifically, (a) alpha oscillations are predicted to modulate the probability of perceiving a target stimulus within a single oscillatory cycle, with detection rate associated with separated (and potentially opposite) phase angles, and (b) alpha phase at the onset of the stimulus should drive electrophysiological correlates of stimulus processing (including the amplitude and/or latency of the N1 ERP component).

Provided the results of this first study do not conclusively disconfirm these hypotheses, the authors will then conduct a follow-up study in which the temporal predictability of the target onset (in relation to a fixation stimulus) is reduced to test the more severe hypothesis that the observed correlations between alpha phase and perception are linked directly to ongoing oscillations, independent of temporal expectations.

URL to the preregistered Stage 1 protocol: https://osf.io/scqj8 (under temporary private embargo)

Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.

List of eligible PCI RR-friendly journals:

References

1. Ruzzoli, M., Cuello, M. T., Molinaro, N., Benwell, C. S. Y., Berkowitz, D., Brignani, D., Falciati, L., Harris, A. M., Keitel, C., Kopčanová, M., Madan, C. R., Mathewson, K., Mishra, S., Morucci, P., Myers, N., Nannetti, F., Nara, S., Pérez-Navarro, J., Ro, T., Schaworonkow, N., Snyder, J. S., Soto-Faraco, S., Srinivasan, N., Trübutschek, D., Zazio, A., Mushtaq, F., Pavlov, Y. G., & Veniero, D. (2023). In principle acceptance of Version 2 by Peer Community in Registered Reports. https://osf.io/scqj8

2. Mathewson, K. E., Gratton, G., Fabiani, M., Beck, D. M., & Ro, T. (2009). To see or not to see: prestimulus α phase predicts visual awareness. Journal of Neuroscience, 29, 2725-2732. https://doi.org/10.1523/JNEUROSCI.3963-08.2009

04 Dec 2023

STAGE 2
(Go to stage 1)

The Effect of Brooding about Societal Problems on Conspiracy Beliefs: A Registered Report

Luisa Liekefett, Simone Sebben, Julia C. Becker https://osf.io/3e8wc

Brooding increases conspiracy beliefs but with practical significance to be determined

Recommended by Chris Chambers based on reviews by Matt Williams and Daniel Toribio-Flórez

The world is seemingly awash with conspiracy theories – from well-trodden examples such as fake Moon landings, the 9/11 truth movement, and Holocaust denial, to relative newcomers including COVID as a bioweapon, QAnon, and the belief that the science of climate change has been invented or falsified. While there is a public perception that conspiracy theories are becoming more prevalent, recent evidence suggests that the rate of conspiracism is relatively stable over time (Uscinski et al., 2022). At any point in history, it seems that a certain proportion of people find themselves vulnerable to conspiracy beliefs, but what distinguishes those who do from those who don’t, and what are the causal factors?

In the current study, Liekefett et al. (2023) investigated the critical role of rumination – a perseverative and repetitive focus on negative content leading to emotional distress. In particular, the authors asked whether one component of rumination referred to as brooding (dwelling on one’s worries and distressing emotions) has a specific causal role in the formation of conspiracy beliefs. In a series of preliminary experiments, the authors first established a procedure for successfully inducing rumination, identifying various boundary conditions and requirements for a successful design. In the main study (N=1,638 to 2,007 depending on the analysis), they asked whether the induction of brooding causes a significant increase in conspiracy beliefs. Manipulation checks were also included to confirm intervention fidelity (independently of this hypothesis), and exploratory analyses tested the effect of various moderators, as well as the causal role of a complementary manipulation of reflection – a component of rumination in which attention is focused on the issue at hand rather than one’s emotions.

As expected by the authors' preliminary work, manipulation checks independently confirmed the effectiveness of the brooding intervention. In answer to the main research question, participants who brooded over the worries and negative emotions associated with an issue were more susceptible to conspiracy beliefs compared to a control group. However, while this effect of brooding was statistically significant, the confidence interval of the effect size estimate overlapped with the authors' proposed smallest effect size of interest (d = 0.20), suggesting that the practical value of the effect remains to be determined.

Overall the findings are consistent with a range of psychological theories suggesting that rumination induces negative affect and/or narrows attention to negative information, which in turn may make conspiracy theories seem more probable and render individuals more vulnerable to cognitive bias. The authors note the importance of future work to define the smallest effect of practical significance, analagous to the criteria used to determine the 'minimal clinically important difference’ in medical research.

URL to the preregistered Stage 1 protocol: https://osf.io/y82bs

Level of bias control achieved: Level 6. No part of the data or evidence that was used to answer the research question was generated until after IPA.

List of eligible PCI RR-friendly journals:

References

1. Uscinski, J., Enders, A., Klofstad, C., Seelig, M., Drochon, H., Premaratne, K. & Murthi, M. (2022) Have beliefs in conspiracy theories increased over time? PLOS ONE 17: e0270429. https://doi.org/10.1371/journal.pone.0270429

2. Liekefett, L. Sebben, S. & Becker, J. C. (2023). The Effect of Brooding about Societal Problems on Conspiracy Beliefs: A Registered Report. Acceptance of Version 2 by Peer Community in Registered Reports. https://osf.io/3e8wc

23 Nov 2023

STAGE 2
(Go to stage 1)

The Medusa effect: A registered replication report of Will, Merritt, Jenkins, and Kingstone (2021)

Jing Han, Minjun Zhang, Jiaxin Liu, Yu Song, Yuki Yamada https://osf.io/yqnu8

Looking (again) at Medusa: Evidence that pictorial abstraction influences mind perception

Recommended by Chris Chambers based on reviews by Alan Kingstone and 1 anonymous reviewer

The Medusa effect is a recently described phenomenon in which people judge a person to be more mindful when they appear as a picture (termed L1) than as a picture within a picture (L2). Across a series of experiments, Will et al. (2021) reported that at higher levels of abstraction, images of people were judged lower in realness (how real the person seemed), experience (the ability to feel) and agency (the ability to plan and act), and also benefited less from prosocial behaviour. The findings provide an intriguing window into mind perception – the extent to which we attribute minds and mental capacities to others.

In the current study, Han et al. (2023) undertook a close replication of two experiments from the original report by Will et al. (2021), asking first, whether the level of pictorial abstraction influences ratings of realness, agency and experience, and second, whether it also influences prosocial behaviour as measured in the dictator game (with participants predicted to allocate more money to recipients presented as pictures than as pictures within pictures). In the event of a non-replication using the original materials, the authors planned to further repeat the experiments using newly generated stimuli that are better matched for cultural context and more tightly controlled along various dimensions.

Results supported all pre-registered hypotheses. Participants rated and perceived L1 stimuli as having significantly higher levels of realness, agency, and experience than L2, and they also allocated significantly more money to L1 recipients than L2 recipients in a dictator game. Furthermore, participants who judged L1 as higher than L2 on all three dimensions also differentiated significantly between L1 and L2 in the dictator game, indicating a relationship between mind perception and prosociality. Overall, the findings confirm that pictures with lower levels of abstraction are perceived as more mindful and are associated with higher levels of prosocial behavior. Consequently, the results suggest that the Medusa effect is a reproducible phenomenon.

References

1. Will, P., Merritt, E., Jenkins, R., & Kingstone, A. (2021). The Medusa effect reveals levels of mind perception in pictures. Proceedings of the National Academy of Sciences, 118(32), e2106640118. https://doi.org/10.1073/pnas.2106640118

2. Han, J., Zhang, M., Liu, J., Song, Y. & Yamada, Y. (2023).The Medusa effect: A registered replication report of Will, Merritt, Jenkins, and Kingstone (2021). Acceptance of Version 2 by Peer Community in Registered Reports. https://osf.io/yqnu8

08 Nov 2023

STAGE 2
(Go to stage 1)

Responding to Online Toxicity: Which Strategies Make Others Feel Freer to Contribute, Believe That Toxicity Will Decrease, and Believe that Justice Has Been Restored?

Alison I. Young Reusser, Kristian M. Veit, Elizabeth A. Gassin, and Jonathan P. Case https://osf.io/k46e8

Benevolent correction may provide a promising antidote to online toxicity

Recommended by Chris Chambers based on reviews by Corina Logan and Marcel Martončik

Social media is a popular tool for online discussion and debate, bringing with it various forms of hostile interactions – from offensive remarks and insults, to harassment and threats of physical violence. The nature of such online toxicity has been well studied, but much remains to be understood regarding strategies to reduce it. Existing theory and evidence suggests that a range of responses – including those that emphasise prosociality and empathy – might be effective at mitigating online toxicity. But do such strategies work in practice?

In the current study, Young Reusser et al (2023) tested the effectiveness of three types of responses to online toxicity – benevolent correction (including disagreement), benevolent going along (including joking/agreement) and retaliation (additional toxicity) – on how able participants feel to contribute to conversations, their belief that the toxicity would be reduced by the intervention, and their belief that justice had been restored.

The results showed the benevolent correction – while an uncommon strategy in online communities – was most effective in helping participants feel freer to contribute to online discussions. Benevolent correction was also the preferred approach for discouraging toxicity and restoring justice. Overall, the findings suggest that responding to toxic commenters with empathy and understanding while (crucially) also correcting their toxicity may be an effective intervention for bystanders seeking to improve the health of online interaction. The authors note that future research should focus on whether benevolent correction actually discourages toxicity, which wasn't tested in the current experiment, and if so how the use of benevolent corrections might be encouraged.

Following one round of review and revisions, the recommender judged that the manuscript met the Stage 2 criteria and awarded a positive recommendation.

URL to the preregistered Stage 1 protocol: https://osf.io/hfjnb

Level of bias control achieved: Level 6. No part of the data or evidence that was used to answer the research question was generated until after IPA.

List of eligible PCI RR-friendly journals:

References

1. Young Reusser, A. I., Veit, K. M., Gassin, E. A., & Case, J. P. (2023). Responding to Online Toxicity:
Which Strategies Make Others Feel Freer to Contribute, Believe That Toxicity Will Decrease, and Believe that Justice Has Been Restored? [Stage 2 Registered Report] Acceptance of Version 2 by Peer Community in Registered Reports. https://osf.io/k46e8

08 Nov 2023

STAGE 2
(Go to stage 1)

Relationship between creativity and depression: the role of reappraisal and rumination

Chin Yui Lam and Jeffrey Allen Saunders https://osf.io/z3ap5

Evidence for a weak relationship between creativity and depressive traits

Recommended by Chris Chambers

For centuries, the relationship between creativity and mental health has been a subject of fascination, propelled by the impression that many of the most famous artists in history likely suffered from mood disorders or other mental illnesses. However, with the advent of psychological science – including more precise and diagnostic clinical measures – the empirical evidence for an association between creativity and depressive symptoms has been mixed, with some studies suggesting a positive relationship and others showing either no effect or indicating that the link, if there is one, may be driven by other personality characteristics (Verhaeghen et al., 2005).

In the current study, Lam and Saunders used an online design in 201 participants to ask whether creativity is associated with higher depressive traits, and further, whether that relationship depends on two additional variables that could explain an observed positive correlation: self-reflective rumination (repetitive thoughts that maintain a negative mood state) and the frequency with which individuals engage in reappraisal (a regulation strategy that involves reinterpreting an event or situation to diminish its negative impact).

Results showed mixed support for the hypotheses. Contrary to expectations, the relationship between creativity and depression was significantly negative rather than positive. However, even though the directionality of this relationship was opposite to predicted, the hypothesis that the association between creativity and depression is mediated by self-reflective rumination was supported. Finally, the results disconfirmed the hypothesis that reappraisal frequency contributes to the relationship between creativity and depression. Exploratory analyses indicated no reliable moderating role of gender. Overall, these findings suggest that creativity and depression may be only weakly related, and that self-reflective rumination could account for that relationship.

The Stage 2 manuscript was evaluated over one round of review provided by the recommender and Managing Board, as the Stage 1 reviewers were no longer available. Based on additional changes to the manuscript, the recommender judged that the manuscript met the Stage 2 criteria and awarded a positive recommendation.

URL to the preregistered Stage 1 protocol: https://osf.io/yub7n

Level of bias control achieved: Level 6. No part of the data or evidence that was used to answer the research question was generated until after IPA.

List of eligible PCI RR-friendly journals:

References

1. Verhaeghen, P., Joormann, J., & Khan, R. (2005). Why we sing the blues: The relation between self-reflective rumination, mood, and creativity. Emotion, 5, 226-232. https://doi.org/10.1037/1528-3542.5.2.226

2. Lam, C. Y. & Saunders, J. A. (2023). Relationship between creativity and depression: the role of reappraisal and rumination [Stage 2 Registered Report]. Acceptance of Version 2 by Peer Community in Registered Reports. https://osf.io/z3ap5

30 Oct 2023

STAGE 1

The role of spatial location in irrelevant speech revisited: A pre-registered replication

Florian Kattner, Mitra Hassanzadeh, & Wolfgang Ellermeier https://osf.io/tx2wr

Does auditory stream segregation reduce the irrelevant speech effect?

Recommended by Chris Chambers based on reviews by Massimo Grassi and 2 anonymous reviewers

The irrelevant-speech effect (ISE) is a laboratory phenomenon in which performance at memory recall is impaired by the presence of irrelevant auditory stimuli during the initial encoding phase. In a typical ISE experiment, participants are asked to remember a sequence of letters presented visually (e.g. F, K, L, M, Q, R, Y in a shuffled random order between trials) while irrelevant speech is played over headphones. The typical finding is that recall performance is impaired by the presentation of speech compared with silence. The ISE has been influential in cognitive psychology, prompting the advancement of two broad classes of competing explanations: one in which the irrelevant sounds gain automatic access to memory processes without any specified role for attentional selection, and another in which the ISE is explained by irrelevant speech drawing attention away from the relevant items to be recalled.

In the current study, Kattner et al. (2023) propose a replication of a seminal study by Jones and Macken (1995) that provided a foundation for the automatic access (or ‘interference-by-process’) class of theories. In their original set of experiments, Jones and Macken reported that the segregating individual components of the irrelevant speech (the spoken letters V, J, and X) into different lateralized locations reduced the magnitude of the ISE by converting a single ‘changing-state’ stream three separate ‘steady-state’ streams. Here, Kattner et al. ask firstly whether this classic finding can be successfully replicated in a well-powered sample, and secondly whether the streaming-by-location effect in Jones and Macken reduces the ISE to the same level as observed during a steady-state baseline condition in which a single letter is repeated from each location. If the answer to either question is No then doubts will have been raised about interference-by-process theories, opening the door (even more) to alternative theoretical explanations of the ISE.

URL to the preregistered Stage 1 protocol: https://osf.io/2tb8e

Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.

List of eligible PCI RR-friendly journals:

References

1. Jones, D. M. & Macken, W. J. (1995). Organizational factors in the effect of irrelevant speech: The role of spatial location and timing. Memory & Cognition, 23, 192–200. https://doi.org/10.3758/BF03197221

2. Kattner, F., Hassanzadeh, M. & Ellermeier, W. (2023). The role of spatial location in irrelevant speech revisited: A registered replication of Jones and Macken (1995). In principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/2tb8e

25 Sep 2023

STAGE 1

Effects of Auditory Stimuli During Submaximal Exercise on Cerebral Oxygenation

Dr Ségolène M. R. Guérin, Professor Costas I. Karageorghis, Marine R. Coeugnet, Dr Marcelo Bigliassi and Professor Yvonne N. Delevoye-Turrell https://doi.org/10.5281/zenodo.8324914

Does listening to music alter prefrontal cortical activity during exercise?

Recommended by Chris Chambers based on reviews by David Mehler and 1 anonymous reviewer

The relationship between music and exercise has been studied for over a century, with implications for our understanding of biomechanics, physiology, brain function, and psychology. Listening to music while exercising is associated with a wide range of benefits, from increasing motivation, to reducing perceived exertion, inhibiting awareness of negative bodily signals, boosting mood, and ultimately improving physical performance. But while these ergogenic benefits of music are well documented, much remains to be discovered about how music alters brain function during exercise. One reason for this gap in understanding is the technical difficulty in recording brain activity during realistic exercise, as neuroimaging methods such as fMRI, EEG or MEG typically require participants to remain as still as possible.

In the current study, Guérin et al. (2023) will use the optical brain imaging technique of functional near infrared spectroscopy (fNIRS) to measure oxygenation of key brain areas during exercise. Unlike other neuroimaging methods, fNIRS has a high tolerance for motion artefacts, making it the ideal method of choice for the current investigation. The authors propose a series of hypotheses based on previous studies that observed a decrease in cerebral oxygenation during intense exercise, particularly within the medial prefrontal cortex (mPFC) and dorsolateral prefrontal cortex (dlPFC). If, as suggested, the prefrontal cortex is important for regulation of cognition and emotion during exercise, then the benefits of listening to music might arise by delaying or reducing this drop in prefrontal oxygenation.

Using a within-subject designs, Guérin et al. will combine an incremental exercise protocol involving a cycling task with three auditory conditions: asynchronous music (the active condition), listening to an audiobook (an auditory control) or silence (baseline control). Compared to the two control conditions, they predict that music exposure will increase oxygenation in prefrontal and parietal regions and will also delay the drop in oxygenation associated with intense exercise (specifically within dlPFC and mPFC). To test whether any such changes are specific for prefrontal and parietal cortex, they will also compare the haemodynamic responses of the occipital cortex between the auditory conditions, predicting no difference.

URL to the preregistered Stage 1 protocol: https://osf.io/52aeb

Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.

List of eligible PCI RR-friendly journals:

References

1. Guérin, S. M. R., Karageorghis, C. I., Coeugnet, M. R., Bigliassi, M. & Delevoye-Turrell, Y. N. (2023). Effects of Auditory Stimuli During Submaximal Exercise on Cerebral Oxygenation. In principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/52aeb

11 Sep 2023

STAGE 1

Finding the right words to evaluate research: An empirical appraisal of eLife’s assessment vocabulary

Tom E. Hardwicke, Sarah Schiavone, Beth Clarke, Simine Vazire https://osf.io/e5pkz?view_only=3f65527bb5dc428382f4b9154bfc58e0

Understanding the validity of standardised language in research evaluation

Recommended by Sarahanne Miranda Field and Chris Chambers based on reviews by Chris Hartgerink (they/them), Veli-Matti Karhulahti, Štěpán Bahník and Ross Mounce

In 2023, the journal eLife ended the practice of making binary accept/reject decisions following peer review, instead sharing peer review reports (for manuscripts that are peer-reviewed) and brief “eLife assessments” representing the consensus opinions of editors and peer reviewers. As part of these assessments, the journal draws language from a "common vocabulary" to linguistically rank the significance of findings and strength of empirical support for the article's conclusions. In particular, the significance of findings is described using an ordinal scale of terms from "landmark" → "fundamental" → "important" → "valuable" → "useful", while the strength of support is ranked across six descending levels from "exceptional" down to "inadequate".

In the current study, Hardwicke et al. (2023) question the validity of this taxonomy, noting a range of linguistic ambiguities and counterintuitive characteristics that may undermine the communication of research evaluations to readers. Given the centrality of this common vocabulary to the journal's policy, the authors propose a study to explore whether the language used in the eLife assessments will be interpreted as intended by readers. Using a repeated-measures experimental design, they will tackle three aims: first, to understand the extent to which people share similar interpretations of phrases used to describe scientific research; second, to reveal the extent to which people’s implicit ranking of phrases used to describe scientific research aligns with each other and with the intended ranking; and third, to test whether phrases used to describe scientific research have overlapping interpretations. The proposed study has the potential to make a useful contribution to metascience, as well as being a valuable source of information for other journals potentially interested in following the novel path made by eLife.

The Stage 1 manuscript was evaluated over one round of in-depth review. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).

URL to the preregistered Stage 1 protocol: https://osf.io/mkbtp

Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.

List of eligible PCI RR-friendly journals:

References

1. Hardwicke, T. E., Schiavone, S., Clarke, B. & Vazire, S. (2023). Finding the right words to evaluate research: An empirical appraisal of eLife’s assessment vocabulary. In principle acceptance of Version 2 by Peer Community in Registered Reports. https://osf.io/mkbtp

11 Sep 2023

STAGE 1

Researcher Predictions of Effect Generalizability Across Global Samples

Kathleen Schmidt, Priya Silverstein, & Christopher R. Chartier https://osf.io/ygbr5?view_only=348484e6e86442e5a43e75e0cf9aa310

Can psychology researchers predict which effects will generalise across cultures?

Recommended by Chris Chambers based on reviews by Michèle Nuijten, Ian Hussey, Jim Grange and Matthias Stefan

Compared to the wealth of debate surrounding replicability and transparency, relatively little attention has been paid to the issue of generalisability – the extent to which research findings hold across different samples, cultures, and other parameters. Existing research suggests that researchers in psychology are prone to generalisation bias, relying on narrow samples (e.g. drawn predominantly from US or European undergraduate samples) to draw broad conclusions about the mind and behaviour. While recent attempts to address generalisability concerns have been made – such as journals requiring explicit statements acknowledging constraints on generality – addressing this bias at root, and developing truly generalisable methods and results, requires a deeper understanding of how researchers perceive generalisability in the first place.

In the current study, Schmidt et al. (2023) tackle the issue of cross-cultural generalisability using four large-scale international studies that are being conducted as part of the Psychological Science Accelerator (PSA) – a globally distributed network of researchers in psychology that coordinates crowdsourced research projects across six continents. Specifically, participants (who will be PSA research members) will estimate the probability that an expected focal effect will be observed both overall and within regional subsamples of the PSA studies. They will also predict the size of these focal effects overall and by region.

Using this methodology, the authors plan to ask two main questions: first whether researchers can accurately predict the generalisability of psychological phenomena in upcoming studies, and second whether certain researcher characteristics (including various measures of expertise, experience, and demographics) are associated with the accuracy of generalisability predictions. Based on previous evidence that scientists can successfully predict the outcomes of research studies, the authors expect to observe a positive association between predicted and actual outcomes and effect sizes. In secondary analyses, the authors will also test if researchers can predict when variables that capture relevant cultural differences will moderate the focal effects – if so, this would suggest that at least some researchers have a deeper understanding as to why the effects generalise (or not) across cultural contexts.

URL to the preregistered Stage 1 protocol: https://osf.io/vwqsa (under temporary private embargo)

Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.

List of eligible PCI RR-friendly journals:

References

1. Schmidt, K., Silverstein, P. & Chartier, C. R. (2023). Registered Report: Researcher Predictions of Effect Generalizability Across Global Samples. In principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/vwqsa

14 Aug 2023

STAGE 2
(Go to stage 1)

Life Thinning and Gaming Disorder: A Longitudinal Qualitative Registered Report

Veli-Matti Karhulahti, Miia Siutila, Jukka Vahlo, Raine Koskimaa https://doi.org/10.31234/osf.io/rfbcu

How do intensive gaming experiences evolve over time in clinical and non-clinical contexts?

Recommended by Chris Chambers based on reviews by Peter Branney and Michelle Carras

Over the last 5 years the inclusion of “gaming disorder” in the ICD-11 been controversial (Van Rooij et al, 2018), mirroring wider public debate about the effects of gaming on mental health. One of the major gaps in understanding the validity of gaming disorder as an identifiable mental illness is the absence of qualitative studies comparing the lived experience of gamers who seek treatment with esports players who do not report health problems.

Here, Karhulahti et al. (2023) tackle this question in the second of two Stage 2 Registered Reports associated with their previous programmatic Stage 1 submission. Using interpretative phenomenological analysis, the authors undertook in-depth interviews over a 1-year period with treatment-seeking participants (N=5) and esports-playing participants (N=4) who did not experience gaming-related health problems. The authors sought to answer the folllwing primary question: How do the experiences and meanings of playing videogames—shaped by the individuals’ diverse sociocultural contexts—evolve in those with related health problems (as defined by treatment-seeking) and those who play esports games several hours per day while self-reporting no related health problems?

Both groups exhibited intense relationships with gaming that were cyclical over time across various dimensions, with fluctuations occurring in response to changes in health, occupation, and social networks. The observed variation over time was substantial, with individuals attaching and detaching from games involving hundreds or thousands of hours. The authors report treatment-seeking being followed by a search of new gaming and life meanings, while intensive gaming without related problems continued as an integrated part of the self, with resilience adapting and evolving in the face of unexpected life events. Taking into account their findings, the authors propose life thinning and resilience integration processes to help describe and explain how some individuals end up seeking treatment for their gaming, while for others gaming supports them and becomes integrated into their identity.

Following one round of in-depth review and revision, the recommender judged that the manuscript met the Stage 2 criteria and awarded a positive recommendation.

URL to the preregistered Stage 1 protocol: https://osf.io/a2rwg

Level of bias control achieved: Level 4. At least some of the data/evidence that was used to answer the research question existed prior to in-principle acceptance(IPA) but the authors certify that they did not access any part of that data/evidence prior to IPA.

List of eligible PCI RR-friendly journals:

References

1. van Rooij AJ, Ferguson CJ, Carras MC, Kardefelt-Winther D, Shi J, Aarseth E, Bean AM, Bergmark KH, Brus A, Coulson M, Deleuze J, Dullur P, Dunkels E, Edman J, Elson M, Etchells PJ, Fiskaali A, Granic I, Jansz J, Karlsen F, Kaye LK, Kirsh B, Lieberoth A, Markey P, Mills KL, Nielsen RKL, Orben A, Poulsen A, Prause N, Prax P, Quandt T, Schimmenti A, Starcevic V, Stutman G, Turner NE, Looy J van, Przybylski AK (2018) A weak scientific basis for gaming disorder: Let us err on the side of caution. Journal of Behavioral Addictions, 7, 1–9. https://doi.org/10.1556/2006.7.2018.19

2. Karhulahti V-M, Siutila M, Vahlo J, Koskimaa R (2023). Life Thinning and Gaming Disorder: A Longitudinal Qualitative Registered Report [Stage 2 Registered Report], acceptance of Version 2 by Peer Community in Registered Reports. https://osf.io/hmcqz

07 Aug 2023

STAGE 2
(Go to stage 1)

The link between Empathy and Forgiveness: Replication and extensions Registered Report of McCullough et al. (1997)'s Study 1

Chan Chi Fung, Gilad Feldman https://doi.org/10.17605/OSF.IO/FMUV2

Strong evidence that empathy is important for forgiveness

Recommended by Chris Chambers based on reviews by James Bartlett and Saleh Shuqair

Forgiveness is a core feature of human psychology in which a person makes a deliberate decision to cease negative emotions or attitudes toward an offender who has done them harm. The concept of interpersonal forgiveness is deeply embedded across societies, but much remains to be understood about how it actually works. What are its key ingredients and why does it occur in the first place? Research in social psychology has demonstrated a range of personal and social benefits of forgiveness, giving rise to two dominant mechanistic accounts – one that positions empathy as the driving factor and another that centres motivated reasoning (Donovan & Priester, 2017).

In the current study, Chan and Feldman (2023) sought to replicate a formative study by McCullough et al (1997) that led to the so-called Empathy Model of forgiveness. According to this theory, forgiving is a motivational change facilitated (crucially) by empathy, promoting constructive over destructive behaviour toward the offender. Chan and Feldman replicated Study 1 from McCullough et al., measuring the correlational relationship between apology, forgiving, and empathy for offenders, and exploring whether forgiving is associated with increased conciliation and decreased avoidance motivation. As well as closely replicating the original study, the authors extended it to test the more severe hypothesis that empathy causally influences forgiveness. To achieve this, they experimentally manipulated empathy by adding two groups to the design: one in which participants were asked to recall hurtful past experiences in which they were not empathetic to the offender, and another in which they were highly empathetic.

The outcomes constitute a successful replication. Affective empathy was positively associated with perceived apology and forgiveness, and forgiveness was positively associated with conciliation motivation and negatively associated with both avoidance motivation and revenge motivation. In addition, the results of the experimental extension revealed a reliable causal effect of empathy on forgiveness and perceived apology. Overall, the findings provide robust support for the Empathy Model of forgiveness.

The Stage 2 manuscript was evaluated over one round of in-depth review. Based on responses to the comments, the recommender judged that the manuscript met the Stage 2 criteria and therefore awarded a positive recommendation.

URL to the preregistered Stage 1 protocol: https://osf.io/q78fs

References

1. Donovan, L. A. N., & Priester, J. R. (2017). Exploring the psychological processes underlying interpersonal forgiveness: The superiority of motivated reasoning over empathy. Journal of Experimental Social Psychology, 71, 16-30. https://doi.org/10.1016/j.jesp.2017.02.005

2. McCullough, M. E., Worthington, E. L., & Rachal, K. C. (1997). Interpersonal Forgiving in Close Relationships. Journal of Personality and Social Psychology, 73, 321–336. https://doi.org/10.1037/0022-3514.73.2.321

3. Chan, C. F. & Feldman, G. (2023). The link between Empathy and Forgiveness: Replication and extensions of McCullough et al. (1997)'s Study 1, acceptance of Version 4 by Peer Community in Registered Reports. https://osf.io/956fa

13 Jul 2023

STAGE 1

Modulatory effects of instructions on extinction efficacy in appetitive and aversive learning: A registered report

Lea Busch, Katja Wiech, Matthias Gamer, Balint Kincses, Tamas Spisak, Katharina Schmidt, Ulrike Bingel https://osf.io/cj75p

Neurocognitive insights on instructed extinction in the context of pain

Recommended by Chris Chambers based on reviews by Tom Beckers, Gaëtan Mertens and Karita Ojala

Rapid learning in response to pain is a crucial survival mechanism, relying on forming associations between cues in the environment and subsequent pain or injury. Existing evidence suggests that associations between conditioned stimuli (cues) and unconditioned aversive stimuli (such as pain) are learned faster than for appetitive stimuli that signal pain relief. In addition, when the link between a conditioned and unconditioned stimulus is broken (by unpairing them), the extinction of this learning effect is slower for aversive that appetitive stimuli, resulting in a flatter extinction slope. Understanding why extinction slopes are reduced for aversive stimuli is important for advancing theoretical models of learning, and for devising ways of increasing the slope (and thus facilitating extinction learning) could help develop more effective methods of pain relief, particularly in the treatment of chronic pain.

In the current programmatic submission, Busch et al. (2023) will undertake two Registered Reports to test whether a verbal instruction intervention that explicitly informs participants about contingency changes between conditioned and unconditioned stimuli facilitates extinction learning, especially for aversive (painful) stimuli, and how changes in extinction learning relate to neural biomarkers of functional connectivity. In the first Registered Report, they will initially seek to replicate previous findings including faster acquisition of aversive than appetitive conditioned stimuli as well as incomplete extinction of aversive conditioned stimuli without verbal instruction. They will then test how the instruction intervention alters extinction slopes and the completeness of extinction for appetitive and aversive stimuli, using a range of behavioral measures (expectancy and valence ratings) and physiological measures (pupillometry, skin conductance responses). To shed light on the neural correlates of these processes, in the second Registered Report the authors will use functional magnetic resonance imaging (fMRI) to ask firstly how acquisition and extinction of aversive and appetitive conditioned responses are related to resting state brain connectivity within a network that includes ventromedial prefrontal cortex, amygdala, and striatum, and secondly, whether the effectiveness of instruction on extinction learning is associated with differences in resting state connectivity across this network.

URL to the preregistered Stage 1 protocol: https://osf.io/cj75p (under temporary private embargo)

Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.

List of eligible PCI RR-friendly journals:

Advances in Cognitive Psychology
Brain and Neuroscience Advances (for RR #2 only)
Cortex
Experimental Psychology (for RR #1 only)
F1000Research
Imaging Neuroscience (for RR #2 only)
In&Vertebrates
Journal of Cognition (for RR #1 only)
NeuroImage: Reports (for RR #2 only)
Peer Community Journal
PeerJ
Royal Society Open Science
Swiss Psychology Open (for RR #1 only)

References

1. Busch, L., Wiech, K., Gamer, M., Knicses, B., Spisak, T., Schmidt, K., & Bingel, U. (2023). Modulatory effects of instructions on extinction efficacy in appetitive and aversive learning: A registered report. In principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/cj75p

03 Jul 2023

STAGE 2
(Go to stage 1)

Globally, songs and instrumental melodies are slower, higher, and use more stable pitches than speech [Stage 2 Registered Report]

Yuto Ozaki, Adam Tierney, Peter Pfordresher, John Mcbride, Emmanouil Benetos, Polina Proutskova, Gakuto Chiba, Fang Liu, Nori Jacoby, Suzanne Purdy, Patricia Opondo, Tecumseh Fitch, Shantala Hegde, Martín Rocamora, Rob Thorne, Florence Ewomazino Nweke, Dhwani Sadaphal, Parimal Sadaphal, Shafagh Hadavi, Shinya Fujii, Sangbuem Choo, Marin Naruse, Utae Ehara, Latyr Sy, Mark Lenini Parselelo, Manuel Anglada-Tort, Niels Chr. Hansen, Felix Haiduk, Ulvhild Færøvik, Violeta Magalhães, Wojciech Krzyżanow... https://doi.org/10.31234/osf.io/jr9x7

Strong evidence for cross-cultural regularities in music and speech

Recommended by Chris Chambers based on reviews by Bob Slevc and Nai Ding

For centuries, the ubiquity of language and music across human societies has prompted scholars to speculate about their cross-cultural origins as well as their shared and unique characteristics. Depending on the extent to which contemporary theories emphasise the role of biology vs. culture, a range of hypotheses have been proposed concerning expected similarities and differences in song and speech. One class of hypotheses stemming from cultural relativism assumes a lack of universal regularities in song and speech, and therefore predicts no systematic cross-cultural relationships. On the other hand, more recent evolutionary hypotheses such as the social bonding hypothesis, motor constraint hypothesis, and sexual selection hypothesis all predict differences or similarities in specific characteristic of vocalisations, such as pitch regularity, pitch interval size, and melodic contour. Existing results are mixed in their support of these predictions.

In the current study, Ozaki et al. (2023) elucidated cross-cultural similarities and differences between speech and song in 75 different linguistic varieties spanning 21 language families. Understanding precisely how song and speech are related is methodologically challenging due to the multitude of confounds that can arise in comparing natural recordings. Here the authors overcame these difficulties with four types of carefully controlled recordings: singing, recitation of sung lyrics, spoken description of the song, and instrumental version of the sung melody. The authors then examined six features that are amenable to reliable comparison, including pitch height, temporal rate, pitch stability, timbral brightness, pitch interval size, and pitch declination. With this data in hand, the authors asked which acoustic features differ reliably between song and speech across cultures, with the expectation that song would exhibit higher pitch, slower rate and more stable pitch than speech. At the same time, the authors expected song and speech to be reliably similar in the characteristics of timbral brightness, pitch intervals and pitch contours

The findings provided strong support for the preregistered hypotheses. Relative to speech, songs exhibited higher pitch, slower temporal rate, and more stable pitches, while both songs and speech had similar pitch interval size and timbral brightness. Only one hypothesis was unsupported, with the comparison of pitch declination between song and speech turning out inconclusive. To overcome potential sources of analytic bias, the authors undertook additional robustness checks, including reanalysis of a previously published dataset of over 400 song/speech recordings; this exploratory analysis corroborated the conclusions from the confirmatory analysis. Overall this study offers a unique insight into the shared global characteristics of langage and music, with implications for understanding their cultural and biological (co)evolution.

The Stage 2 manuscript was evaluated over one round of in-depth review. Based on responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 2 criteria and therefore awarded a positive recommendation.

URL to the preregistered Stage 1 protocol: https://osf.io/jdhtz

Level of bias control achieved: Level 2. At least some data/evidence that was used to answer the research question had been accessed and partially observed by the authors, but the authors certify that they had not yet observed the key variables within the data that were be used to answer the research question AND they took additional steps to maximise bias control and rigour.

List of eligible PCI RR-friendly journals:

References

1. Ozaki, Y. et al. (2023). Globally, songs and instrumental melodies are slower, higher, and use more stable pitches than speech [Stage 2 Registered Report]. Acceptance of Version 11 by Peer Community in Registered Reports. https://doi.org/10.31234/osf.io/jr9x7

25 Jun 2023

STAGE 1

Reference points and decision-making: Impact of status quo and defaults in a conceptual replication and extensions Registered Report of Dinner et al. (2011)

Monique Moon Ling YAM, Gilad Feldman https://osf.io/5ak6p

Understanding the impact of status quo bias and the default effect on decision-making

Recommended by Chris Chambers based on reviews by Laurens van Gestel, Julia Nolte and Sylvain Chabé-Ferret

Everyday decisions can often be biased by how different options are presented and which choices were made previously, over and above whichever option is rationally preferable. Two such major biases in judgment and decision-masking are status quo bias and the default effect. The status quo bias reflects a tendency for people to choose an option that has already been implemented or represents the current state of affairs (for instance, choosing to remain with a current energy supplier rather than switching to a different one, even when the current supplier provides less value for money), while the default effect is a bias toward taking a course of action that would occur automatically in the absence of an active choice (such as the pre-selected energy supplier in questionnaire). Status quo bias and default effects can overlap or diverge: the status quo option will often be the same as the default, while on other occasions the default option in a choice set will be determined by other factors and differ from the option that was already implemented.

In the current study, Yam and Feldman (2023) propose a replication and extension of an influential study by Dinner et al. (2011) that purported to examine default effects but, arguably, actually studied its nearby cousin, status quo bias. Using a large online sample, the authors will independently test for the existence of both status quo bias and the default effect, before then asking whether (and if so how) status quo bias and default effects interact and how they are related to several potential explanatory variables, including perceived effort (which may be lower for the status quo or default) and endorsements (whether through direct recommendations or indirectly through perceived norms). The authors also build in additional manipulation checks and comprehension checks, in addition to exploratory analyses examining (among other variables), the political orientation of participants.

URL to the preregistered Stage 1 protocol: https://osf.io/ep3jh

Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.

List of eligible PCI RR-friendly journals:

References

1. Dinner, I., Johnson, E. J., Goldstein, D. G., & Liu, K. (2011). Partitioning default effects: Why people choose not to choose. Journal of Experimental Psychology: Applied, 17, 332– 341. https://doi.org/10.1037/a0024354

2. Yam, M. L. M. & Feldman, G. (2023). Reference points and decision-making: Impact of status quo and defaults in a conceptual replication and extensions Registered Report of Dinner et al. (2011), in principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/ep3jh

25 Jun 2023

STAGE 1

Cortical plasticity of the tactile mirror system in borderline personality disorder

Agnese Zazio, Giacomo Guidali, Roberta Rossi, Nadia Bolognini, Marta Bortoletto https://osf.io/ujkxb?view_only=c0d7ffddc6d647949099e9b6e26f6f49

Is borderline personality disorder linked to impairment of the tactile mirror system?

Recommended by Chris Chambers based on reviews by Zoltan Dienes and 2 anonymous reviewers

Borderline personality disorder (BPD) is a mental illness affecting ~1 in 100 people (Ellison et al., 2018), characterised by emotional dysregulation, impulsivity, a distorted sense of self, and a long-term pattern of unstable interpersonal relationships. Among this heterogenous range of symptoms is difficulty in the cognitive dimension of empathy, in particular understanding the perspectives of others, which in turn has been suggested to rely on the mirror neuron system, both in the motor and somatosensory domains. The integrity of the mirror system has therefore been a focus for understanding the possible causes or consequences of the disorder, with preliminary studies pointing to hypoactivity of neuronal areas associated with the mirror system in BPD (Mier et al., 2013).

In the current study, Zazio et al. (2023) will use crossmodal paired associative stimulation (cm-PAS) in which an image of a hand being touched is repeatedly paired with transcranial magnetic stimulation (TMS) of the primary somatosensory cortex (S1) to test the hypothesis that BPD is associated with a specific deficit in the tactile mirror system. In healthy controls, the close temporal coupling (20ms) between the visual depiction of tactile stimulation and TMS of S1 is expected boost tactile acuity and elevate the performance cost of incongruence in a task that manipulates visuo-tactile spatial congruity (VTSC) – effects that are thought to reflect the fidelity of the tactile mirror system.

In BPD patients, however, the authors make the crucial prediction that impairment of the tactile mirror system (if present) will lead to a reduced (or even non-existent) effect of cm-PAS on tactile acuity and VTSC task performance compared to healthy controls. To help ensure a severe test of this hypothesis, the design includes a variety of controls, including an attention check, control cm-PAS in which the inter-stimulus interval is increased to 100ms to break the close temporal coupling between visual stimulation and TMS, and a positive control to confirm that active cm-PAS (compared to control cm-PAS) produces the expected boost in tactile acuity in healthy controls.

URL to the preregistered Stage 1 protocol: https://osf.io/sqnwd

Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.

List of eligible PCI RR-friendly journals:

References

1. Ellison, W. D., Rosenstein, L. K., Morgan, T. A., & Zimmerman, M. (2018). Community and clinical epidemiology of borderline personality disorder. Psychiatric Clinics, 41, 561-573. https://doi.org/10.1016/j.psc.2018.07.008

2. Mier, D., Lis, S., Esslinger, C., Sauer, C., Hagenhoff, M., Ulferts, J., Gallhofer, B. & Kirsch, P. (2013). Neuronal correlates of social cognition in borderline personality disorder. Social Cognitive and Affective Neuroscience, 8, 531-537. https://doi.org/10.1093/scan/nss028

2. Zazio, A., Guidali, G., Rossi, R., Bolognini, N. & Bortoletto, A. (2023). Cortical plasticity of the tactile mirror system in borderline personality disorder, in principle acceptance of Version 4 by Peer Community in Registered Reports. https://osf.io/sqnwd

16 Jun 2023

STAGE 1

Licensing via credentials: Replication of Monin and Miller (2001) with extensions investigating the domain-specificity of moral credentials and the association between the credential effect and trait reputational concern

Qinyu Xiao, Lok Ching Li, Ying Lam Au, Wing Tung Chung, See Ngueh Tan, Gilad Feldman https://osf.io/vrsd3

Revisiting moral licensing

Recommended by Chris Chambers based on reviews by Corey Cusimano, Marek Vranka, Štěpán Bahník and Ethan Meyers

Does being good free people up to be bad? A large literature in social psychology suggests that it might, with evidence that “moral licensing” gives people a perception that actions deemed morally questionable, or socially undesirable, will be tolerated more readily if they have demonstrated a past history of praiseworthy, moral behaviour. In a formative study, Monin and Miller (2001) reported that having a track record of moral credentials as being nonprejudiced (e.g. non-sexist or non-racist) increased the willingness of participants to later express a prejudiced attitude. For example, in their Study 2 they found that participants who built up their moral credit by selecting a Black woman in a hypothetical recruitment task were then more willing to then prefer a White man for a second job, compared to participants who did not have the opportunity to initially recommend a Black woman. These results have prompted a burgeoning literature on moral licensing, albeit one that is mixed and has been found to exhibit substantial publication bias.

In the current study, Xiao et al. (2023) propose a large online replication of Study 2 in Monin and Miller (2001), asking whether previous moral behaviours that furnish participants with moral credentials make them more likely to then engage in morally questionable behaviours. The authors will also extend earlier work by testing whether moral credentials license immoral behaviours more effectively in the same domain (e.g. within sex) than in a different domain (e.g. across sex and race), asking whether there is a negative relationship between expression of prejudice and trait reputational concern (fear of negative evaluation), and whether moral credentials attenuate any such observed relationship.

URL to the preregistered Stage 1 protocol: https://osf.io/uxgrk

Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.

List of eligible PCI RR-friendly journals:

References

1. Monin, B., & Miller, D. T. (2001). Moral credentials and the expression of prejudice. Journal of Personality and Social Psychology, 81, 33-43. https://psycnet.apa.org/doi/10.1037/0022-3514.81.1.33

2. Xiao, Q., Ching Li, L., Au, Y. L., Chung, W. T., Tan, S. N. & Feldman, G. (2023). Licensing via credentials: Replication of Monin and Miller (2001) with extensions investigating the domain-specificity of moral credentials and the association between the credential effect and trait reputational concern, in principle acceptance of Version 5 by Peer Community in Registered Reports. https://osf.io/uxgrk

15 Jun 2023

STAGE 1

Revisiting the impact of affection on insurance purchase and claim decision-making: Replication and extensions Registered Report of Hsee and Kunreuther (2000)

Yan Yi (Veronica) Law, Gilad Feldman https://osf.io/ye864

Understanding how object-oriented emotional attachment influences economic response to loss

Recommended by Chris Chambers based on reviews by Bence Palfi, Rima-Maria Rahal and Fausto Gonzalez

Emotion is a well-established mediator of decision-making, including prospective economic decisions, but does it affect the way we respond economically to loss? According to classic economic theories, when an object is lost and cannot be recovered, our emotional attachment to that object should be irrelevant for decisions such as choosing whether to claim insurance or compensation. Intriguingly, however, this does not appear to be the case: in a series of experiments, Hsee and Kunreuther (2000) found that when people have higher affection towards an object, they are more sensitive to its loss and are more willing to claim compensation or purchase insurance for the object. They explained these findings according to an influential “consolation hypothesis” in which people see insurance compensation as means to mitigate against the emotional distress associated with property loss.

Using a large online sample (N=1000), Law and Feldman (2023) propose to replicate four of six studies from Hsee and Kunreuther (2000), each asking (primarily) whether people with higher affection towards an object are more willing to claim compensation or purchase insurance for that object. In each experiment, participants are randomly assigned to either a high affection group or a low affection group and then given a scenario in which the level of affection to an object is correspondingly manipulated while the monetary value is held constant. For example, for high affection: “You liked the now-damaged painting very much and you fell in love with it at first sight. Although you paid only $100, it was worth a lot more to you”, and for low affection: “You were not particularly crazy about the now-damaged painting. You paid $100 for it, and that’s about how much you think it was worth.” A range of dependent measures are then collected, including the maximum hours participants would be willing to spend driving to claim compensation, the maximum amount participants would be willing to pay for insurance, and how likely participants would be to claim compensation or purchase insurance. As part of the replication, the authors have also built in manipulation checks to confirm that the scenarios influenced participants' (imagined) level of affection for the object, and a range of exploratory analyses.

URL to the preregistered Stage 1 protocol: https://osf.io/b7y5z

Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.

List of eligible PCI RR-friendly journals:

References

1. Hsee, C. K., & Kunreuther, H. C. (2000). The affection effect in insurance decisions. Journal of Risk and Uncertainty, 20, 141-159. https://doi.org/10.1023/A:1007876907268

2. Law, Y. Y. & Feldman, G. (2023). Revisiting the impact of affection on insurance purchase and claim decision-making: Replication and extensions Registered Report of Hsee and Kunreuther (2000), in principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/b7y5z

08 Jun 2023

STAGE 2
(Go to stage 1)

Communicating Dynamic Norms With Visual Cues

Alaa Aldoh, Paul Sparks, Peter R. Harris https://doi.org/10.31234/osf.io/tac3j

No short-term benefit of a dynamic norm intervention on reducing indicators of meat consumption

Recommended by Chris Chambers based on reviews by Gabriela Jiga-Boy

Human meat consumption is associated with a variety of risks to health, animal welfare, sustainability, and the environment (including greenhouse gas emissions and loss of biodiversity), prompting a growing research effort to develop psychological interventions to reduce it and encourage alternative diets. At the same time, although meat consumption remains the majority choice in the UK, its prevalence is declining, with the proportion of vegetarians and vegans increasing substantially over the last two decades.

One potential tool to accelerate behaviour change is to expose people to “dynamic norm” messaging, which, rather than providing static descriptive information about the prevalence of a desired behaviour, emphasises how the desired behaviour is changing over time so that people can begin to conform to the emerging trend. Although promising in theory, previous research offers mixed evidence on the effectiveness of dynamic norms in encouraging a reduction in meat consumption, with some studies suggesting benefits and others showing no effect or even counterproductive effects. The methodological rigour of some studies is also in question.

In the present study, Aldoh et al. (2023) investigated the effectiveness of dynamic norm information (compared to static norms) on several indicators of meat consumption, including interest, attitudes, and intentions toward reducing meat consumption, as well as self-reported meat consumption itself. Using an online sample of ~1500 participants, the authors also tested the role of visual cues (including data trend graphics) in causing any effects and explored the potential longevity of the intervention over a period of 7 days. Results revealed moderate evidence for no net effect of dynamic (compared to static) norm information on meat consumption outcomes, nor any positive change over the 7-day period. However, the addition of visual cues enhanced the effect of dynamic norm messages, suggesting potential avenues for increasing the potency of future messaging interventions.

The Stage 2 manuscript was evaluated over one round of in-depth review, following which the recommender judged that the manuscript met the Stage 2 criteria and awarded a positive recommendation.

URL to the preregistered Stage 1 protocol: https://osf.io/txzvm

Level of bias control achieved: Level 6. No part of the data or evidence that was used to answer the research question was generated until after IPA.

List of eligible PCI RR-friendly journals:

References

1. Aldoh, A., Sparks, P. & Harris, P. R. (2023). Communicating dynamic norm information [Stage 2]. Acceptance of Version 1 by Peer Community in Registered Reports. https://doi.org/10.31234/osf.io/tac3j

23 May 2023

STAGE 1

Does Brooding Meaningfully Increase the Likelihood of Believing in a Conspiracy? A Registered Report

Luisa Liekefett, Simone Sebben, Julia C. Becker https://osf.io/qf2av?view_only=5286ad5b89584a0ba7d1f238db9aa0b4

Does brooding increase conspiracy beliefs?

Recommended by Chris Chambers based on reviews by Matt Williams and 1 anonymous reviewer

In the current study, Liekefett et al. (2023) investigate the critical role of rumination – a perseverative and repetitive focus on negative content leading to emotional distress. In particular, the authors ask whether one component of rumination referred to as brooding (dwelling on one’s worries and distressing emotions) has a specific causal role in the formation of conspiracy beliefs. In a series of preliminary experiments, the authors first established a procedure for successfully inducing rumination, identifying various boundary conditions and requirements for a successful design. In the proposed study (of up to N=1,638), they will then ask whether the induction of brooding causes a significant increase in conspiracy beliefs. Manipulation checks will be included to confirm intervention fidelity (independently of this hypothesis), and exploratory analyses will test the effect of various moderators, as well as the causal role of a complementary manipulation of reflection – a component of rumination in which attention is focused on the issue at hand rather than one’s emotions.

URL to the preregistered Stage 1 protocol: https://osf.io/y82bs

Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.

List of eligible PCI RR-friendly journals:

References

2. Liekefett, L. Sebben, S. & Becker, J. C. (2023). Does Brooding Meaningfully Increase the Likelihood of Believing in a Conspiracy? Stage 1 Registered Report, in principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/y82bs

21 May 2023

STAGE 2
(Go to stage 1)

Sunk cost effects for time versus money: Replication and extensions Registered Report of Soman (2001)

Nikolay PETROV, Yin Kan (Megan) CHAN, Cheuk Nam (Chris) LAU, Tin Ho (Donald) KWOK, Lok Ching (Estelle) CHOW, Wai Yan (Vivian) LO, Wenkai SONG, Gilad FELDMAN https://doi.org/10.17605/OSF.IO/PM264

Mixed evidence for the hypothesis that sunk cost effects are weaker for time than money

Recommended by Chris Chambers based on reviews by Christopher Olivola and Dilip Soman

The sunk cost fallacy is a cognitive bias in which people persist with a decision that is no longer optimal because of previous resources they have invested (now considered to be spent or “sunk”). Most of us will have heard sunk costs reflected in the saying “throwing good money after bad”, but sunk costs can, in theory, occur more broadly, whether for money, time or any other resource-limited investment. The sunk cost effect for money has been widely studied and appears robust; in contrast, the sunk cost effect for time is more uncertain, and is potentially moderated by the age of respondents (and likely resource availability), the fact that time is irreplaceable, and the tendency for people to account for time less easily than they do for money. In an impactful study, Soman (2001) found that the sunk cost effect for time was indeed weaker than for money, although this finding has not been widely replicated.

In the current study, Petrov et al. (2023) replicated three studies (1, 2 and 5) from Soman (2001), asking whether sunk costs are weaker for time than for money, and then testing whether the relative absence of a sunk time cost arises from the inability of participants to account for time or due to more rational beliefs in the evaluation of past time investments.

Results provided mixed support for the original findings. Consistent with Soman (2001), the sunk cost effect for money was reliably stronger than for time in Study 1; however, sunk costs for both money and time were comparable in Study 2 (and if anything, slightly stronger for time). The indirect replication of Study 5 from Soman (2001) found that the sunk cost effect for time was not significantly influenced by accounting for time, either using education or by highlighting opportunity costs. Robustness checks confirmed the main preregistered outcomes while also ruling out a range of potential alternative explanations. Overall, the results suggest that that sunk cost effects for time are more context-dependent and empirically volatile than sunk costs for money.

URL to the preregistered Stage 1 protocol: https://osf.io/65htv

References

1. Soman, D. (2001). The mental accounting of sunk time costs: Why time is not like money. Journal of Behavioral Decision Making,14, 169-185. https://doi.org/10.1002/bdm.370

2. Petrov, N. B., Chan, Y. K., Lau, C. N., Kwok, T. H., Chow, L. C., Lo, W. Y. V, Song W., & Feldman, G. (2023). Sunk cost effects for time versus money: Replication and extensions Registered Report of Soman (2001), acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/q9s6p

20 Apr 2023

STAGE 1

The relationship of memory consolidation with task incorporations into dreams – A registered report

Sarah F. Schoch, Somayeh Ataei, Leila Salvesen, Michael Schredl, Jennifer Windt, Giulio Bernardi, Björn Rasch, Nikolai Axmacher, and Martin Dresler https://osf.io/h9t3v

Are dreams important for memory consolidation?

Recommended by Chris Chambers based on reviews by 1 anonymous reviewer

Sleep is known to be crucial for human memory, but what about dreams? Previous research has shown that the content of dreams can be manipulated by specific stimuli or tasks prior to sleep, but whether incorporating tasks into dreams influences memory consolidation is less clear. Some studies have shown an association between incorporating memory tasks into dreams and later memory performance, while others show either no effect or weaker effects. Potential reasons for this variation include the targeting of different stages of sleep – including rapid eye moment (REM) and non-REM stages (NREM) – small sample sizes, and the fact that many previous studies do not employ declarative memory tasks, which have been found to benefit more from sleep compared with tasks that target procedural memory.

In the current study. Schoch et al. (2023) ask whether dreams are an epiphenomenon of sleep-dependent memory processing or, instead, whether they play a key role in memory consolidation – and if so, whether that role differs for subjective experiences during NREM and REM sleep stages. Using a declarative memory task, a serial awakening paradigm (in which participants are woken and tested during NREM or REM stages), and targeted memory reactivation (TMR), the authors will test two main hypotheses: that incorporating picture categories of a declarative memory task leads to immediate (next morning) and sustained (4 days later) improvement in memory performance (especially for NREM dreams); and second, whether TMR influences the reported content of dreams. The authors also build in a range of control analyses to confirm that the task was incorporated successfully into dreams and that TMR benefited memory performance.

The Stage 1 manuscript was evaluated over two rounds of in-depth review, initially at Nature Communications before being transferred to PCI RR for further evaluation (see review history below for details). Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).

URL to the preregistered Stage 1 protocol: https://osf.io/7dwjz

References

1. Schoch, S. F., Ataei, S., Salvesen, L., Schredl, M., Windt, J., Bernadi, G., Rasch, B., Axmacher, N., & Desler, M. (2023). The relationship of memory consolidation with task incorporations into dreams – A registered report, in principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/7dwjz

11 Apr 2023

STAGE 2
(Go to stage 1)

Stage 2 Registered Report: Stress regulation via being in nature and social support in adults, a meta-analysis

Alessandro Sparacio, Ivan Ropovik, Gabriela M. Jiga-Boy, Adar Cem Lağap, Hans IJzerman https://doi.org/10.31234/osf.io/a4zmj

Does emotional support and being in nature influence stress?

Recommended by Chris Chambers based on reviews by Felix Schönbrodt and Siu Kit Yeung

Stress is a familiar presence in modern life and may be rising in severity (Almeida et al., 2020). As a key driver of many health problems, controlling stress and its impacts is a central goal in clinical and health psychology, yet the effectiveness of existing interventions to regulate stress remains unclear.

In the current study, Sparacio et al tackled this question from a meta-analytic perspective, focusing on a corpus of existing research that has addressed the efficacy of two specific stress regulation interventions: being in nature and emotional social support. As well as evaluating the evidential content of the relevant literatures, the authors also examined signs of publication bias and the moderating role of personality traits.

After correcting for publication bias, the results reveal evidence that being in nature is effective at reducing stress while emotional social support is not. The moderating role of personality for both interventions was inconclusive due to lack of evidence. In addition, the quality of the surveyed literature was found to be low overall, suffering from a high risk of bias and high rate of statistical reporting errors. The authors offer several recommendations to improve the rigour and quality of studies in this field, including open data, open materials, code review, preregistration and the use of Registered Reports.

URL to the preregistered Stage 1 protocol: https://osf.io/c25qw

Level of bias control achieved: Level 3. At least some data/evidence that was used to the answer the research question had been previously accessed by the authors (e.g. downloaded or otherwise received), but the authors certify that they did not observe ANY part of the data/evidence prior to Stage 1 IPA.

List of eligible PCI RR-friendly journals:

References

1. Almeida, D. M., Charles, S. T., Mogle, J., Drewelies, J., Aldwin, C. M., Spiro, A. III, & Gerstorf, D. (2020). Charting adult development through (historically changing) daily stress processes. American Psychologist, 75(4), 511–524. https://doi.org/10.1037/amp0000597

2. Sparacio, A., Ropovik, I., Jiga-Boy, G. M., Lağap, A. C. & IJzerman, H. (2023). Stage 2 Registered Report: Stress regulation via being in nature and social support in adults, a meta-analysis. Acceptance of version 2 by Peer Community in Registered Reports. https://doi.org/10.31234/osf.io/a4zmj

11 Apr 2023

STAGE 2
(Go to stage 1)

Does childhood adversity alter opioid drug reward? A conceptual replication in outpatients before surgery

Molly Carlyle1*, Malin Kvande*, Isabell M. Meier, Martin Trøstheim, Kaja Buen, Eira Nordeng Jensen, Gernot Ernst, Siri Leknes, Marie Eikemo (*denotes equal contribution) https://doi.org/10.17605/OSF.IO/XR2VB

Is childhood adversity associated with a heightened response to opioids?

Recommended by Chris Chambers based on reviews by Zoltan Dienes, Yuki Yamada and 1 anonymous reviewer

A convergence of evidence suggests that early life adversity may cause dysfunction in opioid-sensitive reward systems. Childhood adversity is associated with opioid use, potentially by altering reward and motivation networks, and experimental models in animals have found that early life adversity increases and consolidates opioid seeking behaviours. Further, in a recent controlled experiment, Carlyle et al. (2021) found that opioid administration produced stronger positive responses, and weaker negative responses, in adults with a history of childhood abuse and neglect.

In the current study, Carlyle et al. (2023) tested the generalisability of these previous findings in a pre-operative clinical setting. Using partially observed data from an existing cohort study (N=155), the authors asked whether patients with greater experience of childhood trauma in turn exhibit a larger mood boost and express greater subjective pleasure following opioid administration.

In contrast to previous findings, the results did not support the hypotheses that more experiences of childhood adversity would heighten ratings of drug liking and feeling good following opioid administration. Regression analyses instead revealed a statistically significant negative association between childhood adversity and post-opioid liking and no significant relationship with feeling good. The authors suggest that the discrepancy between the current and previous results may be due to stress related to the pre-surgical setting, the brief duration of drug exposure, and the relatively limited levels of high childhood adversity in the study sample. Nevertheless, these findings cast some doubt on the theory that adversity elevates risk of opioid addiction by altering sensitivity to subjectively pleasurable effects.

Following one round of in-depth review, the recommender judged that the manuscript met the Stage 2 criteria and awarded a positive recommendation.

URL to the preregistered Stage 1 protocol: https://osf.io/7ymts

Level of bias control achieved: Level 2. At least some data/evidence that was used to answer the research question had been accessed and partially observed by the authors prior to IPA, but the authors certify that they had not yet observed the key variables within the data that were used to answer the research question AND they took additional steps to maximise bias control and rigour.

List of eligible PCI RR-friendly journals:

References

1. Carlyle M., Broomby R., Simpson G., Hannon R., Fawaz L., Mollaahmetoglu O.M., Drain, J., Mostazir, M., & Morgan C. (2021). A randomised, double‐blind study investigating the relationship between early childhood trauma and the rewarding effects of morphine. Addiction Biology, 26(6):e13047. https://doi.org/10.1111/adb.13047

2. Carlyle, M., Kvande, M., Meier, I. M., Trøstheim, M., Buen, K., Jensen, E. N., Ernst, G. & Leknes, S. & Eikemo, M. (2023). Does childhood adversity alter opioid drug reward? A conceptual replication in outpatients before surgery, acceptance of Version 2 by Peer Community in Registered Reports. https://osf.io/9kt3a?view_only=4238d2ee3d654c4f908a94efea82a027

11 Apr 2023

STAGE 1

The link between Empathy and Forgiveness: Replication and extensions of McCullough et al. (1997)'s Study 1

Chan Chi Fung, Gilad Feldman https://osf.io/hxdms

Is empathy important for forgiveness?

Recommended by Chris Chambers based on reviews by Wenrui Cao, James Bartlett and Saleh Shuqair

In the current study, Chan and Feldman (2023) seek to replicate a formative study by McCullough et al (1997) that led to the so-called Empathy Model of forgiveness. According to this theory, forgiving is a motivational change facilitated (crucially) by empathy, promoting constructive over destructive behaviour toward the offender. Chan and Feldman will replicate Study 1 from McCullough et al., measuring the correlational relationship between apology, forgiving, and empathy for offenders, and exploring whether forgiving is associated with increased conciliation and decreased avoidance motivation. As well as closely replicating the original study, the authors will extend it to test the more severe hypothesis that empathy causally influences forgiveness. To achieve this, they will experimentally manipulate empathy by adding two groups to the design: one in which participants are asked to recall hurtful past experiences in which they were not empathetic to the offender, and another in which they were highly empathetic.

URL to the preregistered Stage 1 protocol: https://osf.io/q78fs

References

2. Chan, C. F. & Feldman, G. (2023). The link between Empathy and Forgiveness: Replication and extensions of McCullough et al. (1997)'s Study 1, in principle acceptance of Version 2 by Peer Community in Registered Reports. https://osf.io/q78fs

23 Mar 2023

STAGE 2
(Go to stage 1)

Revisiting the role of public exposure and moral beliefs on feelings of shame and guilt: Replication Registered Report of Smith et al. (2002)’s Study 1

Yikang Zhang, Fung Chit (Jack) Cheung, Hei Tung (Patrina) Wong, Lok Yee (Noel) Yuen, Hui Ching (Rachel) Sin, Hiu Tung Kristy Chow, Gilad Feldman https://doi.org/10.17605/OSF.IO/J3UE4

The effect of public exposure and moral beliefs on feelings of shame and guilt

Recommended by Chris Chambers based on reviews by Uriel Haran

Shame and guilt are powerful negative emotions that are notable for their external vs. internal focus: while shame is generally experienced in response to public scrutiny, guilt arises from a self-directed, private evaluation. In a formative study, Smith et al. (2002) asked whether the level of public exposure influenced levels of shame and guilt arising from one's transgressions, and found that, compared to private situations, public exposure was more strongly associated with shame than with guilt. Since then, these findings have had significant implications for theories and applications of moral psychology.

In the current study, Zhang et al. (2023) directly replicated Smith et al. (2002) in a large online sample, revisiting two critical questions from Study 1: (a) whether public exposure affects the magnitude of shame and guilt over one’s misconduct, and (b) whether stronger moral belief increases guilt and shame over one’s misconduct. The results fail to confirm the original conclusions: both public exposure and manipulation of moral beliefs were found to influence shame and guilt, with no reliable evidence that shame was influenced more strongly than guilt. These findings thus constitute a non-replication and offer a challenge to theoretical models that hinge on the separability of shame and guilt as separate constructs.

URL to the preregistered Stage 1 protocol: https://osf.io/j7kt2

Level of bias control achieved: Level 6. No part of the data or evidence that was used to answer the research question was generated until after IPA.

List of eligible PCI RR-friendly journals:

References

1. Smith, R. H., Webster, J. M., Parrott, W. G., & Eyre, H. L. (2002). The role of public exposure in moral and nonmoral shame and guilt. Journal of Personality and Social Psychology, 83, 138-159. https://doi.apa.org/doi/10.1037/0022-3514.83.1.138

2. Zhang, Y., Cheung, F. C., Wong, H.T., Yuen, L. Y., Sin, H. C., Chow, H. T. & Feldman, G. (2023). Revisiting the role of public exposure and moral beliefs on feelings of shame and guilt: Replication Registered Report of Smith et al. (2002)’s Study 1. Acceptance of Version 5 by Peer Community in Registered Reports. https://osf.io/jpx87

23 Mar 2023

STAGE 2
(Go to stage 1)

Revisiting the links between numeracy and decision making: Replication Registered Report of Peters et al. (2006) with an extension examining confidence

Minrui Zhu, Gilad Feldman https://doi.org/10.17605/OSF.IO/4HJCK

Assessing the replicability of specific links between numeracy and decision-making

Recommended by Chris Chambers based on reviews by Elena Rusconi

Numeracy – the ability to understand and work with numbers – is associated with a wide range of social and health-related outcomes, including socioeconomic status, employment, literacy, reasoning, and life satisfaction. A substantial body of evidence has also shown links between numeracy and decision-making, prompting the question of how it relates to finer-grained measures of reasoning, judgment and affect/emotion.

In the current study, Zhu and Feldman repeated four influential experiments from a study by Peters et al. (2006), which reported links between numeracy and performance on a variety of decision-making tasks, including attribute framing, frequency-percentage framing, susceptibility to affective influences, and various cognitive biases. The authors also explored several extended questions, including refinements of the original hypotheses and an examination of the relationship between numeracy and confidence in numeric judgments (subjective numeracy).

The results broadly constitute a successful replication, with higher numeracy associated with weaker attribute framing and susceptibility to bias. The relationship between numeracy and the frequency-percentage framing effect – that is, the change in decision-making when numbers are presented as frequencies (e.g. 5 out of 100) rather than percentages (e.g. 5%) – was inconclusive for the main analysis that treated numeracy as a categorical variable (low vs. high); however the link emerged reliably in exploratory analyses that considered numeracy as a continuous variable. The outcomes of the extended analyses were mixed, revealing evidence for a potentially weak relationship between numeracy and confidence.

URL to the preregistered Stage 1 protocol: https://osf.io/r73fb

Level of bias control achieved: Level 6. No part of the data or evidence that was used to answer the research question was generated until after IPA.

List of eligible PCI RR-friendly journals:

References

1. Zhu, M. & Feldman, G. (2022). Revisiting the links between numeracy and decision making: Replication Registered Report of Peters et al. (2006) with an extension examining confidence. Acceptance of Version 5 by Peer Community in Registered Reports. https://osf.io/62wqb

2. Peters, E., Västfjäll, D., Slovic, P., Mertz, C. K., Mazzocco, K., & Dickert, S. (2006). Numeracy and decision making. Psychological Science, 17, 407-413. https://doi.org/10.1111%2Fj.1467-9280.2006.01720.x

07 Mar 2023

STAGE 2
(Go to stage 1)

Beneath the label: Unsatisfactory compliance with ESRB, PEGI, and IARC industry self-regulation requiring loot box presence warning labels by video game companies

Leon Y. Xiao https://doi.org/10.31219/osf.io/asbcg

Failure of industry self-regulation in loot box labelling

Recommended by Chris Chambers

Paid loot boxes – items bought for real-world money that offer randomised rewards – are a prevalent feature of contemporary video games (Zendle et al., 2020). Because they employ random chance to provide rewards after spending real money, loot boxes have been considered a form of gambling, raising concerns about risk of harm to children and other vulnerable users. In response, some countries have taken legal steps to regulate and even ban the use of loot boxes, with only limited success so far (Xiao, 2022). At the same time, the Entertainment Software Rating Board (ESRB) and PEGI (Pan-European Game Information) now expect games that contain loot boxes to be marked with warning labels that, in theory, will enable users (including parents) to make more informed decisions. These requirements by ESRB/PEGI are not legally binding and may be considered a form of industry self-regulation.

In the current study, Xiao (2023) investigated the effectiveness of self-regulation in the use of loot box labels. Study 1 examined the consistency of warning labels by the ESRB and PEGI, with the expectation that if self-regulation works as it should then these labels should always (or nearly always) co-occur. Study 2 established the compliance rate for labelling among popular games that are known to contain loot boxes, with a rate of ≥95% considered to be successful.

The results of both studies reveal deficiences in industry self-regulation. The consistency rate of warning labels by the ESRB and PEGI was just 39.4% in preregistered analyses, rising to 83.9% in an unregistered exploratory analysis that took into account industry responses to the findings. Even at this upper bound, this rate is lower than expected by complete (or near-complete) consistency. The results of Study 2 indicate that only 29% of games on the Google Play Store known to contain loot boxes were accurately labelled, indicating that 71% were non-compliant with industry requirements.

Following careful evaluation, the recommender judged that the manuscript met the Stage 2 criteria and awarded a positive recommendation.

URL to the preregistered Stage 1 protocol: https://osf.io/e6qbm

Level of bias control achieved: Level 3. At least some data/evidence that was used to the answer the research question had been previously accessed by the authors (e.g. downloaded or otherwise received), but the authors certifed that they had not yet observed ANY part of the data/evidence prior to in-principle-acceptance.

List of eligible PCI RR-friendly journals:

References

1. Zendle, D., Meyer, R., Cairns, P., Waters, S., & Ballou, N. (2020). The prevalence of loot boxes in mobile and desktop games. Addiction, 115(9), 1768-1772. https://doi.org/10.1111/add.14973

2. Xiao, L. Y. (2022). Breaking Ban: Belgium’s ineffective gambling law regulation of video game loot boxes. Stage 2 Registered Report, acceptance of Version 2 by Peer Community in Registered Reports. https://doi.org/10.31219/osf.io/hnd7w

3. Xiao, L. Y. (2023). Beneath the label: Unsatisfactory compliance with ESRB, PEGI, and IARC industry self-regulation requiring loot box presence warning labels by video game companies, acceptance of Version 2 by Peer Community in Registered Reports. https://doi.org/10.31219/osf.io/asbcg

10 Feb 2023

STAGE 2
(Go to stage 1)

Neuroanatomical Correlates of System-justifying Ideologies: A Pre-registered Voxel-based Morphometry Study on Right-Wing Authoritarianism and Social Dominance Orientation

Jan Paolo M. Balagtas, Serenella Tolomeo, Bindiya L. Ragunath, Paola Rigo, Marc H. Bornstein & Gianluca Esposito https://doi.org/10.17605/OSF.IO/9AEBG

No definitive evidence for neuroanatomical correlates of system-justifying ideologies

Recommended by Chris Chambers based on reviews by Bonni Crawford and 1 anonymous reviewer

According to the tenets of system justification theory, system-justifying ideologies are beliefs held by individuals to defend and justify the status quo, even when doing do perpetuates social inequalities (Jost and Hunyady, 2005). Two such well-studied ideologies to emerge from political science and social psychology are social dominance orientation (SDO) – the belief that some social groups are superior to others – and right wing authoritarianism (RWA) – the belief that people should follow conventional traditions and authorities, avoiding rebellious ideas. Although considered to be stable traits that may have a heritable basis, there has been little investigation of the neural correlates of SDO and RWA, and it remains unknown whether they are associated with common or distinct brain systems.

In the current study, Balagtas et al. report a novel investigation of the neuroanatomical correlates of both SDO and RWA in a Chinese Singaporean sample using voxel-based morphometry. Based on previous research, the authors chose to focus especially on relationships between SDO, RWA and the volume of the amygdala, ventromedial prefrontal cortex, and anterior insula.

As predicted, the results showed a reliable positive correlation between measures of RWA and SDO; however, none of the neuroanatomical hypotheses were fully supported. Preregistered whole brain analyses revealed no significant regions associated with either RWA or SDO, while ROI analyses identified overlapping (including the amygdala and ventromedial prefrontal cortex) and non-overlapping regions (including left anterior insula) associated with RWA and SDO. Exploratory robustness checks suggested that the authors' spherical ROI localisation method may have identified clusters that were not within the amygdala or left anterior insula, prompting the need for future replication in a larger sample using more precise, atlas-based analyses.

The Stage 2 manuscript was evaluated over two rounds of in-depth review. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 2 criteria and awarded a positive recommendation.

URL to the preregistered Stage 1 protocol: https://osf.io/btkwq

Level of bias control achieved: Level 4. At least some of the data/evidence that was used to answer the research question already existed AND was accessible in principle to the authors (e.g. residing in a public database or with a colleague) BUT the authors certified that they had not yet accessed any part of that data/evidence prior to IPA.

List of eligible PCI RR-friendly journals:

References

1. Jost, J. T., & Hunyady, O. (2005). Antecedents and consequences of system-justifying ideologies. Current Directions in Psychological Science, 14, 260-265. https://doi.org/10.1111%2Fj.0963-7214.2005.00377.x

2. Balagtas, P. M., Tolomeo, S., Ragunath, B., Rigo, P., Bornstein, M. H. & Esposito, G. (2023). Neuroanatomical Correlates of System-justifying Ideologies: A Pre-registered Voxel-based Morphometry Study on Right-Wing Authoritarianism and Social Dominance Orientation. Stage 2 Registered Report, acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/nrqtz

09 Feb 2023

STAGE 1

The Medusa effect: A registered replication report of Will, Merritt, Jenkins, and Kingstone (2021)

Jing Han, Minjun Zhang, Jiaxin Liu, Yu Song, Yuki Yamada https://osf.io/bjt37

Looking (again) at Medusa: does pictorial abstraction influence mind perception?

Recommended by Chris Chambers based on reviews by Alan Kingstone, Brittany Cassidy and 3 anonymous reviewers

The Medusa effect is a recently described phenomenon in which people judge a person to be more mindful when they appear as a picture than as a picture within a picture. Across a series of experiments, Will et al. (2021) reported that at higher levels of abstraction, images of people were judged lower in realness (how real the person seemed), experience (the ability to feel) and agency (the ability to plan and act), and also benefited less from prosocial behaviour. The findings provide an intriguing window into mind perception – the extent to which we attribute minds and mental capacities to others.

In the current study, Han et al. (2023) propose a close replication of two experiments from the original report by Will et al. (2021), asking first, whether the level of pictorial abstraction influences ratings of realness, agency and experience, and second, whether it also influences prosocial behaviour as measured in the dictator game (with participants predicted to allocate more money to recipients presented as pictures than as pictures within pictures). In the event of a non-replication using the original materials, the authors will further repeat the experiments using newly generated stimuli that are better matched for cultural context and more tightly controlled along various dimensions.

References

2. Han, J., Zhang, M., Liu, J., Song, Y. & Yamada, Y. (2023).The Medusa effect: A registered replication report of Will, Merritt, Jenkins, and Kingstone (2021), in principle acceptance of Version 2 by Peer Community in Registered Reports. https://osf.io/xj46z

06 Feb 2023

STAGE 1

Investigating the impact of vascular risk factors on the progression of white matter lesions

Frauke Beyer,Laurenz Lammer, Markus Loeffler, Steffi Riedel-Heller, Arno Villringer, Veronica Witte https://osf.io/phctk

Understanding predictors of white matter lesions in the human brain

Recommended by Chris Chambers based on reviews by Max Elliott, Isabel Garcia Garcia and 1 anonymous reviewer

The presence of CSVD is associated with white matter lesions (WML) detected using neuroimaging, which have in turn been shown to predict future stroke, cognitive decline and dementia. While vascular risk factors of CSVD (such as hypertension and obesity) are also associated with CSVD, a complete picture of the predictive relationship between WML, cognitive decline, and blood pressure remains to be determined, as does the role of sex/gender. These inter-relationships are important to determine for improving the diagnosis and treatment of CSVD.

In the current study, Beyer et al. will analyse a large emerging dataset from the LIFE-Adult project – a longitudinal, two-wave, population-based study – to ask whether higher blood pressure predicts a greater increase in WML, and whether progression of WML is associated with measures of memory and executive function. In addition, the authors will explore the relationship between abdominal obesity and WML progression, and the extent to which WML progression, and its interaction with vascular risk factors, depends on sex/gender.

Level of bias control achieved: Level 2. At least some data/evidence that will be used to answer the research question has been accessed and partially observed by the authors, but the authors certify that they have not yet observed the key variables within the data that will be used to answer the research question.

List of eligible PCI RR-friendly journals:

References

1. Beyer, F., Lammer, L., Loeffler, M., Riedel-Heller, S., Villringer, A. & Witte, V. (2023). Investigating the impact of vascular risk factors on the progression of white matter lesions, in principle acceptance of Version 2 by Peer Community in Registered Reports. https://osf.io/qkbgj

23 Jan 2023

STAGE 1

Genetically-modified animals as models of neurodevelopmental conditions: an umbrella review

Emma Wilson; Gillian Currie; Malcolm Macleod; Peter Kind; Emily S Sena https://osf.io/4xvgp

Evaluating the quality of systematic reviews in preclinical animal studies of neurodevelopmental conditions

Recommended by Chris Chambers based on reviews by Marietta Papadatou-Pastou and Richel Bilderbeek

Single gene alterations have been estimated to account for nearly half of neurodevelopmental conditions (NDCs), providing a crucial opportunity for animal models to understand the underlying mechanisms, causes and potential treatments. The use of systematic reviews (SRs) can, in principle, provide a powerful means to synthesise this evidence-base; however, the reporting quality of previous SRs in preclinical animal research has been found lacking (Hunniford et al., 2021). In the current study, Wilson et al. (2023) will undertake an umbrella review – a systematic review of systematic reviews – to assess the characteristics and reporting quality of SRs that, in turn, synthesise research in genetically-modified animals to model NDCs. In particular, the authors will extract key features of reviews (including, among others, the aim and primary research questions, relevant animal model, and number of studies in the SR), in addition to quality indicators such as risk of bias and completeness of reporting. In doing so, the authors aim to enhance guidance on the conduct and reporting of systematic reviews in this area.

Level of bias control achieved: Level 4. At least some of the data/evidence that will be used to answer the research question already exists AND is accessible in principle to the authors BUT the authors certify that they have not yet accessed any part of that data/evidence.

List of eligible PCI RR-friendly journals:

References

2. Wilson, E., Currie, G., Macleod, M., Kind, P. & Sena, E. S. (2023). Genetically-modified animals as models of neurodevelopmental conditions: an umbrella review, in principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/952qk

23 Jan 2023

STAGE 1

Comparing time versus money in sunk cost effects: Replication of Soman (2001)

Nikolay Petrov, Wenkai Song, Yin Kan (Megan) CHAN, Cheuk Nam (Chris) LAU, Tin Ho (Donald) KWOK, Lok Ching (Estelle) CHOW, Wai Yan (Vivian) LO, Gilad Feldman (gfeldman@hku.hk) https://osf.io/twehu

Are sunk cost effects weaker for time than money?

Recommended by Chris Chambers based on reviews by Johanna Peetz, Christopher Olivola, David Ronayne, Johannes Leder and Dilip Soman

In the current study, Petrov et al. (2023) propose a replication of three studies from Soman (2001), asking whether sunk costs are weaker for time than for money, and then testing whether the relative absence of a sunk time cost arises from the inability of participants to account for time or due to more rational beliefs in the evaluation of past time investments.

References

1. Soman, D. (2001). The mental accounting of sunk time costs: Why time is not like money. Journal of Behavioral Decision Making,14, 169-185. https://doi.org/10.1002/bdm.370

2. Petrov, N. B., Chan, Y. K., Lau, C. N., Kwok, T. H., Chow, L. C., Lo, W. Y. V, Song W., & Feldman, G. (2023). Sunk cost effects for time versus money: Replication of Soman (2001) [Registered Report Stage 1], in principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/u34zb

23 Jan 2023

STAGE 1

Responding to Online Toxicity: Which Strategies Make Others Feel Freer to Contribute, Believe That Toxicity Will Decrease, and Believe that Justice Has Been Restored?

Alison I. Young Reusser, Houghton University; Kristian Veit, Olivet Nazarene University; Lisa Gassin, Olivet Nazarene University; Jonathan Case, Houghton University https://osf.io/hfjnb

Testing antidotes to online toxicity

Recommended by Chris Chambers based on reviews by Corina Logan and Marcel Martončik

In the current study, Young Reusser et al (2023) propose an experiment to test the effectiveness of three types of responses to online toxicity – Benevolent Correction (including disagreement), Benevolent Going Along (including joking/agreement), or Retaliation (additional toxicity) – on how able participants feel to contribute to conversations, their belief that the toxicity would be reduced by the intervention, and their belief that justice had been restored. The findings promise to shed light on approaches for improving the health of online discourse.

The Stage 1 manuscript was evaluated over two rounds of in-depth review. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).

URL to the preregistered Stage 1 protocol: https://osf.io/hfjnb (under temporary private embargo)

Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.

List of eligible PCI RR-friendly journals:

References

1. Young Reusser, A. I., Veit, K. M., Gassin, E. A., & Case, J. P. (2023). Responding to Online Toxicity: Which Strategies Make Others Feel Freer to Contribute, Believe That Toxicity Will Decrease, and Believe that Justice Has Been Restored? In principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/hfjnb

18 Jan 2023

STAGE 1

Beneath the label: Assessing video games’ compliance with ESRB and PEGI loot box warning label industry self-regulation

Leon Y. Xiao https://osf.io/u7ghb?view_only=60cb55c3c3c74f76a8e170fb498e2789

How effective is self-regulation in loot box labelling?

Recommended by Chris Chambers based on reviews by Pete Etchells and Jim Sauer

In the current study, Xiao (2023) will investigate the effectiveness of self-regulation in the use of loot box labels. Study 1 examines the consistency of warning labels by the ESRB and PEGI, with the expectation that if self-regulation works as it should then these labels should always (or nearly always) co-occur. Study 2 establishes the compliance rate for labelling among popular games that are known to contain loot boxes, with a rate of ≥95% considered to be successful. The findings should prove useful in identifying the success or failure of self-regulation as a means of ensuring industry compliance with loot box labelling.

References

1. Zendle, D., Meyer, R., Cairns, P., Waters, S., & Ballou, N. (2020). The prevalence of loot boxes in mobile and desktop games. Addiction, 115(9), 1768-1772. https://doi.org/10.1111/add.14973

3. Xiao, L. Y. (2023). Beneath the label: Assessing video games’ compliance with ESRB and PEGI loot box warning label industry self-regulation, in principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/e6qbm

17 Jan 2023

STAGE 1

Similarities and differences in a global sample of song and speech recordings

Corresponding authors: Yuto Ozaki and Patrick E. Savage (Keio University, Japan). Full list of 80 authors is in the manuscript https://psyarxiv.com/jr9x7

Exploring cross-cultural variation in speech and song

Recommended by Chris Chambers based on reviews by Bob Slevc, Nai Ding and 1 anonymous reviewer

In the current study, Ozaki et al. (2022) embark on an ambitious project to elucidate cross-cultural similarities and differences between speech and song in 81 different linguistic varieties spanning 23 language families. Understanding precisely how song and speech are related is methodologically challenging due to the multitude of confounds that can arise in comparing natural recordings. Here the authors overcome these difficulties with four types of carefully controlled recordings: singing, recitation of sung lyrics, spoken description of the song, and instrumental version of the sung melody. The authors will then examine six features that are amenable to reliable comparison, including pitch height, temporal rate, pitch stability, timbral brightness, pitch interval size, and pitch declination. With this data in hand, the authors will ask which acoustic features differ reliably between song and speech across cultures, with the expectation that song will exhibit higher pitch, slower rate and more stable pitch than speech. At the same time, the authors expect song and speech to be reliably similar in the characteristics of timbral brightness, pitch intervals and pitch contours. In addition to these confirmatory tests, the authors will explore variation across a range of additional stimulus characteristics and ancillary research questions.

URL to the preregistered Stage 1 protocol: https://osf.io/jdhtz

List of eligible PCI RR-friendly journals:

References

1. Ozaki, Y., Savage P. E. et al. (2022). Similarities and differences in a global sample of song and speech recordings, in principle acceptance of Version 2 by Peer Community in Registered Reports. https://osf.io/jdhtz

02 Dec 2022

STAGE 1

Revisiting the link between anthropomorphism and loneliness with an extension to free will belief: Replication and extensions of Epley et al. (2008)

Mahmoud Elsherif, Christina Pomareda, Qinyu Xiao, Hoi Yan Chu, Ming Chun Tang, Ting Hin (Angus) Wong, Yiming Wu, Gilad Feldman https://osf.io/cj2mx

Are loneliness and free will beliefs associated with anthropomorphism?

Recommended by Chris Chambers based on reviews by John Protzko and Marieke Wieringa

In the current study, Elsherif et al. (2022) propose a partial replication of Epley et al. (2008), focusing on the correlational relationship between anthropomorphism and loneliness, with extensions to examine free will beliefs, anthropomorphism for supernatural beings (in addition to objects/gadgets), and the extent to which participants judged objects/gadgets to be controllable.

References

1. Epley, N., Waytz, A., & Cacioppo, J. T. (2007). On seeing human: A three-factor theory of anthropomorphism. Psychological Review, 114, 864–886. https://doi.org/10.1037/0033-295X.114.4.864

3. Elsherif, M., Pomareda, C., Xiao, Q., Chu, H. Y., Tang, M. C., Wong, T. H., Wu, Y. & Feldman, G. (2022). Revisiting the positive association between loneliness and anthropomorphism with an extension to belief in free will: Replication and extensions of Epley et al. (2008), in principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/by89c

22 Nov 2022

STAGE 1

Estimating the Effect of Reward on Sleep-Dependent Memory Consolidation – A Registered Report

David P. Morgan, Juliane Nagel, N. Cagatay Gürsoy, Simon Kern & Gordon B. Feld https://osf.io/3emj9?view_only=c4a0bcdcbcee423e9e2e61b2e75ff490

How does reward influence the effect of sleep on memory?

Recommended by Chris Chambers based on reviews by 2 anonymous reviewers

Sleep and reward each have an important role in human memory. According to the active system consolidation hypothesis, memory consolidation during sleep originates from the repeated reactivation of memory representations that were encoded during wake (Rasch & Born, 2013). Research has also consistently shown that memory performance is enhanced for items or stimuli associated with higher vs. lower rewards. While these lines of evidence are relatively clear, the role of sleep in shaping the interaction between reward and memory is more opaque, likely due to a combination of methodological variation between studies but also due to the field’s reliance on small-N designs and biased reporting practices. Clarifying this three-way relationship, and setting field benchmarks for effect sizes, is crucial not only for building richer neurocognitive models of memory, but for clinical applications such as targeted sleep interventions to treat addiction and other forms of mental illness.

Using a large, stratified online German sample (N=1750), Morgan et al. (2022) will study the three-way relationship between sleep, reward and memory by asking whether, and if so how, reward influences the magnitude of sleep-dependent memory consolidation. Using an AM:PM-PM:AM design in combination with a motivated learning task, the authors will address three main questions: first, whether sleep yields greater memory performance compared to an equivalent period of wake; second whether information associated with higher reward leads to greater memory performance compared to lower reward; and third, the crucial interaction of whether sleep causes greater recognition memory performance for higher vs. lower reward items. The design also includes a series of rigorous positive controls to confirm testability of the hypotheses, while measuring a host of additional moderating variables for exploratory analyses (including age, education status, mental health, and more).

URL to the preregistered Stage 1 protocol: https://osf.io/q5pk8

Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.

List of eligible PCI RR-friendly journals:

References

1. Rasch, B. & Born, J. (2013). About Sleep's Role in Memory. Physiological Revews, 93, 681–766. https://doi.org/10.1152%2Fphysrev.00032.2012

2. Morgan, D. P., Nagel, J., Cagatay Gürsoy, N., Kern, S. & Feld, G. B. (2022). Estimating the effect of reward on sleep-dependent memory consolidation – A Registered Report, in principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/q5pk8

21 Nov 2022

STAGE 1

Revisiting the motivated denial of mind to animals used for food: Replication and extension of Bastian et al. (2012)

Tyler P. Jacobs, Meiying Wang, Stefan Leach, Siu Ho Loong, Mahika Khanna, Ka Wan Chan, Ho Ting Chau, Yuen Yan Tam, Gilad Feldman https://osf.io/gs4u3

Does denial of animal minds explain the "meat paradox"?

Recommended by Chris Chambers based on reviews by Brock Bastian, Ben De Groeve, Florian Lange and Sebastian Berger

The psychology of meat-eating offers a fascinating window into moral reasoning, cognition and emotion, as well as applications in the shift toward more sustainable and ethical alternatives to meat consumption. One key observation in this field is the so-called “meat paradox” – the tendency for people to simultaneously eat meat while also caring about animals. One way to resolve this conflict and reduce cognitive dissonance is for people to separate the concept of meat from animals, mentally disengaging from the origins of meat in order to make the act of consumption more ethically acceptable. Another potential explanation is a motivated “denial of mind”, in which people believe that animals lack the mental capacity to experience suffering; therefore, eating an animal is not a harm that the animal will experience. In support of the latter hypothesis, Bastian et al (2012) found that animals judged to have greater mental capacities were also judged to less edible, and that simply reminding meat eaters that an animal was being raised for the purposes of meat consumption led to denial of its mental capacities.

Using a large-scale online design in 1000 participants, Jacobs et al. (2022) propose a replication of two studies from Bastian et al. (2012): asking how the perceived mental capabilities of animals relates to both their perceived edibility and the degree of moral concern they elicit, and whether learning that an animal will be consumed influences perceptions of its mental capabilities. Among various exploratory analyses, the authors will also examine whether the perception of animal minds (in animals consumed for meat) varies systematically according to species.

References

2. Jacobs, T. P., Wang, M., Leach, S., Loong, S. H., Khanna, M., Chan, K. W., Chau, H. T., Tam, Y. Y. & Feldman, G. (2022). Revisiting the motivated denial of mind to animals used for food: Replication and extension of Bastian et al. (2012), in principle acceptance of Version 2 by Peer Community in Registered Reports. https://osf.io/cru4z

18 Nov 2022

STAGE 1

Fathers learning on the job: Role of Paternity Leave Duration on Paternal Infant-Directed Speech and Preference for Male Infant-Directed Speech in infants

Silje Robberstad, Natalia Kartushina & Julien Mayor https://osf.io/34h6q?view_only=ab6bac8006444a22a5b3ede3ce6a1173

Dads and baby talk: understanding the role of paternal interaction in infant-directed speech

Recommended by Chris Chambers based on reviews by Naja Ferjan Ramírez, Melanie Soderstrom and Krista Byers-Heinlein

Infant-directed speech (IDS) – colloquially known as “baby talk” – is a form of speech produced by parents that may be important for emotional bonding with children while also helping infants with early language development. In contrast to adult-directed speech (ADS), IDS is characterised by a higher and broader pitch range, slower speech rate, and shorter/simpler syntax. A significant body of research has studied the dynamics of IDS and shown that infants prefer IDS over ADS, however the great majority of this work has focused on maternal speech, leaving much to be discovered about the differences and similarities between paternal and maternal IDS, the relative preference infants exhibit for paternal IDS compared with ADS, and the role of paternal interaction in shaping these dynamics.

Using a Norwegian sample of 70 fathers and children, the proposed study by Robberstad et al. (2022) takes an important step into this less-explored domain, asking whether (and if so, how) fathers employ IDS when interacting with infants, whether any such modulation of speech is related to the amount of time they spend as a caregiver, whether infants show the same preferences for IDS over ADS in fathers as observed previously in mothers, and whether that preference is related to the amount of exposure the infant has to parental speech. The authors will analyse speech modulation using acoustic analysis, while preference for IDS will be tested using eye-tracking to measure infants’ overt gaze orientation while listening to IDS vs ADS.

URL to the preregistered Stage 1 protocol: https://osf.io/c43xu

Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.

List of eligible PCI RR-friendly journals:

References

1. Robberstad, S., Kartushina, N. & Mayor, J. (2022). Fathers learning on the job: Role of paternity leave duration on paternal infant-directed speech and preference for male infant-directed speech in infants, in principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/sjupt

24 Oct 2022

STAGE 2
(Go to stage 1)

Does alleviating poverty increase cognitive performance? Short- and long-term evidence from a randomized controlled trial

Barnabas Szaszi, Bence Palfi, Gabor Neszveda, Aikaterini Taka, Péter Szécsi, Christopher Blattman, Julian C. Jamison, Margaret Sheridan https://doi.org/10.31234/osf.io/4gyzh

No strong effect of unconditional cash transfers on cognition

Recommended by Chris Chambers based on reviews by Charlotte Pennington and Matúš Adamkovič

Recent studies have revealed potential benefits of unconditional cash transfers (UCTs) on a variety of health and social outcomes, including self-reported happiness and life satisfaction (Haushofer & Shapiro, 2016), economic and financial well-being (Blattman et al., 2013; Baird et al., 2018) and educational attainment (Baird et al., 2016). Although the effects of UCTs do not always out-perform rigorous control conditions (Whillans & West, 2022), these findings prompt the question of whether the alleviation of poverty via UCTs can also influence cognitive processing and performance.

In the current study, Szaszi et al. analysed the results of a previous randomised trial of UCTs by Blattman et al. (2017) to test whether a $200 lump sum – equivalent to three months of income – administered to a sample of young men in Liberia carries both short- and long-term benefits for a range of executive functions, including attention, response inhibition, and working memory capacity. Overall, the results suggest minimal if any consequences of the intervention – the observed effects of UCTs on cognition were several times smaller than suggested by previous research, and the evidence for a positive effect was inconclusive. Extensive multiverse analyses showed that these findings were robust to a range of alternative analytical specifications, and the authors estimate that a sample size of nearly 5000 would be required to provide strong evidence.

In their Discussion, the authors explore a range of reasons for the negative findings compared with previous research, including the more rigorous and severe causal test enabled by the randomised trial design, the demographic homogeneity of the sample demographic, the use of pen-and-paper tests (cf. computerised tests in previous studies), and the delivery of a lump-sum cash transfer compared with a regular monthly installment. In addition, although the results were negative or inconclusive, there were hints that a positive effect of UCTs may be more evident in some cognitive domains than in others – in this case, potentially benefiting working memory more than inhibitory control. Further research would be required to confirm this hypothesis.

The Stage 2 manuscript was evaluated over one round of in-depth review. Based on the responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 2 criteria and awarded a positive recommendation.

URL to the preregistered Stage 1 protocol: https://osf.io/k56yv

Level of bias control achieved: Level 2. At least some data/evidence that was used to answer the research question had been accessed and partially observed by the authors prior to Stage 1 acceptance, but the authors certified that they had not yet observed the key variables within the data that would be used to answer the research question AND they took additional steps to maximise bias control and rigour.

List of eligible PCI RR-friendly journals:

References

1. Haushofer, J. & Shapiro, J. (2016). The short-term impact of unconditional cash transfers to the poor: Experimental evidence from Kenya. Quarterly Journal of Economics, 13, 1973–2042. https://doi.org/10.1093/qje/qjw025

2. Blattman, C., Fiala, N. & Martinez, S. (2013) Generating skilled self-employment in developing countries: Experimental evidence from Uganda. Quarterly Journal of Economics, 129, 697–752. https://doi.org/10.1093/qje/qjt057

3. Baird, S., McKenzie, D., & Özler, B. (2018). The effects of cash transfers on adult labor market outcomes. IZA Journal of Development and Migration, 8, 1-20. https://doi.org/10.1186/s40176-018-0131-9

4. Baird, S., Chirwa, E., De Hoop, J., & Özler, B. (2016). Girl power: cash transfers and adolescent welfare: evidence from a cluster-randomized experiment in Malawi. In African Successes, Volume II: Human Capital (pp. 139-164). University of Chicago Press. https://www.nber.org/system/files/chapters/c13380/c13380.pdf

5. Whillans, A., & West, C. (2022). Alleviating time poverty among the working poor: A pre-registered longitudinal field experiment. Scientific Reports, 12(1), 1-17. https://doi.org/10.1038/s41598-021-04352-y

6. Blattman, C., Jamison, J. C. & Sheridan, M. (2017). Reducing crime and violence: Experimental evidence from cognitive behavioral therapy in Liberia. American Economic Review, 107, 1165–1206. http://doi.org/10.1257/aer.20150503

7. Szaszi, B., Palfi, B., Neszveda, G., Taka, A., Szecsi, P., Blattman, C., Jamison, J. C., & Sheridan, M. (2022). Does alleviating poverty increase cognitive performance? Short- and long-term evidence from a randomized controlled trial. Stage 2 Registered Report, acceptance of Version 2 by Peer Community in Registered Reports. https://psyarxiv.com/4gyzh

24 Oct 2022

STAGE 1

Does childhood adversity alter opioid drug reward? A conceptual replication in outpatients before surgery

Molly Carlyle*, Malin Kvande*, Siri Leknes, Isabell Meier, Kaja Buen, Eira Nordeng Jensen, Gernot Ernst, Marie Eikemo. *denotes equal contribution. https://osf.io/qcj5m?view_only=4238d2ee3d654c4f908a94efea82a027

Is childhood adversity associated with a heightened response to opioids?

Recommended by Chris Chambers based on reviews by Zoltan Dienes, Yuki Yamada and 1 anonymous reviewer

In the current study, Carlyle et al. seek to test the generalisability of these previous findings in a pre-operative clinical setting. Using partially observed data from an existing cohort study (N=155), the authors will test whether patients with greater experience of childhood trauma in turn exhibit a larger mood boost and express greater subjective pleasure following opioid administration. Although not a randomised experimental design, this study provides the opportunity to examine the relationship between opioid response and history of childhood adversity in a naturalistic setting, and thus has the potential to either support or cast doubt on the theory that adversity elevates risk of opioid addiction by altering sensitivity to subjectively pleasurable effects.

Following three rounds of in-depth review, the recommender judged that the manuscript met the Stage 1 criteria and awarded in-principle acceptance (IPA).

URL to the preregistered Stage 1 protocol: https://osf.io/7ymts

Level of bias control achieved: Level 2. At least some data/evidence that will be used to answer the research question has been accessed and partially observed by the authors, but the authors certify that they have not yet observed the key variables within the data that will be used to answer the research question AND they have taken additional steps to maximise bias control and rigour.

List of eligible PCI RR-friendly journals:

References

2. Carlyle, M., Kvande, M., Leknes, S., Meier, I., Buen, K., Jensen, E. N., Ernst, G. & Eikemo, M. (2022). Does childhood adversity alter opioid drug reward? A conceptual replication in outpatients before surgery, in principle acceptance of Version 4 by Peer Community in Registered Reports. https://osf.io/7ymts

17 Oct 2022

STAGE 1

Relationship between creativity and depression: the role of reappraisal and rumination

Chin Yui Lam and Jeffrey Allen Saunders https://osf.io/74vpt

Understanding the relationship between creativity and depressive traits

Recommended by Chris Chambers based on reviews by Kate Button and 1 anonymous reviewer

In the current study, Lam and Saunders will use an online design in 200 participants to ask whether creativity is associated with higher depressive traits, and further, whether that relationship depends on two additional variables that could explain an observed positive correlation: self-reflective rumination (repetitive thoughts that maintain a negative mood state) and the frequency with which individuals engage in reappraisal (a regulation strategy that involves reinterpreting an event or situation to diminish its negative impact). If justified by the main confirmatory findings, the authors will also explore the moderating role of gender and how any observed associations are reflected in more fine-grained measures of creativity. The results promise to shed light on not only the basic question of whether creativity is related to depressive traits, but the extent to which that association depends on related determinants of mental health.

Following two rounds of in-depth review, the recommender judged that the manuscript met the Stage 1 criteria and awarded in-principle acceptance (IPA).

URL to the preregistered Stage 1 protocol: https://osf.io/yub7n

Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.

List of eligible PCI RR-friendly journals:

References

1. Verhaeghen, P., Joormann, J., & Khan, R. (2005). Why we sing the blues: The relation between self-reflective rumination, mood, and creativity. Emotion, 5(2), 226-232. https://doi.org/10.1037/1528-3542.5.2.226

2. Lam, C. Y. & Saunders, J. A. (2022). Relationship between creativity and depression: the role of reappraisal and rumination, in principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/yub7n

21 Sep 2022

STAGE 2
(Go to stage 1)

Phenomenological Strands for Gaming Disorder and Esports Play: A Qualitative Registered Report

Veli-Matti Karhulahti, Miia Siutila, Jukka Vahlo, Raine Koskimaa https://doi.org/10.31234/osf.io/q53jz

The lived experience of gamers: a comparative qualitative investigation of treatment-seekers and esports players

Recommended by Chris Chambers based on reviews by Malte Elson and Peter Branney

Since 2018, the inclusion of “gaming disorder” in the ICD-11 has been met with a mixture of interest, confusion and controversy (Van Rooij et al, 2018), mirroring broader debates about the effects of gaming on mental health. One of the major gaps in understanding the validity of gaming disorder as an identifiable mental illness is the absence of qualitative studies comparing the lived experience of gamers who seek treatment with esports players who do not report health problems.

Here, Karhulahti et al. (2022) tackle this question in the first of two Stage 2 Registered Reports associated with their previous programmatic Stage 1 submission. Using interpretative phenomenological analysis in gamers and medical experts, they find that treatment-seekers and esports players differ in how gaming is associated with the sense of self, either interfering with the self for treatment-seekers or successfully integrating into the self for esports players. These findings help to identify the key characteristics of problematic and non-problematic gaming and call for more intensive and wide-reaching qualitative research in this area.

Following one round of in-depth review and revision, the recommender judged that the manuscript met the Stage 2 criteria and awarded a positive recommendation.

URL to the preregistered Stage 1 protocol: https://osf.io/a2rwg

List of eligible PCI RR-friendly journals:

References

2. Karhulahti V-M, Siutila M, Vahlo J, Koskimaa R (2022) Phenomenological Strands for Gaming Disorder and Esports Play: A Qualitative Registered Report. Stage 2 Registered Report, acceptance of Version 2 by Peer Community in Registered Reports. https://doi.org/10.31234/osf.io/q53jz

16 Sep 2022

STAGE 1

Action-Inaction Asymmetries in Emotions and Counterfactual ‎Thoughts: Meta-Analysis of the Action Effect‎

Siu Kit Yeung, Gilad Feldman https://osf.io/ycenp

Charting meta-analytic evidence for the action-effect

Recommended by Chris Chambers based on reviews by Dan Quintana, Emiel Cracco and priyali rajagopal

Winston Churchill once famously quipped, “I never worry about action, but only inaction.” Churchill, however, may have been an exception to the rule, with psychological research suggesting that people are more concerned about the consequences of actions than inactions. During the so-called “action-effect”, first reported by Kahneman and Tversky (1982), people regret an action leading to a bad outcome more than they do an inaction leading to the same bad outcome

In the current study, Yeung and Feldman (2022) propose a wide-ranging meta-analysis to characterise evidence for the action-effect, focusing in particular on emotions and counterfactual thoughts – that is, mental representations of alternative decisions (or “what if” thoughts). Consistent with the expected consequences of the action-effect on emotion, they predict that action will be associated with stronger negative emotions than inaction (when outcomes are negative), and with stronger positive emotions than inaction (when outcomes are positive). The authors also expect action to be associated with a greater abundance of counterfactual thought compared to inaction.

In addition to examining the overall reliability of the action-effect (plus a range of exploratory questions), the study will also examine the extent to which the action-effect is moderated by temporal distance (with more recent events or behaviours predicted to associated with a stronger action effect), the type of study design, prior outcomes and social norms, the specificity (vs. generality) of the prior event, and whether the study employed a hypothetical scenario or a real-life event.

URL to the preregistered Stage 1 protocol: https://osf.io/4pvs6

References

1. Kahneman, D., & Tversky, A. (1982). The psychology of preferences. Scientific American, 246(1), 160-173. https://doi.org/10.1038/scientificamerican0182-160

2. Yeung, S. K. & Feldman, G. (2022). Action-Inaction Asymmetries in Emotions and Counterfactual ‎Thoughts: Meta-Analysis of the Action Effect‎, in principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/4pvs6

08 Sep 2022

STAGE 1

How to succeed in human modified environments

Logan CJ, Shaw R, Lukas D, McCune KB http://corinalogan.com/ManyIndividuals/mi1.html

The role of behavioural flexibility in promoting resilience to human environmental impacts

Recommended by Chris Chambers based on reviews by Gloriana Chaverri, Vedrana Šlipogor and Alizée Vernouillet

Understanding and mitigating the environmental effects of human expansion is crucial for ensuring long-term biosustainability. Recent research indicates a steep increase in urbanisation – including the expansion of cities – with global urban extent expanding by nearly 10,000 km^2 per year between 1985 and 2015 (Liu et al, 2020). The consequences of these human modified environments on animal life are significant: in order to succeed, species must adapt quickly to environmental changes, and those populations that demonstrate greater behavioural flexibility are likely to cope more effectively. These observations have, in turn, prompted the question of whether enhancing behavioural flexibility in animal species might increase their resilience to human impacts.

In the current research, Logan et al. (2022) will use a serial reversal learning paradigm to firstly understand how behavioural flexibility relates to success in avian species that are already successful in human modified environments. The authors will then deploy these flexibility interventions in more vulnerable species to establish whether behavioural training can improve success, as measured by outcomes such as foraging breadth, dispersal dynamics, and survival rate.

The Stage 1 manuscript was submitted via the programmatic track and will eventually produce three Stage 2 outputs focusing on different species (toutouwai, grackles, and jays). Following two rounds of in-depth review, the recommender judged that the manuscript met the Stage 1 criteria and awarded in-principle acceptance (IPA).

URL to the preregistered Stage 1 protocol: https://osf.io/wbsn6

Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.

List of eligible PCI RR-friendly journals:

References

1. Liu, X., Huang, Y., Xu, X., Li, X., Li, X., Ciais, P., Lin, P., Gong, K., Ziegler, A. D., Chen, A., et al. (2020). High-spatiotemporal-resolution mapping of global urban change from 1985 to 2015. Nature Sustainability, 1–7. https://doi.org/10.1038/s41893-020-0521-x

2. Logan, C.J., Shaw, R., Lukas, D. & McCune, K.B. (2022). How to succeed in human modified environments, in principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/wbsn6

15 Jul 2022

STAGE 1

Registered Report: A Laboratory Experiment on Using Different Financial-Incentivization Schemes in Software-Engineering Experimentation

Jacob Krüger, Gül Çalıklı, Dmitri Bershadskyy, Robert Heyer, Sarah Zabel, Siegmar Otto https://doi.org/10.48550/arXiv.2202.10985

Bug detection in software engineering: which incentives work best?

Recommended by Chris Chambers based on reviews by Edson OliveiraJr and 1 anonymous reviewer

Bug detection is central to software engineering, but what motivates programmers to perform as optimally as possible? Despite a long history of economic experiments on incentivisation, there is surprisingly little research on how different incentives shape software engineering performance. In the current study, Krüger et al. (2022) propose an experiment to evaluate how the pay-off functions associated with different financial incentives influence the performance of participants in identifying bugs during code review. The authors hypothesise that performance-based incentivisation will result in higher average performance, as defined using the F1-score, and that different incentivisation schemes may also differ in their effectiveness. As well as testing confirmatory predictions, the authors will explore a range of ancillary strands, including how the different incentivisation conditions influence search and evaluation behaviour (using eye-tracking), and the extent to which any effects are moderated by demographic factors.

The Stage 1 manuscript was evaluated over one round of in-depth review. Based on detailed responses to the recommender and reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).

URL to the preregistered Stage 1 protocol: https://osf.io/s36c2

References

1. Krüger, J., Çalıklı, G., Bershadskyy, D., Heyer, R., Zabel, S. & Siegmar, O. (2022). Registered Report: A Laboratory Experiment on Using Different Financial-Incentivization Schemes in Software-Engineering Experimentation, in principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/s36c2

30 Jun 2022

STAGE 1

Revisiting and updating the risk-benefits link: Replication of Fischhoff et al. (1978) with extensions examining pandemic related factors

Jason M. Frank, Gilad Feldman https://osf.io/zayn3

Understanding the relationship between the perception of risks and benefits

Recommended by Chris Chambers based on reviews by Katherine Fox-Glassman, Bjørn Sætrevik, Richard Brown and Toby Wise

Everyday decisions involve weighing up many kinds of risks and benefits, prompting the question of how our perception of those risks relates to our perception of the associated benefits. Intuitively, we might assume that behaviours or practices that are judged by society as riskier would also be seen as carrying greater potential benefits, in keeping with the expression “high risk, high reward”. The psychology of risk perception, however, appears to be more complex. In a seminal study, Fischhoff et al. (1978) in fact found the opposite pattern: that perceived risk and perceived benefit were negatively correlated – behaviours or practices that were perceived to be higher risk tended to be perceived as carrying lower benefits. This counterintuitive finding has had a significant impact on the field of judgment and decision making, despite being subjected only rarely to close replication.

Using a large-scale online design, Frank and Feldman (2022) propose a replication that incorporates key elements of Fischhoff et al. (1978) as well as a recent replication by Fox-Glassman et al. (2016). In particular, the authors will reassess the strength and directionality of the relationship between perceived risks and perceived benefits, and how these relate to both risk characteristics and acceptable levels of risk. As part of a series of exploratory extensions, they will also examine the risk/benefit relationship for policies and practices related to the Covid-19 pandemic, including vaccinations, lockdowns, and social distancing.

References

1. Fischhoff, B., Slovic, P., Lichtenstein, S., Read, S., & Combs, B. (1978). How safe is safe enough? A psychometric study of attitudes towards technological risks and benefits. Policy Sciences, 9, 127-152. https://doi.org/10.1007/BF00143739

2. Fox-Glassman, K. T. & Weber, E. U. (2016). What makes risk acceptable? Revisiting the 1978 psychological dimensions of perceptions of technological risks. Journal of Mathematical Psychology, 75, 157-169. https://doi.org/10.1016/j.jmp.2016.05.003

3. Frank, J. M. & Feldman, G. (2022). Revisiting and updating the risk-benefits link: Replication of Fischhoff et al. (1978) with extensions examining pandemic related factors, in principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/bx93v

29 Jun 2022

STAGE 1

Go above and beyond: Does input variability affect children’s ability to learn spatial adpositions in a novel language?

Eva Viviani1, Michael Ramscar2, Elizabeth Wonnacott1 [1: University of Oxford, 2: University of Tübingen] https://osf.io/2k6gj/

Can discriminative learning theory explain productive generalisation in language?

Recommended by Chris Chambers based on reviews by Julien Mayor, Natalia Kartushina, Caroline Rowland and 1 anonymous reviewer

One of the major challenges in studies of language learning is understanding productive generalisation – the ability to use words and linguistic structures in novel settings that the learner has never encountered previously. According to discriminative learning theory, this skill arises from an iterative process of prediction and error-correction that gradually reduces uncertainty, allowing learners to discriminate linguistic outcomes and to identify informative, invariant cues for generalisation to novel cases. In the current study, Viviani et al (2022) use computational modelling to propose a central hypothesis stemming from this theory that children will learn the meaning and use of spatial adpositions (words such as “above” and “below” that describe relative positions) more effectively when there is more variability in the use of the nouns within the spatial sentences. They will also test a range of additional hypotheses, including that learning and generalisation to novel contexts will be enhanced when children learn from skewed distributions that are similar to those found in natural languages.

Level of bias control achieved: Level 6. Some of the data that will be used in the preregistered analyses was obtained in the second of two pilot experiments. However, since no further revisions to the analysis plan were made after this pilot, the risk of bias due to prior data observation remains zero, and the manuscript therefore qualifies for Level 6.

List of eligible PCI RR-friendly journals:

References

1. Viviani, E., Ramscar, M. & Wonnacott, E. (2022). Go above and beyond: Does input variability affect children’s ability to learn spatial adpositions in a novel language? In principle acceptance of Version 4 by Peer Community in Registered Reports. https://osf.io/37dxr

21 Jun 2022

STAGE 1

Pathway between Negative Interpretation Biases and Psychological Symptoms: Rumination as a Transdiagnostic Mediator in a Longitudinal Study

Chung, Ho-Fung, Cheung, Sing-Hang, https://osf.io/89n7u

Probing the interaction between interpretation bias and repetitive negative thinking in subclinical psychopathology

Recommended by Chris Chambers based on reviews by Ariana Castro and Rita Pasion

Research in clinical psychology has found that interpretation bias (perceiving ambiguous information in a systematically negative or hostile way) and repetitive negative thinking (recurrent, prolonged worry or rumination) are associated with a range of psychopathologies – including depression, anxiety and paranoia – but the complex interplay between them in driving symptomatology is unclear. Here, Chung and Cheung (2022) propose a longitudinal examination of the directional relationship between interpretation bias and psychological symptoms in subclinical depression and paranoia, as well as the potential transdiagnostic mediating role of repetitive negative thinking. Using an online three-wave design, they ask whether the association between negative interpretation biases and psychological symptoms is bidirectional, whether negative interpretation biases are associated with repetitive negative thinking over time, and whether repetitive negative thinking is associated with psychological symptoms over time. They will also test whether negative interpretation biases and psychological symptoms exert reciprocal influences across dimensions through repetitive negative thinking, and whether repetitive negative thinking acts as a transdiagnostic mediator for depression and paranoid thoughts. Overall, the study aims to generate a clearer understanding of the relationship between interpretation biases and subclinical symptomatology, as well as clarifying the role of rumination as a transdiagnostic mechanism that mediates psychopathology.

The Stage 1 manuscript was evaluated over two rounds of in-depth review. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).

URL to the preregistered Stage 1 protocol: https://osf.io/89n7u (currently under private embargo)

References

1. Chung, H.-F. & Cheung, S.-H. (2022). Repetitive negative thinking as a transdiagnostic mediator in the interplay of interpretation biases and psychological symptoms in depression and paranoia: A three-wave longitudinal study, in principle acceptance of Version 4 by Peer Community in Registered Reports. https://osf.io/89n7u

20 Jun 2022

STAGE 1

Revisiting stigma attributions and reactions to stigma: Replication and extensions of Weiner et al. (1988)

Kwan Yin (Gladys) Yeung, Gilad Feldman https://osf.io/rqdn2/

Understanding the psychology of stigmas

Recommended by Chris Chambers based on reviews by Charlotte Pennington and Joanne Rathbone

Stigmas are prejudices or discrimination against people based on qualities that vary from the norm, such as a physical or mental illness, disability, sexuality, race, or one of many other personal characteristics. The harm caused by stigmatisation has made understanding the causes and potential solutions a vital area of study in psychology and public health. One of the major focuses of ongoing research is understanding the factors that determine whether a particular characteristic becomes stigmatised, and if so how the stigma might be eliminated. Previous research has found that for disease-based stigmas, the contagiousness, course, and disruptiveness of a disease can be influential. Another key determinant is the perceived cause of the stigmatised condition or characteristic. In a landmark study, Weiner et al. (1988) reported that attributes based on physical health were more likely to be perceived as being uncontrollable, stable and irreversible, prompting feelings of sympathy without anger or judgment. On the other hand, attributes related to mental health and behaviour were more likely to be regarded as controllable and reversible, prompting lack of sympathy coupled with feelings of anger and negative judgement. In a second experiment, they also found that manipulating the perception of controllability can modify emotional responses and judgments – for some stigmas (but not others), providing participants with information that a particular characteristic was controllable vs. uncontrollable was found to increase or decrease negative attributions, respectively.

In the current study, Yeung and Feldman (2022) propose to replicate Experiment 2 from Weiner et al. (1988) in a large online sample. In particular, they plan to ask how the source of a stigma is related to perceived controllability and stability, emotional reactions, and willingness to help. They also propose a range of extensions, including the inclusion of additional stigmas that have become relevant since the original study was published over 30 years ago.

References

1. Weiner, B., Perry, R. P., & Magnusson, J. (1988). An attributional analysis of reactions to stigmas. Journal of Personality and Social Psychology, 55, 738–748. https://doi.org/10.1037/0022-3514.55.5.738

2. Yeung, K. Y. & Feldman, G. (2022). Revisiting stigma attributions and reactions to stigma: Replication and extensions of Weiner et al. (1988), in principle acceptance of Version 2 by Peer Community in Registered Reports. https://osf.io/k957f

13 Jun 2022

STAGE 1

Revisiting the link between true-self and morality: Replication and extensions of Newman, Bloom and Knobe (2014) Studies 1 and 2

Shuk Ching (Janet) Lee, Gilad Feldman https://osf.io/8rp96/

Replicating positive evaluations of our "true selves"

Recommended by Chris Chambers based on reviews by Andrew Christy, Cillian McHugh, Caleb Reynolds and Sergio Barbosa

The concept of a “true self” – the deepest and most genuine part of a person’s personality – is fundamental to many aspects of psychology, with influences that extend deep into society and culture. For decades, research in psychology has consistently found that people see their true selves as positive and virtuous. But people also positively regard (and indeed overestimate) many other characteristics related to the self, such as their abilities and achievements, prompting the question of whether there is anything special about the “true self” as a psychological concept. In an influential study, Newman et al. (2014) found that people were more likely to attribute morally good than morally bad changes in the behaviour of other people to their true selves. Crucially, they also found that our tendency to view the true self positively is shaped by our own moral values – in essence, what we regard as morally or politically good, we see in the true selves of others. Newman et al’s findings suggest that the tendency for us to regard our true self in a positive light stems from the specific nature of true self as a concept.

In the current study, Lee and Feldman (2022) propose to replicate two key studies from Newman et al. (2014) in a large online sample. In particular, they will ask whether true-self attributions are higher for changes in behaviour that are morally positive compared to morally negative or neutral, and, further, how true-self attributions are aligned with personal moral/political views. The authors also propose exploring the relationship between true-self attributions and perceived social norms.

References

1. Newman, G. E., Bloom, P., & Knobe, J. (2014). Value judgments and the true self. Personality and Social Psychology Bulletin, 40, 203–216. https://doi.org/10.1177/0146167213508791

2. Lee, S. C. & Feldman, G. (2022). Revisiting the link between true-self and morality: Replication and extension of Newman, Bloom, and Knobe (2014) Studies 1 and 2, in principle acceptance of Version 2 by Peer Community in Registered Reports. https://osf.io/v2tpf

13 Jun 2022

STAGE 1

Associations of fear, anger, happiness, and hope with risk judgments: Revisiting appraisal-tendency framework with a replication and extensions of Lerner and Keltner (2001)

Sirui Lu; Gilad Feldman https://osf.io/zbqyr/

Replicating the relationship between emotions and judgments of risk

Recommended by Chris Chambers based on reviews by Kelly Wolfe, Max Primbs, Agata Sobków and Karolina Scigala

The Appraisal-Tendency Framework proposed by Lerner and Keltner (2000) refined cognitive-appraisal theory by proposing that specific emotions trigger a predisposition to appraise future (or hypothetical) events in line with the central appraisal dimensions that triggered the emotion, even when the emotion and the judgment are unrelated. For example, an individual who is triggered to become fearful of a heightened risk, such as nuclear war, may then exhibit heightened pessimism about risks unrelated to war. The Appraisal-Tendency Framework also predicts relationships between traits, such as between fear, anger and risk-taking/risk-seeking tendencies. In an influential paper, Lerner and Keltner (2001) reported direct empirical support for the Appraisal-Tendency Framework, which aside from its influence in cognitive/affective psychology has had considerable impact in behavioural economics, moral psychology, and studies of consumer behaviour.

In the current study, Lu and Feldman (2022) propose to replicate three key studies from Lerner and Keltner (2001) in a large online sample. Through a combination of replication and extension, the authors will probe the relationship between various trait emotions (including fear, anger, happiness, and hope) and trait characteristics of risk seeking and optimistic risk assessment. The authors also propose examining how the ambiguity of triggering events moderates the relationship between specific emotions and risk judgments.

References

1. Smith, C. A., & Ellsworth, P. C. (1985). Patterns of cognitive appraisal in emotion. Journal of Personality and Social Psychology, 48, 813-838. https://doi.org/10.1037/0022-3514.48.4.813

2. Johnson, E. J., & Tversky, A. (1983). Affect, generalization, and the perception of risk. Journal of Personality and Social Psychology, 45(1), 20–31. https://doi.org/10.1037/0022-3514.45.1.20

3. Lerner, J. S., & Keltner, D. (2000). Beyond valence: Toward a model of emotion-specific influences on judgment and choice. Cognition & Emotion, 14, 473-493. https://doi.org/10.1080/026999300402763

4. Lerner, J. S., & Keltner, D. (2001). Fear, anger, and risk. Journal of Personality and Social Psychology, 81, 146–159. https://doi.org/10.1037/0022-3514.81.1.146

5. Lu, S. & Feldman, G. (2022). Associations of fear, anger, happiness, and hope with risk judgments: Revisiting appraisal-tendency framework with a replication and extensions of Lerner and Keltner (2001), in principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/8yu2x

09 Jun 2022

STAGE 1

Revisiting diversification bias and partition dependence: Replication and extensions of Fox, Ratner, and Lieb (2005) Studies 1, 2, and 5

Mei Yee (Alice) Li, Gilad Feldman https://osf.io/vkp3q/

Testing the replicability of diversification bias and partition dependence

Recommended by Chris Chambers based on reviews by Craig Fox and Leo Cohen

When offered a range of options and asked to make multiple selections, how do people choose? Over the last 30 years, a key finding to emerge from behavioural economics is that people distribute their choices more evenly than would be considered optimal – a phenomenon termed “diversification bias” or the “diversification heuristic” (Read & Loewenstein, 1995). For example, when filling a plate from a buffet, you might be inclined to choose a relatively even amount of everything on offer, even when you prefer some foods over others. Similarly, when allocating savings among different investment options, people are prone to spreading their money more evenly than would maximise utility.

In an influential study, Fox et al. (2005) found that diversification bias can be shaped by so-called “partition dependence” – the tendency to allocate resources differently across options depending on how they are subjectively grouped. Such groupings could be arbitrary; so, for example, to return to the buffet example, people might diversify across high-level categories such as cooked and uncooked, savoury and sweet, or surf and turf, and then diversify across the options within those categories. The nature of level of these subjective (and potentially arbitrary) categorisations can strongly influence the final allocation of resources. Diversification bias and partition dependence have important implications for basic theory in judgment and decision-making as well as applications in behavioral economics and finance.

In the current study, Li and Feldman (2022) propose to replicate Studies 1, 2 and 5 from Fox et al. (2002) in a large online sample. In particular, they plan to ask how partitioning influences the allocation of choices between options, and the extent to which partition dependence is reduced in people with greater relevant expertise. The authors also propose extending the original study to explore individual differences in the desire for choice diversity as predictors of partition dependence.

References

1. Read, D., & Loewenstein, G. (1995). Diversification bias: Explaining the discrepancy in variety seeking between combined and separated choices. Journal of Experimental Psychology: Applied, 1, 34-49. https://doi.org/10.1037/1076-898X.1.1.34

2. Fox, C. R., Ratner, R. K., & Lieb, D. S. (2005). How subjective grouping of options influences choice and allocation: Diversification bias and the phenomenon of partition dependence. Journal of Experimental Psychology: General, 134, 538-551. https://doi.org/10.1037/0096-3445.134.4.538

3. Li, M. Y. & Feldman, G. (2022). Revisiting diversification bias and partition dependence:
Replication and extension of Fox, Ratner, and Lieb (2005) Studies 1, 2, and 5, in principle acceptance of Version 2 by Peer Community in Registered Reports. https://osf.io/bx8vq

06 Jun 2022

STAGE 1

Communicating dynamic norms with visual cues

Alaa Aldoh, Paul Sparks, Peter R Harris https://osf.io/a5xdg

Can dynamic norm information reduce indicators of meat consumption?

Recommended by Chris Chambers based on reviews by Gabriela Jiga-Boy and 1 anonymous reviewer

In the present study, Aldoh et al. (2022) will investigate the effectiveness of dynamic norm information (compared to static norms) on several indicators of meat consumption, including interest, attitudes, and intentions toward reducing meat consumption, as well as self-reported meat consumption itself. Using an online sample up to 1500 participants, the authors will also test the role of visual cues (including data trend graphics) in causing any effects and will explore the potential longevity of the intervention over a period of 7 days.

URL to the preregistered Stage 1 protocol: https://osf.io/txzvm

Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.

List of eligible PCI RR-friendly journals:

References

1. Aldoh, A., Sparks, P. & Harris, P. R. (2022). Communicating dynamic norm information, in principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/txzvm

06 Jun 2022

STAGE 1

Revisiting the psychological sources of ambiguity avoidance: Replication and extensions of Curley, Yates, and Abrams (1986)

Sze Ying (Dawn) Yiu, Gilad Feldman https://osf.io/xdes8/

Reducing ambiguity in the psychological understanding of ambiguity avoidance

Recommended by Chris Chambers based on reviews by Leyla Loued-Khenissi and Hayley Jach

A considerable body of research in behavioural economics has established the existence of ambiguity avoidance: the tendency for people, when given a choice between two options, to choose the option for which there is greater certainty about the probabilities of certain outcomes occurring. In a seminal study, Curley, Yates, and Abrams (1986) explored potential psychological explanations of ambiguity avoidance, contrasting five hypotheses: hostile nature (the anticipation that more ambiguous options are biased against oneself), other-evaluation (the anticipation that one’s decision will be evaluated by others), self-evaluation (the anticipation that one's decision will be self-evaluated in the future), forced-choice (in which the less ambiguous option is selected only when all other considerations are equal), and a more general uncertainty avoidance associated with risk aversion. The results favoured other-evaluation as the most promising explanation, with implications in the following decades for research in social psychology, judgment and decision making, behavioural economics, consumer behaviour, and cognitive psychology.

In the current study, Yiu and Feldman (2022) plan to revisit the psychological basis of ambiguity avoidance in a large online sample through a replication of key studies from Curley et al. (1986), including extensions to increase methodological rigour and to explore the relationship between ambiguity avoidance and hostility bias, anticipated future regret, and post-choice social judgment from others, as well as trait measures of risk tolerance and ambiguity tolerance.

URL to the preregistered Stage 1 protocol: https://osf.io/wb3hc

Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.

List of eligible PCI RR-friendly journals:

References

1. Curley, S. P., Yates, J. F. & Abrams, R. A. (1986). Psychological sources of ambiguity avoidance. Organizational Behavior and Human Decision Processes, 38, 230-256. https://doi.org/10.1016/0749-5978(86)90018-X

2. Yiu, S. Y. & Feldman, G. (2022). Revisiting the psychological sources of ambiguity avoidance:
Replication and extensions of Curley, Yates, and Abrams (1986), in principle acceptance of Version 2 by Peer Community in Registered Reports. https://osf.io/wb3hc

06 Jun 2022

STAGE 1

Revisiting the role of public exposure and moral beliefs on feelings of shame and guilt: Replication of Smith et al. (2002)’s Study 1

Yikang Zhang, Fung Chit (Jack) Cheung, Hei Tung (Patrina) Wong, Lok Yee (Noel) Yuen, Hui Ching (Rachel) Sin, Hiu Tang (Kristy) Chow, Gilad Feldman https://osf.io/4nqy6/

How do public exposure and moral beliefs impact feelings of shame and guilt?

Recommended by Chris Chambers based on reviews by Roger Giner-Sorolla and Uriel Haran

In the current study, Zhang et al. propose to directly replicate Smith et al. (2002) in a large online sample. In particular, they will revisit the critical questions from Study 1, asking (a) whether public exposure affects the magnitude of shame and guilt over one’s misconduct, and (b) whether stronger moral belief increases guilt and shame over one’s misconduct.

URL to the preregistered Stage 1 protocol: https://osf.io/j7kt2

Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.

List of eligible PCI RR-friendly journals:

References

2. Zhang, Y., Cheung, F. C., Wong, H.T., Yuen, L. Y., Sin, H. C., Chow, H. T. & Feldman, G. (2022). Revisiting the role of public exposure and moral beliefs on feelings of shame and guilt: Replication of Smith et al. (2002)’s Study 1. https://osf.io/j7kt2

17 May 2022

STAGE 1

Revisiting mental accounting classic paradigms: Replication of Thaler (1999) and an extension examining impulsivity

Mengfei Li; Gilad Feldman https://osf.io/4ps8m/

Mental accounting under the microscope

Recommended by Chris Chambers based on reviews by Barnabas Szaszi and Féidhlim McGowan

In recent years, the study of mental accounting – the thought processes by which people informally record, categorise, and evaluate the costs and benefits of their financial transactions – has been an active research area, drawing attention to a range of biases and distortions that deviate from optimal economic decision-making (Zhang & Sussman, 2018). Although the term “mental accounting” is a relatively recent construction (Thaler, 1999), it stems from a longer history of behavioural economic research on value functions, decision frames, risk-taking, and related concepts.

In the current study, Li and Feldman propose to replicate 17 influential mental accounting problems (or tasks) reviewed by Thaler (1999) in a large online sample. The authors also propose several extensions examining the effects of sunk costs and expenses framing.

URL to the preregistered Stage 1 protocol: https://osf.io/d6cjk

Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.

List of eligible PCI RR-friendly journals:

References

1. Zhang, C. Y., & Sussman, A. B. (2018). Perspectives on mental accounting: An exploration of budgeting and investing. Financial Planning Review, 1, e1011. https://doi.org/10.1002/cfp2.1011

2. Thaler, R. H. (1999). Mental accounting matters. Journal of Behavioral Decision Making, 12, 183-206. https://doi.org/10.1002/(SICI)1099-0771(199909)12:3%3C183::AID-BDM318%3E3.0.CO;2-F

3. Li, M. & Feldman, G. (2022). Revisiting mental accounting classic paradigms: Replication of the problems reviewed in Thaler (1999), in principle acceptance of Version 2 by Peer Community in Registered Reports. https://osf.io/d6cjk

03 May 2022

STAGE 1

Revisiting the links between numeracy and decision making: Replication of Peters et al. (2006) with an extension examining confidence

Minrui Zhu, Gilad Feldman https://osf.io/8z6ga/

Assessing the replicability of specific links between numeracy and decision-making

Recommended by Chris Chambers based on reviews by Daniel Ansari and Elena Rusconi

In the current study, Zhu and Feldman propose to replicate four influential experiments from a study by Peters et al. (2006), which demonstrated links between numeracy and performance on a variety of decision-making tasks, including attribute framing, frequency-percentage framing, susceptibility to affective influences, and various cognitive biases. The authors also propose several extended questions, including refinements of the original hypotheses and an examination of the relationship between numeracy and confidence in numeric judgments (subjective numeracy).

URL to the preregistered Stage 1 protocol: https://osf.io/r73fb

Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.

List of eligible PCI RR-friendly journals:

References

1. Zhu, M. & Feldman, G. (2022). Revisiting the links between numeracy and decision making: Replication of Peters et al. (2006) with an extension examining confidence, in principle acceptance of Version 2 by Peer Community in Registered Reports. https://osf.io/r73fb

30 Mar 2022

STAGE 1

Stage 1 Registered Report: Stress regulation via being in nature and social support in adults - a meta-analysis

Alessandro Sparacio, Ivan Ropovik, Gabriela M. Jiga-Boy, Hans IJzerman https://psyarxiv.com/a4zmj

Does emotional support and being in nature influence stress?

Recommended by Chris Chambers based on reviews by Felix Schönbrodt and Siu Kit Yeung

In the current study, Sparacio et al propose tackling this question from a meta-analytic perspective, focusing on a corpus of existing research that has addressed the efficacy of two specific stress regulation interventions: being in nature and emotional social support. As well as evaluating the evidential content of the relevant literatures, the authors will examine signs of publication bias and the moderating role of personality traits.

URL to the preregistered Stage 1 protocol: https://osf.io/c25qw

List of eligible PCI RR-friendly journals:

References

2. Sparacio, A., Ropovik, I., Jiga-Boy, G. M., & IJzerman, H. (2022). Stage 1 Registered Report: Stress regulation via being in nature and social support in adults - a meta-analysis, in principle acceptance of version 3 by Peer Community in Registered Reports.

16 Mar 2022

STAGE 1

Neuroanatomical Correlates of System-justifying Ideologies: A Pre-registered Voxel-based Morphometry Study on Right-Wing Authoritarianism and Social Dominance Orientation

Jan Paolo M. Balagtas, Serenella Tolomeo, Bindiya L. Ragunath, Paolo Rigo, Marc H. Bornstein & Gianluca Esposito https://osf.io/29p8f/

What are the neuranatomical correlates of system-justifying ideologies?

Recommended by Chris Chambers based on reviews by Bonni Crawford and 2 anonymous reviewers

Under the tenets of system justification theory, system-justifying ideologies are beliefs held by individuals to defend and justify the status quo, even when doing do perpetuates social inequalities (Jost and Hunyady, 2005). Two such well-studied ideologies to emerge from political science and social psychology are social dominance orientation (SDO) – the belief that some social groups are superior to others – and right wing authoritarianism (RWA) – the belief that people should follow conventional traditions and authorities, avoiding rebellious ideas. Although considered to be stable traits that may have a heritable basis, there has been little investigation of the neural correlates of SDO and RWA, and it remains unknown whether they are associated with common or distinct brain systems.

In the current study, Balagtas et al propose a novel investigation of the neuroanatomical correlates of both SDO and RWA in a Chinese Singaporean sample using voxel-based morphometry. Based on previous research, the authors focus especially on relationships between SDO, RWA and the volume of the amygdala, ventromedial prefrontal cortex, and anterior insula.

URL to the preregistered Stage 1 protocol: https://osf.io/btkwq

List of eligible PCI RR-friendly journals:

References

2. Balagtas, P. M., Tolomeo, S., Ragunath, B., Rigo, P., Bornstein, M. H. & Esposito, G. (2022). Neuroanatomical Correlates of System-justifying Ideologies: A Pre-registered Voxel-based Morphometry Study on Right-Wing Authoritarianism and Social Dominance Orientation in principle acceptance of version 4 by Peer Community in Registered Reports. https://osf.io/btkwq

15 Feb 2022

STAGE 1

Does alleviating poverty increase cognitive performance? Short- and long- term evidence from a randomized controlled trial

Barnabas Szaszi, Bence Palfi, Gabor Neszveda, Aikaterini Taka, Peter Szecsi, Christopher Blattman, Julian C. Jamison, Margaret Sheridan https://osf.io/2r8a9/?view_only=1781fb681edc4cdeb61287172cd14ba2

Understanding the effect of unconditional cash transfers on cognition

Recommended by Chris Chambers based on reviews by Charlotte Pennington and Matúš Adamkovič

Over the last decade, a growing body of evidence has revealed potential benefits of unconditional cash transfers (UCTs) on a variety of outcomes, including self-reported happiness and life satisfaction (Haushofer & Shapiro, 2016), economic and financial well-being (Blattman et al., 2013; Baird et al., 2018) and educational attainment (Baird et al., 2016). Although the effects of UCTs do not always out-perform rigorous control conditions (Whillans & West, 2022), these findings prompt the question of whether the alleviation of poverty via UCTs can also influence cognitive processing and performance.

In the current study, Szaszi et al. propose to analyse the results of a previous randomised trial of UCTs by Blattman et al. (2017) to test whether a $200 lump sum administered to a sample of young men in Liberia carries both short- and long-term benefits for a range of executive functions, including attention, response inhibition, and working memory capacity.

URL to the preregistered Stage 1 protocol: https://osf.io/k56yv

List of eligible PCI RR-friendly journals:

References

6. Szaszi, B., Palfi, B., Neszveda, G., Taka, A., Szecsi, P., Blattman, C., Jamison, J. C., & Sheridan, M. (2022). Does alleviating poverty increase cognitive performance? Short- and long- term evidence from a randomized controlled trial, in principle acceptance of version 3 by Peer Community in Registered Reports. https://osf.io/k56yv

7. Blattman, C., Jamison, J. C. & Sheridan, M. (2017). Reducing crime and violence: Experimental evidence from cognitive behavioral therapy in Liberia. American Economic Review, 107, 1165–1206. http://doi.org/10.1257/aer.20150503

08 Feb 2022

STAGE 1

Motivational Control of Habits: A Preregistered fMRI Study

Andreas B. Eder, David Dignath, Matthias Gamer https://osf.io/52xpg/?view_only=551d1c39ed1f41549cbd35ec6b8bbed6

Putting the Expected Value of Control (EVC) theory to the test in explaining habitual action

Recommended by Chris Chambers based on reviews by 2 anonymous reviewers

What are the neurocognitive mechanisms underlying the formation of habits? In this Stage 1 Registered Report, Eder and colleagues propose an fMRI study to test a key prediction of the Expected Value of Control (EVC) theory: that the dorsal anterior cingulate cortex (dACC) – a region heavily implicated in reward processing, cognitive control, and action selection – will show increased activity during the presentation of Pavlovian cues that are associated with devalued outcomes. In combination with a series of behavioural positive controls, this observation would provide evidence in support of EVC theory, whereas failure to do so may support alternative accounts that propose independence of habits from the representations of outcomes.

The Stage 1 manuscript was evaluated over two rounds of in-depth specialist review. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA). This IPA recommendation was issued on 8 Feb 2022, and was initially provisional due to lack of ethics approval. The recommendation was then updated and confirmed on 21 Feb 2022 following confirmation that ethics approval had been granted.

URL to the preregistered Stage 1 protocol: https://osf.io/k8ygb

Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.

List of eligible PCI RR-friendly journals:

References

Eder, A. B., Dignath, D. & Gamer, M. (2022). Motivational Control of Habits: A Preregistered fMRI Study. Stage 1 preregistration, in principle acceptance of version 3 by Peer Community in Registered Reports. https://osf.io/k8ygb

29 Sep 2021

STAGE 1

Evaluating the pedagogical effectiveness of study preregistration in the undergraduate dissertation: A Registered Report

Madeleine Pownall; Charlotte R. Pennington; Emma Norris; Kait Clark https://doi.org/10.17605/OSF.IO/9HJBW

Does incorporating open research practices into the undergraduate curriculum decrease questionable research practices?

Recommended by Corina Logan and Chris Chambers based on reviews by Kelsey McCune, Neil Lewis, Jr., Lisa Spitzer and 1 anonymous reviewer

In a time when open research practices are becoming more widely used to combat questionable research practices (QRPs) in academia, this Stage 1 Registered Report by Pownall and colleagues (2021) will empirically investigate the practice of preregistering study plans, which will allow us to better understand to what degree such practices increase awareness of QRPs and whether experience with preregistration helps reduce engagement in QRPs. This investigation is timely because results from these kinds of studies are only recently becoming available and the conclusions are providing evidence that open research practices can improve research quality and reliability (e.g., Soderberg et al. 2020, Chambers & Tzavella 2021). The authors crucially focus on the effect of preregistering the undergraduate senior thesis (of psychology students in the UK), which is a key stage in the development of an academic. This data will help shape the future of how we should teach open research practices and what effect we as teachers can have on budding research careers. The five expert peer reviews were of an extremely high quality and were very thorough. The authors did an excellent job of addressing all of the comments in their responses and revised manuscript versions, which resulted in only one round of peer review, plus a second revision based on Recommender feedback. As such, this registered report meets the Stage 1 criteria and is therefore awarded in-principle acceptance (IPA). We wish the authors the best of luck with the study and we look forward to seeing the results.

URL to the preregistered Stage 1 protocol: https://osf.io/9hjbw

Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.

List of eligible PCI RR-friendly journals:

References

Pownall M, Pennington CR, Norris E, Clark K. 2021. Evaluating the pedagogical effectiveness of study preregistration in the undergraduate dissertation: A Registered Report. OSF, stage 1 preregistration, in principle acceptance of version 1 by Peer Community in Registered Reports. https://doi.org/10.17605/OSF.IO/9HJBW
Chambers C, Tzavella L (2021). The past, present, and future of Registered Reports. https://doi.org/10.31222/osf.io/43298
Soderberg CK, Errington TM, Schiavone SR, Bottesini J, Thorn FS, Vazire S, Esterling KM, Nosek BA (2021) Initial evidence of research quality of registered reports compared with the standard publishing model. Nature Human Behaviour, 5, 990–997. https://doi.org/10.1038/s41562-021-01142-4

24 Sep 2021

STAGE 1

Phenomenological Strands for Gaming Disorder and Esports Play: A Qualitative Registered Report

Veli-Matti Karhulahti, Miia Siutila, Jukka Vahlo, Raine Koskimaa https://doi.org/10.31234/osf.io/q53jz

How does the phenomenology of "gaming disorder" differ from intensive but non-pathological videogame play?

Recommended by Chris Chambers based on reviews by Malte Elson, Peter Branney and Michelle Carras

In this Stage 1 Registered Report, Karhulahti and colleagues (2021) propose a qualitative, interview-based study of videogame play, with the central aim to understand key phenomological differences between gaming behaviour that is associated with vs. without health problems. This question is particularly important given the recent inclusion of "gaming disorder" in the WHO's International Statistical Classification of Diseases and Related Health Problems (ICD).

In recent years, the validity of "gaming disorder" as an identifiable mental illness has been controversial (e.g. Van Rooij et al, 2018), as has the debate concerning purported harms or benefits of gaming for mental health. This Stage 1 manuscript describes a rigorous qualitative investigation that should provide new insights on this question, and will also include a longitudinal component to examine changes in phenomonology over time, as well as an examination of the extent to which the phenomonology of gaming is reflected in the experiences of medical experts such as doctors, nurses, and therapists who have worked with gaming-related health problems.

More broadly, the manuscript breaks new ground for Registered Reports, being one of the first to focus on qualitative methods, while also making use of the Programmatic submission track in which the approved Stage 1 manuscript is intended to produce two Stage 2 manuscripts focusing on different elements of the project.

Three expert reviewers with a variety of field-specialist and qualitative methodological expertise assessed the Stage 1 manuscript over two rounds of in-depth review. Following revision, the reviewers and recommender agreed that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).

URL to the preregistered Stage 1 protocol: https://osf.io/a2rwg

List of eligible PCI RR-friendly journals:

References

Karhulahti V-M, Siutila M, Vahlo J, Koskimaa R (2021) Phenomenological Strands for Gaming Disorder and Esports Play: A Qualitative Registered Report. PsyArXiv preprints, Stage 1 preregistration, in principle acceptance of version 1 by Peer Community in Registered Reports. https://doi.org/10.31234/osf.io/q53jz
van Rooij AJ, Ferguson CJ, Carras MC, Kardefelt-Winther D, Shi J, Aarseth E, Bean AM, Bergmark KH, Brus A, Coulson M, Deleuze J, Dullur P, Dunkels E, Edman J, Elson M, Etchells PJ, Fiskaali A, Granic I, Jansz J, Karlsen F, Kaye LK, Kirsh B, Lieberoth A, Markey P, Mills KL, Nielsen RKL, Orben A, Poulsen A, Prause N, Prax P, Quandt T, Schimmenti A, Starcevic V, Stutman G, Turner NE, Looy J van, Przybylski AK (2018) A weak scientific basis for gaming disorder: Let us err on the side of caution. Journal of Behavioral Addictions, 7, 1–9. https://doi.org/10.1556/2006.7.2018.19

Reviews: 8

26 Nov 2024

STAGE 1

The Importance of Long- and Short-Acting Pharmacological Treatment Options for Time Use and Quality of Life in Individuals with Opioid Use Disorder: An Observational, Cross-Sectional, Survey-Based Study

Martin Trøstheim, Siri Leknes, Kristin K. Solli, Molly Carlyle, Gernot Ernst, Marie Eikemo https://osf.io/8r95e

Examining distinct patterns of time-use and their associations with quality of life in individuals receiving treatment for opioid use disorder

Recommended by Andrew Jones based on reviews by Chris Chambers, Cathy Montgomery and 1 anonymous reviewer

Drug use is a time-consuming endeavour, particularly for opioids, whereby substantial time is required to seek out, prepare and consume drugs. This prioritization of drug use reduces the time that is available for substance-free alternatives that contribute positively to quality of life, such as socialization, education, employment, physical activity and self-care (Acuff et al., 2019). Given the time commitments, daily supervised treatment of opioid use disorder has poor adherence (Strang et al., 2020). As such, there is an interest in long-acting injectable medications, which can overcome these adherence issues (Saunders et al 2020). However, little is known about how patients on long-acting medications for opioid use disorder adapt to the increased free-time they have, and where this has downstream impacts on their well-being, quality of life and experience of stigma.

In the current study, Trøstheim and colleagues plan to conduct an observational investigation of >500 individuals from Norway with opioid use disorder who were receiving pharmacological treatment. Their primary hypothesis is that individuals with opioid use disorder will exhibit distinct time use profiles, which will be examined using latent profile analysis to identify time use patterns based on 17 measured time use variables e.g. ‘How many days in the past week have you done paid work, voluntary work, or community service’. Secondary analyses will test the associations between medication type, time use (based on the latent profile analysis), well-being, stigma and life-satisfaction. Findings from this study will provide a greater understanding of how long-acting medications for opioid use disorder impact free-time and quality of life.

The Stage 1 manuscript was evaluated over two rounds of in-depth review by two reviewers and the recommender. Following a response and revision, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).

URL to the preregistered Stage 1 protocol: https://osf.io/vbpjg

References

1. Acuff, S. F., Dennhardt, A. A., Correia, C. J., & Murphy, J. G. (2019). Measurement of substance-free reinforcement in addiction: A systematic review. Clinical Psychology Review, 70, 79-90. https://doi.org/10.1016/j.cpr.2019.04.003

2. Saunders, E. C., Moore, S. K., Walsh, O., Metcalf, S. A., Budney, A. J., Scherer, E., & Marsch, L. A. (2020). Perceptions and preferences for long-acting injectable and implantable medications in comparison to short-acting medications for opioid use disorders. Journal of Substance Abuse Treatment, 111, 54-66. https://doi.org/10.1016/j.jsat.2020.01.009

3. Strang, J., Volkow, N. D., Degenhardt, L., Hickman, M., Johnson, K., Koob, G. F., ... & Walsh, S. L. (2020). Opioid use disorder. Nature Reviews Disease Primers, 6, 3. https://doi.org/10.1038/s41572-019-0137-5

4. Trøstheim, M., Leknes, S., Solli, K. K., Carlyle, M., Ernst, G., & Eikemo, M. (2024). The Importance of Long- and Short-Acting Pharmacological Treatment Options for Time Use and Quality of Life in Individuals with Opioid Use Disorder: An Observational, Cross-Sectional, Survey-Based Study. In principle acceptance of Version 2 by Peer Community in Registered Reports. https://osf.io/vbpjg

16 Oct 2024

STAGE 1

Psychological Wellbeing, Sleep, and Video Gaming: Analyses of Comprehensive Digital Traces

Nick Ballou, Thomas Hakman, Tamas Foldes, Matti Vuorre, Kristoffer Magnusson, Andrew K. Przybylski https://osf.io/pb5nu

What is the relationship between video gaming and wellbeing?

Recommended by Lobna Hassan based on reviews by Chris Chambers, Valtteri Kauraoja and 1 anonymous reviewer

The popularity of gaming has spurred interest in understanding its impact on wellbeing. Significant research has investigated the impact of gaming from multiple angles. However, prior research has been limited by a lack of behavioural data that could be more reliable in examining the impact of gaming than self-reports of behavior. Similarly, previous research has called for examining the impact of gaming while taking genre differences into consideration.

In this programmatic submission (3 x Stage 2 outputs), Ballou et al. (2024) address these gaps by combining digital trace data of gamers across multiple gaming platforms (Nintendo Switch, Xbox (US only), Steam, and mobile systems (iOS and Android)) with psychological surveys measuring the gamers’ basic psychological needs, sleep quality, and subjective wellbeing over a three-month period. Participants will complete 30 daily surveys (US only) and six bi-weekly panel surveys.

The combination of behavioral trace data and psychological self-reports offers a rare and comprehensive look at how gaming influences different important aspects of wellbeing. This work is ambitious and addresses scientifically and socially important questions on the impact of gaming.

The manuscript underwent one round of in-depth review, where three reviewers with a combination of methodological and domain expertise gave generally positive feedback on the manuscript, providing directions to further strengthen the research. The authors – as judged by the recommender – thoroughly addressed the reviewer comments and have worked to further strengthen the rigour of the manuscript. A further revision round was issued by the recommender to address a minor issue with one hypothesis and other small linguistic edits.

Based on detailed responses to the recommender and reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).

URL to the preregistered Stage 1 protocol: https://osf.io/mvngt

Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.

List of eligible PCI RR-friendly journals:

References

1. Ballou, N., Hakman, T., Földes, T., Vuorre, M., Magnusson, K., & Przybylski, A. K. (2024). Psychological Wellbeing, Sleep, and Video Gaming: Analyses of Comprehensive Digital Traces. In principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/mvngt

21 Apr 2024

STAGE 1

Mechanisms of secularization: Testing between three causal pathways

Martin Lang, Radim Chvaja https://osf.io/scnuh?view_only=2afb8c616e6245debd279ee3f0b19675

Understanding links between secularization, rationalisation and insecurity

Recommended by Adrien Fillon based on reviews by Chris Chambers and 1 anonymous reviewer

What relationship can be expected between secularization, rationalisation and insecurity? While some authors argue that rationalisation reduces the willingness to belong to religious groups, others have suggested that insecurity increases this need to belong to religious groups.

In the current study, Lang and Chvaja (2024) will adjudicate between these two possibilities using an economics game in participants from two countries: US and Poland. The central question posed by the authors is whether cooperative insecurity increases the probability of joining a religious normative group. They will test the relationship between an environment (secure and insecure) and institution (which related to the norm context: religious and secular) on the probability of choosing the normative group in an experimental setting. Therefore, the study will be a quantitative analysis.

The authors included an adequate power analysis, alternatives for non-supported hypotheses, and filtering to ensure a high quality of data collection. They also undertook a pilot study to ensure the quality of the procedure and sensitivity of the analyses.

The Stage 1 manuscript was evaluated over one round of in-depth review. Based on detailed responses to reviewers’ and the recommender’s comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance.

URL to the preregistered Stage 1 protocol: https://osf.io/yzgek

References

1.Lang, M. & Chvaja, R. (2024). Mechanisms of secularization: Testing between the rationalization and existential insecurity theories. In principle acceptance of Version 2 by Peer Community in Registered Reports. https://osf.io/yzgek

10 Apr 2024

STAGE 2
(Go to stage 1)

Cue-based modulation of pain stimulus expectation: do ongoing oscillations reflect changes in pain perception? A Registered Report

Chiara Leu, Esther Glineur, Giulia Liberati https://doi.org/10.17605/OSF.IO/9UD7X

Understanding oscillatory correlates of pain expectation

Recommended by Gemma Learmonth based on reviews by Zoltan Dienes, Chris Chambers and Markus Ploner

Recent studies using an EEG frequency tagging approach have reported modulations of alpha, beta and theta bands at the stimulation frequency during nociceptive/painful thermal stimulation compared to non-nociceptive/non-painful vibrotactile stimulation. Prior expectations of the intensity of upcoming painful stimuli are known to strongly modulate the subjective experience of those stimuli. Thus, modulating the expectation of pain should result in a change in the modulation of oscillations if these factors are indeed linked.

In this study, Leu, Glineur and Liberati modulated expectations of pain (low or high intensity) in 40 participants prior to delivering thermal cutaneous stimulation (low, medium or high intensity). They recorded how intense participants expected the pain to be, and how intense they felt it to be, as well as EEG to assess oscillatory differences across the expectation and intensity conditions.

The results confirmed that there was a strong effect of expectation on the perceived stimulus intensity. However, contrary to the hypotheses, this was not reflected in the cortical oscillations. Overall this indicates a possible dissociation between perceived pain and modulation of ongoing oscillations in the theta, alpha and beta bands.

URL to the preregistered Stage 1 protocol: https://osf.io/y6fb8

Level of bias control achieved: Level 6. No part of the data or evidence that was used to answer the research question was generated until after IPA.

List of eligible PCI RR-friendly journals:

References

1. Leu, C., Glineur, E. & Liberati, G. (2023). Cue-based modulation of pain stimulus expectation: do ongoing oscillations reflect changes in pain perception? [Stage 2] Acceptance of Version 2 by Peer Community in Registered Reports. https://osf.io/awrge

25 Mar 2024

STAGE 1

Assessing compliance with UK loot box industry self-regulation on the Apple App Store: a 6-month longitudinal study on the implementation process

Leon Y. Xiao https://osf.io/7xft9

Does self regulation by gaming companies for the use of loot boxes work?

Recommended by Zoltan Dienes based on reviews by Chris Chambers, Lukas J. Gunschera and Andy Przybylski

Video games may provide the option of spending real money in exchange for probabilistically receiving game-relevant rewards; in effect, encouraging potentially young teenagers to gamble. The industry has subscribed to a set of regulatory principles to cover the use of such "loot boxes", including 1) that they will prevent loot box purchasing by under 18s unless parental consent is given; 2) that they will make it initially clear that the game contains loot boxes; and 3) that they will clearly disclose the probabilities of receiving different rewards.

Can the industry effectively self regulate? Xiao (2024) will evaluate this important question by investigating the 100 top selling games on the Apple App Store and estimating the percentage compliance to these three regulatory principles at two time points 6 months apart.

URL to the preregistered Stage 1 protocol: https://osf.io/3knyb

List of eligible PCI RR-friendly journals:

References

1. Xiao, L. (2024). Assessing compliance with UK loot box industry self-regulation on the Apple App Store: a 6-month longitudinal study on the implementation process. In principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/3knyb

14 Aug 2023

STAGE 1

Cue-based modulation of pain stimulus expectation: do ongoing oscillations reflect changes in pain perception?

Chiara Leu, Esther Glineur, Giulia Liberati https://osf.io/4v3sh

Understanding oscillatory correlates of pain expectation

Recommended by Gemma Learmonth based on reviews by Zoltan Dienes, Chris Chambers and Markus Ploner

In this study, Leu, Glineur and Liberati will modulate expectations of pain (low or high intensity) prior to delivering thermal cutaneous stimulation (low, medium or high intensity). They will record how intense participants expect the pain to be, and how intense they felt it to be, as well as record EEG to assess oscillatory differences across the expectation and intensity conditions.

The Stage 1 manuscript was reviewed over 5 rounds by 3 reviewers. Based on detailed responses to the reviewers’ comments and edits to the Stage 1 report, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance.

URL to the preregistered Stage 1 protocol: https://osf.io/y6fb8

Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.

List of eligible PCI RR-friendly journals:

References

1. Leu, C., Glineur, E. & Liberati, G. (2023). Cue-based modulation of pain stimulus expectation: do ongoing oscillations reflect changes in pain perception? In principle acceptance of Version 5 by Peer Community in Registered Reports. https://osf.io/y6fb8

07 Oct 2022

STAGE 2
(Go to stage 1)

Is the past farther than the future? A registered replication and test of the time-expansion hypothesis based on the filling rate of duration

Qinjing Zhang, Yoshitaka Masuda, Kodai Toda, Kohei Ueda, Yuki Yamada https://doi.org/10.31234/osf.io/pb47n

The Temporal Doppler Effect may not be a robust and culturally universal phenomenon

Recommended by Ljerka Ostojic based on reviews by Chris Chambers and 1 anonymous reviewer

The Temporal Doppler Effect refers to the subjective perception that the past is further away than the future even when both temporal distances are objectively the same from the present moment (Caruso et al., 2013). In the current study, Zhang et al. ran a replication of this phenomenon and tested one possible explanation for it, namely that people overestimate the temporal distance of the past because the past is filled with more events than the future. This is because we can access information only about planned events for the future, but have access to both planned and unplanned events that happened in the past (filled-duration illusion; Thomas & Brown, 1974).

Over two studies, the authors found that the sampled participants reported feeling that the past was psychologically closer than the future, which is the opposite of what has previously been reported and termed the Temporal Doppler Effect (Caruso et al., 2013). In addition, the authors reported inconsistent results regarding the correlations between the psychological distance and different variables associated with the filling rate of duration. The authors discuss the differences between their own results and those by Caruso et al. (2013) in terms of methodological and contextual differences and highlight cultural aspects that may be critical to consider in future replications and overall testing of this phenomenon. As such, they highlight that, at the moment, the Temporal Doppler Effect should not be considered a robust and culturally universal phenomenon.

The Stage 2 manuscript was evaluated by two reviewers who had also reviewed the stage 1 report. Following a revision by the authors, which consisted of adding the Data Availability statement, as well as a more precise summary of the results in various sections of the report, the recommender judged that the manuscript met the Stage 2 criteria and awarded a positive recommendation.

URL to the preregistered Stage 1 protocol: https://osf.io/d9ec3/

Level of bias control achieved: Level 6. No part of the data or evidence that was used to answer the research question existed prior to Stage 1 in-principle acceptance.

List of eligible PCI RR-friendly journals:

References

1. Caruso, E. M., Van Boven, L., Chin, M., & Ward, A. (2013). The temporal doppler effect: When the future feels closer than the past. Psychological Science, 24, 530-536. https://doi.org/10.1177/0956797612458804

2. Thomas, E. C., & Brown, I. (1974). Time perception and the filled-duration illusion. Perception & Psychophysics, 16, 449-458. https://doi.org/10.3758/BF03198571

3. Zhang, Q., Masuda, Y., Ueda, K.,Toda, K., & Yamada, Y. (2022). Is the past farther than the future? A registered replication and test of the time-expansion hypothesis based on the filling rate of duration. Stage 2 Registered Report, acceptance of Version 2 by Peer Community in Registered Reports. https://psyarxiv.com/pb47n/

19 Apr 2022

STAGE 1

Is the past farther than the future? A registered replication and test of the time-expansion hypothesis based on the filling rate of duration

Qinjing Zhang, Yoshitaka Masuda, Kohei Ueda, Kodai Toda, Yuki Yamada https://osf.io/c5uf6/

Could asymmetrical perceptions about the frequency of past and future events explain the Temporal Doppler Effect?

Recommended by Ljerka Ostojic based on reviews by Chris Chambers and 2 anonymous reviewers

The Temporal Doppler Effect is a phenomenon where people subjectively perceive the past to be further away than the future even when both temporal distances are objectively the same from the present moment (Caruso et al., 2013). A common explanation for this phenomenon assumes that our perception of the past and future is based on spatial and temporal analogies (Matlock, Ramscar, & Boroditsky, 2005; Casanto & Boroditsky, 2008) and that the subjective discrepancy is due to people feeling that they are moving towards the future and away from the fast, thus underestimating the temporal distance of the former and overestimating the temporal distance of the latter (Caruso et al., 2013).

In the current study, Zhang et al. propose to replicate the Temporal Doppler Effect as tested by Caruso et al. (2013) in study 1 and to test an alternative explanation for the effect in study 2 based on the filled-duration illusion (Thomas & Brown, 1974). This alternative explanation assumes that the subjective discrepancy is based on the difference that the past and the future are filled with events that we can remember or imagine. Because the past has already happened, it is comprised of more events (those that were planned and those that were not), while the future still exists only of events that are currently planned.

The Stage 1 manuscript was evaluated over three rounds of in-depth review. The main changes during the review process involved clarifications and adaptations of the way that the authors will measure the participants’ perception of how full of events the past and the future are, as the originally proposed way measuring this did not have sufficient theoretical or empirical justifications. The authors decided to address this by firstly, clarifying this issue in the stage 1 report so that the reader is aware of the potential shortcomings of this measure, and secondly, by testing a second group of participants with an alternative measure. Based on detailed responses to the reviewers’ comments and edits to the stage 1 report, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).

URL to the preregistered Stage 1 protocol: https://osf.io/d9ec3

Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.

List of eligible PCI RR-friendly journals:

References

2. Casanto, D., & Boroditsky, L. (2008). Time in the mind: Using space to think about time. Cognition, 106, 579-593. https://doi.org/10.1016/j.cognition.2007.03.004

3. Matlock, T., Ramscar, M., & Boroditsky, L. (2005). One the experiential link between spatial and temporal language. Cognitive Science, 29, 655-664. https://doi.org/10.1207/s15516709cog0000_17

4. Thomas, E. C., & Brown, I. (1974). Time perception and the filled-duration illusion. Perception & Psychophysics, 16, 449-458. https://doi.org/10.3758/BF03198571

5. Zhang, Q., Masuda, Y., Ueda, K.,Toda, K., & Yamada, Y. (2022). Is the past farther than the future? A registered replication and test of the time-expansion hypothesis based on the filling rate of duration. Stage 1 Registered Report, in principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/d9ec3

CHAMBERS Chris

CUBRIC, School of Psychology, Cardiff University, Cardiff, United Kingdom
Life Sciences, Social sciences
administrator, manager, recommender, developer

Recommendations: 84

Reviews: 8

Website https://scholar.google.com/citations?user=I-S_hs0AAAAJ&hl=en

Areas of expertise