Submit a report

Announcements

=============================================================================

IMPORTANT ANNOUNCEMENT: To accommodate reviewer and recommender holiday schedules, we will be closed to ALL submissions from 1st Jul - 1st Sep. During this time, reviewers can submit reviews and recommenders can issue decisions, but no new or revised submissions can be made by authors.

The one exception to this rule is that authors using the scheduled track who submit their initial Stage 1 snapshot prior to 1st Jul can choose a date within the shutdown period to submit their full Stage 1 manuscript.

We recommend that authors submit at least 1-2 weeks prior to commencement of the shutdown period to enable time to make any required revisions prior to in-depth review.

=============================================================================

We are recruiting recommenders (editors) from all research fields!

Your feedback matters! If you have authored or reviewed a Registered Report at Peer Community in Registered Reports, then please take 5 minutes to leave anonymous feedback about your experience, and view community ratings.

Latest recommendations

IdTitle * Authors * Abstract * PictureThematic fields * RecommenderReviewersSubmission date
30 Sep 2024
STAGE 1

Examining the role of action interpretation in changes in choice induced by go/no-go and approach/avoidance responses

Does interpretation of actions as either avoid or inhibit influence choice behaviour for candy?

Recommended by based on reviews by Alexander MacLellan and Katrijn Houben
Experimental research demonstrates that executing or inhibiting motor responses (or approaching / avoiding) towards a stimulus can alter the valuation of the stimulus (Yang et al., 2022). There are competing theories as to the proposed mechanisms of value change, such as increased response conflict or prediction errors (Houben & Aulbach, 2023). However, research has mostly examined response execution/inhibition and approach/avoidance in isolation and the few studies that have examined these together have focused on stimulus evaluation as an outcome.
 
In the present study, Chen et al. (2024) will use a novel version of a combined go/no-go / approach avoidance paradigm to test the effects on choice of consumable candy. In this task, participants are randomly assigned to make a response framed as a go / no-go action or an approach / avoidance action to control a shopping cart (Chen & Van Dessel, 2024). Following this they will complete a food choice task in which participants make a series of binary choices for different candies. Their performance on this task will lead to the receipt of real-world candy. The authors aim to test whether the same responses will lead to different effects on food choice, depending on how the response was interpreted (e.g. participants in the approach/avoidance instruction group will select Approach items more often than those in the go/no-go instruction group). The study is well powered to detect the proposed effect size of interest, and data will be analysed using Bayesian mixed-effect models.
 
This study will shed light onto theoretical predictions of action interpretation on stimulus value and choice, which may improve the efficacy of behaviour change tools such as approach bias training in future.  
 
The Stage 1 manuscript was evaluated over two rounds of in-depth review. Based on detailed responses to the recommender and reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
 
URL to the preregistered Stage 1 protocol: https://osf.io/bn5xa
 
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA. 
 
List of eligible PCI RR-friendly journals:
 
 
References

 
1. Chen, Z. and Van Dessel, P. (2024). Action interpretation determines the effects of go/no-go and approach/avoidance actions on stimulus evaluation. Open Mind, 8, 898-923.  https://doi.org/10.1162/opmi_a_00151
 
2. Chen, Z., Van Dessel, P., and Figner, B. (2024). Examining the role of action interpretation in changes in choice induced by go/no-go and approach/avoidance responses. In principle acceptance of Version 2 by Peer Community in Registered Reports. https://osf.io/bn5xa
 
3. Houben, K. and Aulbach, M. (2023). Is there a difference between stopping and avoiding? A review of the mechanisms underlying Go/No-Go and Approach-Avoidance training for food choice. Current Opinion in Behavioral Sciences, 49, 101245. https://doi.org/10.1016/j.cobeha.2022.101245
 
4. Yang, Y., Qi, L., Morys, F., Wu, Q. and Chen, H. (2022). Food-Specific Inhibition Training for Food Devaluation: A Meta-Analysis. Nutrients, 14, 1363. https://doi.org/10.3390/nu14071363
 
Examining the role of action interpretation in changes in choice induced by go/no-go and approach/avoidance responsesZhang Chen, Pieter Van Dessel, Bernd Figner <p>Executing go/no-go (GNG) and approach/avoidance (AAT) responses toward objects can increase people’s choices for go over no-go items, and for approach over avoidance items. Some theoretical accounts explain these effects as the results of merel...Social sciencesAndrew Jones Alexander MacLellan, Katrijn Houben2024-06-17 17:57:07 View
24 Oct 2024
STAGE 2
(Go to stage 1)

When children can explain why they believe a claim, they suggest better empirical tests for those claims

The role of metacognition in how children test surprising claims

Recommended by ORCID_LOGO based on reviews by Elizabeth Lapidow and Amy Masnick
As children grow, their cognition develops alongside their metacognition – the awareness and understanding of their own thought processes. One important aspect of cognitive development is learning effective strategies for exploring new situations and testing surprising claims, prompting the question of how improvement in cognition and reasoning is related to metacognitive understanding of these processes. For example, as children develop more targeted and efficient exploration strategies to test a surprising claim (e.g. “of these three rocks, the smallest one is the heaviest”), metacognitive understanding of why they are uncertain or skeptical may be crucial to testing the claim effectively and, in the long run, developing more complex reasoning and logical skills.
 
In this lab-based study of 174 children, Hermansen et al. (2024) tested the role of metacognition in shaping how children search for information to test surprising claims. Using a series of measures – including an experimental task involving comparative claims (e.g. “this rubber duck sinks much faster than this metal button”) – the authors asked whether older (relative to younger) children express more uncertainty about surprising claims, propose more plausible reasons for their uncertainty, and are more likely to suggest specific empirical tests for a claim. Furthermore, they investigated whether prompting children to reflect on their uncertainty helps them devise an efficient test for the claim, and whether any such benefit of prompting is greater for younger children.
 
Results provided mixed support for the hypotheses. Contrary to expectations, older children were not more likely than younger children to express uncertainty about surprising claims -- although an exploratory analysis suggested that prior belief may moderate the relationship with age. Consistent with predictions, older children did, however, propose more plausible reasons for their uncertainty and were more likely to suggest specific empirical tests for a claim. Interestingly, prompting children to reflect on their uncertainty did not significantly increase the likelihood that they would generate an efficient test for a claim, although exploratory analysis again suggested that taking to account additional variables (in this case the type of explanation children provide when prompted) could moderate the effect. Taken together, these findings suggest that the development of children’s reasoning about their own beliefs influences their empirical evaluation of those beliefs. Overall, the study highlights the role of metacognition in the development of explicit scientific thinking and suggests a variety of promising avenues for future research.
 
The Stage 2 manuscript was evaluated over one round of in-depth review. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 2 criteria and awarded a positive recommendation.
 
URL to the preregistered Stage 1 protocol: https://osf.io/uq6dw
 
Level of bias control achieved: Level 6. No part of the data or evidence that was used to answer the research question was generated until after IPA. 
 
List of eligible PCI RR-friendly journals:
 
*Note: Despite being listed as a PCI RR-friendly outlet at Stage 1 (in 2022), Infant and Child Development was removed from the above listing at Stage 2 due to the decision by the journal's publisher (Wiley) in 2024 to withdraw its journals from all PCIs, including PCI RR. As part of this withdrawal, Wiley chose to renege on previous commitments issued by Infant and Child Development to PCI RR authors.
 
References
 
1. Hermansen T. K., Mathisen, K. F., & Ronfard, S. (2024). When children can explain why they believe a claim, they suggest better empirical tests for those claims [Stage 2]. Acceptance of Version 2 by Peer Community in Registered Reports. https://osf.io/6ket7?view_only=d86eb8b5296b4499801e052a6a22291f
When children can explain why they believe a claim, they suggest better empirical tests for those claimsTone K. Hermansen, Kamilla F. Mathisen, Samuel Ronfard<p>Hearing about surprising phenomena triggers exploration, even in young children. This exploration increases and changes with age. It becomes more targeted and efficient with children around 6-years-old clearly exploring with the intent to verif...Social sciencesChris Chambers2024-06-19 09:39:15 View
21 Oct 2024
STAGE 2
(Go to stage 1)

Inconclusive evidence for associations between adverse experiences in adulthood and working memory performance

Adversity and working memory: Nuanced effects underpinned by rigorous methodology

Recommended by ORCID_LOGO based on reviews by Kathryn Bates and 1 anonymous reviewer
Adverse environments involving threat, uncertainty, deprivation, and stress have been shown to have significant impacts on cognition and development. In this Stage 2 manuscript, Vermeent et al. (2024) adhere to their Stage 1 protocol, investigating the effects of adversity on working memory (WM) using a comprehensive, psychometric modeling approach. The authors aimed to clarify seemingly contradictory findings from previous research: The evidence for working memory capacity impairments in adverse environments versus the possibility that adversity might enhance specific aspects of WM, such as updating ability. Moreover, they examined the effects of distinct types of adversity—neighborhood threat, material deprivation, and unpredictability—on WM performance.
 
The results of the study were, overall, inconclusive: the authors did not find consistent associations between adversity and either WM capacity or WM updating ability. Despite using a large sample and employing latent variable modeling, the study did not reveal significant effects that were either clearly positive or negative for any type of adversity examined. In addition, no evidence for equivalence to zero associations was found. The lack of clear associations suggests that the relationship between adversity and WM is likely more complex than previously thought.
 
As with the Stage 1 evaluation, this manuscript has undergone a rigorous peer review process at Stage 2. The reviewers included specialists in child and youth cognitive development. The constructive feedback from the reviewers ensured that the pre-registered protocol was followed accurately, deviations were reported appropriately, and all concerns raised were addressed satisfactorily. These processes helped to refine Vermeent et al.'s methods and confirm that the planned analysis was followed. Despite the inconclusive results, this study makes a significant contribution to our understanding of the subtle effects of adversity on working memory by providing transparent and rigorous findings that add valuable data to the field. Therefore, I am fully confident that this manuscript is suitable for Stage 2 recommendation.
 
URL to the preregistered Stage 1 protocol: https://osf.io/dp7wc
 
Level of bias control achieved: Level 3. At least some data/evidence that was used to the answer the research question had been previously accessed by the authors (e.g. downloaded or otherwise received), but the authors certify that they had not yet observed ANY part of the data/evidence until after Stage 1 in-principle acceptance.
 
List of eligible PCI RR-friendly journals:
 
 
References
 
1. Vermeent, S., Schubert, A.-L., DeJoseph, M. L., Denissen, J. J. A, van Gelder, J.-L. & Frankenhuis, W. E. (2024). Inconclusive evidence for associations between adverse experiences in adulthood and working memory performance [Stage 2]. Acceptance of Version 3 by Peer Community in Registered Reports. https://github.com/StefanVermeent/liss_wm_profiles_2023/blob/master/manuscript/stage2_tracked.pdf
Inconclusive evidence for associations between adverse experiences in adulthood and working memory performance Stefan Vermeent, Anna-Lena Schubert, Meriah L. DeJoseph, Jaap J. A. Denissen, Jean-Louis van Gelder, Willem E. Frankenhuis<p>Decades of research have shown that adversity tends to be associated with lower working memory (WM) performance. This literature has mainly focused on impairments in the capacity to hold information available in WM for further processing. Howev...Social sciencesYuki Yamada2024-06-25 15:25:13 View
10 Jan 2025
STAGE 1
article picture

Development and evaluation of a revised 20-item short version of the UPPS-P Impulsive Behavior Scale

Assessing Impulsivity Measurement (UPPS-P-20-R)

Recommended by ORCID_LOGO based on reviews by Ivan Ropovik and Orestis Zavlis
Impulsivity, as a construct, operates by an established history with various models and theories (Leshem & Glicksohn 2007) having accumulated evidence of relevance especially for mental disorders. One of the dominant models, the Impulsive Behavior Model, is conventionally measured in survey studies with UPPS-P scales, a short version of which was recently assessed in a large cross-cultural project (Fournier et al. 2024). In the present study, Fournier and colleagues (2025) aim to further test the revised 20-item scale in English via a three-phase protocol involving evaluations of construct validity, internal consistency reliability, test-retest reliability, convergent validity, and criterion validity. As such, the study contributes to ongoing important development of useful and up-to-date survey scales, which can help researchers avoid measurement issues (Flake & Fried 2020) in various fields where, in this case, impulsivity plays a role.
 
The study was reviewed over three rounds by two reviewers, with respective topic and methods expertise. Based on detailed responses to reviewers’ feedback and the recommender’s comments on the construct, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance.
 
URL to the preregistered Stage 1 protocol: https://osf.io/wevc4 (under temporary private embargo)

Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.
 
List of eligible PCI-RR-friendly journals:
 
 
References
 
1. Flake, J. K. & Fried, E. I. (2020). Measurement schmeasurement: Questionable measurement practices and how to avoid them. Advances in Methods and Practices in Psychological Science, 3, 456-465. https://doi.org/10.1177/2515245920952393
 
2. Fournier, L., Bőthe, … & Billieux, J. (2024). Evaluating the factor structure and measurement invariance of the 20-item short version of the UPPS-P Impulsive Behavior Scale across multiple countries, languages, and gender identities. Assessment, 10731911241259560. https://doi.org/10.1177/10731911241259560
 
3. Fournier, L., Heeren, A., Baggio, S., Clark, L., Verdejo-García, A., Perales J.C., Billieux J. (2025) Development and evaluation of a revised 20-item short version of the UPPS-P Impulsive Behavior Scale. In principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/wevc4
 
4. Leshem, R. & Glicksohn, J. (2007). The construct of impulsivity revisited. Personality and individual Differences, 43, 681-691. https://doi.org/10.1016/j.paid.2007.01.015
Development and evaluation of a revised 20-item short version of the UPPS-P Impulsive Behavior ScaleLoïs Fournier, Alexandre Heeren, Stéphanie Baggio, Luke Clark, Antonio Verdejo-García, José C. Perales, Joël Billieux<p style="text-align: justify;">The UPPS-P Impulsive Behavior Scale is a well-established psychometric instrument for assessing impulsivity, a key psychological construct transdiagnostically involved in the etiology of numerous psychiatric and neu...Social sciencesVeli-Matti Karhulahti Ivan Ropovik 2024-06-27 17:47:17 View
06 Feb 2025
STAGE 1

Disentangling the Influences of Curiosity and Active Exploration on Cognitive Map Formation

Investigating influences of curiosity and active exploration on spatial memory

Recommended by ORCID_LOGO based on reviews by Alexandr Ten and 2 anonymous reviewers
A growing body of research suggests that feelings of curiosity are associated with better memory for new information. However, while curiosity has been broadly defined as an instrinsic drive to obtain information, much of this existing work has focused on learning of trivia facts or factual information, settings where people have relatively little freedom to actively explore aspects of the environment that generate those feelings of curiosity. In this Stage 1 manuscript, O'Donoghue, Cen, and Gruber (2025) propose to conduct an experiment to examine whether feelings of curiosity promote the formation of cognitive maps when exploring novel spatial environments. Participants will encounter a series of virtual rooms for which they report their level of curiosity before exploring each room. The experiment will compare groups of participants who can actively explore for themselves vs. passive observers of the same exploration patterns. The proposed analyses will examine whether anticipatory curiosity leads to better memory for the spatial environments for both active or passive participants, or if benefits to memory are mediated by active participants' ability to act of their feelings of curiosity through their exploration of the environment. The findings of the study will provide new insight into the mechanisms through which anticipatory curiosity enhances memory.
 
The Stage 1 submission was evaluated by three expert reviewers. After three rounds of revision, the recommender determined that the manuscript met the Stage 1 criteria and awarded in-principle acceptance (IPA).
 
URL to the preregistered Stage 1 protocol: https://osf.io/86r3x
 
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.
 
List of eligible PCI RR-friendly journals:
 
 
References
 
1. O'Donoghue, E. M., Cen, D., & Gruber, M. (2025). Disentangling the Influences of Curiosity and Active Exploration on Cognitive Map Formation. In principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/86r3x
Disentangling the Influences of Curiosity and Active Exploration on Cognitive Map FormationEllen M. O'Donoghue, Danlu Cen, Matthias J. Gruber<p>Curiosity has long been assumed to promote exploration, and in turn, to support cognitive map formation. However, little research has directly investigated these claims. Recently, Cen et al. (2024) demonstrated that when participants feel more ...Social sciencesDouglas Markant2024-06-28 10:30:38 View
14 Sep 2024
STAGE 2
(Go to stage 1)

Self-Control Beyond Inhibition. German Translation and Quality Assessment of the Self-Control Strategy Scale (SCSS)

Strategies for self control: German translation and evaluation of the Self Control Strategy Scale

Recommended by ORCID_LOGO based on reviews by Eleanor Miles, Kaitlyn Werner and Sebastian Bürgler
Self-control has shown to be a trait related to beneficial outcomes, including health, academic achievement and relationship quality. It is mostly understood as the ability to suppress immediate urges in order to achieve long-term goals, such as not watching another episode and therefore reaching a healthy amount of sleep. An emerging perspective on self-control shows that there is broader variety in applied strategies, such as removing oneself from a tempting situation, or reminding oneself of one's long-term goal, or reinterpreting the temptation.
 
Katzir et al. (2021) developed a novel instrument, the Self-Control Strategy Scale, that measured the tendency to engage in eight such strategies. In the current study, Roth et al. (2024) translated the scale into German and assessed its psychometric properties: internal consistency and retest reliability were sufficient for six or seven of the eight subscales. Further, different strategies (subscales) were related to particular outcomes; at least one strategy was related to each outcome for 20 out of 23 outcomes in health behavior, school/work achievement, life satisfaction, interpersonal functioning and pro-environmental behavior (though the particular pattern of similarities and differences would need confirming). Thus, the SCSS is a valid and reliable measure that can now be used in German.
 
The Stage 2 manuscript was evaluated over two rounds of in-depth review by the recommender and at least two expert reviewers. Following revision, the recommender judged that the manuscript met the Stage 2 criteria and awarded a positive recommendation.
 
URL to the preregistered Stage 1 protocol: https://osf.io/s7qwk
 
Level of bias control achieved: Level 6. No part of the data or evidence that was used to answer the research question was generated until after IPA.
 
List of eligible PCI RR-friendly journals:
 

References
 
1. Katzir, M., Baldwin, M., Werner, K. M., and Hofmann, W. (2021). Moving beyond inhibition: Capturing a broader scope of the self-control construct with the Self-Control Strategy Scale (SCSS). Journal of Personality Assessment, 103, 762-776. https://doi.org/10.1080/00223891.2021.1883627
 
2. Roth, L. H. O., Jankowski, J., Meindl, D., Clay, G., Mlynski, C., Freiman, O., Nordmann, A., Stenzel, L., and Wagner, V. (2024). Self-Control beyond inhibition. German Translation and Quality Assessment of the Self-Control Strategy Scale (SCSS) [Stage 2]. Acceptance of Version 3 by Peer Community in Registered Reports. https://doi.org/10.31234/osf.io/gpmnv

Self-Control Beyond Inhibition. German Translation and Quality Assessment of the Self-Control Strategy Scale (SCSS)Leopold H. O. Roth, Julia M. Jankowski, Dominik Meindl, Georgia Clay, Christopher Mlynski, Olga Freiman, Artemis L. Nordmann, Loana-Corine Stenzel, Victoria Wagner<p>Self-control is crucial for goal attainment and related to several beneficial outcomes, such as health and education. For a long time, it was predominantly understood in terms of inhibition, namely the ability to suppress immediate urges for th...Social sciencesZoltan Dienes Kaitlyn Werner, Eleanor Miles, Sebastian Bürgler2024-06-28 11:50:25 View
16 Oct 2024
STAGE 1

Psychological Wellbeing, Sleep, and Video Gaming: Analyses of Comprehensive Digital Traces

What is the relationship between video gaming and wellbeing?

Recommended by ORCID_LOGO based on reviews by Chris Chambers, Valtteri Kauraoja and 1 anonymous reviewer
The popularity of gaming has spurred interest in understanding its impact on wellbeing. Significant research has investigated the impact of gaming from multiple angles. However, prior research has been limited by a lack of behavioural data that could be more reliable in examining the impact of gaming than self-reports of behavior. Similarly, previous research has called for examining the impact of gaming while taking genre differences into consideration.
 
In this programmatic submission (3 x Stage 2 outputs), Ballou et al. (2024) address these gaps by combining digital trace data of gamers across multiple gaming platforms (Nintendo Switch, Xbox (US only), Steam, and mobile systems (iOS and Android)) with psychological surveys measuring the gamers’ basic psychological needs, sleep quality, and subjective wellbeing over a three-month period. Participants will complete 30 daily surveys (US only) and six bi-weekly panel surveys.
 
The combination of behavioral trace data and psychological self-reports offers a rare and comprehensive look at how gaming influences different important aspects of wellbeing. This work is ambitious and addresses scientifically and socially important questions on the impact of gaming.
 
The manuscript underwent one round of in-depth review, where three reviewers with a combination of methodological and domain expertise gave generally positive feedback on the manuscript, providing directions to further strengthen the research. The authors – as judged by the recommender – thoroughly addressed the reviewer comments and have worked to further strengthen the rigour of the manuscript. A further revision round was issued by the recommender to address a minor issue with one hypothesis and other small linguistic edits.
 
Based on detailed responses to the recommender and reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
 
URL to the preregistered Stage 1 protocol: https://osf.io/mvngt
 
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.
 
List of eligible PCI RR-friendly journals:
 
 
References
 
1. Ballou, N., Hakman, T., Földes, T., Vuorre, M., Magnusson, K., & Przybylski, A. K. (2024). Psychological Wellbeing, Sleep, and Video Gaming: Analyses of Comprehensive Digital Traces. In principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/mvngt
Psychological Wellbeing, Sleep, and Video Gaming: Analyses of Comprehensive Digital TracesNick Ballou, Thomas Hakman, Tamas Foldes, Matti Vuorre, Kristoffer Magnusson, Andrew K. Przybylski<p>The increasing prevalence of video gaming has raised questions about its psychological effects, yet research has been hampered by challenges in accessing comprehensive behavioral and psychological data. We aim to address these gaps by collectin...Social sciencesLobna Hassan2024-06-28 15:59:07 View
09 Sep 2024
STAGE 2
(Go to stage 1)

The effects of isolated game elements on adherence rates in food response inhibition training

Using gamification to improve food response inhibition training

Recommended by ORCID_LOGO based on reviews by Miguel Vadillo and Daniel Phipps
A poor diet has severe detrimental health effects, and attempts to reduce caloric intake often prove unsuccessful. Unhealthy foods, high in fat, sugar, and salt tend to be highly appetitive, and can undermine individuals’ ability to refrain themselves from consuming them. Computerized cognitive retraining techniques have shown promise in curbing the intake of unhealthy foods and promoting weight loss. However, in real-world scenarios, adherence to such retraining programs can be suboptimal, potentially diminishing their effectiveness.
 
In the present study, Maclellan et al. (2024) aimed to investigate whether the incorporation of gamified elements, transforming the cognitive retraining task into a game-like experience, can enhance adherence and overall intervention effectiveness by boosting engagement and motivation.
 
Upon testing the main hypotheses, the authors found mostly non-significant effects of adding gamified elements to adherence, motivation, or effectiveness of food response inhibition training programs. These results hold high relevance, as indeed there has been a push in introducing gamified elements to cognitive retraining programs. These findings should guide future developments in the field of cognitive retraining.
 
The Stage 2 manuscript was evaluated over one round of review and revision. Based on detailed evaluations by two expert reviewers, the recommender judged that the manuscript met the Stage 2 criteria and awarded a positive recommendation.
 
URL to the preregistered Stage 1 protocol: https://osf.io/jspf3

Level of bias control achieved: Level 6. No part of the data or evidence that was used to answer the research question was generated until after IPA.
 
List of eligible PCI RR-friendly journals:
 
References
 
MacLellan, A., Pennington, C. R., Lawrence, N., Westwood, S. J., Jones, A., Slegrova, A., Sung, B., Parker, L., Relph, L., Miranda, J. O., Shakeel, M., Mouka, E., Lovejoy, C., Chung, C., Lash, S., Suhail, Y., Nag M., and Button​, K. S. (2024). The effects of isolated game elements on adherence rates in food response inhibition training​ [Stage 2]. Acceptance of Version 3 by Peer Community in Registered Reports.
The effects of isolated game elements on adherence rates in food response inhibition trainingAlexander MacLellan, Charlotte R. Pennington, Natalia Lawrence, Samuel J. Westwood, Andrew Jones, Anna Slegrova, Beatrice Sung, Louise Parker, Luke Relph, Jessica O. Miranda, Maryam Shakeel, Elizabeth Mouka, Charlotte Lovejoy, Chaebin Chung, Sabel...<p>Introduction: Poor diet and the consumption of foods high in fat, sugar and salt are common causes of numerous health conditions and premature mortality. Computerised food response inhibition training (food-RIT) is a type of intervention found ...Social sciencesMateo Leganes-Fonteneau2024-06-28 23:29:31 View
01 Apr 2025
STAGE 2
(Go to stage 1)

Revisiting Partition Priming in judgment under uncertainty: Replication and extension Registered Report of Fox and Rottenstreich (2003)

Understanding probability assessments with partitioned framing

Recommended by ORCID_LOGO based on reviews by Olivier L'Haridon and Don Moore

Decision-making based on limited information is a common occurrence. Whether it is the possibility of a cheaper product elsewhere or the unknown qualifications of election candidates, people are regularly forced to make a decision under ignorance or uncertainty. In such situations, information about certain events is unavailable or too costly to acquire and people rely on subjective probability allocation to guide decision-making processes. This allocation seems to result in what is known as ignorance priors, i.e., decision-makers assigning equal probabilities to each possible outcome within a given set. How events are grouped or partitioned is often subjective and may influence probability judgments and subsequent decisions. In such cases, the way the choices within a choice set are presented may shape the perceived likelihood of different outcomes. Understanding the impact of partitioning on probability estimation is crucial for both psychological and economic theories of judgment and decision-making.

In the current work, Ding and Feldman (2025) conducted a replication study of one of the foundational works on the topic: Fox and Rottenstreich (2003). In the original work, the authors provided exploratory evidence indicating that the framing of a situation affects the way individuals perceive probabilities of possible outcomes. They showed that people assigned uniform probabilities to sets of events described in a problem, such that the way the events are described partly determined people’s partitioning of those events and evaluations of the probabilities of the possible outcomes. Additionally, this partitioned framing affected judgments both under conditions of ignorance (where individuals have no information and rely solely on uniform probability assignments) and uncertainty (where individuals have some information but still rely on heuristics influenced by partitioning). This suggests that priors resulting from the inference of available evidence are sometimes partly contaminated by partitioning bias, affecting both uninformed and partially informed decision-making processes. As a consequence, the partitioning of events into different subsets might lead to varying evaluations of a single situation, resulting in inconsistencies and poorly calibrated probability assessments.

Ding and Feldman (2025) conducted a replication work on Studies 1a, 1b, 3, and 4 from Fox and Rottenstreich (2003). Their close replication relies on original data (US participants, Prolific, N=603) with a large statistical power (>95%). The replication aimed to assess whether the partitioned framing affects prior formation under ignorance (Studies 1a, 1b, and 4) and uncertainty (Study 3). The authors also proposed an extension examining estimations of complementary events contrasting estimations of the probabilities of the events happening versus the probabilities of the events not happening.

Overall, the authors successfully replicated the original study based on their pre-registered evaluation criteria, finding support for partition dependence for most scenarios under scrutiny, yet with weaker effect sizes than the original studies. Out of the eleven Cohen’s h estimated by the replication study, one is consistent with the original study’s estimate (i.e., the original point estimate lies within the confidence interval of the replication), seven go in the same direction but are smaller (i.e., same sign for the estimated effect but the original point estimate is outside the CI of the replication), and two are not statistically different from zero (i.e., the CI of the replication includes zero).  

This Stage 2 manuscript was evaluated over one round of in-depth review by two expert reviewers and a second round of review by the recommender. After the revisions, the recommender judged that the manuscript met the Stage 2 criteria and therefore awarded a positive recommendation.
 
URL to the preregistered Stage 1 protocol: https://osf.io/px6vb
 
Level of bias control achieved: Level 6. No part of the data or evidence that was used to answer the research question was generated until after IPA.
 
List of eligible PCI RR-friendly journals:
 
 
References 
 
1. Ding, K. & Feldman, G. (2025). Revisiting Partition Priming in judgment under uncertainty:
Replication and extension Registered Report of Fox and Rottenstreich (2003) [Stage 2]. Acceptance of Version 4 by Peer Community in Registered Reports. https://osf.io/xdpkt
 
2. Fox, C. R. & Rottenstreich, Y. (2003). Partition priming in judgment under uncertainty. Psychological Science, 14, 195-200. https://doi.org/10.1111/1467-9280.02431
Revisiting Partition Priming in judgment under uncertainty: Replication and extension Registered Report of Fox and Rottenstreich (2003)Kerou Ding, Gilad Feldman<p>Partition dependence is the phenomenon in which individuals' evaluations of probabilities are influenced by the partitioning of the information in the way the information is presented or framed. In a Registered Report experiment with an America...Social sciencesRomain Espinosa2024-06-29 17:30:22 View
24 Feb 2025
STAGE 1

Gold in, gold out. Quality appraisal and risk of bias tools to assess non-intervention studies for systematic reviews in the behavioural sciences: A scoping review

Scoping review of quality appraisal and risk of bias tools and their relevance for behavioral sciences

Recommended by ORCID_LOGO based on reviews by Alejandro Sandoval-Lentisco
Systematic reviews and meta-analyses are becoming more popular across sciences, often influencing future research, policies, interventions, and similar. The conclusions of evidence synthesis will depend on the quality of the primary studies (i.e. evidence) included. Thus, the quality and risk of bias in these primary studies must be essential components of evidence synthesis. However, in many scientific fields, including behavioural sciences, this is rarely so.
 
In this Stage 1 manuscript, Batinović et al. (2025) propose to conduct a systematic map of the existing tools to assess methodological quality of risk of bias tools across scientific fields, and map their applicability for primary studies within the broad field of behavioral sciences. The review will provide a comprehensive overview of how existing tools can be applied to the behavioral sciences, and identify gaps for future development of relevant tools in the field. The protocol and its methods were thoroughly developed, and are suitable to reach the research aims.
 
The Stage 1 submission was evaluated by two expert reviewers. After two rounds of revision, the recommender judged that the manuscript met the Stage 1 criteria, and the manuscript was awarded in-principle acceptance (IPA).
 
URL to the preregistered Stage 1 protocol: https://osf.io/4gy5b

Level of bias control achieved: Level 4. At least some of the data/evidence that will be used to answer the research question already exists AND is accessible in principle to the authors (e.g. residing in a public database or with a colleague) BUT the authors certify that they have not yet accessed any part of that data/evidence.
 
List of eligible PCI RR-friendly journals:
 
References
 
1. Batinović, L., Pickering, J. S., van den Akker, O. R., Bishop, D., Elsherif, M., Evans, T. R., Gibbs, M., Kalandadze, T., Staaks, J., & Topor, M., Gold in, gold out. Quality appraisal and risk of bias tools to assess non-intervention studies for systematic reviews in the behavioural sciences: A scoping review. In principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/4gy5b
Gold in, gold out. Quality appraisal and risk of bias tools to assess non-intervention studies for systematic reviews in the behavioural sciences: A scoping reviewLucija Batinović, Jade S. Pickering, Olmo R. van den Akker, Dorothy Bishop, Mahmoud Elsherif, Thomas Rhys Evans, Melissa Gibbs, Tamara Kalandadze, Janneke Staaks, Marta Topor<p>Systematic reviews depend critically on the methodological quality and bias levels of the studies they synthesise to provide the highest standard of evidence available for informing future research, practice, and policy. Despite the development...Social sciencesAntica Culina2024-06-30 20:24:39 View