Announcements
=============================================================================
IMPORTANT ANNOUNCEMENT: To accommodate reviewer and recommender holiday schedules, we will be closed to ALL submissions from 1st Jul - 1st Sep. During this time, reviewers can submit reviews and recommenders can issue decisions, but no new or revised submissions can be made by authors.
The one exception to this rule is that authors using the scheduled track who submit their initial Stage 1 snapshot prior to 1st Jul can choose a date within the shutdown period to submit their full Stage 1 manuscript.
We recommend that authors submit at least 1-2 weeks prior to commencement of the shutdown period to enable time to make any required revisions prior to in-depth review.
=============================================================================
We are recruiting recommenders (editors) from all research fields!
Your feedback matters! If you have authored or reviewed a Registered Report at Peer Community in Registered Reports, then please take 5 minutes to leave anonymous feedback about your experience, and view community ratings.
Latest recommendations
Id | Title * | Authors * | Abstract * | Picture▼ | Thematic fields * | Recommender | Reviewers | Submission date | |
---|---|---|---|---|---|---|---|---|---|
The effects of isolated game elements on adherence rates in food response inhibition trainingAlexander MacLellan, Charlotte R. Pennington, Natalia Lawrence, Samuel J. Westwood, Andrew Jones, Anna Slegrova, Beatrice Sung, Louise Parker, Luke Relph, Jessica O. Miranda, Maryam Shakeel, Elizabeth Mouka, Charlotte Lovejoy, Chaebin Chung, Sabela Lash, Yusra Suhail, Mehr Nag Katherine S. Button https://doi.org/10.31234/osf.io/2e73bUsing gamification to improve food response inhibition trainingRecommended by Mateo Leganes-FonteneauA poor diet has severe detrimental health effects, and attempts to reduce caloric intake often prove unsuccessful. Unhealthy foods, high in fat, sugar, and salt tend to be highly appetitive, and can undermine individuals’ ability to refrain themselves from consuming them. Computerized cognitive retraining techniques have shown promise in curbing the intake of unhealthy foods and promoting weight loss. However, in real-world scenarios, adherence to such retraining programs can be suboptimal, potentially diminishing their effectiveness.
In the present study, Maclellan et al. (2024) aimed to investigate whether the incorporation of gamified elements, transforming the cognitive retraining task into a game-like experience, can enhance adherence and overall intervention effectiveness by boosting engagement and motivation.
Upon testing the main hypotheses, the authors found mostly non-significant effects of adding gamified elements to adherence, motivation, or effectiveness of food response inhibition training programs. These results hold high relevance, as indeed there has been a push in introducing gamified elements to cognitive retraining programs. These findings should guide future developments in the field of cognitive retraining.
The Stage 2 manuscript was evaluated over one round of review and revision. Based on detailed evaluations by two expert reviewers, the recommender judged that the manuscript met the Stage 2 criteria and awarded a positive recommendation.
URL to the preregistered Stage 1 protocol: https://osf.io/jspf3
Level of bias control achieved: Level 6. No part of the data or evidence that was used to answer the research question was generated until after IPA. List of eligible PCI RR-friendly journals: References
MacLellan, A., Pennington, C. R., Lawrence, N., Westwood, S. J., Jones, A., Slegrova, A., Sung, B., Parker, L., Relph, L., Miranda, J. O., Shakeel, M., Mouka, E., Lovejoy, C., Chung, C., Lash, S., Suhail, Y., Nag M., and Button, K. S. (2024). The effects of isolated game elements on adherence rates in food response inhibition training [Stage 2]. Acceptance of Version 3 by Peer Community in Registered Reports.
| The effects of isolated game elements on adherence rates in food response inhibition training | Alexander MacLellan, Charlotte R. Pennington, Natalia Lawrence, Samuel J. Westwood, Andrew Jones, Anna Slegrova, Beatrice Sung, Louise Parker, Luke Relph, Jessica O. Miranda, Maryam Shakeel, Elizabeth Mouka, Charlotte Lovejoy, Chaebin Chung, Sabel... | <p>Introduction: Poor diet and the consumption of foods high in fat, sugar and salt are common causes of numerous health conditions and premature mortality. Computerised food response inhibition training (food-RIT) is a type of intervention found ... | Social sciences | Mateo Leganes-Fonteneau | 2024-06-28 23:29:31 | View | ||
Revisiting Partition Priming in judgment under uncertainty: Replication and extension Registered Report of Fox and Rottenstreich (2003)Kerou Ding, Gilad Feldman https://osf.io/xdpktUnderstanding probability assessments with partitioned framingRecommended by Romain EspinosaDecision-making based on limited information is a common occurrence. Whether it is the possibility of a cheaper product elsewhere or the unknown qualifications of election candidates, people are regularly forced to make a decision under ignorance or uncertainty. In such situations, information about certain events is unavailable or too costly to acquire and people rely on subjective probability allocation to guide decision-making processes. This allocation seems to result in what is known as ignorance priors, i.e., decision-makers assigning equal probabilities to each possible outcome within a given set. How events are grouped or partitioned is often subjective and may influence probability judgments and subsequent decisions. In such cases, the way the choices within a choice set are presented may shape the perceived likelihood of different outcomes. Understanding the impact of partitioning on probability estimation is crucial for both psychological and economic theories of judgment and decision-making. In the current work, Ding and Feldman (2025) conducted a replication study of one of the foundational works on the topic: Fox and Rottenstreich (2003). In the original work, the authors provided exploratory evidence indicating that the framing of a situation affects the way individuals perceive probabilities of possible outcomes. They showed that people assigned uniform probabilities to sets of events described in a problem, such that the way the events are described partly determined people’s partitioning of those events and evaluations of the probabilities of the possible outcomes. Additionally, this partitioned framing affected judgments both under conditions of ignorance (where individuals have no information and rely solely on uniform probability assignments) and uncertainty (where individuals have some information but still rely on heuristics influenced by partitioning). This suggests that priors resulting from the inference of available evidence are sometimes partly contaminated by partitioning bias, affecting both uninformed and partially informed decision-making processes. As a consequence, the partitioning of events into different subsets might lead to varying evaluations of a single situation, resulting in inconsistencies and poorly calibrated probability assessments. Ding and Feldman (2025) conducted a replication work on Studies 1a, 1b, 3, and 4 from Fox and Rottenstreich (2003). Their close replication relies on original data (US participants, Prolific, N=603) with a large statistical power (>95%). The replication aimed to assess whether the partitioned framing affects prior formation under ignorance (Studies 1a, 1b, and 4) and uncertainty (Study 3). The authors also proposed an extension examining estimations of complementary events contrasting estimations of the probabilities of the events happening versus the probabilities of the events not happening. Overall, the authors successfully replicated the original study based on their pre-registered evaluation criteria, finding support for partition dependence for most scenarios under scrutiny, yet with weaker effect sizes than the original studies. Out of the eleven Cohen’s h estimated by the replication study, one is consistent with the original study’s estimate (i.e., the original point estimate lies within the confidence interval of the replication), seven go in the same direction but are smaller (i.e., same sign for the estimated effect but the original point estimate is outside the CI of the replication), and two are not statistically different from zero (i.e., the CI of the replication includes zero). This Stage 2 manuscript was evaluated over one round of in-depth review by two expert reviewers and a second round of review by the recommender. After the revisions, the recommender judged that the manuscript met the Stage 2 criteria and therefore awarded a positive recommendation.
URL to the preregistered Stage 1 protocol: https://osf.io/px6vb
Level of bias control achieved: Level 6. No part of the data or evidence that was used to answer the research question was generated until after IPA.
List of eligible PCI RR-friendly journals:
References
1. Ding, K. & Feldman, G. (2025). Revisiting Partition Priming in judgment under uncertainty:
Replication and extension Registered Report of Fox and Rottenstreich (2003) [Stage 2]. Acceptance of Version 4 by Peer Community in Registered Reports. https://osf.io/xdpkt 2. Fox, C. R. & Rottenstreich, Y. (2003). Partition priming in judgment under uncertainty. Psychological Science, 14, 195-200. https://doi.org/10.1111/1467-9280.02431
| Revisiting Partition Priming in judgment under uncertainty: Replication and extension Registered Report of Fox and Rottenstreich (2003) | Kerou Ding, Gilad Feldman | <p>Partition dependence is the phenomenon in which individuals' evaluations of probabilities are influenced by the partitioning of the information in the way the information is presented or framed. In a Registered Report experiment with an America... | Social sciences | Romain Espinosa | 2024-06-29 17:30:22 | View | ||
24 Feb 2025
STAGE 1
![]() Gold in, gold out. Quality appraisal and risk of bias tools to assess non-intervention studies for systematic reviews in the behavioural sciences: A scoping reviewLucija Batinović, Jade S. Pickering, Olmo R. van den Akker, Dorothy Bishop, Mahmoud Elsherif, Thomas Rhys Evans, Melissa Gibbs, Tamara Kalandadze, Janneke Staaks, Marta Topor https://osf.io/7p8bmScoping review of quality appraisal and risk of bias tools and their relevance for behavioral sciencesRecommended by Antica CulinaSystematic reviews and meta-analyses are becoming more popular across sciences, often influencing future research, policies, interventions, and similar. The conclusions of evidence synthesis will depend on the quality of the primary studies (i.e. evidence) included. Thus, the quality and risk of bias in these primary studies must be essential components of evidence synthesis. However, in many scientific fields, including behavioural sciences, this is rarely so.
In this Stage 1 manuscript, Batinović et al. (2025) propose to conduct a systematic map of the existing tools to assess methodological quality of risk of bias tools across scientific fields, and map their applicability for primary studies within the broad field of behavioral sciences. The review will provide a comprehensive overview of how existing tools can be applied to the behavioral sciences, and identify gaps for future development of relevant tools in the field. The protocol and its methods were thoroughly developed, and are suitable to reach the research aims.
The Stage 1 submission was evaluated by two expert reviewers. After two rounds of revision, the recommender judged that the manuscript met the Stage 1 criteria, and the manuscript was awarded in-principle acceptance (IPA).
URL to the preregistered Stage 1 protocol: https://osf.io/4gy5b
Level of bias control achieved: Level 4. At least some of the data/evidence that will be used to answer the research question already exists AND is accessible in principle to the authors (e.g. residing in a public database or with a colleague) BUT the authors certify that they have not yet accessed any part of that data/evidence. List of eligible PCI RR-friendly journals:
References
1. Batinović, L., Pickering, J. S., van den Akker, O. R., Bishop, D., Elsherif, M., Evans, T. R., Gibbs, M., Kalandadze, T., Staaks, J., & Topor, M., Gold in, gold out. Quality appraisal and risk of bias tools to assess non-intervention studies for systematic reviews in the behavioural sciences: A scoping review. In principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/4gy5b | Gold in, gold out. Quality appraisal and risk of bias tools to assess non-intervention studies for systematic reviews in the behavioural sciences: A scoping review | Lucija Batinović, Jade S. Pickering, Olmo R. van den Akker, Dorothy Bishop, Mahmoud Elsherif, Thomas Rhys Evans, Melissa Gibbs, Tamara Kalandadze, Janneke Staaks, Marta Topor | <p>Systematic reviews depend critically on the methodological quality and bias levels of the studies they synthesise to provide the highest standard of evidence available for informing future research, practice, and policy. Despite the development... | Social sciences | Antica Culina | 2024-06-30 20:24:39 | View | ||
Self-Affirmation and Prejudice Against Religious Groups: The Role of Ideological MalleabilityYara Alnajjar, Constantina Badea and Béatrice Sternberg https://osf.io/st47hDoes ideological malleability moderate the effect of self-affirmation on prejudice?Recommended by Anna Elisabeth FürtjesSelf-affirmation may be an effective tool to reduce prejudice and discrimination against minority groups. Its hypothesised mechanism is that prejudice is a defensive act that can be reduced by reinforcing a positive imagine of the self. Such a reinforced self-image is meant to weaken perceived threat to one’s social identity that may be posed by minority groups, such as Muslims in majority Christian countries.
To address mixed evidence for the effectiveness of self-affirmation across the literature, this Registered Report (RR) was designed to elucidate conditions under which self-affirmation may reduce prejudice and discrimination. Whether self-affirmation has the desired effect may be moderated by an individual’s internal representation of secularism. That is, as a reaction to self-affirmation, people may flexibly endorse their feelings towards secularism (‘ideological malleability’) to either reduce prejudice, or maintain and justify it. This study is the first to consider whether this effect depends on a participant’s attitude that French citizens should be able to practice their religion in public places (‘historical’ secularism), or that they should hide it in public (‘new’ secularism).
Alnajjar et al. present a study design (i.e., three-way mixed ANOVA) in which they self-affirmed French participants (N=602) with differing internal representations of secularism. Study results demonstrated that a historical representation of secularism is associated with less effective and behavioural prejudice towards religious groups compared to a new representation of secularism. Participants’ prejudiced attitudes were larger against Muslims than against Christians. It was unexpected that new secularism was linked to negative attitudes towards religious minority groups given that the French government mandated by law that religion should not be practiced in public. Across three self-affirmation conditions (i.e., self-affirmation on a threat-related value, a threat-unrelated value, and no self-affirmation), the authors found no evidence that self-affirmation affected prejudice against religious groups, and there was no evidence that the effectiveness of self-affirmation depended on a participants representation of secularism, which contradicted their pre-registered hypotheses. This paper adds conclusive and sufficiently-powered results to a body of literature with mixed evidence for the effectiveness of self-affirmation.
It increased the robustness of this study that the design considered desirability concerns and employed multiple manipulation checks. By considering nuances of public opinion towards secularism in France specifically, the authors identified a unique opportunity to investigate ideological malleability, which can be challenging to conceive and directly measure.
The Stage 2 manuscript was evaluated by two experts who performed in-depth peer review across one round of revisions. There were no substantial changes to the introduction or the methods, the analyses were conducted as planned and additional analyses were labelled as exploratory. The revised manuscript was judged to meet the Stage 2 criteria and was awarded a positive recommendation.
URL to the preregistered Stage 1 protocol: https://osf.io/f4wm6
Level of bias control achieved: Level 6. No part of the data or evidence that was used to answer the research question was generated until after IPA.
List of eligible PCI RR-friendly journals: References
1. Alnajjar, Y., Badea, C., & Sternberg, B. (2024). Self-Affirmation and Prejudice Against Religious Groups: The Role of Ideological Malleability [Stage 2]. Acceptance of Version 2 by Peer Community in Registered Reports. https://osf.io/st47h
| Self-Affirmation and Prejudice Against Religious Groups: The Role of Ideological Malleability | Yara Alnajjar, Constantina Badea and Béatrice Sternberg | <p>Self-affirmation has shown mixed findings when used as a prejudice reduction technique, sometimes diminishing prejudice while sometimes increasing it or having no significant effect. In a Registered Report experiment with a French representativ... | Social sciences | Anna Elisabeth Fürtjes | 2024-07-30 11:57:10 | View | ||
The effect of covert visual attention on pupil size during perceptual fadingAna Vilotijević, Sebastiaan Mathôt https://osf.io/ku8qc?view_only=f331df53b50f431386fabba9e386b387Does pupil size track high-level attention?Recommended by D. Samuel SchwarzkopfHigher-level cognitive processes like attention, memory, or mental imagery can produce pupil responses, without any actual difference in luminance of the visual stimulus. Interestingly, the inverse scenario remained untested to date: when a physical luminance difference is perceptually eliminated from awareness, does pupil size still track attention to the stimulus? In this Registered Report, Vilotijević and Mathôt (2024) sought to test this experimentally using a perceptual fading phenomenon where two Gaussian patches with different luminances fade from consciousness and are thus perceived as mid-level uniform grey (or at least the subjective difference is much reduced). This fading manipulation, as well as a control condition without perceptual fading, were presented in separate blocks. Participants were instructed to covertly attend one of the patches.
The authors hypothesised that if pupil size reflects attentional selection, these pupil responses in the fading condition should be eliminated or at least reduced, and this should evolve with time as the stimuli are perceptually fading. Their results show that pupil responses during covert attention are indeed reduced during perceptual fading - but they are not eliminated. Interestingly, this reduction did not depend on time or self-reports of the strength of perceptual fading. The findings therefore suggest that pupil dilation tracks subjective brightness differences. One inherent issue with experiments like these is that the experimental and control conditions necessarily involve a physical difference in the stimulus. Here, the fading condition had the same spatial configuration of light and dark stimuli throughout a block while in the control (non-fading) condition the light and dark stimuli alternated sides between trials. It is therefore impossible to completely rule out that the physical difference affects the results. However, the only alternative to this would be an experimental design in which the stimuli never change, but only the subjective perceptual state varies. Such a design is completely at the mercy of the participant's subjective state and therefore loses experimental control and statistical sensitivity. The present results confirmed the authors' prediction that there are indeed differences in overall pupil responses during the fading and control conditions, irrespective of covert attention.
Critically, the fact that the attention effect did not vary with time or subjective self-reports of the illusion supports the authors' interpretation that this reflects higher-level cognition: the mere act of attending to the dark side - even if the actual appearance has faded - could cause a sustained pupil dilation. This would be consistent with the type of pupil effects for memory and mental imagery that motivated the present study. However, a simpler alternative is that the experience of perceptual fading was incomplete (as possibly suggested by Figures 2D and 2F) but that self-reports fail to capture this subjective experience accurately. Perhaps a future study could compare the magnitude of the attentional pupil effects when the initial stimulus is completely removed. If similar differences in pupil response persist this would suggest that the present results are due to high-level modulation or the residual low-level luminance difference.
The Stage 2 manuscript was evaluated by two reviewers and the recommender over two rounds of review. One reviewer again advised additional robustness checks to rule out eye movement confounds, an issue they had already raised during Stage 1 review. The researchers provide clear evidence that this is unlikely to have confounded their findings. This has been added to the supplementary data repository. Following this review and revision, the recommender judged that the Stage 2 criteria were met and awarded a positive recommendation.
URL to the preregistered Stage 1 protocol: https://osf.io/bmtp6
Level of bias control achieved: Level 6. No part of the data or evidence that was used to answer the research question was generated until after IPA. List of eligible PCI RR-friendly journals:
References
1. Vilotijević, A. & Mathôt, S. (2024). The effect of covert visual attention on pupil size during perceptual fading [Stage 2]. Acceptance of Version 2 by Peer Community in Registered Reports. https://osf.io/ku8qc?view_only=f331df53b50f431386fabba9e386b387
| The effect of covert visual attention on pupil size during perceptual fading | Ana Vilotijević, Sebastiaan Mathôt | <p>Pupil size is modulated by various cognitive factors such as attention, working memory, mental imagery, and subjective perception. Previous studies examining cognitive effects on pupil size mainly focused on inducing or enhancing a subjective e... | Social sciences | D. Samuel Schwarzkopf | 2024-08-17 12:58:58 | View | ||
Can playing Dungeons and Dragons be good for you? A registered exploratory pilot program using offline Tabletop Role-Playing Games (TTRPGs) to mitigate social anxiety and reduce problematic involvement in multiplayer online video gamesJoël Billieux, Loïs Fournier, Lucien Rochat, Iliyana Georgieva, Charlotte Eben, Marc Malmdorf Andersen, Daniel L. King, Olivier Simon, Yasser Khazaal, Andreas Lieberoth, Jonathan Bloch https://osf.io/htbwaExpanding the Intervention Potential of Tabletop Role-Playing GamesRecommended by Veli-Matti KarhulahtiThe human capacity and need for play has been recognized as a central psychotherapeutic component for a long time (e.g. Winnicott 1971). More recently, experts have started developing specialized digital gameplay to be used as therapeutic tools and even utilizing existing videogames for similar purposes (see Ceranoglu 2010). On the other hand, the concerns about some players becoming overinvolved in videogames also led the World Health Organization to include “gaming disorder” in the 11th edition of the International Classification of Diseases, which echoes the nuance required to address human-technology relationships in general.
In the present registered report, Billieux et al. (2024) make use of analog structured role-play in a new intervention aiming to mitigate social anxiety and problematic gaming patterns in online gamers. The authors carried out an exploratory pilot to test a 10-week protocol over three modules inspired by the well-known Dungeons & Dragons franchise. Through a multiple single-case design with a 3-month follow-up, the authors carried out the pilot with 20 participants (two dropped out), which enabled collecting valuable early data about the feasibility and potential of the intervention. Weekly psychometric assessments indicated that the intervention may support participants and it should continue to be studied in order to comprehensively evaluate its effectiveness. Feedback obtained from participants and other parts of the pilot project enabled identifying elements (e.g., difficulty adjustments), which can be given attention usefully in intervention development. Without question, the study by Billieux et al. (2024) is to be commended for highly transparent documentation of the project, which allows future researchers and intervention developers to learn from the pilot beyond initial results. Among other relevant materials, the supplements provide a detailed case study and item-level psychometric reporting, which can help the development of technical solutions and new hypotheses. Taken together, the study by Billieux et al. (2024) paves the way for open science invention piloting in the field. The Stage 2 manuscript was evaluated by three experts (areas: experimental methods, psychopathology, gaming) via in-depth peer review across two rounds. Based on the authors’ careful responses and revisions, the revised manuscript was judged to meet the Stage 2 criteria and was awarded a positive recommendation. URL to the preregistered Stage 1 protocol: https://osf.io/h7qat Level of bias control achieved: Level 6. No part of the data or evidence that was used to answer the research question was generated until after IPA. List of eligible PCI RR-friendly journals: References
1. Billieux, J., Fournier, L., Rochat, L., Georgieva, I., Eben, C., Malmdorf Andersen, M., King, D., Simon, O., Khazaal, Y., Lieberoth, A. & Blocha., J. (2024) Can playing Dungeons and Dragons be good for you? A registered exploratory pilot program using offline Tabletop Role-Playing Games (TTRPGs) to mitigate social anxiety and reduce problematic involvement in multiplayer online videogames [Stage 2 RR]. Acceptance of Version 2 by Peer Community in Registered Reports. https://osf.io/z32d5 2. Ceranoglu, T. (2010). Video Games in Psychotherapy. Review of General Psychology, 14 (2). https://doi.org/10.1037/a0019439
3. Winnicott, D. (1971/2009). Playing and Reality. Routledge.
| Can playing Dungeons and Dragons be good for you? A registered exploratory pilot program using offline Tabletop Role-Playing Games (TTRPGs) to mitigate social anxiety and reduce problematic involvement in multiplayer online video games | Joël Billieux, Loïs Fournier, Lucien Rochat, Iliyana Georgieva, Charlotte Eben, Marc Malmdorf Andersen, Daniel L. King, Olivier Simon, Yasser Khazaal, Andreas Lieberoth, Jonathan Bloch | <p><strong>Background</strong>. Gamers with poor self-concept, high social anxiety, and high loneliness are more at risk of problematic involvement in video games, particularly in massively multiplayer online role-playing games (MMORPGs). There is... | Social sciences | Veli-Matti Karhulahti | Charlotte Pennington, Matti Vuorre, Matúš Adamkovič | 2024-08-30 11:29:55 | View | |
12 May 2025
STAGE 1
![]() Is CPP an ERP marker of evidence accumulation in perceptual decision-making? A multiverse studyYikang Liu, Chuyao Yan, Hu Chuan-Peng https://osf.io/p6aumEvaluating the role of the centro-parietal positivity in perceptual decision-makingRecommended by Chris ChambersOne of the hallmarks of adaptive behaviour is perceptual decision-making: the ability to select and integrate sensory inputs to guide judgments and actions. For decades, evidence accumulation models (EAMs) have been influential in shaping understanding of perceptual decision-making, proposing that evidence for different choices builds over time until a threshold is reached and a decision is triggered. At the same time, reliable biomarkers for evidence accumulation have been observed through single-unit recordings in non-human primates, particularly in parietal, frontal and premotor regions. In humans, the centro-parietal positivity (CPP) – a positive deflection in the event-related potential (ERP) waveform – has emerged as a candidate proxy of perceptual decision-making, exhibiting accumulate-to-bound dynamics, modality-independence, and versatility to sensory inputs. However, much remains to be understood about the generalisability of the CPP across different behavioural contexts, from simple decision-making tasks (e.g. motion discrimination) to more complex judgments (e.g. emotion discrimination).
In the current study, Liu et al. (2025) will test the robustness of the CPP in human decision-making by leveraging secondary analysis of existing datasets. Broadly, they hypothesise that if the CPP is a reliable and generalisable biomarker then it should covary statistically with evidence accumulation, both at the trial level and across tasks that increase in complexity. To test this prediction, the authors will undertake joint modelling of behavioural and ERP data using drift-diffusion modelling, capturing variability within and between trials to estimate the relationship between the CPP and drift rate. In addition, the authors will use multiverse analysis to test the robustness of the observed relationships across a range of different analysis choices, with decision nodes focusing on the choice of CPP metric (build-up rate, amplitude, or peak amplitude) and pooling method in statistical analysis (trial-wise or bin-wise). Overall, the study promises to offer a fresh perspective – both methodologically and theoretically – on how CPP relates to perceptual decision-making.
The Stage 1 manuscript was evaluated over two rounds of in-depth review. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
URL to the preregistered Stage 1 protocol: https://osf.io/vwmzh
Level of bias control achieved: Level 3. At least some data/evidence that will be used to the answer the research question has been previously accessed by the authors (e.g. downloaded or otherwise received), but the authors certify that they have not yet observed any part of the data/evidence List of eligible PCI RR-friendly journals: References
Liu, Y., Yan, C., & Chuan-Peng, H. (2025). Is CPP an ERP marker of evidence accumulation in perceptual decision-making? A multiverse study. In principle acceptance of Version 4 by Peer Community in Registered Reports. https://osf.io/vwmzh
| Is CPP an ERP marker of evidence accumulation in perceptual decision-making? A multiverse study | Yikang Liu, Chuyao Yan, Hu Chuan-Peng | <p>Perceptual decision-making is a crucial cognitive process where sensory information is integrated to form judgments and actions. This process is explained by evidence accumulation models (EAM), which posit that decision-makers gather and accumu... | Life Sciences | Chris Chambers | Cassie Short, April Shi Min Ching, Caleb Stone | 2024-09-03 18:27:35 | View | |
23 Jan 2025
STAGE 1
![]() Mapping methodological variation in experience sampling research from design to data analysis: A systematic reviewLisa Peeters, Wim Van Den Noortgate, M. Annelise Blanchard, Gudrun Eisele, Olivia Kirtley, Richard Artner, Ginette Lafit https://osf.io/8mwguMethodological Variation in the Experience Sampling Methods: Can We Do ESM Better?Recommended by Thomas EvansThe replication crisis/credibility revolution has driven a vast number of changes to our research environment (Korbmacher et al., 2023) including a much needed spotlight on issues surrounding measurement (Flake & Fried, 2020). As general understanding and awareness has increased surrounding the 'garden of forking paths' or 'researcher degrees of freedom' (Simmons et al., 2011), and the various decisions made during the scientific process that could impact the conclusions drawn by the process, so too should our interest in meta-research that tells us more about the methodological processes we follow, and how discretionary decisions may influence the design, analysis and reporting of a project.
Peeters et al. (2025) have proposed a systematic literature review of this nature, mapping the methodological variation in experience sampling methods (ESM) from the design stage all the way to dissemination. It starts this journey by mapping how ESM studies vary e.g., in design, considering a variety of factors like sample size, number of measurements, and sampling scheme. It also evaluates reporting quality, rationales provided, and captures the extent of open science practices adopted. Covering many parts of the research process that get assumed, unreported or otherwise unjustified, the proposed work looks set to springboard an important body of work that can tell us more effectively how to design, implement and report ESM studies.
The Stage 1 submission was reviewed over one round of in-depth review with two reviewers. Based on detailed responses to reviewers’ feedback, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance.
URL to the preregistered Stage 1 protocol: https://osf.io/ztvn3
Level of bias control achieved: Level 1. At least some of the data/evidence that will be used to the answer the research question has been accessed and observed by the authors, including key variables, but the authors certify that they have not yet performed any of their preregistered analyses, and in addition they have taken stringent steps to reduce the risk of bias. List of eligible PCI-RR-friendly journals:
References
1. Flake, J. K., & Fried, E. I. (2020). Measurement schmeasurement: Questionable measurement practices and how to avoid them. Advances in Methods and Practices in Psychological Science, 3, 456-465. https://doi.org/10.1177/2515245920952393
2. Korbmacher, M., Azevedo, F., Pennington, C. R., Hartmann, H., Pownall, M., Schmidt, K., ... & Evans, T. (2023). The replication crisis has led to positive structural, procedural, and community changes. Communications Psychology, 1, 3. https://doi.org/10.1038/s44271-023-00003-2
3. Peeters, L., Van Den Noortgate, W., Blanchard, M. A., Eisele, G., Kirtley, O., Artner, R., & Lafit, G. (2025). Mapping Methodological Variation in ESM Research from Design to Data Analysis: A Systematic Review. In principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/ztvn3
4. Simmons, J. P., Nelson, L. D., & Simonsohn, U. (2011). False-positive psychology: Undisclosed flexibility in data collection and analysis allows presenting anything as significant. Psychological Science, 22, 1359-1366. https://doi.org/10.1177/0956797611417632
| Mapping methodological variation in experience sampling research from design to data analysis: A systematic review | Lisa Peeters, Wim Van Den Noortgate, M. Annelise Blanchard, Gudrun Eisele, Olivia Kirtley, Richard Artner, Ginette Lafit | <p><strong>Aim</strong>. The Experience Sampling Method (ESM) has become a widespread tool to study time-varying constructs across many subfields of psychological and psychiatric research. This large variety in subfields of research and constructs... | Social sciences | Thomas Evans | 2024-09-04 10:39:37 | View | ||
Mechanisms of secularization: Testing between the rationalization and existential insecurity theoriesMartin Lang, Radim Chvaja https://doi.org/10.31234/osf.io/gy7sjUnderstanding links between secularization, rationalisation and insecurityRecommended by Adrien FillonWhat relationship can be expected between secularization, rationalization and insecurity? While some authors argue that rationalization reduces the willingness to belong to religious groups, others have suggested that insecurity increases this need to belong to religious groups.
In the current study, Lang and Chvaja (2024) adjudicated between these two possibilities using an economics game with 811 participants from two countries: US and Poland. The central question posed by the authors is whether cooperative insecurity increases the probability of joining a religious normative group. They tested the relationship between an environment (secure and insecure) and institution (which related to the norm context: religious and secular) on the probability of choosing the normative group in an experimental setting.
The authors included an adequate power analysis, alternatives for non-supported hypotheses, and filtering to ensure a high quality of data collection. They also undertook a pilot study to ensure the quality of the procedure and sensitivity of the analyses. There were only a few, minor, and well documented deviations from stage 1.
For the non-religious group, secularity increased the odds of joining the normative group when faced with insecurity. For the religious group, the results were mixed, mostly due to the unexpected high rate of participants joining the religious group in the secure environment. The researchers then pooled the regular and reversed scenarii and found support for the existential insecurity theory.
The authors concluded that both theories (the rationalization theory and the existential insecurity theory) can be at work, as the majority of the sample did not choose the religious normative group due to a potential rationalization, but they do slightly more when faced with (existential) insecurity.
The Stage 2 manuscript was evaluated over two rounds of review. Based on detailed responses to reviewers’ and the recommender’s comments, the recommender judged that the manuscript met the Stage 2 criteria and therefore awarded a positive recommendation.
URL to the preregistered Stage 1 protocol: https://osf.io/yzgek
Level of bias control achieved: Level 6. No part of the data or evidence that was used to answer the research question was generated until after IPA.
List of eligible PCI RR-friendly journals:
References 1.Lang, M. & Chvaja, R. (2024). Mechanisms of secularization: Testing between the rationalization and existential insecurity theories [Stage 2]. Acceptance of Version 2 by Peer Community in Registered Reports. https://doi.org/10.31234/osf.io/gy7sj
| Mechanisms of secularization: Testing between the rationalization and existential insecurity theories | Martin Lang, Radim Chvaja | <p>The study tests two competing explanations of the secularization process related to rationalizing worldviews and decreasing existential insecurity. While the former explanation argues that people are unwilling to join religious groups because o... | Humanities, Social sciences | Adrien Fillon | 2024-09-06 15:23:11 | View | ||
28 Jan 2025
STAGE 1
![]() See me, judge me, pay me: Gendered effort moralization in work and careLeopold H. O. Roth, Tassilo T. Tissot, Thea Fischer, S. Charlotte Masak https://osf.io/rz6yuA gender difference in effort moralization?Recommended by Adrien FillonEffort moralization is the well known idea that, unrelated to actual performance, people doing more effort are judged better, attributed more morality and seen as better collaborators than people doing less effort. However, the series of studies on this topic mostly used vignettes with a man or a neutral protagonist. The current study by Roth et al. (2025) proposes to tackle the gender problem by testing the difference in attribution morality between a man and a woman protagonist, and two contexts: a “care” and a “work” context, mirroring the stereotypes associated with men and women.
The authors included two different and adequate power analyses, various interpretation of the possible effects, and filtering to ensure a high quality of data collection. They also provide a supplementary repository including the qualtrics survey, R script, and simulated data.
The Stage 1 manuscript was evaluated over two rounds of in-depth review. Based on detailed responses to the reviewers’ and the recommender’s comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance. URL to the preregistered Stage 1 protocol: https://osf.io/xd87r Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists, and no part will be generated until after IPA. List of eligible PCI RR-friendly journals:
References
Roth, L. H. O., Tissot, T. T., Fischer, T. & Masak, S. C. (2025). See me, judge me, pay me: Gendered effort moralization in work and care. In principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/xd87r
| See me, judge me, pay me: Gendered effort moralization in work and care | Leopold H. O. Roth, Tassilo T. Tissot, Thea Fischer, S. Charlotte Masak | <p>The display of high effort at work is commonly rewarded with more positive moral judgements and increased cooperation partner attractiveness. This effect was shown to hold, even if higher effort is unrelated to better performance. Yet, current ... | Social sciences | Adrien Fillon | 2024-09-09 15:12:30 | View |
FOLLOW US
MANAGING BOARD
Chris Chambers
Zoltan Dienes
Corina Logan
Benoit Pujol
Maanasa Raghavan
Emily S Sena
Yuki Yamada