Submit a report

Announcements

We are recruiting recommenders (editors) from all research fields!

Your feedback matters! If you have authored or reviewed a Registered Report at Peer Community in Registered Reports, then please take 5 minutes to leave anonymous feedback about your experience, and view community ratings.

Latest recommendations

IdTitle * Authors * Abstract * PictureThematic fields * RecommenderReviewersSubmission date
23 Mar 2023
STAGE 2
(Go to stage 1)

Revisiting the role of public exposure and moral beliefs on feelings of shame and guilt: Replication Registered Report of Smith et al. (2002)’s Study 1

The effect of public exposure and moral beliefs on feelings of shame and guilt

Recommended by ORCID_LOGO based on reviews by Uriel Haran
Shame and guilt are powerful negative emotions that are notable for their external vs. internal focus: while shame is generally experienced in response to public scrutiny, guilt arises from a self-directed, private evaluation. In a formative study, Smith et al. (2002) asked whether the level of public exposure influenced levels of shame and guilt arising from one's transgressions, and found that, compared to private situations, public exposure was more strongly associated with shame than with guilt. Since then, these findings have had significant implications for theories and applications of moral psychology.
 
In the current study, Zhang et al. (2023) directly replicated Smith et al. (2002) in a large online sample, revisiting two critical questions from Study 1: (a) whether public exposure affects the magnitude of shame and guilt over one’s misconduct, and (b) whether stronger moral belief increases guilt and shame over one’s misconduct. The results fail to confirm the original conclusions: both public exposure and manipulation of moral beliefs were found to influence shame and guilt, with no reliable evidence that shame was influenced more strongly than guilt. These findings thus constitute a non-replication and offer a challenge to theoretical models that hinge on the separability of shame and guilt as separate constructs.
 
The Stage 2 manuscript was evaluated over one round of in-depth review. Based on detailed responses to the reviewer's comments, the recommender judged that the manuscript met the Stage 2 criteria and awarded a positive recommendation.
 
URL to the preregistered Stage 1 protocol: https://osf.io/j7kt2
 
Level of bias control achieved: Level 6. No part of the data or evidence that was used to answer the research question was generated until after IPA. 
 
List of eligible PCI RR-friendly journals:
 
References
 
1. Smith, R. H., Webster, J. M., Parrott, W. G., & Eyre, H. L. (2002). The role of public exposure in moral and nonmoral shame and guilt. Journal of Personality and Social Psychology, 83, 138-159. https://doi.apa.org/doi/10.1037/0022-3514.83.1.138
 
2. Zhang, Y., Cheung, F. C., Wong, H.T., Yuen, L. Y., Sin, H. C., Chow, H. T. & Feldman, G. (2023). Revisiting the role of public exposure and moral beliefs on feelings of shame and guilt: Replication Registered Report of Smith et al. (2002)’s Study 1. Acceptance of Version 5 by Peer Community in Registered Reports. https://osf.io/jpx87
Revisiting the role of public exposure and moral beliefs on feelings of shame and guilt: Replication Registered Report of Smith et al. (2002)’s Study 1 Yikang Zhang, Fung Chit (Jack) Cheung, Hei Tung (Patrina) Wong, Lok Yee (Noel) Yuen, Hui Ching (Rachel) Sin, Hiu Tung Kristy Chow, Gilad Feldman<p>Shame and guilt are unpleasant self-conscious emotions associated with negative evaluations of oneself or one’s behavior. Smith et al. (2002) demonstrated that shame and guilt are distinct and are impacted differently by public exposure, that i...Social sciencesChris Chambers2023-02-03 10:58:20 View
17 Nov 2022
STAGE 2
(Go to stage 1)

Removing barriers to plant-based diets: assisting doctors with vegan patients

Informing doctors of the evidence on plant-based diets

Recommended by ORCID_LOGO based on reviews by Alaa Aldoh, Joshua Tasoff and Bence Palfi
What the best diet is has always been an area of contention. But one thing is clear: Meat is not necessary for health or fitness, and a diet high in plant proteins may well be especially healthy (e.g. Herpich et al., 2022). Further, plant- rather than animal-based diets leave a lower carbon footprint. So what might hold people back from adopting a plant-based diet? One reason is that people may understandably approach their doctor for advice; and the doctor may advise against it, given that many doctors are not well trained in nutrition (Crowley et al., 2019).

Espinosa et al. (2022) conducted a randomised control trial on French general practitioners with 200 doctors given a leaflet and access to an online platform, and 200 controls. The information in the materials concerned the health benefits of plant-based diets, and what nutrients (e.g. B12) may be deficient and what may not be. Attitudes towards and knowledge about plant-based diets was assessed. On a scale of 0-100% expressing whether they would advise for or against (0 = not at all, 100 = absolutely), the intervention shifted attitudes making them more positive about plant based diets by 17 percentage points. However, knowledge of specifically what is worth testing for (e.g. is zinc deficiency more probable or not?) did not change much. The research shows just what can be achieved by a small leaflet (shifting attitudes) and what may require more extensive training (knowledge of relevant medical practice).

The Stage 2 manuscript was evaluated over one round of in-depth review. Based on the responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 2 criteria and awarded a positive recommendation.
 
URL to the preregistered Stage 1 protocol: https://osf.io/fc9gp
 
Level of bias control achieved: Level 6. No part of the data or evidence that was used to answer the research question existed prior to Stage 1 in-principle acceptance.
 
List of eligible PCI RR-friendly journals:
 

References

1. Crowley, J., Ball, L. & Hiddink, G. J. (2019.) Nutrition in medical education: a systematic review. Lancet Planetary Health. 3, e379–e389. https://doi.org/10.1016/S2542-5196(19)30171-8
 
2. Herpich, C., Müller-Werdan, U., & Norman, K. (2022). Role of plant-based diets in promoting health and longevity. Maturitas, 165, 47-51. https://doi.org/10.1016/j.maturitas.2022.07.003
 
3. Espinosa, R., Arpinon, T., Maginot, P., Demange, S. & Peureux, F. (2022). Removing barriers to plant-based diets: assisting doctors with vegan patients, acceptance of Version 2 by Peer Community in Registered Reports. https://osf.io/kq6eh?view_only=66eab29c7acb4aebbcec4631cbcb9217
Removing barriers to plant-based diets: assisting doctors with vegan patientsRomain Espinosa, Thibaut Arpinon, Paco Maginot, Sébastien Demange, and Florimond Peureux<p>Shifting to plant-based diets can alleviate many of the externalities associated with the current food<br>system. Spontaneous shifts in diet are often hindered by consumers’ imperfect knowledge about the<br>health risks and benefits, which lead...Medical Sciences, Social sciencesZoltan Dienes2022-08-27 11:01:32 View
20 Apr 2023
STAGE 1

The relationship of memory consolidation with task incorporations into dreams – A registered report

Are dreams important for memory consolidation?

Recommended by ORCID_LOGO based on reviews by 1 anonymous reviewer
Sleep is known to be crucial for human memory, but what about dreams? Previous research has shown that the content of dreams can be manipulated by specific stimuli or tasks prior to sleep, but whether incorporating tasks into dreams influences memory consolidation is less clear. Some studies have shown an association between incorporating memory tasks into dreams and later memory performance, while others show either no effect or weaker effects. Potential reasons for this variation include the targeting of different stages of sleep – including rapid eye moment (REM) and non-REM stages (NREM) – small sample sizes, and the fact that many previous studies do not employ declarative memory tasks, which have been found to benefit more from sleep compared with tasks that target procedural memory.
 
In the current study. Schoch et al. (2023) ask whether dreams are an epiphenomenon of sleep-dependent memory processing or, instead, whether they play a key role in memory consolidation – and if so, whether that role differs for subjective experiences during NREM and REM sleep stages. Using a declarative memory task, a serial awakening paradigm (in which participants are woken and tested during NREM or REM stages), and targeted memory reactivation (TMR), the authors will test two main hypotheses: that incorporating picture categories of a declarative memory task leads to immediate (next morning) and sustained (4 days later) improvement in memory performance (especially for NREM dreams); and second, whether TMR influences the reported content of dreams. The authors also build in a range of control analyses to confirm that the task was incorporated successfully into dreams and that TMR benefited memory performance.
 
The Stage 1 manuscript was evaluated over two rounds of in-depth review, initially at Nature Communications before being transferred to PCI RR for further evaluation (see review history below for details). Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
 
URL to the preregistered Stage 1 protocol: https://osf.io/7dwjz
 
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.
 
List of eligible PCI RR-friendly journals:
 
References
 
1. Schoch, S. F., Ataei, S., Salvesen, L., Schredl, M., Windt, J., Bernadi, G., Rasch, B., Axmacher, N., & Desler, M. (2023). The relationship of memory consolidation with task incorporations into dreams – A registered report, in principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/7dwjz
The relationship of memory consolidation with task incorporations into dreams – A registered reportSarah F. Schoch, Somayeh Ataei, Leila Salvesen, Michael Schredl, Jennifer Windt, Giulio Bernardi, Björn Rasch, Nikolai Axmacher, and Martin Dresler<p>Sleep is crucial for memory consolidation, but whether dreams play an essential role in memory consolidation is still unknown. This research will examine if incorporating a memory task into dreams benefits memory strength in a sleep-stage-depen...Social sciencesChris Chambers2022-03-23 13:49:52 View
05 Mar 2025
STAGE 1
article picture

Social cognition as a matter of structural brain connections? A systematic review and diffusion weighted imaging meta-analysis

Social cognition and white matter integrity: Systematic review and diffusion weighted imaging meta-analysis

Recommended by ORCID_LOGO based on reviews by Sebastian Ocklenburg and Katie Lavigne
Social cognition involves complex processes including empathy, mentalizing, and compassion, which rely on structural connectivity and specifically white matter (WM) integrity. Prior research suggests that deficits in social cognition are linked to deficient structural connectivity, indicating that the latter might be an essential foundation for social cognitive abilities. In the current study, Hansl et al. (2025) explore the relationship between social cognition and white matter (WM) integrity in the brain across different populations, by means of a systematic review and meta-analyses. Using diffusion-weighted imaging data, the authors aim to identify specific WM tracts most associated with social cognition. Meta-analyses of region-of-interest (ROI)-based studies will provide further insights, while meta-regression and subgroup analyses will examine differences across social cognitive constructs, imaging metrics, clinical conditions, and age groups. The findings could clarify global and specific WM contributions to social cognition, guiding future research on brain structure-function relationships in social cognition across various populations.
 
The Stage 1 submission was evaluated by two expert reviewers. After two rounds of revision, the recommender judged that the manuscript met the Stage 1 criteria and awarded in-principle acceptance (IPA).
 
URL to the preregistered Stage 1 protocol: https://osf.io/6n3jy (under temporary private embargo)
 
Level of bias control achieved: Level 2. At least some data/evidence that will be used to answer the research question has been accessed and partially observed by the authors, but the authors certify that they have not yet observed the key variables within the data that will be used to answer the research question and they have taken additional steps to maximise bias control and rigour.
 
List of eligible PCI RR-friendly journals:
 
 
References
 
1. Hansl, R., Maliske, L. Z., Valk, S. L., & Kanske, P. (2025). Social cognition as a matter of structural brain connections? A systematic review and diffusion weighted imaging meta-analysis. In principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/6n3jy
Social cognition as a matter of structural brain connections? A systematic review and diffusion weighted imaging meta-analysisRita Hansl, Lara Z. Maliske, Sofie L. Valk, Philipp Kanske<p>Social cognition encompasses several cognitive and affective processes essential for successful social interaction and communication (e.g. empathy, mentalizing, compassion). The interplay of the various processes necessary for understanding the...Life SciencesMarietta Papadatou-Pastou2024-09-20 13:51:12 View
19 Jan 2024
STAGE 1

A systematic review of social connection inventories

Improving the measurement of social connection

Recommended by ORCID_LOGO based on reviews by Jacek Buczny, Richard James and Alexander Wilson
This is an ambitious systematic review that uses a combination of quantitative and qualitative methods to make the measurement of the construct of social connection more rigorous. Social connection is a heterogeneous construct that includes aspects of structure, function and quality. Here, Paris et al. (2024) will use predefined methods to create a database of social connection measures, and will assess heterogeneity of items using human coders and ChatGPT. This database will form the basis of a second systematic review which will look at evidence for validity and measurement properties. This study will also look at the population groups and country of origin for which different measures were designed, making it possible to see how far culturally specific issues affect the content of measures in this domain.
 
The questions asked by this study are exploratory and descriptive and so the importance of pre-registration is in achieving clear criteria for how each question is addressed, rather than evidential criteria for hypothesis-testing.
 
The authors responded comprehensively to three reviewer reports. This study will provide a wealth of useful information for those studying social connection, and should serve to make the literature in this field more psychometrically robust and less fragmented.
 
URL to the preregistered Stage 1 protocol: https://osf.io/796uv
 
Level of bias control achieved: Level 3. At least some data/evidence that will be used to the answer the research question has been previously accessed by the authors (e.g. downloaded or otherwise received), but the authors certify that they have not yet observed ANY part of the data/evidence. 
 
List of eligible PCI RR-friendly journals:
 
 
References
 

1. Paris, B., Brickau, D., Stoianova, T., Luhmann, M., Mikton, C., Holt-Lunstad, J., Maes, A., & IJzerman, H. (2024). A systematic review of social connection inventories. In principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/796uv

A systematic review of social connection inventoriesBastien Paris, Debora Brickau, Tetiana Stoianova, Maike Luhmann, Christopher Mikton, Julianne Holt-Lunstad, Marlies Maes, Hans IJzerman<p>Social connection is vital to health and longevity. To date, a plethora of instruments exists to measure social connection, assessing a variety of aspects of social connection like loneliness, social isolation, or social support. For comparabil...Social sciencesDorothy Bishop Jacek Buczny, Richard James, Alexander Wilson2023-07-09 21:33:01 View
28 Jan 2025
STAGE 2
(Go to stage 1)

Unveiling the Positivity Bias on Social Media: A Registered Experimental Study On Facebook, Instagram, And X

Social media positivity bias, or just positivity bias?

Recommended by ORCID_LOGO based on reviews by Marcel Martončik, Julius Klingelhoefer and 1 anonymous reviewer
Both research and public debates around social media use tend to involve a premise of positivity bias, which refers to presenting one’s life in an overly positive light by various different means. This premise contributes to multiple potentially important follow-up hypotheses, such as the fear of missing out and low self-image effects, due to repeated consumption of positive social media content (e.g., Bayer et al. 2020, for a review). The positivity bias of social media use, itself, has received limited research attention. 
 
In the present study, Masciantonio and colleagues (2025) tested positivity bias in the context of three social media platforms: Facebook, Instagram, and X. The experiment involved recruiting participants (n=312) into platform-specific user groups and crafting posts to be shared with friends as well as respective social media audiences. For social media positivity bias to differ from everyday positivity bias, posts in the former should introduce more positive valence in comparison to offline sharing—and if the platforms differ in their encouragement of positivity bias, they should introduce significant between-platform differences in valence.
 
Based on how the participants reported events, the study found no significant differences between everyday and social media positivity bias, but messages posted on Twitter/X had a more negative valence than posts in other social media platforms. The results would be consistent with the implication that people's positive actions in social media simply follow the natural human tendency to present oneself positively to others—a hypothesis that should be investigated in follow-up work. More research attention should also be given to specific design features, which may contribute to platform-specific differences in user habits, as suggested by the distinct valence rate found in relation to Twitter/X.
 
The Stage 2 manuscript was evaluated by three experts (areas: experimental methods, social media, statistics) via in-depth peer review across two rounds, with one reviewer returning to validate analysis code and methdological accuracy on a final round. Based on the authors’ careful responses and revisions, the revised manuscript was judged to meet the Stage 2 criteria and was awarded a positive recommendation. 
 
URL to the preregistered Stage 1 protocol: https://osf.io/9z6hm
 
Level of bias control achieved: Level 6. No part of the data or evidence that was used to answer the research question was generated until after IPA.  
 
List of eligible PCI RR-friendly journals:
 
 
References
 
1. Bayer, J. B., Triệu, P., & Ellison, N. B. (2020). Social media elements, ecologies, and effects. Annual review of psychology, 71, 471-497. https:// doi.org/10.1146/annurev-psych-010419-050944
 
2. Masciantonio, A., Heiser, N., & Cherbonnier, A. (2025). Unveiling the Positivity Bias on Social Media: A Registered Experimental Study On Facebook, Instagram, And X [Stage 2]. Acceptance of Version 2 by Peer Community in Registered Reports. https://osf.io/s93yu 
Unveiling the Positivity Bias on Social Media: A Registered Experimental Study On Facebook, Instagram, And XAlexandra Masciantonio, Neele Heiser, Anthony Cherbonnier<p>Social media has transformed how people engage with the world around them. The positivity bias on social media, in particular, warrants in-depth investigation. This is particularly true as previous research has concentrated on one specific plat...Social sciencesVeli-Matti Karhulahti Marcel Martončik2024-09-23 11:20:07 View
31 May 2024
STAGE 1

Unveiling the Positivity Bias on Social Media: A Registered Experimental Study On Facebook, Instagram, And X

Social media positivity bias

Recommended by ORCID_LOGO based on reviews by Linda Kaye, Marcel Martončik, Julius Klingelhoefer and 1 anonymous reviewer
Both research and public debates around social media use tend to involve a premise of positivity bias, which refers to presenting one’s life in an overly positive light by various different means. This premise contributes to multiple potentially important follow-up hypotheses, such as the fear of missing out and low self-image effects, due to repeated consumption of positive social media content (e.g., Bayer et al. 2020, for a review). The positivity bias of social media use, itself, has received limited research attention, however. 
 
In the present study, Masciantonio and colleagues (2024) will test positivity bias in the context of three social media platforms: Facebook, Instagram, and X. The experiment involves recruiting participants into platform-specific user groups and crafting posts to be shared with friends as well as respective social media audiences. If positivity bias manifests in this context, the social media posts should introduce more positive valence in comparison to offline sharing—and if the platforms differ in their encouragement of positivity bias, they should introduce significant between-platform differences in valence.
 
The Stage 1 plan was reviewed by four independent experts representing relevant areas of methodological and topic expertise. Three reviewers proceeded throughout three rounds of review, after which the study was considered having met all Stage 1 criteria and the recommender granted in-principle acceptance. 
 
URL to the preregistered Stage 1 protocol: https://osf.io/9z6hm
 
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.  
 
List of eligible PCI RR-friendly journals:
 
 
References
 
1. Bayer, J. B., Triệu, P., & Ellison, N. B. (2020). Social media elements, ecologies, and effects. Annual review of psychology, 71, 471-497. https:// doi.org/10.1146/annurev-psych-010419-050944
 
2. Masciantonio, A., Heiser, N., & Cherbonnier, A. (2024). Unveiling the Positivity Bias on Social Media: A Registered Experimental Study On Facebook, Instagram, And X. In principle acceptance of Version 4 by Peer Community in Registered Reports. https://osf.io/9z6hm
Unveiling the Positivity Bias on Social Media: A Registered Experimental Study On Facebook, Instagram, And XA. Masciantonio, N. Heiser, A. Cherbonnier<p>Social media has transformed how people engage with the world around them. The positivity bias on social media, in particular, warrants in-depth investigation. This is particularly true as previous research has concentrated on one specific plat...Social sciencesVeli-Matti Karhulahti2024-01-15 10:33:52 View
03 Mar 2025
STAGE 1

Shape of SNARC: How task-dependent are Spatial-Numerical Associations? A highly powered online experiment

Shedding light on task influence in the SNARC effect

Recommended by ORCID_LOGO based on reviews by Michele Vicovaro, Christian Seegelke, Peter Wühr and 1 anonymous reviewer
The Spatial-Numerical Association of Response Codes (SNARC) effect (Dehaene et al., 1993) is a key phenomenon in numerical cognition. It describes the tendency for individuals to respond faster to smaller numbers with a left-side key and to larger numbers with a right-side key, suggesting a mental mapping of numerical magnitudes onto space. While this effect has been widely replicated, its precise nature remains debated, particularly regarding its task dependency.
 
In this Stage 1 Registered Report, Roth et al. (2025) present a highly powered study that systematically investigates whether the SNARC effect differs in two widely used numerical cognition tasks: magnitude classification (MC) and parity judgment (PJ). In the MC task, participants determine whether a presented number is smaller or larger than a reference value (typically 5). This task explicitly requires magnitude processing, making numerical magnitude directly relevant to the response. In contrast, the PJ task requires participants to judge whether a number is odd or even, a decision that does not explicitly involve numerical magnitude.
 
The authors address a fundamental theoretical question in numerical cognition: while the SNARC effect in PJ is often considered continuous, does it follow a categorical pattern in MC? To investigate this, the study directly compares continuous and categorical representations of the SNARC effect across these two tasks, using Bayesian statistical approaches to determine the best-fitting model. By systematically analysing the SNARC effect in these widely used paradigms, this work aims to refine our understanding of how numerical magnitudes are mapped onto space and whether this mapping depends on task demands. The findings of this study will provide crucial insights into the cognitive mechanisms underlying numerical-spatial associations, highlighting the extent to which task structure shapes the emergence of the SNARC effect.
 
Three expert reviewers provided valuable feedback across multiple rounds of review. Based on ​detailed responses to the reviewers’ and recommender’s comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance.​​​
 
URL to the preregistered Stage 1 protocol: https://osf.io/968ad
 
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.
 
List of eligible PCI RR-friendly journals:
 
 
References
 
1. Dehaene, S., Bossini, S., & Giraux, P. (1993). The mental representation of parity and number magnitude. Journal of Experimental Psychology: General, 122(3), 371–396. https://doi.org/10.1037/0096-3445.122.3.371
 
2. Roth, L., Cipora, K., Overlander, A. T., Nuerk, H.-C., & Reips, U.-D. (2025). Shape of SNARC: How task-dependent are Spatial-Numerical Associations? A highly powered online experiment. In principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/968ad
Shape of SNARC: How task-dependent are Spatial-Numerical Associations? A highly powered online experimentLilly Roth, Krzysztof Cipora, Annika T. Overlander, Hans-Christoph Nuerk, Ulf-Dietrich Reips<p>Spatial-Numerical Associations (SNAs) are fundamental to numerical cognition. They are essential for number representation and mathematics learning. However, SNAs are highly dependent on the experimental situation and task. Understanding this d...Life SciencesMario Dalmaso Peter Wühr2024-05-27 13:14:25 View
25 Oct 2023
STAGE 1

Does pupillometry provide a valid measure of spatial attentional bias (pseudoneglect)?

Assessing visuospatial biases (pseudoneglect) using pupillometry: A replication and extension of Strauch et al. (2022)

Recommended by ORCID_LOGO based on reviews by Christoph Strauch and Bianca Hatin
‘Pseudoneglect’ is a small, lateralised bias of visuospatial attention towards the left side of space, and is typically observed in healthy adults. Recently, Strauch et al. (2022) reported that bright stimuli presented in the left visual field induced a greater constriction of the pupil (the pupillary light reflex) compared to the same bright stimuli presented in the right visual field. Further, the pupillary restriction bias was positively correlated with a behavioural measure of pseudoneglect (the greyscales task). This is potentially an important development for attention research, because the passive nature of the task, in addition to the ability to track the time course of the bias measures, could provide a new, and highly sensitive, method of studying spatial attention.
 
In this report, Burns and McIntosh (2023) aim to replicate and extend the study of Strauch et al. (2022). The extension centres around investigating whether the pupillary biases are influenced by recording pupillary responses from the right or left eye. In their pilot replication data, Burns & McIntosh identified a larger constriction in response to stimuli on the right side when recording from the right eye. They hypothesise that pupillary biases may be stronger to stimuli presented in the ipsilateral, rather than contralateral, side of space.
 
The Stage 1 manuscript was reviewed over 2 rounds by 2 reviewers, including the authors of the study being replicated. Based on detailed responses to the reviewers’ comments and edits to the Stage 1 report, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance.
 
URL to the preregistered Stage 1 protocol: https://osf.io/ua9jn

Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.
 
List of eligible PCI-RR-friendly journals:
 
References
 
1. Strauch, C., Romein, C., Naber, M., Van der Stigchel, S. & Ten Brink, A. F. (2022). The orienting response drives pseudoneglect—Evidence from an objective pupillometric method. Cortex, 151, 259-271.
 
2. Burns, N. E. & McIntosh, R. D. (2023). Does pupillometry provide a valid measure of spatial attentional bias (pseudoneglect)? In principle acceptance of Version 2 by Peer Community in Registered Reports. https://osf.io/ua9jn
Does pupillometry provide a valid measure of spatial attentional bias (pseudoneglect)?Nicola E. Burns, and Robert D. McIntosh<p>Strauch et al. (2022) introduced a novel approach to assess biases of visual attention, by measuring pupillary constriction in response to split-field stimuli, in which a bright patch is presented to one visual field and a dark patch to the oth...Social sciencesGemma Learmonth Christoph Strauch2023-07-12 18:27:28 View
23 Jan 2025
STAGE 1

Mapping methodological variation in experience sampling research from design to data analysis: A systematic review

Methodological Variation in the Experience Sampling Methods: Can We Do ESM Better?

Recommended by ORCID_LOGO based on reviews by Priya Silverstein and 1 anonymous reviewer
The replication crisis/credibility revolution has driven a vast number of changes to our research environment (Korbmacher et al., 2023) including a much needed spotlight on issues surrounding measurement (Flake & Fried, 2020). As general understanding and awareness has increased surrounding the 'garden of forking paths' or 'researcher degrees of freedom' (Simmons et al., 2011), and the various decisions made during the scientific process that could impact the conclusions drawn by the process, so too should our interest in meta-research that tells us more about the methodological processes we follow, and how discretionary decisions may influence the design, analysis and reporting of a project.
 
Peeters et al. (2025) have proposed a systematic literature review of this nature, mapping the methodological variation in experience sampling methods (ESM) from the design stage all the way to dissemination. It starts this journey by mapping how ESM studies vary e.g., in design, considering a variety of factors like sample size, number of measurements, and sampling scheme. It also evaluates reporting quality, rationales provided, and captures the extent of open science practices adopted. Covering many parts of the research process that get assumed, unreported or otherwise unjustified, the proposed work looks set to springboard an important body of work that can tell us more effectively how to design, implement and report ESM studies.
 
The Stage 1 submission was reviewed over one round of in-depth review with two reviewers. Based on detailed responses to reviewers’ feedback, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance.
 
URL to the preregistered Stage 1 protocol: https://osf.io/ztvn3
 
Level of bias control achieved: Level 1. At least some of the data/evidence that will be used to the answer the research question has been accessed and observed by the authors, including key variables, but the authors certify that they have not yet performed any of their preregistered analyses, and in addition they have taken stringent steps to reduce the risk of bias.
 
List of eligible PCI-RR-friendly journals:
 
References
 
1. Flake, J. K., & Fried, E. I. (2020). Measurement schmeasurement: Questionable measurement practices and how to avoid them. Advances in Methods and Practices in Psychological Science, 3, 456-465. https://doi.org/10.1177/2515245920952393
 
2. Korbmacher, M., Azevedo, F., Pennington, C. R., Hartmann, H., Pownall, M., Schmidt, K., ... & Evans, T. (2023). The replication crisis has led to positive structural, procedural, and community changes. Communications Psychology, 1, 3. https://doi.org/10.1038/s44271-023-00003-2
 
3. Peeters, L., Van Den Noortgate, W., Blanchard, M. A., Eisele, G., Kirtley, O., Artner, R., & Lafit, G. (2025). Mapping Methodological Variation in ESM Research from Design to Data Analysis: A Systematic Review. In principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/ztvn3
 
4. Simmons, J. P., Nelson, L. D., & Simonsohn, U. (2011). False-positive psychology: Undisclosed flexibility in data collection and analysis allows presenting anything as significant. Psychological Science, 22, 1359-1366. https://doi.org/10.1177/0956797611417632
Mapping methodological variation in experience sampling research from design to data analysis: A systematic reviewLisa Peeters, Wim Van Den Noortgate, M. Annelise Blanchard, Gudrun Eisele, Olivia Kirtley, Richard Artner, Ginette Lafit<p><strong>Aim</strong>. The Experience Sampling Method (ESM) has become a widespread tool to study time-varying constructs across many subfields of psychological and psychiatric research. This large variety in subfields of research and constructs...Social sciencesThomas Evans2024-09-04 10:39:37 View