Submit a report

Announcements

=============================================================================

IMPORTANT ANNOUNCEMENT: To accommodate reviewer and recommender holiday schedules, we will be closed to ALL submissions from 1st Jul - 1st Sep. During this time, reviewers can submit reviews and recommenders can issue decisions, but no new or revised submissions can be made by authors.

The one exception to this rule is that authors using the scheduled track who submit their initial Stage 1 snapshot prior to 1st Jul can choose a date within the shutdown period to submit their full Stage 1 manuscript.

=============================================================================

We are recruiting recommenders (editors) from all research fields!

Your feedback matters! If you have authored or reviewed a Registered Report at Peer Community in Registered Reports, then please take 5 minutes to leave anonymous feedback about your experience, and view community ratings.

Latest recommendations

IdTitle * Authors * Abstract * PictureThematic fields * RecommenderReviewersSubmission date
08 May 2025
STAGE 2
(Go to stage 1)

Changes in memory function in adults following SARS-CoV-2 infection: findings from the Covid and Cognition online study.

Evidence for General Long-Term Memory Impairment Following SARS-CoV-2 Infection

Recommended by ORCID_LOGO based on reviews by Phivos Phylactou, Mitul Mehta and 1 anonymous reviewer
COVID-19 has been associated with cognitive impairments, particularly in memory performance (Guo et al., 2022). Given that associative memory typically declines earlier than item memory in conditions such as mild cognitive impairment (Chen & Chang, 2016), it remains an open question whether COVID-19 differentially affects item and associative memory. Furthermore, it is unclear whether such effects are specific to verbal or non-verbal material. To investigate these questions, Weinerova et al. (2024) recruited participants via long-COVID Facebook groups and clinical settings. They reported a significant detrimental effect of COVID-19 status on long-term memory performance across tasks. However, they did not find evidence for their preregistered hypothesis of an interaction between COVID-19 status and either memory type (item vs. associative) or stimulus type (verbal vs. non-verbal).
 
In the Stage 1 report, the authors preregistered a Bayes Factor threshold of 6 as the criterion for supporting the alternative hypothesis. All planned analyses were preregistered, incorporating both frequentist methods (to replicate Guo et al., 2022) and Bayesian ANCOVA (to test the preregistered hypotheses). As data collection had been completed at the time of Stage 1 submission, we assigned a Level 3 bias control to the Stage 1 report.
 
In the Stage 2 report, the authors confirmed a general negative impact of COVID-19 on long-term memory accuracy. Using frequentist ANCOVA, they successfully replicated Guo et al. (2022)’s findings of reduced accuracy in verbal item and non-verbal associative memory among individuals with prior COVID-19 infection. However, they did not replicate the previously observed effect on reaction times. The Bayesian ANCOVA analyses did not reach the preregistered evidential threshold (BF > 6). Verbal associative memory, which was not part of the original replication attempt, also showed reduced accuracy in individuals with prior infection. In contrast, performance on non-verbal item memory tasks showed a ceiling effect, possibly due to methodological differences from Guo et al. (2022). Across all four memory tasks, the authors found robust evidence for decreased accuracy associated with COVID-19 status but no effect on reaction times.
 
Contrary to their hypotheses, models that included interactions between COVID-19 status and either memory type or stimulus type were less likely than the null model, suggesting a general, rather than specific, detrimental effect of COVID-19 on long-term memory.
 
Analyses of vaccination status yielded inconclusive results, likely due to limited sample size and uncertainty in participants' self-reports of vaccination timing relative to infection. The question of whether vaccination has protective effects on cognition remains unresolved and merits further investigation. The authors also reported tentative exploratory findings, such as a potential association between longer time since infection and slower reaction times in verbal item memory tasks. These observations require confirmation in future studies.
 
Overall, the study makes a valuable contribution by replicating prior findings and extending them to suggest a broad impairment of long-term memory associated with COVID-19.
 
The Stage 2 report was reviewed by the same three reviewers who had evaluated the Stage 1 submission. All reviewers agreed that the authors had addressed prior comments and had adhered to the preregistered methodology and analysis plan. As in the Stage 1 evaluation, we note the potential for selection bias introduced by recruiting participants via long-COVID Facebook groups. Individuals with post-infection cognitive complaints may have been more likely to volunteer, limiting generalizability to the broader SARS-CoV-2-infected population. This and other limitations are clearly acknowledged in the Discussion section of the Stage 2 manuscript. The recommender judged that the manuscript met all Stage 2 criteria for recommendation.
 
URL to the preregistered Stage 1 protocol: https://osf.io/tjs5u
 
Level of bias control achieved: Level 3. At least some data/evidence that was used to the answer the research question had been accessed by the authors prior to in-principle acceptance (e.g. downloaded or otherwise received), but the authors certify that they had not yet observed ANY part of the data/evidence.
 
List of eligible PCI RR-friendly journals:
 
References

1. Chen, P.-C., & Chang, Y.-L. (2016, May). Associative memory and underlying brain correlates in older adults with mild cognitive impairment. Neuropsychologia, 85, 216–225. https://doi.org/10.1016/j.neuropsychologia.2016.03.032
 
2. Guo, P., Benito Ballesteros, A., Yeung, S. P., Liu, R., Saha, A., Curtis, L., ... Cheke, L. G. (2022b). COVCOG 2: Cognitive and memory deficits in long COVID: A second publication from the COVID and Cognition Study. Frontiers in Aging Neuroscience, 14, 804937. https://doi.org/10.3389/fnagi.2022.804937
 
3. Weinerova, J., Yeung, S., Guo, P., Yau, A., Horne, C., Ghinn, M., Curtis, L., Adlard, F., Bhagat, V., Zhang, S., Kaser, M., Bozic, M., Schluppeck, D., Reid, A., Tibon, R., & Cheke, L. (2025). Changes in memory function in adults following SARS-CoV-2 infection: Findings from the Covid and Cognition online study [Stage 2]. Acceptance of Version 1 by Peer Community in Registered Reports. https://osf.io/q5vu2?view_only=228165eb161d490b945ca019143ba98c
Changes in memory function in adults following SARS-CoV-2 infection: findings from the Covid and Cognition online study.Josefina Weinerova, Sabine Yeung, Panyuan Guo, Alice Yau, Connor Horne, Molly Ghinn, Lyn Curtis, Frances Adlard, Vidita Bhagat, Seraphina Zhang, Muzaffer Kaser, Mirjana Bozic, Denis Schluppeck, Andrew Reid, Roni Tibon, Lucy Cheke<p>SARS-CoV-2, the virus responsible for the Covid-19 pandemic, has been shown to have an impact on cognitive function, but the specific aspects of cognition that are affected remain unclear. In this Registered Report, we analysed cognitive data c...Life SciencesVishnu Sreekumar Mitul Mehta, Benedict Michael, Phivos Phylactou, Anonymous2024-11-21 12:32:53 View
08 May 2025
STAGE 1

The Effect of Individual and Group Punishment on Individual and Group-Based Dishonesty

A slap on the wrist, for whom? Effects of punishment on dishonesty for individuals and groups

Recommended by ORCID_LOGO based on reviews by Yikang Zhang, Felipe Vilanova and 1 anonymous reviewer
When humans decide to play by the rules or to violate them is an age-old question. In this manuscript, Zickfeld et al. (2025) address this question through a lens of utility (Becker, 1968): When norm violations are punished (in this case, when a third party imposes monetary fines), breaking the rules is no longer worth it.

Zickfeld et al. (2025) study incentivized (non-)compliance in a tax evasion game. Based on the procedure of Fochmann et al. (2021), participants are allocated to triads. Each triad receives a taxable income and must disclose this income to be taxed appropriately, across several rounds. However, every triad member has an incentive to underreport the triad income, to pay lower taxes and receive an individual bonus. But if they are caught, they receive no payoff for this round. 

Specifically, Zickfeld et al. (2025) set out to compare the effects of group vs. individual payoffs schemes, group vs. individual punishments, and different punishment probabilities (0% vs. 30%) in a well-powered online experiment. By systematically addressing these factors, the manuscript contributes to testing boundary conditions of the economic model of rule-breaking. In addition, considering measures of moral anger, guilt, stress, risk aversion and honesty-humility adds a psychological flavor to the investigation. 

This Stage 1 manuscript was evaluated by three expert reviewers, across two rounds of revisions. Based on detailed responses to the reviewers’ comments and edits to the Stage 1 report, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).

URL to the preregistered Stage 1 protocol: https://osf.io/eqw95
 
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.
 
List of eligible PCI RR-friendly journals:
 
 
References 

1. Becker, G. S. (1968). Crime and Punishment: An Economic Approach. Journal of Political Economy, 76, 169–217. https://doi.org/10.1086/259394

2. Fochmann, M., Fochmann, N., Kocher, M. G., & Müller, N. (2021). Dishonesty and risk-taking: Compliance decisions of individuals and groups. Journal of Economic Behavior & Organization, 185, 250-286. https://doi.org/10.1016/j.jebo.2021.02.018
 
3. Zickfeld, J., Tønnesen, M. T., Elbaek, C. T., Oelrich, S., Cardarelli, T., Ścigała, K. A., Pfattheicher, S., & Mitkidis, P. (2025). The Effect of Individual and Group Punishment on Individual and Group-Based Dishonesty. In principle acceptance of Version 4 by Peer Community in Registered Reports. https://osf.io/eqw95
The Effect of Individual and Group Punishment on Individual and Group-Based DishonestyJanis H. Zickfeld, Mathilde H. Tønnesen, Christian T. Elbæk, Sebastian Oelrich, Thais Cardarelli, Karolina A. Ścigała, Stefan Pfattheicher, Panagiotis Mitkidis<p>Economic dishonesty is a widespread behavior that has substantial implications for organizations and societies. Recent studies suggest that decision making in groups or commitment to other individuals can further increase such dishonesty in con...Social sciencesRima-Maria Rahal2024-05-06 13:54:25 View
08 May 2025
STAGE 1

Cognitive, affective and behavioural effects of temporal comparison with prior aversive experiences in individuals with social anxiety

Does looking back reduce your anxiety now?

Recommended by ORCID_LOGO based on reviews by Katie Hobbs and Mariela Mihaylova
Social anxiety, which designates intense fear or anxiety of social situations due to the expectation of negative evaluation, is a relatively common disorder affecting 7-13% of the population (Modini & Abbott, 2016). Given the negative consequences that the disorder has on affected individuals (Matos et al., 2013; Modini & Abbott, 2016), looking for novel methods to ameliorate the symptoms is a societal imperative. 
 
The current study by McCarthy et al. (2025) focuses on the comparison of the current self with previous selves, which, although well-studied in cognitive neuroscience, has not been widely applied as a treatment of clinical and sub-clinical disorders. Nevertheless, comparison with previous selves has been shown to alter cognitive and affective processes and improve current self-evaluation (Broemer et al., 2007; Hanko et al., 2009; Morina, 2021), making it a prime target for handling sub-clinical individuals with social anxiety. The current paper, therefore, investigates whether comparison with previous selves can help individuals with sub-clinical social anxiety in countering their negative affect, which offers valuable clinical and theoretical contributions.
 
The Stage 1 manuscript was evaluated over two rounds of in-depth review. Based on detailed responses to the recommender and reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA). 
 
URL to the preregistered Stage 1 protocol: https://osf.io/wumdj
 
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.
 
List of eligible PCI RR-friendly journals:
 
 
References
 
1. Broemer, P., Grabowski, A., Gebauer, J. E., Ermel, O., & Diehl, M. (2007). How temporal distance from past selves influences self‐perception. European Journal of Social Psychology, 38, 697-714. https://doi.org/10.1002/ejsp.469
 
2. Hanko, K., Crusius, J., & Mussweiler, T. (2009). When I and me are different: assimilation and contrast in temporal self‐comparisons. European Journal of Social Psychology, 40, 160-168. https://doi.org/10.1002/ejsp.625
 
3. Matos, M., Pinto-Gouveia, J., & Gilbert, P. (2013). The effect of shame and shame memories on paranoid ideation and social anxiety. Clinical Psychology & Psychotherapy, 20, 334-349. https://doi.org/10.1002/cpp.1766
 
4. McCarthy, P. A., Morina, N., & Meyer, T. (2025). Cognitive, affective and behavioural effects of temporal comparison with prior aversive experiences in individuals with social anxiety. In principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/wumdj
 
5. Modini, M., & Abbott, M. J. (2016). A Comprehensive Review of the Cognitive Determinants of Anxiety and Rumination in Social Anxiety Disorder. Behaviour Change, 33, 150-171. https://doi.org/10.1017/bec.2016.10
 
6. Morina, N. (2021). Comparisons Inform Me Who I Am: A General Comparative-Processing Model of Self-Perception. Perspect Psychol Sci, 16, 1281-1299. https://doi.org/10.1177/1745691620966788
Cognitive, affective and behavioural effects of temporal comparison with prior aversive experiences in individuals with social anxietyPeter A. McCarthy, Nexhmedin Morina, Thomas Meyer<p>Temporal comparisons with past selves have been found to influence current self-appraisals of attributes, including well-being. The comparison process involves using a past self as a standard, while the current self serves as the target. Previo...Humanities, Social sciencesAnoushiravan Zahedi 2024-04-18 17:26:31 View
08 May 2025
STAGE 1

Detecting differences in conscious contents using EEG complexity measures

Can EEG complexity measures discriminate between visual- and auditory-evoked differences in conscious contents?

Recommended by ORCID_LOGO based on reviews by Michał Bola, Stefan Wiens, Marcin Koculak and 1 anonymous reviewer
It is a challenging task to measure consciousness. In this project, Ponce de Leon et al. (2025) propose the use of electroencaphalography (EEG) to evaluate the utility of two brain-based complexity measures – Lempel-Ziv complexity and the perturbational complexity index – in the study of conscious content. The overarching aim of the study is to investigate whether these two measures can discriminate between visual and auditory content varying in granularity levels. In addition to the main objectives, the authors plan to conduct a set of exploratory analyses.
 
The study will provide a significant contribution to the field by attempting to replicate effects previously reported in the literature and extending their generalisability through comparisons across varying configurations of the stimuli. The utility of these complexity measures within conscious content research will be further elucidated through exploratory regression analyses with behavioural variables and ratings of subjective experience.
 
The Stage 1 manuscript was evaluated over two rounds of in-depth review. Based on detailed responses to the recommender and reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA). Ethics approval has not been granted yet, so this is a provisional IPA, which will be promoted to a full IPA once ethical approval is in place.
 
URL to the preregistered Stage 1 protocol: https://osf.io/kdsau (under temporary private embargo)
 
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.
 
List of eligible PCI RR-friendly journals:
 
 
References
 
Ponce de Leon, S., Backer, K. C., Monti, M. M., & Yoshimi, J. (2025). Detecting differences in conscious contents using EEG complexity measures. In principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/kdsau
Detecting differences in conscious contents using EEG complexity measuresSergio Ponce de Leon, Kristina C. Backer, Martin M. Monti, Jeff Yoshimi<p>​Measuring consciousness has been a longstanding problem. Even though behavioral responses are commonly used, converging evidence indicates that behavioral responsiveness and behavioral reports about consciousness dissociate from consciousness ...Life Sciences, Social sciencesMarta Topor2024-04-29 01:01:44 View
08 May 2025
STAGE 2
(Go to stage 1)

They look virtually the same: extraretinal representation of symmetry in virtual reality

Immersive virtual reality environments support the processing of extraretinal symmetry

Recommended by ORCID_LOGO based on reviews by Tadamasa Sawada and Felix Klotzsche
​Karakashevska and colleagues (2025) examined the extraretinal representation of visual symmetry presented in a virtual reality environment. Previous research has demonstrated that individuals can detect symmetry when the symmetry is represented on a perspective plane, slanted away from the viewer. In electroencephalography (EEG), perceived symmetry is marked by an Event Related Potential (ERP) called a Sustained Posterior Negativity (SPN). When symmetry is presented on a perspective plane in comparison to front-on (frontoparallel), the SPN is reduced, termed the perspective cost. Here, Karakashevska et al. (2025) determined if presenting symmetry on a perspective plane in a virtual reality (VR) environment reduced the perspective cost with the addition of 3D depth cues. Specifically, participants were requested to detect symmetry or luminance of a stimulus presented in a VR environment whilst wearing an EEG.
 
The authors found no perspective cost during the regularity task when symmetry was presented on a frontoparallel plane versus symmetry on a perspective plane. When participants were performing the luminance task, the authors found no conclusive evidence for the presence or absence of perspective cost. Together these data suggest that when immersed in a virtual reality (VR) environment, critical depth cues are available to overcome perspective cost in the perception of symmetry. 
 
The Stage 2 manuscript was evaluated by two expert reviewers. One of our reviewers reviewed the Stage 1 manuscript, and one reviewer was new. The reviewers agreed that the authors had adhered to their registered Stage 1 manuscript and were convinced by the interpretation of the results. The recommender has determined that the Stage 2 criteria was met and has awarded a positive recommendation. ​
 
URL to the preregistered Stage 1 protocol: https://osf.io/7pnxu
 
Level of bias control achieved: Level 6. No part of the data or evidence that was used to answer the research question was generated until after IPA. 

List of eligible PCI RR-friendly journals:
 
 
References
 
Karakashevska, E., Batterley, M/, Yuxin, Y., & Makin, A. D. J. (2025). They look virtually the same: extraretinal representation of symmetry in virtual reality [Stage 2]. Acceptance of Version 2 by Peer Community in Registered Reports. https://doi.org/10.31234/osf.io/sfyg6_v2
 
They look virtually the same: extraretinal representation of symmetry in virtual reality Elena Karakashevska, Michael Batterley, Yao Yuxin, Alexis D. J. Makin<p>The brain must identify objects from different viewpoints that change the retinal image. This study will determine the conditions under which the brain spends computational resources to construct view-invariant, extraretinal representations in ...Life SciencesGrace Edwards2025-01-13 21:53:25 View
08 May 2025
STAGE 1

A Programmatic Stage 1 Registered Report of global song-speech relationships replicating and extending Ozaki et al. (2024) and Savage et al. (2024)

Do songs differ from speech similarly across cultures?

Recommended by ORCID_LOGO based on reviews by Nai Ding, Fermin Moscoso del Prado Martin and Makiko Sadakata
Most investigations of the relationship between music and speech – two features considered universal to human societies (Brown 1991) – focus on only a few languages in an English and/or European-centric context (Savage et al. 2015). A recent study investigated this relationship in many more languages in a global context and found that songs are different from speech in a few variables (e.g., they are slower), using a relatively small sample per language (Ozaki et al. 2024). The current study (Savage et al. 2025) is conducting a large-scale replication to increase the sample size and understand whether the results reported by Ozaki et al. (2024) persist.
 
In this registered report, Savage and colleagues (2025) will measure pitch height, temporal rate, and pitch stability in 15-30 individuals at 26 sites (languages) around the world. This much larger sample size per language will allow them to determine whether certain languages have different relationships between song and speech, or whether they vary together in the same way across cultures globally. These results will provide robust evidence from which debates about the function of music can move forward.
 
Savage and colleagues (2025) have innovated a more equitable way of conducting big team research using PCI RR’s Programmatic Registered Report mechanism, where one Stage 1 can result in multiple Stage 2 manuscripts. All co-authors are on the Stage 1 manuscript, whereas each site will produce its own Stage 2, thus allowing many authors to move into the first and last author positions and receive the deserved credit for their contributions.
 
The Stage 1 manuscript was evaluated over three rounds of in-depth review. Based on detailed responses to the recommender and reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
 
URL to the preregistered Stage 1 protocol: https://osf.io/vs9my
 
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.
 
List of eligible PCI RR-friendly journals:
 
 
References
 
1. Brown, D. E. Human Universals. (Temple University Press, Philadelphia, 1991).
 
2. Ozaki, Y., Tierney, A., Pfordresher, P. Q., McBride, J. M., Benetos, E., Proutskova, P., ... & Savage, P. E. (2024). Globally, songs and instrumental melodies are slower and higher and use more stable pitches than speech: A Registered Report. Science Advances, 10, eadm9797. https://doi.org/10.1126/sciadv.adm9797
 
3. Savage, P. E., Brown, S., Sakai, E., & Currie, T. E. (2015). Statistical universals reveal the structures and functions of human music. Proceedings of the National Academy of Sciences, 112, 8987-8992. https://doi.org/10.1073/pnas.1414495112
 
4. Savage P. E., Jia Z., Ozaki Y., Pavlovich D. V., Purdy S., Ampiah-Bonney A., … & der Nederlanden, C. (2025). A Programmatic Stage 1 Registered Report of global song-speech relationships replicating and extending Ozaki et al. (2024) and Savage et al. (2025). In principle acceptance of Version 5 by Peer Community in Registered Reports. https://osf.io/vs9my
A Programmatic Stage 1 Registered Report of global song-speech relationships replicating and extending Ozaki et al. (2024) and Savage et al. (2024)Patrick Savage, Zixuan Jia, Yuto Ozaki, Danya Pavlovich, Suzanne Purdy, Adwoa Ampiah-Bonney, Aleksandar Arabadjiev, Flavia Arnese, Joshua Bamford, Brenda Barbosa, Ann-Kathrin Beck, Anne Cabildo, Gakuto Chiba, Shahaboddin Dabaghi Varnosfaderani, Si...<p>How cross-culturally consistent and general are relationships between song and speech? Ozaki et al. (2024) analysed singing and speaking from 75 individuals speaking 55 languages, concluding that songs are “slower and higher and use more stable...Social sciencesCorina Logan2024-11-29 08:04:19 View
29 Apr 2025
STAGE 1

Stochastic resonance and internal noise in schizotypal traits: a random dot kinematograms paradigm

A behavioral measure of individual differences in schizotypal traits

Recommended by ORCID_LOGO based on reviews by 3 anonymous reviewers
Perception is a subjective experience shaped by both bottom-up information from the environment and top-down individual differences in internal processes. External and internal “noise” can affect perception, such as the level of lighting in a room (external) or spontaneous neural excitation (internal). Individual differences in internal noise may, in part, be connected to schizotypal traits: schizotypy is a collection of traits related to the schizophrenia spectrum that can be found in the general (non-clinical) population, including aberrant perceptual experiences. Higher schizotypy is thought to be related to higher levels of internal noise.
 
This hypothesis stems from recent evidence, which suggests a positive link between schizophrenia and internal noise, measured by disruptions in oscillatory EEG activity. Unique to the proposed study, however, the authors suggest this link may also be expressed behaviorally. Specifically, Cessa and colleagues (2025) propose that high and low schizotypy may correspond to high and low levels of internal noise, respectively, which can be measured behaviorally using a Random Dot Kinematogram (RDK) task. In this task, participants will be presented with two RDKs and asked to decide which of them displayed coherent motion, with different levels of external noise added to the RDKs. In individuals with typical perception, intermediate levels of external noise lead to optimal performance in this task. The authors hypothesize that individuals with high schizotypy will show aberrant perceptual effects, in that they will perform best for RDKs with significantly lower levels of external noise compared to individuals with low schizotypy, reflecting individual differences in internal noise levels.
 
In this Stage 1 manuscript, Cessa and colleagues present an introduction that motivates their hypotheses from previous studies from their lab in different age groups: older individuals are thought to experience higher levels of internal noise compared to young adults, similar to high schizotypal individuals. In the previous study, they found that older individuals required lower levels of external noise for optimal RDK performance, suggesting high levels of internal noise interfered with perception. The current study will test for the same effect in schizotypy, now controlling for age (with an age limit of 49 years, based on the previous findings). A minimum of 130 individuals will be recruited online via Prolific, advertisements at the university, and word-of-mouth.
 
The Stage 1 submission - including proposed methods, hypotheses, analysis & interpretation plan, sampling plan, and inference criteria - was evaluated by the recommender and three topic expert reviewers. Following revisions, the recommender judged that the manuscript met the Stage 1 criteria and awarded in-principle acceptance (IPA).
 
URL to the preregistered Stage 1 protocol: https://osf.io/nvydj
 
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.
 
List of eligible PCI RR-friendly journals:
 

References
 
Cessa, R., Contemori, G.,  Battaglini, L., Cenk, E., & Bertamini, M. (2025). Stochastic resonance and internal noise in schizotypal traits: a random dot kinematograms paradigm. In principle acceptance of Version 2 by Peer Community in Registered Reports. https://osf.io/nvydj
Stochastic resonance and internal noise in schizotypal traits: a random dot kinematograms paradigmRoberta Cessa, Giulio Contemori, Luca Battaglini, Ezgi Cenk, Marco Bertamini<div style="text-align: justify;">Stochastic resonance (SR) is a phenomenon where an optimal level of noise enhances the detection of subthreshold signals in nonlinear systems, including the human brain. Psychophysical research suggests that SR in...Life SciencesReshanne Reeder Federica Mauro, Anonymous, Joost Haarsma2024-10-23 18:01:23 View
28 Apr 2025
STAGE 2
(Go to stage 1)

Language models accurately infer correlations between psychological items and scales from text alone

Using large language models to predict relationships among survey scales and items

Recommended by ORCID_LOGO based on reviews by Hu Chuan-Peng, Johannes Breuer and Zak Hussain
How are the thousands of existing, and yet to be created, psychological measurement instruments related, and how reliable are they? Here, Hommel and Arslan (2025) trained a language model--SurveyBot3000--to provide answers to these questions efficiently and without human intervention.
 
In their Stage 1 submission, the authors described the training and pilot validation of a statistical model whose inputs are psychological measurement items or scales, and outputs are the interrelationships between the items and scales, and their reliabilities. The pilot results were promising: SurveyBot3000's predicted inter-scale correlations were strongly associated with empirical correlations from existing human data.
 
In this Stage 2 report, the authors further examined the model's performance and validity. In accordance with their Stage 1 plans, they collected new data from 450 demographically diverse participants, and tested the model's performance fully out of sample. The model's item-to-item correlations correlated at r=.59 with corresponding item-to-item correlations from human participants. The scale-to-scale correlations were even more accurate at r=.83, indicating reasonable performance. Nevertheless, the authors remain justifiably cautious in their recommendation that the "synthetic estimates can guide an investigation but need to be followed up by human researchers with human data."
 
The authors documented all deviations between Stage 2 execution and Stage 1 plans in extensive online supplements. These supplements also addressed other potential issues, such as the potential for data leakage (finding the results in the training data) and robustness of results across different exclusion criteria.
 
The authors' proposed psychometric approach and tool, which is freely available as an online app, could prove valuable for researchers either looking to use or adapt existing scales or items, or when developing new scales or items. More generally, these results add to the growing literature on human-AI research collaboration and highlight a practical application of these tools that remain novel to many researchers in the field. As such, this Stage 2 report and SurveyBot3000 promise to contribute positively to the field.
 
The Stage 2 report was evaluated by two reviewers who also reviewed the Stage 1 report, and a new expert in the field. On aggregate, the reviewers' comments were helpful but relatively minor; the authors improved their work in a resubmission, and the recommender judged accordingly that the manuscript met the Stage  2 criteria for recommendation.
 
URL to the preregistered Stage 1 protocol: https://osf.io/2c8hf
 
Level of bias control achieved: Level 6. No part of the data or evidence that was used to answer the research question was generated until after IPA.
 
List of eligible PCI RR-friendly journals:
 
References
 
Hommel, B. E. & Arslan, R. C. (2025). Language models accurately infer correlations between psychological items and scales from text alone [Stage 2]. Acceptance of Version 4 by Peer Community in Registered Reports. https://doi.org/10.31234/osf.io/kjuce_v4
 
Language models accurately infer correlations between psychological items and scales from text aloneBjörn E. Hommel, Ruben C. Arslan<p>Many behavioural scientists do not agree on core constructs and how they should be measured. Different literatures measure related constructs, but the connections are not always obvious to readers and meta-analysts. Many measures in behavioural...Life Sciences, Social sciencesMatti Vuorre2025-02-03 16:05:59 View
28 Apr 2025
STAGE 1

Language models accurately infer correlations between psychological items and scales from text alone

Using large language models to predict relationships among survey scales and items from text

Recommended by ORCID_LOGO based on reviews by Hu Chuan-Peng, Johannes Breuer and 1 anonymous reviewer
How are the thousands of existing, and yet to be created, psychological measurement instruments related, and how reliable are they? Hommel and Arslan (2024) have trained a language model--SurveyBot3000--to provide answers to these questions efficiently and without human intervention.
 
In their Stage 1 submission, the authors describe the training and pilot validation of a statistical model whose inputs are psychological measurement items or scales, and outputs are the interrelationships between the items, scales, and their reliabilities. The pilot results are promising: SurveyBot3000's predicted inter-scale correlations were extremely strongly associated with empirical correlations from existing human data.
 
The authors now plan for a further examination their model's performance and validity. They will collect novel test data across a large number of subjects, and again test the model's performance fully out of sample. Reviewers deemed these plans, and their associated planned analyses suitable. The anticipated results--along with already existing pilot results--promise a very useful methodological innovation to aid researchers in both selecting and evaluating existing measures, and developing and testing new measures.
 
The Stage 1 submission was reviewed twice by three reviewers each with expertise in the area. All reviewers identified the initial submission as timely and important, and suggested mostly editorial improvements that could be made to the Stage 1 report. After two rounds of review, the relatively minor remaining suggestions can be taken into account during preparation of the Stage 2 report.
 
URL to the preregistered Stage 1 protocol: https://osf.io/2c8hf
 
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.
 
List of eligible PCI RR-friendly journals:
 
 
References
 
Hommel, B. E., & Arslan, R. C. (2024). Language models accurately infer correlations between psychological items and scales from text alone. In principle acceptance of Version 4 by Peer Community in Registered Reports. https://osf.io/2c8hf
Language models accurately infer correlations between psychological items and scales from text aloneBjörn E. Hommel, Ruben C. Arslan<p>Many behavioural scientists do not agree on core constructs and how they should be measured. Different literatures measure related constructs, but the connections are not always obvious to readers and meta-analysts. Many measures in behavioural...Computer science, Social sciencesMatti VuorreAnonymous, Johannes Breuer, Hu Chuan-Peng2024-04-22 14:09:41 View
08 Apr 2025
STAGE 2
(Go to stage 1)

Non-compliance with and non-enforcement of UK loot box industry self-regulation on the Apple App Store: A longitudinal study on poor implementation

Self regulation by gaming companies for the use of loot boxes is not working

Recommended by ORCID_LOGO based on reviews by Chris Chambers
Video games may provide the option of spending real money in exchange for probabilistically receiving game-relevant rewards; in effect, encouraging potentially young teenagers to gamble. The industry has subscribed to a set of regulatory principles to cover the use of such "loot boxes", including 1) that they will prevent loot box purchasing by under 18s unless parental consent is given; 2) that they will make it initially clear that the game contains loot boxes; and 3) that they will clearly disclose the probabilities of receiving different rewards.
 
Can the industry effectively self regulate? Xiao and Lund (2025) evaluated this important question by investigating the 100 top selling games on the Apple App Store and estimating the percentage compliance to these three regulatory principles at two time points 6 months apart. In all cases compliance was minimal, or even non-existent. The authors recommend stricter legal regulations of loot boxes.
 
The Stage 2 manuscript was evaluated over one round of review. The recommender judged that the manuscript met the Stage  2 criteria for recommendation.
 
URL to the preregistered Stage 1 protocol: https://osf.io/3knyb
 
Level of bias control achieved: Level 2. At least some data/evidence that was used to answer the research question had been accessed and partially observed by the authors prior to IPA, but the authors certify that they had not yet observed the key variables within the data that were used to answer the research question.
 
List of eligible PCI RR-friendly journals:
 
 
References
 
Xiao, L. & Lund, M. (2025). Non-compliance with and non-enforcement of UK loot box industry self-regulation on the Apple App Store: A longitudinal study on poor implementation [Stage 2]. Acceptance of Version 2 by Peer Community in Registered Reports. https://osf.io/3re4n
Non-compliance with and non-enforcement of UK loot box industry self-regulation on the Apple App Store: A longitudinal study on poor implementationLeon Y. Xiao, Mie Lund<p>Loot boxes in video games can be purchased with real-world money in exchange for random rewards. Stakeholders are concerned about loot boxes’ similarities with gambling and their potential harms (e.g., overspending money and developing gambling...Humanities, Social sciencesZoltan Dienes2025-01-13 12:43:11 View