Submit a report

Announcements

Please note that we will be CLOSED to ALL SUBMISSIONS from 1 December 2024 through 12 January 2025 to give our recommenders and reviewers a holiday break.

We are recruiting recommenders (editors) from all research fields!

Your feedback matters! If you have authored or reviewed a Registered Report at Peer Community in Registered Reports, then please take 5 minutes to leave anonymous feedback about your experience, and view community ratings.

Latest recommendationsrssmastodon

IdTitle * Authors * Abstract * PictureThematic fields * RecommenderReviewersSubmission date
23 Nov 2023
STAGE 2
(Go to stage 1)

The Medusa effect: A registered replication report of Will, Merritt, Jenkins, and Kingstone (2021)

Looking (again) at Medusa: Evidence that pictorial abstraction influences mind perception

Recommended by ORCID_LOGO based on reviews by Alan Kingstone and 1 anonymous reviewer
The Medusa effect is a recently described phenomenon in which people judge a person to be more mindful when they appear as a picture (termed L1) than as a picture within a picture (L2). Across a series of experiments, Will et al. (2021) reported that at higher levels of abstraction, images of people were judged lower in realness (how real the person seemed), experience (the ability to feel) and agency (the ability to plan and act), and also benefited less from prosocial behaviour. The findings provide an intriguing window into mind perception – the extent to which we attribute minds and mental capacities to others.
 
In the current study, Han et al. (2023) undertook a close replication of two experiments from the original report by Will et al. (2021), asking first, whether the level of pictorial abstraction influences ratings of realness, agency and experience, and second, whether it also influences prosocial behaviour as measured in the dictator game (with participants predicted to allocate more money to recipients presented as pictures than as pictures within pictures). In the event of a non-replication using the original materials, the authors planned to further repeat the experiments using newly generated stimuli that are better matched for cultural context and more tightly controlled along various dimensions.
 
Results supported all pre-registered hypotheses. Participants rated and perceived L1 stimuli as having significantly higher levels of realness, agency, and experience than L2, and they also allocated significantly more money to L1 recipients than L2 recipients in a dictator game. Furthermore, participants who judged L1 as higher than L2 on all three dimensions also differentiated significantly between L1 and L2 in the dictator game, indicating a relationship between mind perception and prosociality. Overall, the findings confirm that pictures with lower levels of abstraction are perceived as more mindful and are associated with higher levels of prosocial behavior. Consequently, the results suggest that the Medusa effect is a reproducible phenomenon.
 
The Stage 2 manuscript was evaluated over one round of in-depth review. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 2 criteria and awarded a positive recommendation.
 
URL to the preregistered Stage 1 protocol: https://osf.io/xj46z
 
Level of bias control achieved: Level 6. No part of the data or evidence that was used to answer the research question was generated until after IPA. 
 
List of eligible PCI RR-friendly journals:
 
References
 
1. Will, P., Merritt, E., Jenkins, R., & Kingstone, A. (2021). The Medusa effect reveals levels of mind perception in pictures. Proceedings of the National Academy of Sciences, 118(32), e2106640118. https://doi.org/10.1073/pnas.2106640118
 
2. Han, J., Zhang, M., Liu, J., Song, Y. & Yamada, Y. (2023).The Medusa effect: A registered replication report of Will, Merritt, Jenkins, and Kingstone (2021). Acceptance of Version 2 by Peer Community in Registered Reports. https://osf.io/yqnu8
The Medusa effect: A registered replication report of Will, Merritt, Jenkins, and Kingstone (2021)Jing Han, Minjun Zhang, Jiaxin Liu, Yu Song, Yuki Yamada<p>Will et al.'s (2021) found the Medusa effect, which refers to the tendency that people evaluate a “person in picture” more mindful than a “person in picture of a picture”. The present study tried to directly replicate the Experiments 2 and 5 of...Social sciencesChris Chambers2023-10-24 03:42:14 View
17 Jun 2024
STAGE 1

Loneliness in the Brain: Distinguishing Between Hypersensitivity and Hyperalertness

A new look at loneliness by testing hyperalterness

Recommended by ORCID_LOGO and ORCID_LOGO based on reviews by Marta Andreatta and 1 anonymous reviewer
Do people who are more alert towards social stimuli vary in loneliness? This report addresses the question how loneliness relates to hypersensitivity to social stimuli using an oddball paradigm. Based on preliminary results, the study plans to compare high and low lonely individuals for how they react to happy and angry facial expressions using neurophysiological correlates. Findings from the study will provide further insights in how loneliness might be related to processing of social information.
 
The Stage 1 manuscript was evaluated over two rounds of in-depth review. Based on detailed responses to the reviewers' and recommender's comments, the recommender judged that the manuscript met the Stage 1 criteria and awarded in-principle acceptance (IPA).
 
URL to the preregistered Stage 1 protocol: https://osf.io/fxngv
 
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA. 
 
List of eligible PCI RR-friendly journals:
 
References
 
1. Bathelt, J., Dijk, C., & Otten, M. (2024). Loneliness in the Brain: Distinguishing Between Hypersensitivity and Hyperalertness. In principle acceptance of Version 5 by Peer Community in Registered Reports. https://osf.io/fxngv
Loneliness in the Brain: Distinguishing Between Hypersensitivity and HyperalertnessJoe Bathelt, Corine Dijk, Marte Otten<p>Introduction: Loneliness has emerged as a pressing public health issue, necessitating greater understanding of its mechanisms to devise effective treatments. While the link between loneliness and biased social cognition is a commonly proposed, ...Social sciencesHedwig EisenbarthAnonymous, Marta Andreatta2023-11-20 16:34:04 View
14 Apr 2023
STAGE 1

Can playing Dungeons and Dragons be good for you? A registered exploratory pilot program using offline Tabletop Role-Playing Games (TTRPGs) to mitigate social anxiety and reduce problematic involvement in multiplayer online videogames

Expanding the Intervention Potential of Tabletop Role-Playing Games

Recommended by ORCID_LOGO based on reviews by Charlotte Pennington, Matúš Adamkovič and Matti Vuorre
The human capacity and need for play has been recognized as a central psychotherapeutic component for a long time (e.g. Winnicott 1971). More recently, experts have started developing specialized digital gameplay to be used as therapeutic tools and even utilizing existing videogames for similar purposes (see Ceranoglu 2010). On the other hand, the concerns about some players becoming overinvolved in videogames also led the World Health Organization to include “gaming disorder” in the 11th edition of the International Classification of Diseases, which echoes the nuance required to address human-technology relationships in general.  
 
In the present registered report, Billieux et al. (2023) make use of analog structured role-play in a new intervention aiming to mitigate social anxiety and problematic gaming patterns in online gamers. The authors carry out an exploratory pilot to test a 10-week protocol over three modules inspired by the well-known Dungeons & Dragons franchise. Through multiple single-case design, the authors explore the feasibility of the intervention and its effectiveness on social skills, self-esteem, loneliness, assertiveness, and gaming disorder symptoms.
 
The Stage 1 manuscript was evaluated over two rounds by three experts with experimental specializations in psychopathology and gaming. Based on the comprehensive responses to the reviewers' feedback, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
 
URL to the preregistered Stage 1 protocol: https://osf.io/h7qat

Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.
 
List of eligible PCI RR-friendly journals
 
 
References
 
1. Billieux  J., Bloch J., Rochat L., Fournier L., Georgieva I., Eben C., Andersen M. M., King D. L., Simon O., Khazaal Y. & Lieberoth A. (2023). Can playing Dungeons and Dragons be good for you? A registered exploratory pilot program using offline Tabletop Role-Playing Games (TTRPGs) to mitigate social anxiety and reduce problematic involvement in multiplayer online videogames. In principle acceptance of Version 2 by Peer Community in Registered Reports. https://osf.io/h7qat
 
2. Ceranoglu, T. (2010). Video Games in Psychotherapy. Review of General Psychology, 14 (2). https://doi.org/10.1037/a0019439
 
3. Winnicott, D. (1971/2009). Playing and Reality. Routledge.
Can playing Dungeons and Dragons be good for you? A registered exploratory pilot program using offline Tabletop Role-Playing Games (TTRPGs) to mitigate social anxiety and reduce problematic involvement in multiplayer online videogamesJoël Billieux, Jonathan Bloch, Lucien Rochat, Loïs Fournier, Iliyana Georgieva, Charlotte Eben, Marc Malmdorf Andersen, Daniel Luke King, Olivier Simon, Yasser Khazaal, Andreas Lieberoth<p><strong>Background</strong>. Gamers with poor self-concept, high social anxiety, and high loneliness are more at risk of problematic involvement in videogames and particularly in massively multiplayer online role-playing games (MMORPGs) than ot...Social sciencesVeli-Matti Karhulahti Matúš Adamkovič, Charlotte Pennington, Matti Vuorre2023-02-06 11:09:55 View
16 Aug 2023
STAGE 1

Identifying relevant experiences to the measurement of social media experience via focus groups with young people: A registered report

A mental health perspective to adolescents’ social media experiences

Recommended by ORCID_LOGO based on reviews by Amy Orben, Jana Papcunova, Lisa Orchard, Elena Gordon-Petrovskaya and Gaurav Saxena
Measuring people’s experiences, thoughts, and mental processes has always been a core challenge of psychological science (e.g. Nisbett & Wilson 1977). When such measurement further relates to rapidly changing and conceptually diverse human-technology interactions, the task becomes even more difficult due to protean, multidimensional constructs. A good understanding of a construct is a basic step in its measurement (Borsboom 2005).  
 
In the present registered report, Hickman Dunne et al. (2023) carry out a focus group study with adolescents (n=32) aged 11 to 15 in Northwest England to improve the understanding of constructs related to social media and mental health experiences. The work is carried out as part of a long-term measure development project. The authors apply reflexive thematic analysis to explore adolescents’ social media use experiences and related motivations in the light of mental health, in addition to which the adolescents’ own views of benefits and risks are mapped out.
 
A particular strength of the design is the engagement of three Young Researchers who will co-facilitate the focus groups and be involved in the analysis. The research plan also meets high reflexivity and transparency criteria, and as such, can significantly contribute to future scale development as well as our general understanding of adolescents’ social media experiences.
 
The Stage 1 manuscript was reviewed over two rounds by five unique reviewers, one of which participated in both rounds. The reviewers’ expertise ranged from social media and technology use research to health psychology and qualitative methods. Based on careful revisions and detailed responses to the reviewers’ comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance.
 
URL to the preregistered Stage 1 protocol: https://osf.io/w24ec
 
Level of bias control achieved: Level 2. At least some data/evidence that will be used to answer the research question has been accessed and partially observed by the authors, but the authors certify that they have not yet observed the key variables within the data that will be used to answer the research question.
 
List of eligible PCI RR-friendly journals:
 
 
References
 
1. Borsboom, D. (2005). Measuring the mind: Conceptual issues in contemporary psychometrics. Cambridge University Press.
 
3. Nisbett, R. E., & Wilson, T. D. (1977). Telling more than we can know: Verbal reports on mental processes. Psychological review, 84, 231–259. https://doi.org/10.1037/0033-295X.84.3.231

2. Hickman Dunne J., Black L., Banwell E., Nanda P., Anderton M, Butters L.C., Demkowicz O., Davidson B., Qualter P., Humphrey N., Jay C., and Panayiotou M. (2023). Identifying relevant dimensions to the measurement of adolescent social media experience via focus groups with young people: A registered report. In principle acceptance of Version 5 by Peer Community in Registered Reports. https://osf.io/w24ec
Identifying relevant experiences to the measurement of social media experience via focus groups with young people: A registered reportJo Hickman Dunne, Louise Black, Emily Banwell, Pratyasha Nanda, Molly Anderton, Lily Corke Butters, Ola Demkowicz, Brittany Davidson, Pamela Qualter, Neil Humphrey, Caroline Jay, and Margarita Panayiotou<p>Background: While work on the relationship between social media use and adolescent mental health has allowed for some progress, research in this area is still relatively new and shows mixed evidence. This is partly the consequence of a rapidly ...Computer science, Social sciencesVeli-Matti Karhulahti2023-06-14 21:10:43 View
22 Nov 2024
STAGE 2
(Go to stage 1)

Identifying relevant experiences to the measurement of social media experience via focus groups with young people

A mental health perspective to adolescents’ social media experiences

Recommended by ORCID_LOGO based on reviews by Amy Orben, Jana Papcunova and Elena Gordon-Petrovskaya
Measuring people’s experiences, thoughts, and mental processes has always been a core challenge of psychological science (e.g. Nisbett & Wilson 1977). When such measurement relates to rapidly changing and conceptually diverse human-technology interactions, the task becomes even more difficult due to protean, multidimensional constructs. A good understanding of a construct is a basic step in its measurement (Borsboom 2005).  
 
In the present registered report—carried out as part of a long-term measure development project—Dunne et al. (2024) carried out a focus group study with adolescents (n=26) aged 11 to 15 in Northwest England to improve the understanding of constructs related to social media and mental health. The authors applied reflexive thematic analysis to explore adolescents’ social media use experiences and related motivations in the light of mental health.
 
The data and research process led to a construction of five themes, which were connected to mental health in direct and indirect ways. The participants voiced direct experiences of anxiety, self-esteem, and social aspects that reflect a mental health network where social media play diverse roles. Indirect implications of coping and self-control were found to supplement the network. Taken together, the themes and their implications to wellbeing make a valuable contribution to the evolving qualitative understanding young people's social media use in the UK (e.g., Conroy et al. 2023) and serve as a useful basis for future measure development.
 
A particular strength of the work was the engagement of three Young Researchers who co-facilitated the focus groups and were involved in the analysis. The research meets high reflexivity and transparency criteria, and the carefully constructed supplementary materials provide informative details especially for measure developers. Finally, the authors must be commended for sharing these valuable data for reuse.
 
The Stage 2 manuscript was reviewed over two rounds by three unique reviewers. The reviewers’ expertise ranged from social media and technology use research to health psychology and qualitative methods. Based on careful revisions and detailed responses to the reviewers’ comments, the recommender judged that the manuscript met the Stage 2 criteria and awarded a positive recommendation.
 
URL to the preregistered Stage 1 protocol: https://osf.io/w24ec
 
Level of bias control achieved: Level 2. At least some data/evidence had been accessed and partially observed by the authors prior to IPA, but the authors certify that they have not yet observed the key variables within the data that were used to answer the research question.
 
List of eligible PCI-RR-friendly journals: 
 
 
References
 
1. Borsboom, D. (2005). Measuring the mind: Conceptual issues in contemporary psychometrics. Cambridge University Press.
 
2. Conroy, D., Chadwick, D., Fullwood, C., & Lloyd, J. (2023). “You have to know how to live with it without getting to the addiction part”: British young adult experiences of smartphone overreliance and disconnectivity. Psychology of Popular Media, 12, 471-480. https://doi.org/10.1037/ppm0000425
 
3. Dunne, J. H., Black, L., Banwell, E., Nanda, P., Anderton, M, Butters, L.C., Demkowicz, O., Davies, J., Davidson, B., Qualter, P., Humphrey, N., Jay, C., & Panayiotou, M. (2024). Identifying relevant dimensions to the measurement of adolescent social media experience via focus groups with young people [Stage 2]. Acceptance of Version 9 by Peer Community in Registered Reports. https://doi.org/10.31234/osf.io/erjvz
 
4. Nisbett, R. E., & Wilson, T. D. (1977). Telling more than we can know: Verbal reports on mental processes. Psychological review, 84, 231-259. https://doi.org/10.1037/0033-295X.84.3.231
Identifying relevant experiences to the measurement of social media experience via focus groups with young peopleJo Hickman Dunne, Louise Black, Molly Anderton, Pratyasha Nanda, Emily Banwell, Lily Corke Butters, Ola Demkowicz, Jade Davies, Brittany I Davidson, Pamela Qualter, Neil Humphrey, Caroline Jay, Margarita Panayiotou<p>While work on the relationship between social media use and adolescent mental health has allowed for some progress, research in this area is still relatively new and shows mixed evidence. This is partly the consequence of a rapidly changing fie...Social sciencesVeli-Matti Karhulahti2024-05-03 20:40:41 View
28 Feb 2024
STAGE 1

Changes in memory function in adults following SARS-CoV-2 infection: findings from the Covid and Cognition online study

Is memory affected in the long run following SARS-CoV-2 infection?

Recommended by ORCID_LOGO based on reviews by Phivos Phylactou, Dipanjan Ray and Mitul Mehta
COVID-19 has been suspected to have long-lasting effects on cognitive function. The SARS-CoV-2 virus may enter the central nervous system (Frontera et al., 2020; Miners, Kehoe, & Love, 2020), explaining the observed detrimental effects of COVID-19 on verbal planning and reasoning (Hampshire et al., 2021; Wild et al., 2021), executive function (Hadad et al., 2022), and long-term memory (Guo et al., 2022). In particular, Guo et al. (2022) used verbal item recognition and non-verbal associative memory tasks. Weinerova et al. (2024), in the current study, propose to conduct a replication of Guo et al. (2022), but specifically, to disentangle the effect of COVID-19 infection status on both memory type (item vs. associative) and stimulus modality (verbal vs. non-verbal). Furthermore, Weinerova et al. (2024) propose to analyze cognitive function based on vaccination status before infection to provide a critical test of the potential protective effects of vaccination on cognitive function.

Data collection has been completed with 325 participants after exclusion criteria were applied (COVID group N = 232, No COVID group N = 93). Simulations assuming an effect size observed in Guo et al. (2022), a Bayesian t-test comparing the groups, and a Bayes Factor of 6 indicated that N = 320 is sufficient to detect an effect on 79% of simulations. The main analyses will be conducted using a Bayesian ANCOVA that allows for the inclusion of control variables such as age, sex, country, and education level. Both accuracy and reaction times from the item and associative recognition tasks will be analyzed as the dependent variables. In one analysis, vaccination status will be included as a between-subjects factor, to understand whether vaccination status at the time of infection influences subsequent cognitive function. 

It is important to note that participants were recruited through long-COVID Facebook groups and clinics. Therefore, the results must be interpreted carefully to avoid generalizing to all COVID-19 infections. The data are part of a larger longitudinal study, and the current pre-registration applies only to the baseline timepoint for a cross-sectional analysis. The remaining longitudinal data collection is ongoing and is not part of the current pre-registration.  

The study plan was refined after one round of review, with input from three external reviewers who all agreed that the proposed study was well-designed and scientifically valid. The recommender then reviewed the revised manuscript and judged that the study met the Stage 1 criteria for in-principle acceptance (IPA).
 
URL to the preregistered Stage 1 protocol: https://osf.io/tjs5u (under temporary private embargo)
 
Level of bias control achieved: Level 3. At least some data/evidence that will be used to the answer the research question has been previously accessed by the authors (e.g. downloaded or otherwise received), but the authors certify that they have not yet observed ANY part of the data/evidence.
 
List of eligible PCI RR-friendly journals:
 
 
References
 
1. Frontera, J., Mainali, S., Fink, E.L. et al. Global Consortium Study of Neurological Dysfunction in COVID-19 (GCS-NeuroCOVID): Study Design and Rationale. Neurocrit Care 33, 25–34 (2020). https://doi.org/10.1007/s12028-020-00995-3

2. Guo, P., Benito Ballesteros, A., Yeung, S. P., Liu, R., Saha, A., Curtis, L., Kaser, M., Haggard, M. P. & Cheke, L. G. (2022). COVCOG 2: Cognitive and Memory Deficits in Long COVID: A Second Publication From the COVID and Cognition Study. Frontiers in Aging Neuroscience. https://doi.org/10.3389/fnagi.2022.804937  

3. Hadad, R., Khoury, J., Stanger, C., Fisher, T., Schneer, S., Ben-Hayun, R., Possin, K., Valcour, V., Aharon-Peretz, J. & Adir, Y. (2022). Cognitive dysfunction following COVID-19 infection. Journal of NeuroVirology, 28(3), 430–437. https://doi.org/10.1007/s13365-022-01079-y  

4. Hampshire, A., Trender, W., Chamberlain, S. R., Jolly, A. E., Grant, J. E., Patrick, F., Mazibuko, N., Williams, S. C., Barnby, J. M., Hellyer, P. & Mehta, M. A. (2021). Cognitive deficits in people who have recovered from COVID-19. EClinicalMedicine, 39, 101044. https://doi.org/10.1016/j.eclinm.2021.101044

5. Miners, S., Kehoe, P. G., & Love, S. (2020). Cognitive impact of COVID-19: looking beyond the short term. Alzheimer's research & therapy, 12, 1-16. https://doi.org/10.1186/s13195-020-00744-w 
 
6. Weinerova, J., Yeung, S., Guo, P., Yau, A., Horne, C., Ghinn, M., Curtis, L., Adlard, F., Bhagat, V., Zhang, S., Kaser, M., Bozic, M., Schluppeck, D., Reid, A., Tibon, R. & Cheke, L. G. (2024). Changes in memory function in adults following SARS-CoV-2 infection: findings from the Covid and Cognition online study. In principle acceptance of Version 2 by Peer Community in Registered Reports. https://osf.io/tjs5u

7. Wild, C. J., Norton, L., Menon, D. K., Ripsman, D. A., Swartz, R. H. & Owen, A. M. (2022). Disentangling the cognitive, physical, and mental health sequelae of COVID-19. Cell Reports Medicine, 3, 100750. https://doi.org/10.1016/j.xcrm.2022.100750 
Changes in memory function in adults following SARS-CoV-2 infection: findings from the Covid and Cognition online studyJosefina Weinerova, Sabine Yeung, Panyuan Guo, Alice Yau, Connor Horne, Molly Ghinn, Lyn Curtis, Francess Adlard, Vidita Bhagat, Seraphina Zhang, Muzaffer Kaser, Mirjana Bozic, Denis Schluppeck, Andrew Reid, Roni Tibon, Lucy Cheke<p>SARS-CoV-2, the virus responsible for the Covid-19 pandemic, has been shown to have an impact on cognitive function, but the specific aspects of cognition that are affected remain unclear. In this Registered Report, we present a study aimed at ...Life SciencesVishnu Sreekumar2023-08-14 11:09:45 View
30 Jun 2023
STAGE 1

Justice in the Eye of the Beholder: How Comparison Framing Affects the Perception of Global Inequality Through Social Emotions and Justice Sensitivity

Why are there variations in perceptions of inequality?

Recommended by ORCID_LOGO based on reviews by Mario Gollwitzer and Sa-Kiera Hudson
Inequalities in income, wealth, and opportunities are rampant both between and within nations around the world. Making strides to rectify inequalities requires examining how people come to understand them as well as the psychological processes that translate those understandings into reparative actions. There is some evidence for a “comparative framing effect,” in which the group that is initially referenced impacts judgements by communicating salient information and the appropriate reference point. Research on this comparative framing effect suggests that focusing on disadvantage, relative to advantage, leads to a more negative assessment and intentions to engage in action to reduce the inequality. 
 
In two pilot studies (reported in the current proposal) focused on global inequalities (low-income vs high-income countries), Schnepf et al. (2023) did not find evidence for a main effect of framing on perceived legitimacy of the inequality or intentions to engage in action. They did, however, find some evidence for an interaction with the perceived size of the inequality. When the low-income country was the subject of the comparison, larger perceptions of the size of the inequality were associated with greater intentions to engage in action (both studies) and greater perceptions of the differences as illegitimate (Study 1 only). Moreover, they found some evidence in both studies that negative social emotions such as guilt and shame were the mechanism that explained why perceiving greater inequality in the low-income framing condition was associated with the outcomes. 
 
In the current study, Schnepf et al. (2023) build upon these two pilot studies to conduct a high-quality replication and a stronger test of their hypotheses. Most notably, the proposed Registered Report uses a much larger sample, providing adequate statistical power to detect relatively small interaction effects. Additionally, the proposed project manipulates the size of the inequality that is being evaluated, rather than relying on participants’ perceptions. Finally, the study includes “justice sensitivity,” or the degree to which individuals assess inequality as unfair as an additional hypothesized moderator, and “social dominance orientation” as an exploratory moderator. Along with the pilot studies, the proposed project will represent a strong test of several hypotheses relevant to many different areas of social and personality psychology. 
 
The Stage 1 manuscript was evaluated over two rounds of in-depth peer review, both of which consisted of substantial comments from two scholars with relevant expertise. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and was therefore awarded in-principle acceptance (IPA).
 
URL to the preregistered Stage 1 protocol: https://osf.io/pgyvw
 
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.
 
List of eligible PCI RR-friendly journals:
 
 
References
 
1. Schnepf, J., Reese, G., Bruckmüller, S., Braun, M., Rotzinger, J., & Martiny, S. E. (2023). Justice in the eye of the beholder: How comparison framing affects the perception of global inequality through social emotions and justice sensitivity. In principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/pgyvw
Justice in the Eye of the Beholder: How Comparison Framing Affects the Perception of Global Inequality Through Social Emotions and Justice SensitivityJulia Schnepf, Gerhard Reese, Susanne Bruckmüller, Maike Braun, Julia Rotzinger, Sarah E. Martiny<p>Global inequality is one of today’s major challenges. How people mentally represent inequality is often determined by its comparative framing. In the present work, we seek to analyze whether putting the focus of a comparison on the disadvantage...Social sciencesMoin Syed2021-12-11 15:41:26 View
11 Sep 2023
STAGE 1

Researcher Predictions of Effect Generalizability Across Global Samples

Can psychology researchers predict which effects will generalise across cultures?

Recommended by ORCID_LOGO based on reviews by Michèle Nuijten, Ian Hussey, Jim Grange and Matthias Stefan
Compared to the wealth of debate surrounding replicability and transparency, relatively little attention has been paid to the issue of generalisability – the extent to which research findings hold across different samples, cultures, and other parameters. Existing research suggests that researchers in psychology are prone to generalisation bias, relying on narrow samples (e.g. drawn predominantly from US or European undergraduate samples) to draw broad conclusions about the mind and behaviour. While recent attempts to address generalisability concerns have been made – such as journals requiring explicit statements acknowledging constraints on generality – addressing this bias at root, and developing truly generalisable methods and results, requires a deeper understanding of how researchers perceive generalisability in the first place.
 
In the current study, Schmidt et al. (2023) tackle the issue of cross-cultural generalisability using four large-scale international studies that are being conducted as part of the Psychological Science Accelerator (PSA) – a globally distributed network of researchers in psychology that coordinates crowdsourced research projects across six continents. Specifically, participants (who will be PSA research members) will estimate the probability that an expected focal effect will be observed both overall and within regional subsamples of the PSA studies. They will also predict the size of these focal effects overall and by region.
 
Using this methodology, the authors plan to ask two main questions: first whether researchers can accurately predict the generalisability of psychological phenomena in upcoming studies, and second whether certain researcher characteristics (including various measures of expertise, experience, and demographics) are associated with the accuracy of generalisability predictions. Based on previous evidence that scientists can successfully predict the outcomes of research studies, the authors expect to observe a positive association between predicted and actual outcomes and effect sizes. In secondary analyses, the authors will also test if researchers can predict when variables that capture relevant cultural differences will moderate the focal effects – if so, this would suggest that at least some researchers have a deeper understanding as to why the effects generalise (or not) across cultural contexts.
 
The Stage 1 manuscript was evaluated over two rounds of in-depth review. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
 
URL to the preregistered Stage 1 protocol: https://osf.io/vwqsa (under temporary private embargo)
 
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.
 
List of eligible PCI RR-friendly journals:
 
 
References
 
1. Schmidt, K., Silverstein, P. & Chartier, C. R. (2023). Registered Report: Researcher Predictions of Effect Generalizability Across Global Samples. In principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/vwqsa
Researcher Predictions of Effect Generalizability Across Global SamplesKathleen Schmidt, Priya Silverstein, & Christopher R. Chartier<p>The generalizability of effects is an increasing concern among researchers in psychological science. Traditionally, the field has relied on university samples from Europe and North America to make claims about humans writ large. The proposed re...Social sciencesChris Chambers2023-02-16 03:49:35 View
05 Jun 2024
STAGE 1

Revisiting Partition Priming in judgment under uncertainty: Replication and extension Registered Report of Fox and Rottenstreich (2003)

Understanding probability assessments with partitioned framing

Recommended by ORCID_LOGO based on reviews by Olivier L'Haridon and Don Moore
Decision-making based on limited information is a common occurrence. Whether it is the possibility of a cheaper product elsewhere or the unknown qualifications of election candidates, people are regularly forced to make a decision under ignorance or uncertainty. In such situations, information about certain events is unavailable or too costly to acquire and people rely on subjective probability allocation to guide decision-making processes. This allocation seems to result in what is known as ignorance priors, i.e., decision-makers assigning equal probabilities to each possible outcome within a given set. How events are grouped or partitioned is often subjective and may influence probability judgments and subsequent decisions. In such cases, the way the choices within a choice set are presented may shape the perceived likelihood of different outcomes. Understanding the impact of partitioning on probability estimation is crucial for both psychological and economic theories of judgment and decision.
 
The question of evaluating probabilities under uncertainty has received much attention in the psychology and economics literature over the past decades given the wide range of possible applications. In the current work, Ding and Feldman (2024) seek to replicate one of the foundational works on the topic: Fox and Rottenstreich (2003). In the original work, the authors provided exploratory evidence indicating that the framing of a situation affects the way individuals perceive probabilities of possible outcomes. They showed that people assigned uniform probabilities to sets of events described in a problem, such that the way the events are described partly determines people’s partitioning of those events and evaluations of the probabilities of the possible outcomes. Additionally, this partitioned framing affected judgments both under conditions of ignorance (where individuals have no information and rely solely on uniform probability assignments) and uncertainty (where individuals have some information but still rely on heuristics influenced by partitioning). This suggests that priors resulting from the inference of available evidence are sometimes partly contaminated by partitioning bias, affecting both uninformed and partially informed decision-making processes. As a consequence, the partitioning of events into different subsets might lead to varying evaluations of a single situation, resulting in inconsistencies and poorly calibrated probability assessments.
 
Ding and Feldman (2024) aim to replicate Studies 1a, 1b, 3, and 4 from Fox and Rottenstreich (2003). Their close replication will rely on original data (US participants, Prolific, N=600, not collected yet) with a large statistical power (>95%). Their replication aims to examine whether the partitioned framing affects prior formation under ignorance (Studies 1a, 1b, and 4) and uncertainty (Study 3). In addition, the authors propose an extension examining estimations of alternative event(s) contrasting estimations of the probabilities of events happening versus of events not happening.
 
The Stage 1 manuscript was evaluated by two external reviewers and the recommender. Based on detailed responses to the reviewers' and the recommender’s comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
 
URL to the preregistered Stage 1 protocol: https://osf.io/px6vb
 
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.
 
List of eligible PCI RR-friendly journals:
 
 
References 
 
1. Ding, K. & Feldman, G. (2024). Revisiting Partition Priming in judgment under uncertainty:
Replication and extension Registered Report of Fox and Rottenstreich (2003). In principle acceptance of Version 2 by Peer Community in Registered Reports. https://osf.io/px6vb
 
2. Fox, C. R. & Rottenstreich, Y. (2003). Partition priming in judgment under uncertainty. Psychological Science, 14, 195-200. https://doi.org/10.1111/1467-9280.02431
Revisiting Partition Priming in judgment under uncertainty: Replication and extension Registered Report of Fox and Rottenstreich (2003)Kerou Ding, Gilad Feldman<p>[IMPORTANT: Abstract, method, and results were written using a randomized dataset produced by Qualtrics to simulate what these sections will look like after data collection. These will be updated following the data collection. For the purpose o...Social sciencesRomain Espinosa2024-01-18 12:46:26 View
01 Jun 2024
STAGE 1

Can Imagining Actions as Occurring Involuntarily Cause Intentional Behaviour to Feel Involuntary?

Can the sense of agency and reality be altered by our meta-cognitive models?

Recommended by ORCID_LOGO based on reviews by Zoltan Kekecs and Sophie Siestrup
Alterations in subjective experience, including alterations in the sense of agency (SoA) and reality (SoR), are commonly implicated in direct-verbal suggestions, such as hypnotic suggestions. Although extensively studied, how direct-verbal suggestions can alter the SoA and SoR is not understood (e.g., see Martin & Pacherie, 2019; Zahedi et al., 2024). One class of theories postulates that the alterations in SoA and SoR are related to meta-cognition. For instance, the intention to move or form a mental image can be kept out of conscious awareness, creating a sense of involuntariness (Dienes & Perner, 2007).

Relying on this theory, in the current study Sheldrake and Dienes (2024) postulate that the metacognitive processes related to these alterations can occur by appropriate use of imagination. In other words, by imagining the movement or object to be hallucinated and further imagining the underlying process was outside of awareness, one can elicit alterations in SoA and SoR. To this end, an intervention is devised whereby the participant is repeatedly asked to consider what might help or hinder them from imagining they are unaware of the relevant intention and thereby adjust their imagination. A control group will be asked to increase the feeling of involuntariness or altered reality simply by repeated practice. Afterward, participants will be asked in a test phase the extent to which the suggested experience felt involuntary.
 
The Stage 1 manuscript was evaluated over three rounds of in-depth review. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA). 
 
URL to the preregistered Stage 1 protocol: https://osf.io/f8hsd
 
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.  
 
List of eligible PCI RR-friendly journals:
 

References
 
1. Dienes, Z. & Perner, J. (2007). Executive control without conscious awareness: The cold control theory of hypnosis. In G. A. Jamieson (Ed.), Hypnosis and conscious states: The cognitive neuroscience perspective (pp. 293-314). Oxford University Press.
 
2. Martin, J. R. & Pacherie, E. (2019). Alterations of agency in hypnosis: A new predictive coding model. Psychol Rev, 126(1), 133-152. https://doi.org/10.1037/rev0000134
 
3. Sheldrake, K. & Dienes, Z. (2043). Can Imagining Actions as Occurring Involuntarily Cause Intentional Behaviour to Feel Involuntary? In principle acceptance of Version 6 by Peer Community in Registered Reports. https://osf.io/f8hsd
 
4. Zahedi, A., Lynn, S. J., & Sommer, W. (2024). Cognitive Simulation along with Neural Adaptation Explain Effects of Suggestions: A Novel Theoretical Framework. Frontiers in Psychology. https://doi.org/10.3389/fpsyg.2024.1388347
Can Imagining Actions as Occurring Involuntarily Cause Intentional Behaviour to Feel Involuntary?Kevin Sheldrake, Zoltan Dienes<p>The cold control theory of response to imaginative suggestions calling for distortions in veridical experience (including hypnotic suggestions) states that behavioural and cognitive responses are generated intentionally, but are perceived as in...Social sciencesAnoushiravan Zahedi Zoltan Kekecs2023-11-25 16:24:53 View