Announcements
Please note that we will be CLOSED to ALL SUBMISSIONS from 1 December 2024 through 12 January 2025 to give our recommenders and reviewers a holiday break.
We are recruiting recommenders (editors) from all research fields!
Your feedback matters! If you have authored or reviewed a Registered Report at Peer Community in Registered Reports, then please take 5 minutes to leave anonymous feedback about your experience, and view community ratings.
235 records found
Latest recommendations
Id | Title * | Authors * | Abstract * | Picture▲ | Thematic fields * | Recommender | Reviewers | Submission date | |
---|---|---|---|---|---|---|---|---|---|
27 Jun 2024
STAGE 1
Learning from comics versus non-comics material in education: Systematic review and meta-analysisMarianna Pagkratidou, Neil Cohn, Phivos Phylactou, Marietta Papadatou-Pastou, Gavin Duffy https://osf.io/preprints/metaarxiv/ceda3/Comics in EducationRecommended by Veli-Matti Karhulahti based on reviews by Adrien Fillon, Benjamin Brummernhenrich, Solip Park and Pavol KačmárEspecially after the impactful experiments in modern comics (e.g. McCloud 1993), research interest in the medium increased with new practical developments (Kukkonen 2013). Some of these developments now manifest in educational settings where comics are used for various pedagogical purposes in diverse cultural contexts. To what degree comics are able to reach educational outcomes in comparison to other pedagogical tools remains largely unknown, however.
In the present registered report, Pagkratidou and colleagues (2024) respond to the research gap by investigating the effectiveness of educational comics materials. By means of systematic review and meta-analysis, the authors assess all empirical studies on educational comics to map out what their claimed benefits are, how the reported effectiveness differs between STEM and non-STEM groups, and what moderating effects complicate the phenomenon. With the help of large language models, all publication languages are included in analysis. The research plan was reviewed over three rounds by four reviewers with diverse sets of expertise ranging from education and meta-analytic methodology to comics culture and design. After comprehensive revisions by the authors, the recommender considered the plan to meet high Stage 1 criteria and provided in-principle acceptance. URL to the preregistered Stage 1 protocol: https://osf.io/vdr8c Level of bias control achieved: Level 3. At least some data/evidence that will be used to the answer the research question has been previously accessed by the authors (e.g. downloaded or otherwise received), but the authors certify that they have not yet observed ANY part of the data/evidence.
List of eligible PCI RR-friendly journals: References 1. Kukkonen, K. (2013). Studying comics and graphic novels. John Wiley & Sons.
2. McCloud, S. (1993). Understanding comics: The invisible art. Tundra.
3. Pagkratidou, M., Cohn, N., Phylactou, P., Papadatou-Pastou, M., & Duffy, G. (2024). Learning from comics versus non-comics material in education: Systematic review and meta-analysis. In principle acceptance of Version 4 by Peer Community in Registered Reports. https://osf.io/vdr8c
| Learning from comics versus non-comics material in education: Systematic review and meta-analysis | Marianna Pagkratidou, Neil Cohn, Phivos Phylactou, Marietta Papadatou-Pastou, Gavin Duffy | <p>The past decades have seen a growing use of comics (i.e., sequential presentation of images and/or text) educational material. However, there are inconsistent reports regarding their effectiveness. In this study, we aim to systematically review... | Social sciences | Veli-Matti Karhulahti | 2023-10-16 22:55:09 | View | ||
Functional MRI brain state occupancy in the presence of cerebral small vessel disease -- a pre-registered replication analysis of the Hamburg City Health StudyThies Ingwersen, Carola Mayer, Marvin Petersen, Benedikt M. Frey, Jens Fiehler, Uta Hanning, Simone Kühn, Jürgen Gallinat, Raphael Twerenbold, Christian Gerloff, Bastian Cheng, Götz Thomalla, Eckhard Schlemm, https://github.com/csi-hamburg/HCHS-brain-states-RR/blob/f9d00adbbcf9593d8d191bf5b93912141b80ab1b/manuscript/build/main.pdfReplicable dynamic functional connectivity and cognitive correlates of cerebral small vessel disease in the Hamburg City Health StudyRecommended by Robert McIntosh based on reviews by 1 anonymous reviewerIn a previous analysis of data from 988 participants in the Hamburg City Health Study (HCHS), Schlemm and colleagues (2022) reported significant associations between the extent of cerebral small vessel disease (cSVD) and dynamic functional connectivity measures from resting state fMRI. Specifically, the volume of white matter hyperintensities of presumed vascular origin, a structural indicator of cSVD, was negatively related to the proportion of time (‘fractional occupancy’) spent in the two most occupied functional brain states. Reduced fractional occupancy was also associated with longer times to complete part B of the Trail Making Test.
In the present Registered Report, Ingwersen and colleagues (2023) successfully replicated these associations between structural, functional and cognitive measures in a sample of 1651 HCHS participants not included in the earlier study. An exploratory multiverse analysis found that the associations were generally robust to different brain parcellation and confound regression strategies. These replicable patterns reinforce the idea that cSVD may disrupt the brain’s ability to enter and maintain distinct functional modes, and that these changes in functional dynamics are predictive of cognitive impairment.
The Stage 2 manuscript was assessed over one round of in-depth review. The recommender judged that responses to reviewer comments were appropriate, and that the manuscript met the Stage 2 criteria for recommendation.
URL to the preregistered Stage 1 protocol: https://osf.io/9yhzc
Level of bias control achieved: Level 2. At least some data/evidence that was used to answer the research question had been accessed and partially observed by the authors prior to Stage 1 in-principle acceptance, but the authors certify that they had not yet observed the key variables within the data that were used to answer the research question AND they took additional steps to maximise bias control and rigour. List of eligible PCI RR-friendly journals:
References
1. Schlemm, E., Frey, B. M., Mayer, C., Petersen, M., Fiehler, J., Hanning, U., Kühn, S., Twerenbold, R., Gallinat, J., Gerloff, C., Thomalla, G. & Cheng, B. (2022). Equalization of brain state occupancy accompanies cognitive impairment in cerebral small vessel disease. Biological Psychiatry, 92, 592-602. https://doi.org/10.1016/j.biopsych.2022.03.019
2. Ingwersen, T., Mayer, C., Petersen, M., Frey, B. M., Fiehler, J., Hanning, U., Kühn, S., Gallinat, J., Twerenbold, R., Gerloff, C., Cheng, B., Thomalla, G. & Schlemm, E. (2023). Functional MRI brain state occupancy in the presence of cerebral small vessel disease -- a pre-registered replication analysis of the Hamburg City Health Study. Acceptance of Version 2.01 by Peer Community in Registered Reports. https://github.com/csi-hamburg/HCHS-brain-states-RR/blob/f9d00adbbcf9593d8d191bf5b93912141b80ab1b/manuscript/build/main.pdf
| Functional MRI brain state occupancy in the presence of cerebral small vessel disease -- a pre-registered replication analysis of the Hamburg City Health Study | Thies Ingwersen, Carola Mayer, Marvin Petersen, Benedikt M. Frey, Jens Fiehler, Uta Hanning, Simone Kühn, Jürgen Gallinat, Raphael Twerenbold, Christian Gerloff, Bastian Cheng, Götz Thomalla, Eckhard Schlemm, | <p><strong>Objective</strong>: To replicate recent findings on the association between the extent of cerebral small vessel disease (cSVD), functional brain network dedifferentiation, and cognitive impairment.</p> <p><strong>Methods:</strong> We a... | Life Sciences, Medical Sciences | Robert McIntosh | 2023-10-17 09:53:02 | View | ||
The Effect of Brooding about Societal Problems on Conspiracy Beliefs: A Registered ReportLuisa Liekefett, Simone Sebben, Julia C. Becker https://osf.io/3e8wcBrooding increases conspiracy beliefs but with practical significance to be determinedRecommended by Chris Chambers based on reviews by Matt Williams and Daniel Toribio-FlórezThe world is seemingly awash with conspiracy theories – from well-trodden examples such as fake Moon landings, the 9/11 truth movement, and Holocaust denial, to relative newcomers including COVID as a bioweapon, QAnon, and the belief that the science of climate change has been invented or falsified. While there is a public perception that conspiracy theories are becoming more prevalent, recent evidence suggests that the rate of conspiracism is relatively stable over time (Uscinski et al., 2022). At any point in history, it seems that a certain proportion of people find themselves vulnerable to conspiracy beliefs, but what distinguishes those who do from those who don’t, and what are the causal factors?
In the current study, Liekefett et al. (2023) investigated the critical role of rumination – a perseverative and repetitive focus on negative content leading to emotional distress. In particular, the authors asked whether one component of rumination referred to as brooding (dwelling on one’s worries and distressing emotions) has a specific causal role in the formation of conspiracy beliefs. In a series of preliminary experiments, the authors first established a procedure for successfully inducing rumination, identifying various boundary conditions and requirements for a successful design. In the main study (N=1,638 to 2,007 depending on the analysis), they asked whether the induction of brooding causes a significant increase in conspiracy beliefs. Manipulation checks were also included to confirm intervention fidelity (independently of this hypothesis), and exploratory analyses tested the effect of various moderators, as well as the causal role of a complementary manipulation of reflection – a component of rumination in which attention is focused on the issue at hand rather than one’s emotions.
As expected by the authors' preliminary work, manipulation checks independently confirmed the effectiveness of the brooding intervention. In answer to the main research question, participants who brooded over the worries and negative emotions associated with an issue were more susceptible to conspiracy beliefs compared to a control group. However, while this effect of brooding was statistically significant, the confidence interval of the effect size estimate overlapped with the authors' proposed smallest effect size of interest (d = 0.20), suggesting that the practical value of the effect remains to be determined.
Overall the findings are consistent with a range of psychological theories suggesting that rumination induces negative affect and/or narrows attention to negative information, which in turn may make conspiracy theories seem more probable and render individuals more vulnerable to cognitive bias. The authors note the importance of future work to define the smallest effect of practical significance, analagous to the criteria used to determine the 'minimal clinically important difference’ in medical research.
The Stage 2 manuscript was evaluated over one round of in-depth review. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 2 criteria and awarded a positive recommendation.
URL to the preregistered Stage 1 protocol: https://osf.io/y82bs
Level of bias control achieved: Level 6. No part of the data or evidence that was used to answer the research question was generated until after IPA. List of eligible PCI RR-friendly journals: References
1. Uscinski, J., Enders, A., Klofstad, C., Seelig, M., Drochon, H., Premaratne, K. & Murthi, M. (2022) Have beliefs in conspiracy theories increased over time? PLOS ONE 17: e0270429. https://doi.org/10.1371/journal.pone.0270429
2. Liekefett, L. Sebben, S. & Becker, J. C. (2023). The Effect of Brooding about Societal Problems on Conspiracy Beliefs: A Registered Report. Acceptance of Version 2 by Peer Community in Registered Reports. https://osf.io/3e8wc | The Effect of Brooding about Societal Problems on Conspiracy Beliefs: A Registered Report | Luisa Liekefett, Simone Sebben, Julia C. Becker | <p>This Stage 2 Registered Report concerns the relationship between rumination, a repetitive style of negative thinking, and conspiracy beliefs (Stage 1 protocol: https://osf.io/y82bs, date of in-principle-acceptance: 23/05/2023). Based on four pi... | Humanities, Social sciences | Chris Chambers | 2023-10-19 17:46:59 | View | ||
The Medusa effect: A registered replication report of Will, Merritt, Jenkins, and Kingstone (2021)Jing Han, Minjun Zhang, Jiaxin Liu, Yu Song, Yuki Yamada https://osf.io/yqnu8Looking (again) at Medusa: Evidence that pictorial abstraction influences mind perceptionRecommended by Chris Chambers based on reviews by Alan Kingstone and 1 anonymous reviewerThe Medusa effect is a recently described phenomenon in which people judge a person to be more mindful when they appear as a picture (termed L1) than as a picture within a picture (L2). Across a series of experiments, Will et al. (2021) reported that at higher levels of abstraction, images of people were judged lower in realness (how real the person seemed), experience (the ability to feel) and agency (the ability to plan and act), and also benefited less from prosocial behaviour. The findings provide an intriguing window into mind perception – the extent to which we attribute minds and mental capacities to others.
In the current study, Han et al. (2023) undertook a close replication of two experiments from the original report by Will et al. (2021), asking first, whether the level of pictorial abstraction influences ratings of realness, agency and experience, and second, whether it also influences prosocial behaviour as measured in the dictator game (with participants predicted to allocate more money to recipients presented as pictures than as pictures within pictures). In the event of a non-replication using the original materials, the authors planned to further repeat the experiments using newly generated stimuli that are better matched for cultural context and more tightly controlled along various dimensions.
Results supported all pre-registered hypotheses. Participants rated and perceived L1 stimuli as having significantly higher levels of realness, agency, and experience than L2, and they also allocated significantly more money to L1 recipients than L2 recipients in a dictator game. Furthermore, participants who judged L1 as higher than L2 on all three dimensions also differentiated significantly between L1 and L2 in the dictator game, indicating a relationship between mind perception and prosociality. Overall, the findings confirm that pictures with lower levels of abstraction are perceived as more mindful and are associated with higher levels of prosocial behavior. Consequently, the results suggest that the Medusa effect is a reproducible phenomenon.
The Stage 2 manuscript was evaluated over one round of in-depth review. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 2 criteria and awarded a positive recommendation.
URL to the preregistered Stage 1 protocol: https://osf.io/xj46z Level of bias control achieved: Level 6. No part of the data or evidence that was used to answer the research question was generated until after IPA.
List of eligible PCI RR-friendly journals: References
1. Will, P., Merritt, E., Jenkins, R., & Kingstone, A. (2021). The Medusa effect reveals levels of mind perception in pictures. Proceedings of the National Academy of Sciences, 118(32), e2106640118. https://doi.org/10.1073/pnas.2106640118
2. Han, J., Zhang, M., Liu, J., Song, Y. & Yamada, Y. (2023).The Medusa effect: A registered replication report of Will, Merritt, Jenkins, and Kingstone (2021). Acceptance of Version 2 by Peer Community in Registered Reports. https://osf.io/yqnu8
| The Medusa effect: A registered replication report of Will, Merritt, Jenkins, and Kingstone (2021) | Jing Han, Minjun Zhang, Jiaxin Liu, Yu Song, Yuki Yamada | <p>Will et al.'s (2021) found the Medusa effect, which refers to the tendency that people evaluate a “person in picture” more mindful than a “person in picture of a picture”. The present study tried to directly replicate the Experiments 2 and 5 of... | Social sciences | Chris Chambers | 2023-10-24 03:42:14 | View | ||
08 Nov 2024
STAGE 1
Relationship between perceived risk and compliance to infection control measures during the first year of a pandemicSebastian Bjørkheim, Sigurd Hystad, Bjørn Sætrevik https://osf.io/z6rmhThe relationship between risk and compliance during the first year of the Covid-19 pandemic in NorwayRecommended by Adrien Fillon based on reviews by Erik Løhre, Gaëlle Marinthe, Lewend Mayiwar and 1 anonymous reviewerWhat relationship can be expected between the perception of risk and compliance with protective measures? The authors of the current study measured the perceived risk of COVID-19 and compliance with infection control in Norway during the first year of the pandemic. While the authors state that the perceived risk has a positive association with compliance, they also hypothesize that both measures at Tn will predict the other at Tn+1, indicating a dynamic and bi-directional relationship. Finding support (or not) for this hypothesis can be crucial for developing interventions that will encourage compliance with infection control measures. The analysis will be quantitative.
The authors already collected the data, and the risk of bias due to the accessibility of data was discussed extensively during the peer-reviewing process. In summary, the authors will set up an alpha at 0.01, perform a multiverse analysis and present all the results associated. They will analyse the model with various ways of handling outliers, and the analysis will be made by a colleague who did not have access to the data. The authors already provided a script to produce the multiverse analysis. The recommender and reviewers agreed that these procedures are sufficient to control for the level of bias due to the accessibility of data.
The Stage 1 manuscript was evaluated over three rounds of in-depth review. Based on detailed responses to reviewers’ and the recommender’s comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance. URL to the preregistered Stage 1 protocol: https://osf.io/epdn8
Level of bias control achieved: Level 1. At least some of the data/evidence that will be used to the answer the research question has been accessed and observed by the authors, the data analyst excepted, including key variables, but the authors certify that they have not yet performed ANY of their preregistered analyses, and in addition they have taken stringent steps to reduce the risk of bias.
List of eligible PCI RR-friendly journals: References Bjørkheim, S., Hystad, S., & Sætrevik, B. (2024). Relationship between perceived risk and compliance to infection control measures during the first year of a pandemic. In principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/epdn8
| Relationship between perceived risk and compliance to infection control measures during the first year of a pandemic | Sebastian Bjørkheim, Sigurd Hystad, Bjørn Sætrevik | <p>The way people perceive health risks is often assumed to influence how they adopt precautionary measures. However, people’s assessment of a given phenomenon’s risk may vary over time, and the relationship between perceived risk and compliance w... | Social sciences | Adrien Fillon | Lewend Mayiwar | 2023-10-25 10:16:57 | View | |
28 Mar 2024
STAGE 1
Working memory performance in adverse environments: Enhanced, impaired, or intact?Stefan Vermeent, Anna-Lena Schubert, Meriah L. DeJoseph, Jaap J. A. Denissen, Jean-Louis van Gelder, Willem E. Frankenhuis https://github.com/StefanVermeent/liss_wm_profiles_2023/blob/master/manuscript/manuscript.pdfA closer look at working memory changing with adversityRecommended by Yuki Yamada based on reviews by Kathryn Bates and 1 anonymous reviewerAdverse environments involving threat, uncertainty, deprivation and stress can cause significant and long-lasting harm to cognition and development. In this Stage 1 protocol, Vermeent and colleagues (2024) aim to simultaneously test with a single paradigm and statistical model for findings from previous studies showing that human working memory capacity is impaired in adverse environments, as well as other evidence suggesting that adversity may actually enhance updating of working memory. Furthermore, they will also investigate whether working memory is related to each of the adversity types: threat, deprivation, and unpredictability.
The findings of this study should help clarify how working memory functions in combination with adversity, and will provide insight into the development of better interventions and training methods for optimal performance in a variety of environments.
The manuscript was reviewed by two experts and the recommender. Following two rounds of peer review, and based on detailed responses to the reviewers' comments, I, the recommender, judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
URL to the preregistered Stage 1 protocol: https://osf.io/dp7wc
Level of bias control achieved: Level 3. At least some data/evidence that will be used to the answer the research question has been previously accessed by the authors (e.g. downloaded or otherwise received), but the authors certify that they have not yet observed ANY part of the data/evidence. List of eligible PCI RR-friendly journals:
References
1. Vermeent, S., Schubert, A.-L., DeJoseph, M. L., Denissen, J. J. A, van Gelder, J.-L. & Frankenhuis, W. E. (2024). Working memory performance in adverse environments: Enhanced, impaired, or intact? In principle acceptance of Version 2 by Peer Community in Registered Reports. https://osf.io/dp7wc | Working memory performance in adverse environments: Enhanced, impaired, or intact? | Stefan Vermeent, Anna-Lena Schubert, Meriah L. DeJoseph, Jaap J. A. Denissen, Jean-Louis van Gelder, Willem E. Frankenhuis | <p>Decades of research have shown that adversity tends to lower working memory (WM) performance. This literature has mainly focused on impairments in the overall capacity to hold information available in WM for further processing. However, some re... | Social sciences | Yuki Yamada | Anonymous, Kathryn Bates | 2023-10-30 15:11:48 | View | |
24 Apr 2024
STAGE 1
Synaesthesia as a Model for Assessing Individual Differences in Visual Perception and Memory PerformanceEmily Whelan, Chhavi Sachdeva, Rebecca Ovalle-Fresa, Nicolas Rothen and Jamie Ward https://osf.io/6h8dxWhat can synaesthesia tell us about links between perception and memory?Recommended by Reshanne Reeder based on reviews by Janina Neufeld, David Brang and Tessa van LeeuwenWhat is the relationship between perception and memory? Although these topics are typically investigated separately, there is evidence that these cognitive processes may be related: for example, individuals with synaesthesia may experience both enhancements in visual acuity and visual memory; and individuals with amnesia may also show deficits in visual perceptual processing. However, comprehensive evidence for the relationship between perception and different forms of memory (both short-term and long-term) is currently lacking.
In this Stage 1 manuscript, Whelan et al. (2024) seek to elucidate this relationship by investigating individual differences in perception and memory in a general population sample (i.e., in synaesthetes, non-synaesthetic relatives, and controls). There are two accounts that may explain enhanced perception and memory in synaesthesia: a ‘dual-coding’ account, which suggests that the extra perceptual information often experienced in synaesthesia (e.g., seeing colors for different letters of the alphabet) may contribute to encoding richer information in sensory memory; and an ‘enhanced processing’ account, which posits that enhanced perception and memory in synaesthesia may be due to genetic or environmental factors not directly related to synaesthetic experiences. In the former case, synaesthetes should perform more similarly to each other than to their non-synaesthetic relatives; in the latter case, non-synaesthetic relatives of synaesthetes should show similar perceptual and memory benefits. The current study should therefore find evidence in favor of one of these accounts over the other. In addition to this, the authors will generate multidimensional cognitive profiles of synaesthetes and their relatives, compared to non-synaethetes, including perception, memory, mental imagery and cognitive styles.
The Stage 1 submission was evaluated by the recommender and two expert reviewers. Following revisions, the recommender judged that the manuscript met the Stage 1 criteria and awarded in-principle acceptance (IPA).
URL to the preregistered Stage 1 protocol: https://osf.io/6h8dx (under temporary private embargo) Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA. List of eligible PCI RR-friendly journals:
References
1. Whelan, E., Sachdeva, C., Ovalle-Fresa, R., Rothen R., & Ward, J. (2024). Synaesthesia as a Model for Assessing Individual Differences in Visual Perception and Memory Performance. In principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/6h8dx
| Synaesthesia as a Model for Assessing Individual Differences in Visual Perception and Memory Performance | Emily Whelan, Chhavi Sachdeva, Rebecca Ovalle-Fresa, Nicolas Rothen and Jamie Ward | <p>In this study, the cognitive profile of synaesthesia (a perceptual condition in which primary experiences, such as perceiving digits or words, elicit extra secondary sensations) is used as a model system to assess visual perceptual abilities an... | Social sciences | Reshanne Reeder | 2023-11-07 13:02:39 | View | ||
26 Feb 2024
STAGE 1
Lure of choice revisited: Replication and extensions Registered Report of Bown et al. (2003)Nga Yi (Angela) Chan, Gilad Feldman https://osf.io/f48kuReplicating the "lure of choice" phenomenonRecommended by Patrick Savage based on reviews by Hu Chuan-Peng and Gakuto ChibaThe "lure of choice" refers to the idea that we prefer to preserve the option to choose even when the choice is not helpful. In a classic study cited hundred of times, Bown et al. (2003) reported evidence for the lure of choice from a series of studies involving choices between competing options of night clubs, bank savings accounts, casino spinners, and the Monty Hall door choice paradigm. In all cases, participants tended to prefer to choose an option when paired with a "lure", even when that lure was objectively inferior (e.g., same probability of winning but lower payoff).
The lure of choice phenomenon applies to a variety of real-life situations many of us often face in our daily lives, and Bown et al.’s findings have influenced the way organizations present choices to prospective users. Despite their theoretical and practical impact, Bown et al.'s findings have not previously been directly replicated, even as the importance of replication studies has become increasingly acknowledged (Nosek et al., 2022).
Here, Chan & Feldman (2024) outline a close replication of Bown et al. (2003) that will replicate and extend their original design. By unifying Bown et al.'s multiple studies into a single paradigm with which they will collect data from approximately 1,000 online participants via Prolific, they will have substantially greater statistical power than the original study to detect the predicted effects. They will follow LeBel et al.’s (2019) criteria for evaluating replicability, such that it will be considered a successful replication depending on how many of the 4 scenarios show a signal in the same direction as Bown et al.’s original results (at least 3 out of 4 scenarios = successful replication; no scenarios = failed replication; 1 or 2 scenarios = mixed results replication). They have also added additional controls including a neutral baseline choice without a lure, further ensuring the the validity and interpretability of their eventual findings.
One of the goals in creating Peer Community In Registered Reports (PCI RR) was to increase the availability of publishing venues for replication studies, and so PCI RR is well-suited to the proposed replication. Feldman’s lab has also pioneered the use of PCI RR for direct replications of previous studies (e.g., Zhu & Feldman, 2023), and the current submission uses an open-access template he developed (Feldman, 2023). This experience combined with PCI RR’s efficient scheduled review model meant that the current full Stage 1 protocol was able to go from initial submission, receive detailed peer review by two experts, and receive in-principle acceptance (IPA) for the revised submission, all in less than one month.
URL to the preregistered Stage 1 protocol: https://osf.io/8ug9m
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA. List of eligible PCI RR-friendly journals: References
Bown, N. J., Read, D. & Summers, B. (2003). The lure of choice. Journal of Behavioral Decision Making, 16(4), 297–308. https://doi.org/10.1002/bdm.447
Chan, A. N. Y. & Feldman, G. (2024). The lure of choice revisited: Replication and extensions Registered Report of Bown et al. (2003) [Stage 1]. In principle acceptance of Version 2 by Peer Community In Registered Reports. https://osf.io/8ug9m
Feldman, G. (2023). Registered Report Stage 1 manuscript template. https://doi.org/10.17605/OSF.IO/YQXTP
LeBel, E. P., Vanpaemel, W., Cheung, I. & Campbell, L. (2019). A brief guide to evaluate replications. Meta-Psychology, 3. https://doi.org/10.15626/MP.2018.843
Nosek, B. A., Hardwicke, T. E., Moshontz, H., Allard, A., Corker, K. S., Dreber, A., ... & Vazire, S. (2022). Replicability, robustness, and reproducibility in psychological science. Annual Review of Psychology, 73(1), 719-748. https://doi.org/10.1146/annurev-psych-020821-114157
Zhu, M. & Feldman, G. (2023). Revisiting the links between numeracy and decision making: Replication Registered Report of Peters et al. (2006) with an extension examining confidence. Collabra: Psychology, 9(1). https://doi.org/10.1525/collabra.77608
| Lure of choice revisited: Replication and extensions Registered Report of Bown et al. (2003) | Nga Yi (Angela) Chan, Gilad Feldman | <p>[IMPORTANT: Abstract, method, and results were written using a randomised dataset produced by Qualtrics to simulate what these sections will look like after data collection. These will be updated following the data collection. For the purpose o... | Social sciences | Patrick Savage | 2023-11-15 00:40:47 | View | ||
17 Jun 2024
STAGE 1
Loneliness in the Brain: Distinguishing Between Hypersensitivity and HyperalertnessJoe Bathelt, Corine Dijk, Marte Otten https://doi.org/10.31219/osf.io/j5v9bA new look at loneliness by testing hyperalternessRecommended by Hedwig Eisenbarth and D. Samuel Schwarzkopf based on reviews by Marta Andreatta and 1 anonymous reviewerDo people who are more alert towards social stimuli vary in loneliness? This report addresses the question how loneliness relates to hypersensitivity to social stimuli using an oddball paradigm. Based on preliminary results, the study plans to compare high and low lonely individuals for how they react to happy and angry facial expressions using neurophysiological correlates. Findings from the study will provide further insights in how loneliness might be related to processing of social information.
The Stage 1 manuscript was evaluated over two rounds of in-depth review. Based on detailed responses to the reviewers' and recommender's comments, the recommender judged that the manuscript met the Stage 1 criteria and awarded in-principle acceptance (IPA).
URL to the preregistered Stage 1 protocol: https://osf.io/fxngv Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA. List of eligible PCI RR-friendly journals: References
1. Bathelt, J., Dijk, C., & Otten, M. (2024). Loneliness in the Brain: Distinguishing Between Hypersensitivity and Hyperalertness. In principle acceptance of Version 5 by Peer Community in Registered Reports. https://osf.io/fxngv | Loneliness in the Brain: Distinguishing Between Hypersensitivity and Hyperalertness | Joe Bathelt, Corine Dijk, Marte Otten | <p>Introduction: Loneliness has emerged as a pressing public health issue, necessitating greater understanding of its mechanisms to devise effective treatments. While the link between loneliness and biased social cognition is a commonly proposed, ... | Social sciences | Hedwig Eisenbarth | Marta Andreatta, Anonymous | 2023-11-20 16:34:04 | View | |
09 Sep 2024
STAGE 1
How Effortful is Boredom? Studying Self-Control Demands Through PupillometryVanessa C. Radtke, Wanja Wolff, Corinna S. Martarelli https://osf.io/eujpa?view_only=12191f02a5db4689b00b42bab7dbd522Unmasking the effort of boredom: A deeper look into self-control dynamicsRecommended by Thomas Meyer based on reviews by Jonas Dora, Julia Englert, Erik Bijleveld and 1 anonymous reviewerEffective effort regulation is central for self-control and has been a focus of psychological research for many decades. It is well established that challenging cognitive tasks, which impose self-control demands due to their complexity, are perceived as more effortful and require greater physiological activation than simpler tasks. However, the experience and allocation of effort during a task, whether easy or difficult, likely depends on more than these inherent self-control demands. Another key factor is boredom, which can arise during task execution. Yet, the role of boredom and the interplay with perceived task difficulty over time remains underexamined.
Based on these considerations, Radtke et al. (2024) aim to examine how boredom and task difficulty influence both subjective and objective measures of effort. They propose that subjective cognitive effort consists of both boredom-related and difficulty-related components, hypothesizing that both factors together more accurately predict objective effort allocation than task difficulty alone. The proposed study will use a within-subject design, in which participants perform two versions of the Stroop task: an easy version with only congruent trials and a hard version. Thought probes during the task will track subjective boredom, fatigue, perceived difficulty, and effort. Phasic and stimulus-evoked pupil dilation will serve as an objective index of cognitive effort, while a subsequent flanker task will assess effects on secondary task performance.
The authors predict that the easy Stroop version will result in lower perceived difficulty but higher boredom, as well as fewer errors and faster reaction times compared to the hard version. Over time, boredom and perceived effort due to boredom are expected to increase, while perceived task difficulty and effort attributed to difficulty are anticipated to decrease. Linear Mixed Models will be employed to determine whether phasic and stimulus-evoked pupil dilation can be predicted by effort attributed to boredom, difficulty, or both. This innovative approach combines objective and subjective measures and promises to deepen our understanding of the cognitive demands posed by boredom, with significant implications for research on effort regulation and motivation.
The Stage 1 manuscript was evaluated by four expert reviewers in two rounds of in-depth review. Following responses from the authors, the recommender determined that Stage 1 criteria were met and awarded in-principle acceptance (IPA).
URL to the preregistered Stage 1 protocol: https://osf.io/38qz4
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA. List of eligible PCI RR-friendly Journals:
References Radtke, V., Wolff, W., & Martarelli, C. S. (2024). How effortful is boredom? Studying self-control demands through pupillometry. In principle acceptance of Version 2 by Peer Community in Registered Reports. https://osf.io/38qz4
| How Effortful is Boredom? Studying Self-Control Demands Through Pupillometry | Vanessa C. Radtke, Wanja Wolff, Corinna S. Martarelli | <p>Self-control is essential for managing our actions, yet its exertion is perceived as effortful. Performing a task may require effort not only because of its inherent difficulty but also due to its potential for inducing boredom, as boredom has ... | Humanities, Social sciences | Thomas Meyer | 2023-11-21 17:56:13 | View |
MANAGING BOARD
Chris Chambers
Zoltan Dienes
Corina Logan
Benoit Pujol
Maanasa Raghavan
Emily S Sena
Yuki Yamada