Announcements
=============================================================================
IMPORTANT ANNOUNCEMENT: To accommodate reviewer and recommender holiday schedules, we will be closed to ALL submissions from 1st Jul - 1st Sep. During this time, reviewers can submit reviews and recommenders can issue decisions, but no new or revised submissions can be made by authors.
The one exception to this rule is that authors using the scheduled track who submit their initial Stage 1 snapshot prior to 1st Jul can choose a date within the shutdown period to submit their full Stage 1 manuscript.
We recommend that authors submit at least 1-2 weeks prior to commencement of the shutdown period to enable time to make any required revisions prior to in-depth review.
=============================================================================
We are recruiting recommenders (editors) from all research fields!
Your feedback matters! If you have authored or reviewed a Registered Report at Peer Community in Registered Reports, then please take 5 minutes to leave anonymous feedback about your experience, and view community ratings.
Latest recommendations
Id | Title * | Authors * | Abstract * ▼ | Picture | Thematic fields * | Recommender | Reviewers | Submission date | |
---|---|---|---|---|---|---|---|---|---|
27 Nov 2024
STAGE 1
![]() Does Truth Pay? Investigating the Effectiveness of the Bayesian Truth Serum with an Interim Payment: A Registered ReportClaire M. Neville, Matt N. Williams https://osf.io/cyf39Do interim payments promote honesty in self-report? A test of the Bayesian Truth SerumRecommended by Romain EspinosaSurveys that measure self-report are a workhorse in psychology and the social sciences, providing a vital window into beliefs, attitudes and emotions, both at the level of groups and individuals. The validity of self-report data, however, is an enduring methodological concern, with self-reports vulnerable to a range of response biases, including (among others) the risk of social desirability bias in which, rather than responding honestly, participants answer questions in a way that they believe will be viewed favourably by others. One proposed solution to socially desirable responding is the so-called Bayesian Truth Serum (BTS), which aims to incentivise truthfulness by taking into account the relationship between an individual’s response and their belief about the dominant (or most likely) response given by other people, and then assigning a high truthfulness score to answers that are surprisingly common.
Although valid in theory (under a variety of assumptions), questions remain regarding the empirical utility of the BTS. One area of concern is participants’ uncertainty regarding incentives for truth-telling – if participants don’t understand the extent to which telling the truth is in their own interests (or they don’t believe that it matters) then the validity of the BTS is undermined. In the current study, Neville and Williams (2024) aim to test the role of clarifying incentives, particularly for addressing social desirability bias when answering sensitive questions. The authors will administer an experimental survey design including sensitive questions, curated from validated scales, that are relevant to current social attitudes and sensitivities (e.g. “Men are not particularly discriminated against”, “Younger people are usually more productive than older people at their jobs”). Three groups of participants will complete the survey under different incentive conditions: the BTS delivered alone in standard format, the BTS with an interim bonus payment that is awarded to participants (based on their BTS score) half-way through the survey to increase certainty in incentives, and a Regular Incentive control group in which participants receive payment without additional incentives.
The authors will then address two questions: whether the BTS overall effectively incentivises honesty (the contrast of BTS alone + BTS with interim payment vs the Regular Incentive group), and whether interim payments, specifically, further boost assumed honesty (the contrast of BTS alone vs BTS with interim payment). Regardless of how the results turn out, the study promises to shed light on the effectiveness of the BTS and its dependence on the visibility of incentives, with implications for survey design in psychology and beyond.
The Stage 1 manuscript was evaluated over two rounds of in-depth review. Based on detailed responses to reviewers’ and the recommender’s comments, the recommenders judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance.
URL to the preregistered Stage 1 protocol: https://osf.io/vuh8b
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.
List of eligible PCI-RR-friendly journals:
References
Neville, C. M & Williams, M. N. (2024). Does Truth Pay? Investigating the Effectiveness of the Bayesian
Truth Serum with an Interim Payment: A Registered Report. In principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/vuh8b | Does Truth Pay? Investigating the Effectiveness of the Bayesian Truth Serum with an Interim Payment: A Registered Report | Claire M. Neville, Matt N. Williams | <p>Self-report data is vital in psychological research, but biases like careless responding and socially desirable responding can compromise its validity. While various methods are employed to mitigate these biases, they have limitations. The Baye... | Social sciences | Romain Espinosa | Martin Schnuerch, Philipp Schoenegger, Sarahanne Miranda Field | 2024-05-02 06:40:18 | View | |
09 Sep 2024
STAGE 1
![]() How Effortful is Boredom? Studying Self-Control Demands Through PupillometryVanessa C. Radtke, Wanja Wolff, Corinna S. Martarelli https://osf.io/eujpa?view_only=12191f02a5db4689b00b42bab7dbd522Unmasking the effort of boredom: A deeper look into self-control dynamicsRecommended by Thomas MeyerEffective effort regulation is central for self-control and has been a focus of psychological research for many decades. It is well established that challenging cognitive tasks, which impose self-control demands due to their complexity, are perceived as more effortful and require greater physiological activation than simpler tasks. However, the experience and allocation of effort during a task, whether easy or difficult, likely depends on more than these inherent self-control demands. Another key factor is boredom, which can arise during task execution. Yet, the role of boredom and the interplay with perceived task difficulty over time remains underexamined.
Based on these considerations, Radtke et al. (2024) aim to examine how boredom and task difficulty influence both subjective and objective measures of effort. They propose that subjective cognitive effort consists of both boredom-related and difficulty-related components, hypothesizing that both factors together more accurately predict objective effort allocation than task difficulty alone. The proposed study will use a within-subject design, in which participants perform two versions of the Stroop task: an easy version with only congruent trials and a hard version. Thought probes during the task will track subjective boredom, fatigue, perceived difficulty, and effort. Phasic and stimulus-evoked pupil dilation will serve as an objective index of cognitive effort, while a subsequent flanker task will assess effects on secondary task performance.
The authors predict that the easy Stroop version will result in lower perceived difficulty but higher boredom, as well as fewer errors and faster reaction times compared to the hard version. Over time, boredom and perceived effort due to boredom are expected to increase, while perceived task difficulty and effort attributed to difficulty are anticipated to decrease. Linear Mixed Models will be employed to determine whether phasic and stimulus-evoked pupil dilation can be predicted by effort attributed to boredom, difficulty, or both. This innovative approach combines objective and subjective measures and promises to deepen our understanding of the cognitive demands posed by boredom, with significant implications for research on effort regulation and motivation.
The Stage 1 manuscript was evaluated by four expert reviewers in two rounds of in-depth review. Following responses from the authors, the recommender determined that Stage 1 criteria were met and awarded in-principle acceptance (IPA).
URL to the preregistered Stage 1 protocol: https://osf.io/38qz4
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA. List of eligible PCI RR-friendly Journals:
References Radtke, V., Wolff, W., & Martarelli, C. S. (2024). How effortful is boredom? Studying self-control demands through pupillometry. In principle acceptance of Version 2 by Peer Community in Registered Reports. https://osf.io/38qz4
| How Effortful is Boredom? Studying Self-Control Demands Through Pupillometry | Vanessa C. Radtke, Wanja Wolff, Corinna S. Martarelli | <p>Self-control is essential for managing our actions, yet its exertion is perceived as effortful. Performing a task may require effort not only because of its inherent difficulty but also due to its potential for inducing boredom, as boredom has ... | Humanities, Social sciences | Thomas Meyer | 2023-11-21 17:56:13 | View | ||
04 Dec 2023
STAGE 1
![]() Self-Control beyond inhibition. German Translation and Quality Assessment of the Self-Control Strategy Scale (SCSS)Leopold H. O. Roth1, Julia Jankowski1, Georgia Clay1, Dominik Meindl1, Lisa-Marie Vogt1, Victoria Wagner1, Artemis Nordmann1, Loana Stenzel1, Olga Freiman1, Christopher Mlynski1, Veronika Job1; 1University of Vienna, Vienna, Austria https://osf.io/n2xsdStrategies for self control: German translation and evaluation of the Self Control Strategy ScaleRecommended by Zoltan DienesSelf-control has shown to be a trait related to beneficial outcomes, including health, academic achievement and relationship quality. It is mostly understood as the ability to surpress immediate urges in order to achieve long-term goals, such as not watching another episode and therefore reaching a healthy amount of sleep. An emerging perspective on self-control shows that there is broader variety in applied strategies, such as removing oneself from a tempting situation, or reminding oneself of one's long-term goal, or reinterpreting the temptation.
Katzir et al. (2021) developed a novel instrument, the Self-Control Strategy Scale, that measured the tendency to engage in eight such strategies. In the current study, Roth et al. (2023) propose to translate the scale into German and assess its psychometric properties. Further, they will determine which strategies are related to particular outcomes that may be beneficial; for example, amount of physical activity engaged in, how healthy the diet is, exam performance and life satisfaction.
The Stage 1 manuscript was evaluated over two rounds of in-depth review by the recommender and at least two expert reviewers, before issuing in-principle acceptance.
URL to the preregistered Stage 1 protocol: https://osf.io/s7qwk
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA. List of eligible PCI RR-friendly journals:
References 1. Katzir, M., Baldwin, M., Werner, K. M., & Hofmann, W. (2021). Moving beyond inhibition: Capturing a broader scope of the self-control construct with the Self-Control Strategy Scale (SCSS). Journal of Personality Assessment, 103, 762-776. https://doi.org/10.1080/00223891.2021.1883627
2. Roth, L. H. O., Jankowski, J., Clay, G., Meindl, D., Vogt, L.-M., Wagner, V., Nordmann, A., Stenzel, L., Freiman, O., Mlynski, C., & Job, V. (2023). Self-Control beyond inhibition. German Translation and Quality Assessment of the Self-Control Strategy Scale (SCSS). In principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/s7qwk
| Self-Control beyond inhibition. German Translation and Quality Assessment of the Self-Control Strategy Scale (SCSS) | Leopold H. O. Roth1, Julia Jankowski1, Georgia Clay1, Dominik Meindl1, Lisa-Marie Vogt1, Victoria Wagner1, Artemis Nordmann1, Loana Stenzel1, Olga Freiman1, Christopher Mlynski1, Veronika Job1; 1University of Vienna, Vienna, Austria | <p>Self-control is crucial for goal attainment and related to several beneficial outcomes, such as health and education. For a long time, it was predominantly understood in terms of inhibition, namely the ability to suppress immediate urges for th... | Social sciences | Zoltan Dienes | 2023-07-13 13:46:30 | View | ||
Self-Control Beyond Inhibition. German Translation and Quality Assessment of the Self-Control Strategy Scale (SCSS)Leopold H. O. Roth, Julia M. Jankowski, Dominik Meindl, Georgia Clay, Christopher Mlynski, Olga Freiman, Artemis L. Nordmann, Loana-Corine Stenzel, Victoria Wagner https://doi.org/10.31234/osf.io/gpmnvStrategies for self control: German translation and evaluation of the Self Control Strategy ScaleRecommended by Zoltan DienesSelf-control has shown to be a trait related to beneficial outcomes, including health, academic achievement and relationship quality. It is mostly understood as the ability to suppress immediate urges in order to achieve long-term goals, such as not watching another episode and therefore reaching a healthy amount of sleep. An emerging perspective on self-control shows that there is broader variety in applied strategies, such as removing oneself from a tempting situation, or reminding oneself of one's long-term goal, or reinterpreting the temptation.
Katzir et al. (2021) developed a novel instrument, the Self-Control Strategy Scale, that measured the tendency to engage in eight such strategies. In the current study, Roth et al. (2024) translated the scale into German and assessed its psychometric properties: internal consistency and retest reliability were sufficient for six or seven of the eight subscales. Further, different strategies (subscales) were related to particular outcomes; at least one strategy was related to each outcome for 20 out of 23 outcomes in health behavior, school/work achievement, life satisfaction, interpersonal functioning and pro-environmental behavior (though the particular pattern of similarities and differences would need confirming). Thus, the SCSS is a valid and reliable measure that can now be used in German.
The Stage 2 manuscript was evaluated over two rounds of in-depth review by the recommender and at least two expert reviewers. Following revision, the recommender judged that the manuscript met the Stage 2 criteria and awarded a positive recommendation.
URL to the preregistered Stage 1 protocol: https://osf.io/s7qwk
Level of bias control achieved: Level 6. No part of the data or evidence that was used to answer the research question was generated until after IPA. List of eligible PCI RR-friendly journals:
References 1. Katzir, M., Baldwin, M., Werner, K. M., and Hofmann, W. (2021). Moving beyond inhibition: Capturing a broader scope of the self-control construct with the Self-Control Strategy Scale (SCSS). Journal of Personality Assessment, 103, 762-776. https://doi.org/10.1080/00223891.2021.1883627
2. Roth, L. H. O., Jankowski, J., Meindl, D., Clay, G., Mlynski, C., Freiman, O., Nordmann, A., Stenzel, L., and Wagner, V. (2024). Self-Control beyond inhibition. German Translation and Quality Assessment of the Self-Control Strategy Scale (SCSS) [Stage 2]. Acceptance of Version 3 by Peer Community in Registered Reports. https://doi.org/10.31234/osf.io/gpmnv
| Self-Control Beyond Inhibition. German Translation and Quality Assessment of the Self-Control Strategy Scale (SCSS) | Leopold H. O. Roth, Julia M. Jankowski, Dominik Meindl, Georgia Clay, Christopher Mlynski, Olga Freiman, Artemis L. Nordmann, Loana-Corine Stenzel, Victoria Wagner | <p>Self-control is crucial for goal attainment and related to several beneficial outcomes, such as health and education. For a long time, it was predominantly understood in terms of inhibition, namely the ability to suppress immediate urges for th... | Social sciences | Zoltan Dienes | Eleanor Miles, Kaitlyn Werner, Sebastian Bürgler | 2024-06-28 11:50:25 | View | |
Self-Affirmation and Prejudice Against Religious Groups: The Role of Ideological MalleabilityYara Alnajjar, Constantina Badea and Béatrice Sternberg https://osf.io/st47hDoes ideological malleability moderate the effect of self-affirmation on prejudice?Recommended by Anna Elisabeth FürtjesSelf-affirmation may be an effective tool to reduce prejudice and discrimination against minority groups. Its hypothesised mechanism is that prejudice is a defensive act that can be reduced by reinforcing a positive imagine of the self. Such a reinforced self-image is meant to weaken perceived threat to one’s social identity that may be posed by minority groups, such as Muslims in majority Christian countries.
To address mixed evidence for the effectiveness of self-affirmation across the literature, this Registered Report (RR) was designed to elucidate conditions under which self-affirmation may reduce prejudice and discrimination. Whether self-affirmation has the desired effect may be moderated by an individual’s internal representation of secularism. That is, as a reaction to self-affirmation, people may flexibly endorse their feelings towards secularism (‘ideological malleability’) to either reduce prejudice, or maintain and justify it. This study is the first to consider whether this effect depends on a participant’s attitude that French citizens should be able to practice their religion in public places (‘historical’ secularism), or that they should hide it in public (‘new’ secularism).
Alnajjar et al. present a study design (i.e., three-way mixed ANOVA) in which they self-affirmed French participants (N=602) with differing internal representations of secularism. Study results demonstrated that a historical representation of secularism is associated with less effective and behavioural prejudice towards religious groups compared to a new representation of secularism. Participants’ prejudiced attitudes were larger against Muslims than against Christians. It was unexpected that new secularism was linked to negative attitudes towards religious minority groups given that the French government mandated by law that religion should not be practiced in public. Across three self-affirmation conditions (i.e., self-affirmation on a threat-related value, a threat-unrelated value, and no self-affirmation), the authors found no evidence that self-affirmation affected prejudice against religious groups, and there was no evidence that the effectiveness of self-affirmation depended on a participants representation of secularism, which contradicted their pre-registered hypotheses. This paper adds conclusive and sufficiently-powered results to a body of literature with mixed evidence for the effectiveness of self-affirmation.
It increased the robustness of this study that the design considered desirability concerns and employed multiple manipulation checks. By considering nuances of public opinion towards secularism in France specifically, the authors identified a unique opportunity to investigate ideological malleability, which can be challenging to conceive and directly measure.
The Stage 2 manuscript was evaluated by two experts who performed in-depth peer review across one round of revisions. There were no substantial changes to the introduction or the methods, the analyses were conducted as planned and additional analyses were labelled as exploratory. The revised manuscript was judged to meet the Stage 2 criteria and was awarded a positive recommendation.
URL to the preregistered Stage 1 protocol: https://osf.io/f4wm6
Level of bias control achieved: Level 6. No part of the data or evidence that was used to answer the research question was generated until after IPA.
List of eligible PCI RR-friendly journals: References
1. Alnajjar, Y., Badea, C., & Sternberg, B. (2024). Self-Affirmation and Prejudice Against Religious Groups: The Role of Ideological Malleability [Stage 2]. Acceptance of Version 2 by Peer Community in Registered Reports. https://osf.io/st47h
| Self-Affirmation and Prejudice Against Religious Groups: The Role of Ideological Malleability | Yara Alnajjar, Constantina Badea and Béatrice Sternberg | <p>Self-affirmation has shown mixed findings when used as a prejudice reduction technique, sometimes diminishing prejudice while sometimes increasing it or having no significant effect. In a Registered Report experiment with a French representativ... | Social sciences | Anna Elisabeth Fürtjes | 2024-07-30 11:57:10 | View | ||
28 Feb 2024
STAGE 1
![]() Changes in memory function in adults following SARS-CoV-2 infection: findings from the Covid and Cognition online studyJosefina Weinerova, Sabine Yeung, Panyuan Guo, Alice Yau, Connor Horne, Molly Ghinn, Lyn Curtis, Francess Adlard, Vidita Bhagat, Seraphina Zhang, Muzaffer Kaser, Mirjana Bozic, Denis Schluppeck, Andrew Reid, Roni Tibon, Lucy Cheke https://osf.io/tjs5uIs memory affected in the long run following SARS-CoV-2 infection?Recommended by Vishnu SreekumarCOVID-19 has been suspected to have long-lasting effects on cognitive function. The SARS-CoV-2 virus may enter the central nervous system (Frontera et al., 2020; Miners, Kehoe, & Love, 2020), explaining the observed detrimental effects of COVID-19 on verbal planning and reasoning (Hampshire et al., 2021; Wild et al., 2021), executive function (Hadad et al., 2022), and long-term memory (Guo et al., 2022). In particular, Guo et al. (2022) used verbal item recognition and non-verbal associative memory tasks. Weinerova et al. (2024), in the current study, propose to conduct a replication of Guo et al. (2022), but specifically, to disentangle the effect of COVID-19 infection status on both memory type (item vs. associative) and stimulus modality (verbal vs. non-verbal). Furthermore, Weinerova et al. (2024) propose to analyze cognitive function based on vaccination status before infection to provide a critical test of the potential protective effects of vaccination on cognitive function.
Data collection has been completed with 325 participants after exclusion criteria were applied (COVID group N = 232, No COVID group N = 93). Simulations assuming an effect size observed in Guo et al. (2022), a Bayesian t-test comparing the groups, and a Bayes Factor of 6 indicated that N = 320 is sufficient to detect an effect on 79% of simulations. The main analyses will be conducted using a Bayesian ANCOVA that allows for the inclusion of control variables such as age, sex, country, and education level. Both accuracy and reaction times from the item and associative recognition tasks will be analyzed as the dependent variables. In one analysis, vaccination status will be included as a between-subjects factor, to understand whether vaccination status at the time of infection influences subsequent cognitive function. It is important to note that participants were recruited through long-COVID Facebook groups and clinics. Therefore, the results must be interpreted carefully to avoid generalizing to all COVID-19 infections. The data are part of a larger longitudinal study, and the current pre-registration applies only to the baseline timepoint for a cross-sectional analysis. The remaining longitudinal data collection is ongoing and is not part of the current pre-registration. The study plan was refined after one round of review, with input from three external reviewers who all agreed that the proposed study was well-designed and scientifically valid. The recommender then reviewed the revised manuscript and judged that the study met the Stage 1 criteria for in-principle acceptance (IPA). URL to the preregistered Stage 1 protocol: https://osf.io/tjs5u
Level of bias control achieved: Level 3. At least some data/evidence that will be used to the answer the research question has been previously accessed by the authors (e.g. downloaded or otherwise received), but the authors certify that they have not yet observed ANY part of the data/evidence. List of eligible PCI RR-friendly journals:
References
1. Frontera, J., Mainali, S., Fink, E.L. et al. Global Consortium Study of Neurological Dysfunction in COVID-19 (GCS-NeuroCOVID): Study Design and Rationale. Neurocrit Care 33, 25–34 (2020). https://doi.org/10.1007/s12028-020-00995-3
2. Guo, P., Benito Ballesteros, A., Yeung, S. P., Liu, R., Saha, A., Curtis, L., Kaser, M., Haggard, M. P. & Cheke, L. G. (2022). COVCOG 2: Cognitive and Memory Deficits in Long COVID: A Second Publication From the COVID and Cognition Study. Frontiers in Aging Neuroscience. https://doi.org/10.3389/fnagi.2022.804937 3. Hadad, R., Khoury, J., Stanger, C., Fisher, T., Schneer, S., Ben-Hayun, R., Possin, K., Valcour, V., Aharon-Peretz, J. & Adir, Y. (2022). Cognitive dysfunction following COVID-19 infection. Journal of NeuroVirology, 28(3), 430–437. https://doi.org/10.1007/s13365-022-01079-y 4. Hampshire, A., Trender, W., Chamberlain, S. R., Jolly, A. E., Grant, J. E., Patrick, F., Mazibuko, N., Williams, S. C., Barnby, J. M., Hellyer, P. & Mehta, M. A. (2021). Cognitive deficits in people who have recovered from COVID-19. EClinicalMedicine, 39, 101044. https://doi.org/10.1016/j.eclinm.2021.101044 5. Miners, S., Kehoe, P. G., & Love, S. (2020). Cognitive impact of COVID-19: looking beyond the short term. Alzheimer's research & therapy, 12, 1-16. https://doi.org/10.1186/s13195-020-00744-w 6. Weinerova, J., Yeung, S., Guo, P., Yau, A., Horne, C., Ghinn, M., Curtis, L., Adlard, F., Bhagat, V., Zhang, S., Kaser, M., Bozic, M., Schluppeck, D., Reid, A., Tibon, R. & Cheke, L. G. (2024). Changes in memory function in adults following SARS-CoV-2 infection: findings from the Covid and Cognition online study. In principle acceptance of Version 2 by Peer Community in Registered Reports. https://osf.io/tjs5u
7. Wild, C. J., Norton, L., Menon, D. K., Ripsman, D. A., Swartz, R. H. & Owen, A. M. (2022). Disentangling the cognitive, physical, and mental health sequelae of COVID-19. Cell Reports Medicine, 3, 100750. https://doi.org/10.1016/j.xcrm.2022.100750 | Changes in memory function in adults following SARS-CoV-2 infection: findings from the Covid and Cognition online study | Josefina Weinerova, Sabine Yeung, Panyuan Guo, Alice Yau, Connor Horne, Molly Ghinn, Lyn Curtis, Francess Adlard, Vidita Bhagat, Seraphina Zhang, Muzaffer Kaser, Mirjana Bozic, Denis Schluppeck, Andrew Reid, Roni Tibon, Lucy Cheke | <p>SARS-CoV-2, the virus responsible for the Covid-19 pandemic, has been shown to have an impact on cognitive function, but the specific aspects of cognition that are affected remain unclear. In this Registered Report, we present a study aimed at ... | Life Sciences | Vishnu Sreekumar | 2023-08-14 11:09:45 | View | ||
Changes in memory function in adults following SARS-CoV-2 infection: findings from the Covid and Cognition online study.Josefina Weinerova, Sabine Yeung, Panyuan Guo, Alice Yau, Connor Horne, Molly Ghinn, Lyn Curtis, Frances Adlard, Vidita Bhagat, Seraphina Zhang, Muzaffer Kaser, Mirjana Bozic, Denis Schluppeck, Andrew Reid, Roni Tibon, Lucy Cheke https://osf.io/q5vu2?view_only=228165eb161d490b945ca019143ba98cEvidence for General Long-Term Memory Impairment Following SARS-CoV-2 InfectionRecommended by Vishnu SreekumarCOVID-19 has been associated with cognitive impairments, particularly in memory performance (Guo et al., 2022). Given that associative memory typically declines earlier than item memory in conditions such as mild cognitive impairment (Chen & Chang, 2016), it remains an open question whether COVID-19 differentially affects item and associative memory. Furthermore, it is unclear whether such effects are specific to verbal or non-verbal material. To investigate these questions, Weinerova et al. (2024) recruited participants via long-COVID Facebook groups and clinical settings. They reported a significant detrimental effect of COVID-19 status on long-term memory performance across tasks. However, they did not find evidence for their preregistered hypothesis of an interaction between COVID-19 status and either memory type (item vs. associative) or stimulus type (verbal vs. non-verbal).
In the Stage 1 report, the authors preregistered a Bayes Factor threshold of 6 as the criterion for supporting the alternative hypothesis. All planned analyses were preregistered, incorporating both frequentist methods (to replicate Guo et al., 2022) and Bayesian ANCOVA (to test the preregistered hypotheses). As data collection had been completed at the time of Stage 1 submission, we assigned a Level 3 bias control to the Stage 1 report.
In the Stage 2 report, the authors confirmed a general negative impact of COVID-19 on long-term memory accuracy. Using frequentist ANCOVA, they successfully replicated Guo et al. (2022)’s findings of reduced accuracy in verbal item and non-verbal associative memory among individuals with prior COVID-19 infection. However, they did not replicate the previously observed effect on reaction times. The Bayesian ANCOVA analyses did not reach the preregistered evidential threshold (BF > 6). Verbal associative memory, which was not part of the original replication attempt, also showed reduced accuracy in individuals with prior infection. In contrast, performance on non-verbal item memory tasks showed a ceiling effect, possibly due to methodological differences from Guo et al. (2022). Across all four memory tasks, the authors found robust evidence for decreased accuracy associated with COVID-19 status but no effect on reaction times.
Contrary to their hypotheses, models that included interactions between COVID-19 status and either memory type or stimulus type were less likely than the null model, suggesting a general, rather than specific, detrimental effect of COVID-19 on long-term memory.
Analyses of vaccination status yielded inconclusive results, likely due to limited sample size and uncertainty in participants' self-reports of vaccination timing relative to infection. The question of whether vaccination has protective effects on cognition remains unresolved and merits further investigation. The authors also reported tentative exploratory findings, such as a potential association between longer time since infection and slower reaction times in verbal item memory tasks. These observations require confirmation in future studies.
Overall, the study makes a valuable contribution by replicating prior findings and extending them to suggest a broad impairment of long-term memory associated with COVID-19.
The Stage 2 report was reviewed by the same three reviewers who had evaluated the Stage 1 submission. All reviewers agreed that the authors had addressed prior comments and had adhered to the preregistered methodology and analysis plan. As in the Stage 1 evaluation, we note the potential for selection bias introduced by recruiting participants via long-COVID Facebook groups. Individuals with post-infection cognitive complaints may have been more likely to volunteer, limiting generalizability to the broader SARS-CoV-2-infected population. This and other limitations are clearly acknowledged in the Discussion section of the Stage 2 manuscript. The recommender judged that the manuscript met all Stage 2 criteria for recommendation.
URL to the preregistered Stage 1 protocol: https://osf.io/tjs5u
Level of bias control achieved: Level 3. At least some data/evidence that was used to the answer the research question had been accessed by the authors prior to in-principle acceptance (e.g. downloaded or otherwise received), but the authors certify that they had not yet observed ANY part of the data/evidence. List of eligible PCI RR-friendly journals:
References
1. Chen, P.-C., & Chang, Y.-L. (2016, May). Associative memory and underlying brain correlates in older adults with mild cognitive impairment. Neuropsychologia, 85, 216–225. https://doi.org/10.1016/j.neuropsychologia.2016.03.032 2. Guo, P., Benito Ballesteros, A., Yeung, S. P., Liu, R., Saha, A., Curtis, L., ... Cheke, L. G. (2022b). COVCOG 2: Cognitive and memory deficits in long COVID: A second publication from the COVID and Cognition Study. Frontiers in Aging Neuroscience, 14, 804937. https://doi.org/10.3389/fnagi.2022.804937
3. Weinerova, J., Yeung, S., Guo, P., Yau, A., Horne, C., Ghinn, M., Curtis, L., Adlard, F., Bhagat, V., Zhang, S., Kaser, M., Bozic, M., Schluppeck, D., Reid, A., Tibon, R., & Cheke, L. (2025). Changes in memory function in adults following SARS-CoV-2 infection: Findings from the Covid and Cognition online study [Stage 2]. Acceptance of Version 1 by Peer Community in Registered Reports. https://osf.io/q5vu2?view_only=228165eb161d490b945ca019143ba98c
| Changes in memory function in adults following SARS-CoV-2 infection: findings from the Covid and Cognition online study. | Josefina Weinerova, Sabine Yeung, Panyuan Guo, Alice Yau, Connor Horne, Molly Ghinn, Lyn Curtis, Frances Adlard, Vidita Bhagat, Seraphina Zhang, Muzaffer Kaser, Mirjana Bozic, Denis Schluppeck, Andrew Reid, Roni Tibon, Lucy Cheke | <p>SARS-CoV-2, the virus responsible for the Covid-19 pandemic, has been shown to have an impact on cognitive function, but the specific aspects of cognition that are affected remain unclear. In this Registered Report, we analysed cognitive data c... | Life Sciences | Vishnu Sreekumar | Anonymous, Mitul Mehta, Phivos Phylactou, Benedict Michael | 2024-11-21 12:32:53 | View | |
22 Nov 2022
STAGE 1
![]() Estimating the Effect of Reward on Sleep-Dependent Memory Consolidation – A Registered ReportDavid P. Morgan, Juliane Nagel, N. Cagatay Gürsoy, Simon Kern & Gordon B. Feld https://osf.io/3emj9?view_only=c4a0bcdcbcee423e9e2e61b2e75ff490How does reward influence the effect of sleep on memory?Recommended by Chris ChambersSleep and reward each have an important role in human memory. According to the active system consolidation hypothesis, memory consolidation during sleep originates from the repeated reactivation of memory representations that were encoded during wake (Rasch & Born, 2013). Research has also consistently shown that memory performance is enhanced for items or stimuli associated with higher vs. lower rewards. While these lines of evidence are relatively clear, the role of sleep in shaping the interaction between reward and memory is more opaque, likely due to a combination of methodological variation between studies but also due to the field’s reliance on small-N designs and biased reporting practices. Clarifying this three-way relationship, and setting field benchmarks for effect sizes, is crucial not only for building richer neurocognitive models of memory, but for clinical applications such as targeted sleep interventions to treat addiction and other forms of mental illness.
Using a large, stratified online German sample (N=1750), Morgan et al. (2022) will study the three-way relationship between sleep, reward and memory by asking whether, and if so how, reward influences the magnitude of sleep-dependent memory consolidation. Using an AM:PM-PM:AM design in combination with a motivated learning task, the authors will address three main questions: first, whether sleep yields greater memory performance compared to an equivalent period of wake; second whether information associated with higher reward leads to greater memory performance compared to lower reward; and third, the crucial interaction of whether sleep causes greater recognition memory performance for higher vs. lower reward items. The design also includes a series of rigorous positive controls to confirm testability of the hypotheses, while measuring a host of additional moderating variables for exploratory analyses (including age, education status, mental health, and more).
The Stage 1 manuscript was evaluated over two rounds of in-depth review. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
URL to the preregistered Stage 1 protocol: https://osf.io/q5pk8
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA. List of eligible PCI RR-friendly journals: References
1. Rasch, B. & Born, J. (2013). About Sleep's Role in Memory. Physiological Revews, 93, 681–766. https://doi.org/10.1152%2Fphysrev.00032.2012
2. Morgan, D. P., Nagel, J., Cagatay Gürsoy, N., Kern, S. & Feld, G. B. (2022). Estimating the effect of reward on sleep-dependent memory consolidation – A Registered Report, in principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/q5pk8
| Estimating the Effect of Reward on Sleep-Dependent Memory Consolidation – A Registered Report | David P. Morgan, Juliane Nagel, N. Cagatay Gürsoy, Simon Kern & Gordon B. Feld | <p>Rewards play an important role in guiding which memories are formed. Dopamine has been shown to be an important neuromodulator mediating the effect of rewards on memory. In rodents dopaminergic activity during learning has been shown to enhance... | Life Sciences, Social sciences | Chris Chambers | 2022-05-16 10:12:18 | View | ||
02 Jun 2024
STAGE 1
![]() Mapping Cross-Disciplinary Perspectives on Responsible Conduct of Research: A Delphi StudySarahanne M. Field, Jackie Thompson, Tom van Drimmelen, Jennifer Ferrar, Bart Penders, Sarah de Rijcke, and Marcus R. Munafò https://osf.io/6hqysCapturing Perspectives on Responsible Research Practice: A Delphi StudyRecommended by Charlotte PenningtonThe responsible conduct of research (RCR) is crucial for the health of the research ecosystem: high quality research should lead to more credible findings and increase public trust. However, the dimensions and responsibilities that make up RCR differ across disciplines, who together can learn from one another to ensure rigorous, transparent, and reliable research and foster healthier research culture.
Bridging this gap, in their Stage 1 Registered Report, Field and colleagues (2024) outline their plans for a large-scale Delphi study to evaluate academics' perceived levels of importance of the most crucial elements of RCR and how these align and differ across disciplines. First, they plan to assemble a Delphi panel of RCR experts across multiple disciplines who will evaluate a list of RCR dimensions to suggest any additions. Then, these same panellists will judge each RCR dimension on its importance within their discipline of expertise, with iterative rounds of ratings until stability is reached. In this latter phase, the goal is to probe which items are more broadly appreciated by the sample (i.e., those that are perceived as a universally valuable RCR practice), versus which might be more discipline specific. The findings will present the median importance ratings and categories of response agreement across the entire panel and between different disciplines. Finally, to contextualise these findings, the team will analyse qualitative findings from open-ended text responses with a simple form of thematic analysis. From this, the team will develop a framework, using the identified RCR dimensions, that reflects the needs of the academic community.
By mapping a broader multidisciplinary perspective on RCR, this research will fill the gap between the two extremes that existing conceptualisations of RCR tend to fall under: high-level frameworks designed to be universally applicable across all disciplines (e.g., the Singapore Statement on Research Integrity) and prescriptive guides tailored to the practical instruction of researchers within a specific discipline or field (e.g., RCR training designed for members of a university department). The hope is that this will stimulate a more nuanced understanding and discussion of cross-disciplinary conceptions of RCR.
Five expert reviewers with field expertise assessed the Stage 1 manuscript over two rounds of in-depth review. Based on detailed and informed responses to the reviewer’s comments, the recommenders judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
URL to the preregistered Stage 1 protocol: https://osf.io/xmnu5 Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA. List of eligible PCI RR-friendly journals:
References
Field, S. M., Thompson, J., van Drimmelen, T., Ferrar, J., Penders, B., de Rijcke, S., & Munafò, M. R. (2024). Mapping Cross-Disciplinary Perspectives on Responsible Conduct of Research: A Delphi Study. In principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/xmnu5
| Mapping Cross-Disciplinary Perspectives on Responsible Conduct of Research: A Delphi Study | Sarahanne M. Field, Jackie Thompson, Tom van Drimmelen, Jennifer Ferrar, Bart Penders, Sarah de Rijcke, and Marcus R. Munafò | <p>Responsible conduct of research (RCR) is generally agreed to be a laudable goal. It promotes high quality research practices, which should lead to more credible findings, and instill confidence in the research community. However, it is as yet u... | Social sciences | Charlotte Pennington | 2023-05-19 15:27:54 | View | ||
Do Ecological Valid Stop Signals Aid Detour Performance? A Comparison of Four Bird SpeciesAnneleen Dewulf, Clara Garcia-Co, Wendt Müller, Joah R. Madden, An Martel, Luc Lens, Frederick Verbruggen https://osf.io/j2k9hWhat is the role of sensory perception in cognitive task performance? An improved replication of detour performance in four different bird speciesRecommended by Dieter LukasThe detour task, where an individual has to go around a see-through barrier in order to reach a goal, is one of the oldest paradigms used in animal cognition research (Kabadayi et al. 2018). While these previous tests have documented variation in the ability of animals to inhibit going straight for the visible reward, the cognitive underpinnings of this behaviour are as yet not fully understood. In the current study, Dewulf et al. (2025) assessed one of the specific cognitive processes that might be involved in this behaviour, the ability to identify the transparent object as a barrier. Through experimental procedures relying on large samples of individuals from four bird species, they compared the role of signal detection in inhibitory response performance in a detour task. The authors found that, unlike suggested in previous work with these four species (Regolin et al. 1994, Zucca et al. 2005), changing the markings on the barriers to potentially better match those experienced by individuals in their natural environments did not improve their performance. Nevertheless, the detailed further explorations suggest that in order to understand variation in how quickly individuals and species solve the detour task, it is important to consider that different cognitive processes are involved. Their work therefore provides a basis to better understand and further investigate why species might differ in their performance in the detour task.
The Stage 2 manuscript was evaluated over two rounds of in-depth review, the first round consisting of detailed comments from two reviewers and the second round consisting of a close read by the recommender. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 2 criteria and awarded a positive recommendation.
Level of bias control achieved: Level 6. No part of the data or evidence that was used to answer the research question was generated until after IPA.
URL to the preregistered Stage 1 protocol: https://osf.io/qvxgh
List of eligible PCI RR-friendly journals:
References
1. Dewulf, A., Garcia-Co, C., Müller, W., Madden, J.R., Martel, A., Lens, L. & Verbruggen, F. (2025). Do Ecological Valid Stop Signals Aid Detour Performance? A Comparison of Four Bird Species [Stage 2]. Acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/j2k9h
2. Kabadayi, C., Bobrowicz, K., & Osvath, M. (2018). The detour paradigm in animal cognition. Animal Cognition, 21, 21-35. https://doi.org/10.1007/s10071-017-1152-0
3. Regolin, L., Vallortigara, G., & Zanforlin, M. (1995). Object and spatial representations in detour problems by chicks. Animal Behaviour, 49, 195-199. https://doi.org/10.1016/0003-3472(95)80167-7
4. Zucca, P., Antonelli, F., & Vallortigara, G. (2005). Detour behaviour in three species of birds: quails (Coturnix sp.), herring gulls (Larus cachinnans) and canaries (Serinus canaria). Animal Cognition, 8, 122-128. https://doi.org/10.1007/s10071-004-0243-x
| Do Ecological Valid Stop Signals Aid Detour Performance? A Comparison of Four Bird Species | Anneleen Dewulf, Clara Garcia-Co, Wendt Müller, Joah R. Madden, An Martel, Luc Lens, Frederick Verbruggen | <p>Response inhibition, or the stopping of actions, is considered a key component of flexible and adaptive behaviour. Across fields, response inhibition is often treated as a unitary cognitive mechanism. However, we propose that response inhibitio... | Life Sciences, Social sciences | Dieter Lukas | 2024-10-22 14:00:30 | View |
FOLLOW US
MANAGING BOARD
Chris Chambers
Zoltan Dienes
Corina Logan
Benoit Pujol
Maanasa Raghavan
Emily S Sena
Yuki Yamada