Submit a report

Announcements

Please note that we will be CLOSED to ALL SUBMISSIONS from 1 December 2024 through 12 January 2025 to give our recommenders and reviewers a holiday break.

We are recruiting recommenders (editors) from all research fields!

Your feedback matters! If you have authored or reviewed a Registered Report at Peer Community in Registered Reports, then please take 5 minutes to leave anonymous feedback about your experience, and view community ratings.

Latest recommendationsrssmastodon

IdTitle * Authors * Abstract * PictureThematic fields * RecommenderReviewersSubmission date
08 Sep 2022
STAGE 1
article picture

How to succeed in human modified environments

The role of behavioural flexibility in promoting resilience to human environmental impacts

Recommended by ORCID_LOGO based on reviews by Gloriana Chaverri, Vedrana Šlipogor and Alizée Vernouillet
Understanding and mitigating the environmental effects of human expansion is crucial for ensuring long-term biosustainability. Recent research indicates a steep increase in urbanisation – including the expansion of cities – with global urban extent expanding by nearly 10,000 km^2 per year between 1985 and 2015 (Liu et al, 2020). The consequences of these human modified environments on animal life are significant: in order to succeed, species must adapt quickly to environmental changes, and those populations that demonstrate greater behavioural flexibility are likely to cope more effectively. These observations have, in turn, prompted the question of whether enhancing behavioural flexibility in animal species might increase their resilience to human impacts.
 
In the current research, Logan et al. (2022) will use a serial reversal learning paradigm to firstly understand how behavioural flexibility relates to success in avian species that are already successful in human modified environments. The authors will then deploy these flexibility interventions in more vulnerable species to establish whether behavioural training can improve success, as measured by outcomes such as foraging breadth, dispersal dynamics, and survival rate.
 
The Stage 1 manuscript was submitted via the programmatic track and will eventually produce three Stage 2 outputs focusing on different species (toutouwai, grackles, and jays). Following two rounds of in-depth review, the recommender judged that the manuscript met the Stage 1 criteria and awarded in-principle acceptance (IPA).
 
URL to the preregistered Stage 1 protocol: https://osf.io/wbsn6
 
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA. 
 
List of eligible PCI RR-friendly journals:
 
 
References
 
1. Liu, X., Huang, Y., Xu, X., Li, X., Li, X., Ciais, P., Lin, P., Gong, K., Ziegler, A. D., Chen, A., et al. (2020). High-spatiotemporal-resolution mapping of global urban change from 1985 to 2015. Nature Sustainability, 1–7. https://doi.org/10.1038/s41893-020-0521-x
 
2. Logan, C.J., Shaw, R., Lukas, D. & McCune, K.B. (2022). How to succeed in human modified environments, in principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/wbsn6
How to succeed in human modified environmentsLogan CJ, Shaw R, Lukas D, McCune KB<p>Human modifications of environments are increasing, causing global changes that other species must adjust to or suffer from. Behavioral flexibility (hereafter ‘flexibility’) could be key to coping with rapid change. Behavioral research can cont...Life SciencesChris Chambers2022-05-06 12:12:05 View
27 Mar 2024
STAGE 1

Registered Report: Are anticipatory predictions enhanced in tinnitus and independent of hearing loss?

Can predictive coding explain subjective tinnitus?

Recommended by ORCID_LOGO based on reviews by Will Sedley, Pia Brinkmann and Emilie Cardon
Subjective tinnitus is a common disorder in which people experience a persistent sound in the absence of any external source. The underlying causes of tinnitus are debated – although the condition is strongly associated with hearing loss resulting from auditory damage, much remains to be understood about the neural processes that give rise to the phantom perception. Various classes of neurophysiological theories have been proposed, including the “altered gain” model – in which neurons in the auditory pathway increase their responsiveness to compensate for reduced auditory input following hearing loss – and the “noise cancellation” model –  in which disrupted feedback connections from limbic regions are unable to tune out phantom signals. Although these theories account for much observed data, they have not been conclusively supported, and their ability to explain tinnitus is limited by the fact that hearing loss and tinnitus can arise independently and at different times.
 
In the current study, Reisinger et al. (2023) will test an emerging alternative theory based on a Bayesian predictive-coding framework (Sedley et al., 2016) in which the alteration of perceptual priors leads the auditory system to expect a sound that, if functioning normally, it should not expect. Using magnetoencephalography (MEG) in a sample of tinnitus patients (and carefully-matched controls for age, gender, and level of hearing loss), they will ask whether tinnitus is associated with anticipatory brain activation, tuned to the carrier-frequency of an expected auditory stimulus. Specifically, the authors predict that if the predictive-coding framework is correct then individuals with tinnitus should show different regularity-dependent pre-activations of carrier- frequency-specific information compared to the control group, while tone carrier-frequencies should be processed normally in tinnitus patients. They also predict that any such pre-activations should not be related to levels of reported subjective tinnitus distress, as measured with the short version of the Tinnitus Questionnaire (mini-TQ).
 
The Stage 1 manuscript was evaluated over two rounds of in-depth review. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
 
URL to the preregistered Stage 1 protocol: https://osf.io/6gvpy
 
Level of bias control achieved: Level 3. At least some data/evidence that will be used to the answer the research question has been previously accessed by the authors (e.g. downloaded or otherwise received), but the authors certify that they have not yet observed ANY part of the data/evidence.
 
List of eligible PCI RR-friendly journals: 
 
 
References
 
Reisinger, L., Demarchi, G., Rösch, , S., Trinka, E., Obleser, L., & Weisz, N.  (2023). Registered Report: Are anticipatory predictions enhanced in tinnitus and independent of hearing loss? In principle acceptance of Version 4 by Peer Community in Registered Reports. https://osf.io/6gvpy
 
Sedley, W., Friston, K. J., Gander, P. E., Kumar, S., & Griffiths, T. D. (2016). An integrative tinnitus model based on sensory precision. Trends in Neurosciences, 39, 799-812. https://doi.org/10.1016/j.tins.2016.10.004
Registered Report: Are anticipatory predictions enhanced in tinnitus and independent of hearing loss?L. Reisinger, G. Demarchi, S. Rösch, E. Trinka, J. Obleser, N. Weisz<p>Phantom perceptions occur without any identifiable environmental or bodily source. The mechanisms and key drivers behind phantom perceptions like tinnitus are not well understood. The dominant view suggests that tinnitus results from hyperactiv...Life SciencesChris Chambers2023-01-03 08:35:12 View
27 Mar 2024
STAGE 2
(Go to stage 1)

Registered Report: Are anticipatory auditory predictions enhanced in tinnitus and independent of hearing loss?

Evidence for the role of predictive coding in subjective tinnitus

Recommended by ORCID_LOGO based on reviews by Will Sedley, Pia Brinkmann and Emilie Cardon
Subjective tinnitus is a common disorder in which people experience a persistent sound in the absence of any external source. The underlying causes of tinnitus are debated – although the condition is strongly associated with hearing loss resulting from auditory damage, much remains to be understood about the neural processes that give rise to the phantom perception. Various classes of neurophysiological theories have been proposed, including the “altered gain” model – in which neurons in the auditory pathway increase their responsiveness to compensate for reduced auditory input following hearing loss – and the “noise cancellation” model – in which disrupted feedback connections from limbic regions are unable to tune out phantom signals. Although these theories account for much observed data, they have not been conclusively supported, and their ability to explain tinnitus is limited by the fact that hearing loss and tinnitus can arise independently and at different times.
 
In the current study, Reisinger et al. (2024) tested an emerging alternative theory based on a Bayesian predictive-coding framework (Sedley et al., 2016) in which the alteration of perceptual priors leads the auditory system to expect a sound that, if functioning normally, it should not expect. Using magnetoencephalography (MEG) in a sample of tinnitus patients (and carefully-matched controls for age, gender, and level of hearing loss), they asked whether tinnitus is associated with anticipatory brain activation, tuned to the carrier-frequency of an expected auditory stimulus. Specifically, the authors predicted that if the predictive-coding framework is correct then individuals with tinnitus should show different regularity-dependent pre-activations of carrier- frequency-specific information compared to the control group, while tone carrier-frequencies should be processed normally in tinnitus patients. They also predicted that any such pre-activations should not be related to levels of reported subjective tinnitus distress, as measured with the short version of the Tinnitus Questionnaire (mini-TQ).
 
The results broadly confirmed the hypotheses, with some caveats. Statistically significant differences in regularity-dependent pre-activations were observed between the tinnitus and control groups, however – curiously – the effects appear to be driven by below-chance decoding in the control group, complicating the interpretration. At the same time, consistent with expectations, frequency processing did not differ significantly between individuals with and without tinnitus, and the observed pre-activations were not significantly related to tinnitus distress. Overall, the findings cautiously support the conclusion that chronic tinnitus is associated with maladaptively upregulated predictive neural processing, and that this phenomenon is unlikely to be explained by either tinnitus distress or hearing loss.
 
The Stage 2 manuscript was evaluated over one round of in-depth review. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 2 criteria and awarded a positive recommendation.
 
URL to the preregistered Stage 1 protocol: https://osf.io/6gvpy
 
Level of bias control achieved: Level 3. At least some data/evidence that was used to the answer the research question had been previously accessed by the authors (e.g. downloaded or otherwise received), but the authors certify that they had yet observed any part of the data/evidence prior to Stage 1 IPA.
 
List of eligible PCI RR-friendly journals: 
 
 
References
 
1. Reisinger, L., Demarchi, G., Rösch, , S., Trinka, E., Obleser, L., & Weisz, N. (2024). Registered Report: Are anticipatory auditory predictions enhanced in tinnitus and independent of hearing loss? [Stage 2] Acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/9wqjh
 
2. Sedley, W., Friston, K. J., Gander, P. E., Kumar, S., & Griffiths, T. D. (2016). An integrative tinnitus model based on sensory precision. Trends in Neurosciences, 39, 799-812. https://doi.org/10.1016/j.tins.2016.10.004
Registered Report: Are anticipatory auditory predictions enhanced in tinnitus and independent of hearing loss?L. Reisinger, G. Demarchi, S. Rösch, E. Trinka, J. Obleser, N. Weisz<p>Phantom perceptions occur without any identifiable environmental or bodily source. The mechanisms and key drivers behind phantom perceptions like tinnitus are not well understood. The dominant “altered-gain”-framework suggests that tinnitus res...Life SciencesChris Chambers2024-02-21 16:17:33 View
23 May 2023
STAGE 1

Does Brooding Meaningfully Increase the Likelihood of Believing in a Conspiracy? A Registered Report

Does brooding increase conspiracy beliefs?

Recommended by ORCID_LOGO based on reviews by Matt Williams and 1 anonymous reviewer
The world is seemingly awash with conspiracy theories – from well-trodden examples such as fake Moon landings, the 9/11 truth movement, and Holocaust denial, to relative newcomers including COVID as a bioweapon, QAnon, and the belief that the science of climate change has been invented or falsified. While there is a public perception that conspiracy theories are becoming more prevalent, recent evidence suggests that the rate of conspiracism is relatively stable over time (Uscinski et al., 2022). At any point in history, it seems that a certain proportion of people find themselves vulnerable to conspiracy beliefs, but what distinguishes those who do from those who don’t, and what are the causal factors?
 
In the current study, Liekefett et al. (2023) investigate the critical role of rumination – a perseverative and repetitive focus on negative content leading to emotional distress. In particular, the authors ask whether one component of rumination referred to as brooding (dwelling on one’s worries and distressing emotions) has a specific causal role in the formation of conspiracy beliefs. In a series of preliminary experiments, the authors first established a procedure for successfully inducing rumination, identifying various boundary conditions and requirements for a successful design. In the proposed study (of up to N=1,638), they will then ask whether the induction of brooding causes a significant increase in conspiracy beliefs. Manipulation checks will be included to confirm intervention fidelity (independently of this hypothesis), and exploratory analyses will test the effect of various moderators, as well as the causal role of a complementary manipulation of reflection – a component of rumination in which attention is focused on the issue at hand rather than one’s emotions.
 
The Stage 1 manuscript was evaluated over two rounds of in-depth review. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
 
URL to the preregistered Stage 1 protocol: https://osf.io/y82bs
 
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.
 
List of eligible PCI RR-friendly journals:
 
 
References
 
1. Uscinski, J., Enders, A., Klofstad, C., Seelig, M., Drochon, H., Premaratne, K. & Murthi, M. (2022) Have beliefs in conspiracy theories increased over time? PLOS ONE 17: e0270429. https://doi.org/10.1371/journal.pone.0270429

2. Liekefett, L. Sebben, S. & Becker, J. C. (2023). Does Brooding Meaningfully Increase the Likelihood of Believing in a Conspiracy? Stage 1 Registered Report, in principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/y82bs
Does Brooding Meaningfully Increase the Likelihood of Believing in a Conspiracy? A Registered ReportLuisa Liekefett, Simone Sebben, Julia C. Becker<p>This project aims to investigate the relationship between rumination and conspiracy beliefs. It<br>involves four pilot studies, including one observational and three experimental studies, but the<br>results were inconclusive. We suggest that ru...Humanities, Social sciencesChris Chambers2023-02-01 14:47:09 View
04 Dec 2023
STAGE 2
(Go to stage 1)

The Effect of Brooding about Societal Problems on Conspiracy Beliefs: A Registered Report

Brooding increases conspiracy beliefs but with practical significance to be determined

Recommended by ORCID_LOGO based on reviews by Matt Williams and Daniel Toribio-Flórez
The world is seemingly awash with conspiracy theories – from well-trodden examples such as fake Moon landings, the 9/11 truth movement, and Holocaust denial, to relative newcomers including COVID as a bioweapon, QAnon, and the belief that the science of climate change has been invented or falsified. While there is a public perception that conspiracy theories are becoming more prevalent, recent evidence suggests that the rate of conspiracism is relatively stable over time (Uscinski et al., 2022). At any point in history, it seems that a certain proportion of people find themselves vulnerable to conspiracy beliefs, but what distinguishes those who do from those who don’t, and what are the causal factors?
 
In the current study, Liekefett et al. (2023) investigated the critical role of rumination – a perseverative and repetitive focus on negative content leading to emotional distress. In particular, the authors asked whether one component of rumination referred to as brooding (dwelling on one’s worries and distressing emotions) has a specific causal role in the formation of conspiracy beliefs. In a series of preliminary experiments, the authors first established a procedure for successfully inducing rumination, identifying various boundary conditions and requirements for a successful design. In the main study (N=1,638 to 2,007 depending on the analysis), they asked whether the induction of brooding causes a significant increase in conspiracy beliefs. Manipulation checks were also included to confirm intervention fidelity (independently of this hypothesis), and exploratory analyses tested the effect of various moderators, as well as the causal role of a complementary manipulation of reflection – a component of rumination in which attention is focused on the issue at hand rather than one’s emotions.
 
As expected by the authors' preliminary work, manipulation checks independently confirmed the effectiveness of the brooding intervention. In answer to the main research question, participants who brooded over the worries and negative emotions associated with an issue were more susceptible to conspiracy beliefs compared to a control group. However, while this effect of brooding was statistically significant, the confidence interval of the effect size estimate overlapped with the authors' proposed smallest effect size of interest (d = 0.20), suggesting that the practical value of the effect remains to be determined.
 
Overall the findings are consistent with a range of psychological theories suggesting that rumination induces negative affect and/or narrows attention to negative information, which in turn may make conspiracy theories seem more probable and render individuals more vulnerable to cognitive bias. The authors note the importance of future work to define the smallest effect of practical significance, analagous to the criteria used to determine the 'minimal clinically important difference’ in medical research.
 
The Stage 2 manuscript was evaluated over one round of in-depth review. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 2 criteria and awarded a positive recommendation.
 
URL to the preregistered Stage 1 protocol: https://osf.io/y82bs
 
Level of bias control achieved: Level 6. No part of the data or evidence that was used to answer the research question was generated until after IPA.
 
List of eligible PCI RR-friendly journals:
 
 
References
 
1. Uscinski, J., Enders, A., Klofstad, C., Seelig, M., Drochon, H., Premaratne, K. & Murthi, M. (2022) Have beliefs in conspiracy theories increased over time? PLOS ONE 17: e0270429. https://doi.org/10.1371/journal.pone.0270429

2. Liekefett, L. Sebben, S. & Becker, J. C. (2023). The Effect of Brooding about Societal Problems on Conspiracy Beliefs: A Registered Report. Acceptance of Version 2 by Peer Community in Registered Reports. https://osf.io/3e8wc
The Effect of Brooding about Societal Problems on Conspiracy Beliefs: A Registered ReportLuisa Liekefett, Simone Sebben, Julia C. Becker<p>This Stage 2 Registered Report concerns the relationship between rumination, a repetitive style of negative thinking, and conspiracy beliefs (Stage 1 protocol: https://osf.io/y82bs, date of in-principle-acceptance: 23/05/2023). Based on four pi...Humanities, Social sciencesChris Chambers2023-10-19 17:46:59 View
27 Mar 2023
STAGE 1
article picture

Optimizing Esports Performance Using a Synergistic Mindsets Intervention

Synergistic Mindset Intervention for Competitive Situations

Recommended by ORCID_LOGO based on reviews by Lee Moore, Ivan Ropovik , Ivana Piterová and Jacob Keech
Mindset theories suggest that the mere belief in the malleability of human abilities can already help one to develop related performance. On the other hand, one and the same performance situation can also be experienced in various affective ways, which differently contribute to performance outcomes. Arguably, appraising a performance situation as a “threat” instead of “challenge” is associated with maladaptive responses, such as impaired cardiovascular mobilization. If people could experience performance situations as positive challenges, this might also improve performance outcomes. Drawing from these connected theoretical premises, the synergistic mindset intervention was developed and tentatively found to help adolescents in stressful situations (Yeager et al., 2022).
 
In the present registered report, Behnke et al. (2023) build on the above and test whether the synergistic mindset intervention can help individuals in competitive gaming situations. The authors utilize one of the leading esport games, Counter-Strike: Global Offensive​, and recruit its active players into randomized control and intervention groups for two weeks. Ultimately, the participants compete in a cash-prize tournament involving measures of affective experience and cardiovascular responses. Behnke et al. (2023) hypothesize that the synergistic mindset group will show greater challenge affective responses and superior performance outcomes. As such, the study design has significant potential to generate valuable evidence for various theoretical models and the synergistic mindset model in particular.
 
The Stage 1 manuscript was evaluated over two rounds by four experts with experimental psychology specializations in mindsets, stress, and statistics. Based on the comprehensive responses to the reviewers' feedback, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
 
URL to the preregistered Stage 1 protocol: https://osf.io/z3adb
 
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.
 
List of eligible PCI RR-friendly journals: 
 
 
References
 
Behnke M., Lakens D., Petrova K., Chwiłkowska P., Kaczmarek L. D., Jamieson J. P., & Gross J. J. (2023) Optimizing Esports Performance Using a Synergistic Mindsets Intervention. In principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/z3adb

Yeager D.S., Bryan C.J., Gross J.J., Murray J., Krettek D., Santos P., ... & Jamieson J.P. (2022) A synergistic mindsets intervention protects adolescents from stress. Nature 607, 512–520. https://doi.org/10.1038/s41586-022-04907-7
Optimizing Esports Performance Using a Synergistic Mindsets InterventionMaciej Behnke, Daniël Lakens, Kate Petrova, Patrycja Chwiłkowska, Lukasz D. Kaczmarek, Jeremy P. Jamieson, James J. Gross<p>Affective responses during stressful high-stakes situations can play an important role in shaping performance outcomes. For example, feeling shaky and nervous at a job interview can undermine performance, whereas feeling pumped and excited duri...Social sciencesVeli-Matti Karhulahti2023-01-04 10:12:55 View
08 Apr 2024
STAGE 2
(Go to stage 1)

Applying a Synergistic Mindsets Intervention to an Esports Context

Synergistic Mindset Intervention in Competitive Situations

Recommended by ORCID_LOGO based on reviews by Lee Moore, Ivan Ropovik and Jacob Keech
Mindset theories suggest that the mere belief in the malleability of human abilities can help one to develop related performance. On the other hand, one and the same performance situation can also be experienced in various affective ways, which differently contribute to performance outcomes. One theoretically justifiable premise is that appraising a performance situation as a “threat” instead of “challenge” is associated with maladaptive responses, such as impaired cardiovascular mobilization. If people could experience performance situations as positive challenges, this might also improve performance outcomes. Drawing from these connected premises, the synergistic mindset intervention was developed and tentatively found to help adolescents in stressful situations (Yeager et al., 2022).
 
In the present registered report, Behnke et al. (2024) built on the above to test whether the synergistic mindset intervention can help individuals in competitive gaming situations. The authors utilized one of the leading esport games, Counter-Strike: Global Offensive​, and recruited its active players (N=300) into randomized control and intervention groups. The participants competed in a cash-prize tournament involving measures of affective experience and cardiovascular responses. Behnke et al. (2024) hypothesized the synergistic mindset group (SMI) to show greater challenge affective responses and superior performance outcomes. 
 
Although the SMI produced a number of positive outcomes such as more beneficial stress mindsets, the hypotheses were not corroborated but the results supported a null. This may be related to the observation that participants generally experienced the intervention positively, which, in turn, limits the potential for improving affective and physiological responses. These rigorous null results are informative by directing the SMI research program toward test designs where more participants experience strong negative stress responses. Moreover, the results encourage researchers to reassess the underlying auxiliary hypotheses regarding affective responses and performance outcomes, the relationships of which may be complicated by situational factors that are not yet fully understood.
 
The Stage 2 manuscript was evaluated over one round of in-depth review. Three out of the four Stage 1 experts returned to review and, due to the study’s exceptionally high level of transparency, the reviewers had only minor requests for revision. As all the requested revisions were implemented carefully, the recommender judged that the manuscript met the Stage 2 criteria and awarded a positive recommendation.
 
URL to the preregistered Stage 1 protocol: https://osf.io/z3adb
 
Level of bias control achieved: Level 6. No part of the data or evidence that was used to answer the research question was generated until after IPA.
 
List of eligible PCI RR-friendly journals: 
 
 
References
 
1. Behnke M., Lakens D., Petrova K., Chwiłkowska P., Kaczmarek L. D., Jamieson J. P., & Gross J. J. (2024) Applying a Synergistic Mindsets Intervention to an Esports Context. Acceptance of Version 2 by Peer Community in Registered Reports https://osf.io/53z8e
 
2. Yeager D.S., Bryan C.J., Gross J.J., Murray J., Krettek D., Santos P., ... & Jamieson J.P. (2022) A synergistic mindsets intervention protects adolescents from stress. Nature 607, 512–520. https://doi.org/10.1038/s41586-022-04907-7
 
Applying a Synergistic Mindsets Intervention to an Esports ContextMaciej Behnke, Daniël Lakens, Kate Petrova, Patrycja Chwiłkowska, Szymon Jęśko Białek, Maciej Kłoskowski, Wadim Krzyżaniak, Patryk Maciejewski, Lukasz D. Kaczmarek, Kacper Szymański, Jeremy P. Jamieson, James J. Gross<p>Affective responses during stressful, high-stakes situations can play an important role in shaping performance. For example, feeling shaky and nervous at a job interview can undermine performance, whereas feeling excited during that same interv...Social sciencesVeli-Matti Karhulahti2024-02-02 17:57:13 View
29 Sep 2021
STAGE 1

Evaluating the pedagogical effectiveness of study preregistration in the undergraduate dissertation: A Registered Report

Does incorporating open research practices into the undergraduate curriculum decrease questionable research practices?

Recommended by ORCID_LOGO and ORCID_LOGO based on reviews by Kelsey McCune, Neil Lewis, Jr., Lisa Spitzer and 1 anonymous reviewer

In a time when open research practices are becoming more widely used to combat questionable research practices (QRPs) in academia, this Stage 1 Registered Report by Pownall and colleagues (2021) will empirically investigate the practice of preregistering study plans, which will allow us to better understand to what degree such practices increase awareness of QRPs and whether experience with preregistration helps reduce engagement in QRPs. This investigation is timely because results from these kinds of studies are only recently becoming available and the conclusions are providing evidence that open research practices can improve research quality and reliability (e.g., Soderberg et al. 2020, Chambers & Tzavella 2021). The authors crucially focus on the effect of preregistering the undergraduate senior thesis (of psychology students in the UK), which is a key stage in the development of an academic. This data will help shape the future of how we should teach open research practices and what effect we as teachers can have on budding research careers. The five expert peer reviews were of an extremely high quality and were very thorough. The authors did an excellent job of addressing all of the comments in their responses and revised manuscript versions, which resulted in only one round of peer review, plus a second revision based on Recommender feedback. As such, this registered report meets the Stage 1 criteria and is therefore awarded in-principle acceptance (IPA). We wish the authors the best of luck with the study and we look forward to seeing the results.

URL to the preregistered Stage 1 protocol: https://osf.io/9hjbw

Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.

List of eligible PCI RR-friendly journals:

References

  1. Pownall M, Pennington CR, Norris E, Clark K. 2021. Evaluating the pedagogical effectiveness of study preregistration in the undergraduate dissertation: A Registered Report. OSF, stage 1 preregistration, in principle acceptance of version 1 by Peer Community in Registered Reports.   https://doi.org/10.17605/OSF.IO/9HJBW
  2. Chambers C, Tzavella L (2021). The past, present, and future of Registered Reports. https://doi.org/10.31222/osf.io/43298
  3. Soderberg CK, Errington TM, Schiavone SR, Bottesini J, Thorn FS, Vazire S, Esterling KM, Nosek BA (2021) Initial evidence of research quality of registered reports compared with the standard publishing model. Nature Human Behaviour, 5, 990–997. https://doi.org/10.1038/s41562-021-01142-4
Evaluating the pedagogical effectiveness of study preregistration in the undergraduate dissertation: A Registered Report Madeleine Pownall; Charlotte R. Pennington; Emma Norris; Kait Clark <p style="text-align: justify;">Research shows that questionable research practices (QRPs) are present in undergraduate final-year dissertation projects. One entry-level Open Science practice proposed to mitigate QRPs is ‘study preregistration’, t...Life Sciences, Social sciencesCorina Logan2021-07-08 15:27:24 View
18 Aug 2023
STAGE 2
(Go to stage 1)

Evaluating the Pedagogical Effectiveness of Study Preregistration in the Undergraduate Dissertation

Incorporating open research practices into the undergraduate curriculum increases understanding of such practices

Recommended by ORCID_LOGO based on reviews by Kelsey McCune, Neil Lewis, Jr., Lisa Spitzer and 1 anonymous reviewer
In a time when open research practices are becoming more widely used to combat questionable research practices (QRPs) in academia, this Registered Report by Pownall and colleagues (2023) empirically investigated the practice of preregistering study plans, which allows us to better understand to what degree such practices increase awareness of QRPs and whether experience with preregistration helps reduce engagement in QRPs. This investigation is timely because results from these kinds of studies are only recently becoming available and the conclusions are providing evidence that open research practices can improve research quality and reliability (e.g., Soderberg et al. 2021, Chambers & Tzavella 2022). The authors crucially focused on the effect of preregistering the undergraduate senior thesis (of psychology students in the UK), which is a key stage in the development of an academic.
 
Pownall and colleagues found that preregistration did not affect attitudes toward QRPs, but it did improve student understanding of open research practices. Using exploratory analyses, they additionally found that those who preregistered were those students who reported that they had more opportunity, motivation, and greater capability. This shows how important it is to incorporate the teaching of open research practices such that students can increase their capability, motivation, and opportunity to pursue such practices, whether it is preregistration or other practices that are better known to reduce QRPs (such as registered reports; Krypotos et al. 2022). 
 
After four rounds of review and revisions, the recommender judged that the manuscript met the Stage 2 criteria and awarded a positive recommendation.
 
URL to the preregistered Stage 1 protocol: https://osf.io/9hjbw
 
Level of bias control achieved: Level 6. No part of the data or evidence that was used to answer the research question was generated until after IPA.
 
List of eligible PCI RR-friendly journals:
 
 
References
 
1. Chambers C. D. & Tzavella, L. (2022). The past, present, and future of Registered Reports. Nature Human Behaviour, 6, 29-42. https://doi.org/10.1038/s41562-021-01193-7
 
2. Krypotos, A. M., Mertens, G., Klugkist, I., & Engelhard, I. M. (2022). Preregistration: Definition, advantages, disadvantages, and how it can help against questionable research practices. In Avoiding Questionable Research Practices in Applied Psychology (pp. 343-357). Cham: Springer International Publishing.
 
3. Pownall, M., Pennington, C. R., Norris, E., Juanchich, M., Smaile, D., Russell, S., Gooch, D., Rhys Evans, T., Persson, S., Mak, M. H. C., Tzavella, L., Monk, R., Gough, T., Benwell, C. S. Y., Elsherif, M., Farran, E., Gallagher-Mitchell, T., Kendrick, L. T., Bahnmueller, J., Nordmann, E., Zaneva, M., Gilligan-Lee, K., Bazhydai, M., Jones, A., Sedgmond, J., Holzleitner, I., Reynolds, J., Moss, J., Farrelly, D., Parker, A. J. & Clark, K. (2023). Evaluating the pedagogical effectiveness of study preregistration in the undergraduate dissertation [Stage 2 Registered Report], acceptance of Version 4 by Peer Community in Registered Reports. https://psyarxiv.com/xg2ah
 
4. Soderberg C. K., Errington T. M., Schiavone S. R., Bottesini J., Thorn F. S., Vazire S., Esterling K. M. & Nosek B. A. (2021) Initial evidence of research quality of registered reports compared with the standard publishing model. Nature Human Behaviour, 5, 990–997. https://doi.org/10.1038/s41562-021-01142-4
Evaluating the Pedagogical Effectiveness of Study Preregistration in the Undergraduate DissertationMadeleine Pownall, Charlotte R. Pennington, Emma Norris, Marie Juanchich, David Smaile, Sophie Russell, Debbie Gooch, Thomas Rhys Evans, Sofia Persson, Matthew HC Mak, Loukia Tzavella, Rebecca Monk, Thomas Gough, Christopher SY Benwell, Mahmoud El...<p>Research shows that questionable research practices (QRPs) are present in undergraduate final-year dissertation projects. One entry-level Open Science practice proposed to mitigate QRPs is ‘study preregistration’, through which researchers outl...Life Sciences, Social sciencesCorina Logan2023-03-25 11:38:54 View
22 Jul 2024
STAGE 1
article picture

Replication of “Carbon-Dot-Based Dual-Emission Nanohybrid Produces a Ratiometric Fluorescent Sensor for In Vivo Imaging of Cellular Copper Ions”

Replicating, Revising and Reforming: Unpicking the Apparent Nanoparticle Endosomal Escape Paradox

Recommended by and ORCID_LOGO based on reviews by Cecilia Menard-Moyon and Zeljka Krpetic
Context
 
Over the past decade there has been an exponential increase in the number of research papers utlising nanoparticles for biological applications such as intracellular sensing [1, 2], theranostics [3-5] and more recently drug delivery and precision medicine [6, 7]. Despite the success stories, there is a disconnect regarding current dogma on issues such as nanoparticle uptake and trafficking, nanoparticle delivery via the enhanced permeability and retention (EPR) effect, and endosomal escape. Critical re-evaluation of these concepts both conceptually and experimentally is needed for continued advancement in the field.
 
For this preregistration, Said et al. (2024) focus on nanoparticle intracellular trafficking, specifically endosomal escape [8]. The current consensus in the literature is that nanoparticles enter cells via endocytosis [9, 10] but reportedly just 1-2% of nanoparticles/ nanoparticle probes escape endosomes and enter the cytoplasm [11-13]. There is therefore an apparent paradox over how sensing nanoparticles can detect their intended targets in the cytoplasm if they are trapped within the cell endosomes. To address this fundamental issue of nanoparticle endosomal escape, Lévy and coworkers are carrying out replication studies to thoroughly and transparently replicate the most influential papers in the field of nanoparticle sensing. The aim of these replication studies is twofold: to establish a robust methodology to study endosomal escape of nanoparticles, and to encourage discussions, transparency and a step-change in the field.  
 
Replication of “Carbon-Dot-Based Dual-Emission Nanohybrid Produces a Ratiometric Fluorescent Sensor for In Vivo Imaging of Cellular Copper Ions”
 
For this replication study, the authors classified papers on the topic of nanoparticle sensing and subsequently ranked them by number of citations.  Based on this evaluation they selected a paper by Zhu and colleagues [14] entitled “Carbon-Dot-Based Dual-Emission Nanohybrid Produces a Ratiometric Fluorescent Sensor for In Vivo Imaging of Cellular Copper Ions” for their seminal replication study.  To determine the reproducibility of the results from Zhu et al., the authors aim to establish the proportion of endosomal escape of the nanoparticles, and to examine the data in a biological context relevant to the application of the probe.
 
Beyond Replication
 
The authors plan to replicate the exact conditions reported in the materials and methods section of the selected paper such as nanoparticle probe synthesis of CdSe@C-TPEA nanoparticles, assessment of particle size, stability and reactivity and effect on cells (TEM, pH experiments, fluorescent responsivity to metal ions and cell viability). In addition, Said et al., plan to include further experimental characterisation to complement the existing study by Zhu and colleagues. They will incorporate additional controls and methodology to determine the intracellular location of nanoparticle probes in cells including: quantifying excess fluorescence in the culture medium, live cell imaging analysis, immunofluorescence with endosomal and lysosomal markers, and electron microscopy of cell sections. The authors will also include supplementary viability studies to assess the impact of the nanoparticles on HeLa cells as well as an additional biologically relevant cell line (for use in conjunction with the HeLa cells as per the original paper).
 
The Stage 1 manuscript underwent two rounds of thorough in-depth review. After considering the detailed responses to the reviewers' comments, the recommenders  determined that the manuscript met the Stage 1 criteria and awarded in-principle acceptance (IPA).  
 
The authors have thoughtfully considered their experimental approach to the replication study, whilst acknowledging any potential limitations. Given that conducting such a replication study is novel in the field of Nanotechnology and there is currently no ‘gold standard’ approach in doing so, the authors have showed thoughtful regard of statistical analysis and unbiased methodology where possible.
 
Based on current information, this study is the first use of preregistration via Peer Community in Registered Reports and the first formalised replication study in Nanotechnology for Biosciences. The outcomes of this of this study will be significant both scientifically and in the wider context in discussion of the scientific method.
 
URL to the preregistered Stage 1 protocol: https://osf.io/qbxpf
 
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.
 
List of eligible PCI RR-friendly Journals:
 
References
 
1. Howes, P. D., Chandrawati, R., & Stevens, M. M. (2014). Colloidal nanoparticles as advanced biological sensors. Science, 346(6205), 1247390. https://doi.org/10.1126/science.1247390
 
2. Liu, C. G., Han, Y. H., Kankala, R. K., Wang, S. B., & Chen, A. Z. (2020). Subcellular performance of nanoparticles in cancer therapy. International Journal of Nanomedicine, 675-704. https://doi.org/10.2147/IJN.S226186
 
3. Tang, W., Fan, W., Lau, J., Deng, L., Shen, Z., & Chen, X. (2019). Emerging blood–brain-barrier-crossing nanotechnology for brain cancer theranostics. Chemical Society Reviews, 48(11), 2967-3014. https://doi.org/10.1039/C8CS00805A
 
4. Yoon, Y. I., Pang, X., Jung, S., Zhang, G., Kong, M., Liu, G., & Chen, X. (2018). Smart gold nanoparticle-stabilized ultrasound microbubbles as cancer theranostics. Journal of Materials Chemistry B, 6(20), 3235-3239. https://doi.org/10.1039%2FC8TB00368H
 
5. Lin, H., Chen, Y., & Shi, J. (2018). Nanoparticle-triggered in situ catalytic chemical reactions for tumour-specific therapy. Chemical Society Reviews, 47(6), 1938-1958. https://doi.org/10.1039/C7CS00471K
 
6. Hou, X., Zaks, T., Langer, R., & Dong, Y. (2021). Lipid nanoparticles for mRNA delivery. Nature Reviews Materials, 6(12), 1078-1094. https://doi.org/10.1038/s41578-021-00358-0
 
7. Mitchell, M. J., Billingsley, M. M., Haley, R. M., Wechsler, M. E., Peppas, N. A., & Langer, R. (2021). Engineering precision nanoparticles for drug delivery. Nature Reviews Drug Discovery, 20(2), 101-124. https://doi.org/10.1038/s41573-020-0090-8
 
8. Said, M., Gharib, M., Zrig, S., & Lévy, R. (2024). Replication of “Carbon-Dot-Based Dual-Emission Nanohybrid Produces a Ratiometric Fluorescent Sensor for In Vivo Imaging of Cellular Copper Ions”. In principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/qbxpf
 
9. Behzadi, S., Serpooshan, V., Tao, W., Hamaly, M. A., Alkawareek, M. Y., Dreaden, E. C., ... & Mahmoudi, M. (2017). Cellular uptake of nanoparticles: Journey inside the cell. Chemical Society Reviews, 46(14), 4218-4244. https://doi.org/10.1039/C6CS00636A
 
10. de Almeida, M. S., Susnik, E., Drasler, B., Taladriz-Blanco, P., Petri-Fink, A., & Rothen-Rutishauser, B. (2021). Understanding nanoparticle endocytosis to improve targeting strategies in nanomedicine. Chemical society reviews, 50(9), 5397-5434. https://doi.org/10.1039/D0CS01127D
 
11. Smith, S. A., Selby, L. I., Johnston, A. P., & Such, G. K. (2018). The endosomal escape of nanoparticles: toward more efficient cellular delivery. Bioconjugate Chemistry, 30(2), 263-272. http://dx.doi.org/10.1021/acs.bioconjchem.8b00732
 
12. Cupic, K. I., Rennick, J. J., Johnston, A. P., & Such, G. K. (2019). Controlling endosomal escape using nanoparticle composition: current progress and future perspectives. Nanomedicine, 14(2), 215-223. https://doi.org/10.2217/nnm-2018-0326
 
13. Wang, Y., & Huang, L. (2013). A window onto siRNA delivery. Nature Biotechnology, 31(7), 611-612. https://doi.org/10.1038/nbt.2634
 
14. Zhu, A., Qu, Q., Shao, X., Kong, B., & Tian, Y. (2012). Carbon-dot-based dual-emission nanohybrid produces a ratiometric fluorescent sensor for in vivo imaging of cellular copper ions. Angewandte Chemie (International ed. in English), 51(29), 7185-7189. https://doi.org/10.1002/anie.201109089
Replication of “Carbon-Dot-Based Dual-Emission Nanohybrid Produces a Ratiometric Fluorescent Sensor for In Vivo Imaging of Cellular Copper Ions”Maha Said, Mustafa Gharib, Samia Zrig, Raphaël Lévy <p>In hundreds of articles published over the past two decades, nanoparticles have been described as probes for sensing and imaging of a variety of intracellular cytosolic targets. However, nanoparticles generally enter cells by endocytosis with o...Life Sciences, Medical Sciences, Physical SciencesEmily Linnane2023-11-29 19:14:03 View