Submit a report

Announcements

We are recruiting recommenders (editors) from all research fields!

Your feedback matters! If you have authored or reviewed a Registered Report at Peer Community in Registered Reports, then please take 5 minutes to leave anonymous feedback about your experience, and view community ratings.


 

Latest recommendationsrssmastodon

IdTitleAuthors▲AbstractPictureThematic fieldsRecommenderReviewersSubmission date
29 Sep 2021
STAGE 1
toto

Evaluating the pedagogical effectiveness of study preregistration in the undergraduate dissertation: A Registered Report

Does incorporating open research practices into the undergraduate curriculum decrease questionable research practices?

Recommended by ORCID_LOGO and ORCID_LOGO based on reviews by Kelsey McCune, Neil Lewis, Jr., Lisa Spitzer and 1 anonymous reviewer

In a time when open research practices are becoming more widely used to combat questionable research practices (QRPs) in academia, this Stage 1 Registered Report by Pownall and colleagues (2021) will empirically investigate the practice of preregistering study plans, which will allow us to better understand to what degree such practices increase awareness of QRPs and whether experience with preregistration helps reduce engagement in QRPs. This investigation is timely because results from these kinds of studies are only recently becoming available and the conclusions are providing evidence that open research practices can improve research quality and reliability (e.g., Soderberg et al. 2020, Chambers & Tzavella 2021). The authors crucially focus on the effect of preregistering the undergraduate senior thesis (of psychology students in the UK), which is a key stage in the development of an academic. This data will help shape the future of how we should teach open research practices and what effect we as teachers can have on budding research careers. The five expert peer reviews were of an extremely high quality and were very thorough. The authors did an excellent job of addressing all of the comments in their responses and revised manuscript versions, which resulted in only one round of peer review, plus a second revision based on Recommender feedback. As such, this registered report meets the Stage 1 criteria and is therefore awarded in-principle acceptance (IPA). We wish the authors the best of luck with the study and we look forward to seeing the results.

URL to the preregistered Stage 1 protocol: https://osf.io/9hjbw

Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.

List of eligible PCI RR-friendly journals:

References

  1. Pownall M, Pennington CR, Norris E, Clark K. 2021. Evaluating the pedagogical effectiveness of study preregistration in the undergraduate dissertation: A Registered Report. OSF, stage 1 preregistration, in principle acceptance of version 1 by Peer Community in Registered Reports.   https://doi.org/10.17605/OSF.IO/9HJBW
  2. Chambers C, Tzavella L (2021). The past, present, and future of Registered Reports. https://doi.org/10.31222/osf.io/43298
  3. Soderberg CK, Errington TM, Schiavone SR, Bottesini J, Thorn FS, Vazire S, Esterling KM, Nosek BA (2021) Initial evidence of research quality of registered reports compared with the standard publishing model. Nature Human Behaviour, 5, 990–997. https://doi.org/10.1038/s41562-021-01142-4
Evaluating the pedagogical effectiveness of study preregistration in the undergraduate dissertation: A Registered Report Madeleine Pownall; Charlotte R. Pennington; Emma Norris; Kait Clark <p style="text-align: justify;">Research shows that questionable research practices (QRPs) are present in undergraduate final-year dissertation projects. One entry-level Open Science practice proposed to mitigate QRPs is ‘study preregistration’, t...Life Sciences, Social sciencesCorina Logan2021-07-08 15:27:24 View
18 Aug 2023
STAGE 2
(Go to stage 1)
toto

Evaluating the Pedagogical Effectiveness of Study Preregistration in the Undergraduate Dissertation

Incorporating open research practices into the undergraduate curriculum increases understanding of such practices

Recommended by ORCID_LOGO based on reviews by Kelsey McCune, Neil Lewis, Jr., Lisa Spitzer and 1 anonymous reviewer
In a time when open research practices are becoming more widely used to combat questionable research practices (QRPs) in academia, this Registered Report by Pownall and colleagues (2023) empirically investigated the practice of preregistering study plans, which allows us to better understand to what degree such practices increase awareness of QRPs and whether experience with preregistration helps reduce engagement in QRPs. This investigation is timely because results from these kinds of studies are only recently becoming available and the conclusions are providing evidence that open research practices can improve research quality and reliability (e.g., Soderberg et al. 2021, Chambers & Tzavella 2022). The authors crucially focused on the effect of preregistering the undergraduate senior thesis (of psychology students in the UK), which is a key stage in the development of an academic.
 
Pownall and colleagues found that preregistration did not affect attitudes toward QRPs, but it did improve student understanding of open research practices. Using exploratory analyses, they additionally found that those who preregistered were those students who reported that they had more opportunity, motivation, and greater capability. This shows how important it is to incorporate the teaching of open research practices such that students can increase their capability, motivation, and opportunity to pursue such practices, whether it is preregistration or other practices that are better known to reduce QRPs (such as registered reports; Krypotos et al. 2022). 
 
After four rounds of review and revisions, the recommender judged that the manuscript met the Stage 2 criteria and awarded a positive recommendation.
 
URL to the preregistered Stage 1 protocol: https://osf.io/9hjbw
 
Level of bias control achieved: Level 6. No part of the data or evidence that was used to answer the research question was generated until after IPA.
 
List of eligible PCI RR-friendly journals:
 
 
References
 
1. Chambers C. D. & Tzavella, L. (2022). The past, present, and future of Registered Reports. Nature Human Behaviour, 6, 29-42. https://doi.org/10.1038/s41562-021-01193-7
 
2. Krypotos, A. M., Mertens, G., Klugkist, I., & Engelhard, I. M. (2022). Preregistration: Definition, advantages, disadvantages, and how it can help against questionable research practices. In Avoiding Questionable Research Practices in Applied Psychology (pp. 343-357). Cham: Springer International Publishing.
 
3. Pownall, M., Pennington, C. R., Norris, E., Juanchich, M., Smaile, D., Russell, S., Gooch, D., Rhys Evans, T., Persson, S., Mak, M. H. C., Tzavella, L., Monk, R., Gough, T., Benwell, C. S. Y., Elsherif, M., Farran, E., Gallagher-Mitchell, T., Kendrick, L. T., Bahnmueller, J., Nordmann, E., Zaneva, M., Gilligan-Lee, K., Bazhydai, M., Jones, A., Sedgmond, J., Holzleitner, I., Reynolds, J., Moss, J., Farrelly, D., Parker, A. J. & Clark, K. (2023). Evaluating the pedagogical effectiveness of study preregistration in the undergraduate dissertation [Stage 2 Registered Report], acceptance of Version 4 by Peer Community in Registered Reports. https://psyarxiv.com/xg2ah
 
4. Soderberg C. K., Errington T. M., Schiavone S. R., Bottesini J., Thorn F. S., Vazire S., Esterling K. M. & Nosek B. A. (2021) Initial evidence of research quality of registered reports compared with the standard publishing model. Nature Human Behaviour, 5, 990–997. https://doi.org/10.1038/s41562-021-01142-4
Evaluating the Pedagogical Effectiveness of Study Preregistration in the Undergraduate DissertationMadeleine Pownall, Charlotte R. Pennington, Emma Norris, Marie Juanchich, David Smaile, Sophie Russell, Debbie Gooch, Thomas Rhys Evans, Sofia Persson, Matthew HC Mak, Loukia Tzavella, Rebecca Monk, Thomas Gough, Christopher SY Benwell, Mahmoud El...<p>Research shows that questionable research practices (QRPs) are present in undergraduate final-year dissertation projects. One entry-level Open Science practice proposed to mitigate QRPs is ‘study preregistration’, through which researchers outl...Life Sciences, Social sciencesCorina Logan2023-03-25 11:38:54 View
02 Dec 2022
STAGE 1
toto

Revisiting the link between anthropomorphism and loneliness with an extension to free will belief: Replication and extensions of Epley et al. (2008)

Are loneliness and free will beliefs associated with anthropomorphism?

Recommended by ORCID_LOGO based on reviews by John Protzko and Marieke Wieringa
Anthropomorphism is a widespread phenomenon in which people instil non-human entities or objects with human-like characteristics, such as motivations, intentions, and goals. Although common, the tendency to anthropomorphise varies between people, and a growing body of psychological research has examined the importance of various individual differences. One major theoretical account of anthropomorphism (Epley et al. 2007) suggests that sociality motivation – the drive to establish social relationships – is a key moderator of the phenomenon. In support of this account, some evidence suggests that people who experience greater loneliness (a proposed marker of sociality motivation) are more likely to anthropomorphise. In an influential series of studies, Epley et al. (2008) found that anthropomorphism and loneliness were positively correlated and that inducing participants experimentally to feel more lonely led to greater anthropomorphism. Later studies, however, produced more mixed results, particularly concerning the effectiveness of the experimental interventions.
 
In the current study, Elsherif et al. (2022) propose a partial replication of Epley et al. (2008), focusing on the correlational relationship between anthropomorphism and loneliness, with extensions to examine free will beliefs, anthropomorphism for supernatural beings (in addition to objects/gadgets), and the extent to which participants judged objects/gadgets to be controllable.
 
The Stage 1 manuscript was evaluated over two rounds of in-depth review. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
 
URL to the preregistered Stage 1 protocol: https://osf.io/by89c
 
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA. 
 
List of eligible PCI RR-friendly journals:
 
References
 
1. Epley, N., Waytz, A., & Cacioppo, J. T. (2007). On seeing human: A three-factor theory of anthropomorphism. Psychological Review, 114, 864–886. https://doi.org/10.1037/0033-295X.114.4.864 
 
2. Epley, N., Akalis, S., Waytz, A., & Cacioppo, J. T. (2008). Creating social connection through inferential reproduction: Loneliness and perceived agency in gadgets, Gods, and greyhounds. Psychological Science, 19, 114–120. https://doi.org/10.1111/j.1467-9280.2008.02056.x 
 
3. Elsherif, M., Pomareda, C., Xiao, Q., Chu, H. Y., Tang, M. C., Wong, T. H., Wu, Y. &  Feldman, G. (2022). Revisiting the positive association between loneliness and anthropomorphism with an extension to belief in free will: Replication and extensions of Epley et al. (2008), in principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/by89c
Revisiting the link between anthropomorphism and loneliness with an extension to free will belief: Replication and extensions of Epley et al. (2008)Mahmoud Elsherif, Christina Pomareda, Qinyu Xiao, Hoi Yan Chu, Ming Chun Tang, Ting Hin (Angus) Wong, Yiming Wu, Gilad Feldman<p>This is a scheduled PCI-RR snap shot for a planned project: "Revisiting the link between anthropomorphism and loneliness with an extension to free will belief: Replication and extensions of Epley et al. (2008)​"</p>Social sciencesChris Chambers2022-02-16 07:03:50 View
11 Jul 2023
STAGE 1
toto

Factors impacting effective altruism: Revisiting heuristics and biases in charity in a replication and extensions of Baron and Szymanska (2011)

Understanding biases and heuristics in charity donations

Recommended by ORCID_LOGO based on reviews by Amanda Geiser and Jonathan Berman
Decisions to give to charities are affected by numerous external and internal factors. Understanding the elements that influence donation decisions is of first-order importance for science and society. On the scientific side, understanding the determinants of charity giving contributes to the knowledge of altruistic behaviors in the presence of collective problems such as poverty, climate change, or animal welfare. On the social side, pointing out which factors affect donations can help increase pro-social behaviors and might facilitate collective actions in the case of public goods. 
 
Previous work identified multiple mechanisms affecting altruistic donations to charities (Bekkers and Weeping, 2011). Importantly, Baron and Szymanska (2011) collected empirical evidence suggesting that people prefer (i) their donations to be directly used for projects rather than organizational costs, (ii) when charities have low past costs, (iii) to diversity their donations into several NGOs, (iv) to favor charities that deal with close peers like nationals, and (v) to give voluntarily rather than through taxes. 
 
In the current study, Chan and Feldman seek to replicate the results of Baron and Szymanska (2011). They propose a close replication of the original study using a large sample of online participants (1,400 participants). In addition to the five mechanisms identified by the original study, they will further explore whether public donation increases contributions and whether individuals are more likely to donate when the charities’ overhead costs are paid for by other donors. 
 
The Stage 1 manuscript was evaluated over two rounds of in-depth review. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
 
URL to the preregistered Stage 1 protocol: https://osf.io/gmswz
 
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.
 
List of eligible PCI RR-friendly journals:
 
 
References
 
1. Baron, J. & Szymanska, E. (2011). Heuristics and Biases in Charity. In D. M. Oppenheimer & C. Y. Olivola (Eds.), The Science of Giving: Experimental Approaches to the Study of Charity (pp. 215–235). Psychology Press. 
 
2. Bekkers, R. & Wiepking, P. (2011). A Literature Review of Empirical Studies of Philanthropy. Nonprofit and Voluntary Sector Quarterly, 40, 924–973.
 
3. Chan, M. & Feldman, G. (2023). Factors impacting effective altruism: Revisiting heuristics and biases in charity in a replication and extensions Registered Report of Baron and Szymanska (2011), in principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/gmswz
Factors impacting effective altruism: Revisiting heuristics and biases in charity in a replication and extensions of Baron and Szymanska (2011)Mannix CHAN, Gilad FELDMAN<p>This is a scheduled PCI-RR snap shot for a planned project: "Factors impacting effective altruism: Revisiting heuristics and biases in charity in a replication and extensions of Baron and Szymanska (2011)​​"</p>Social sciencesRomain Espinosa2023-02-28 13:19:52 View
08 Dec 2023
STAGE 1
toto

An #EEGManyLabs study to test the role of the alpha phase on visual perception (a replication and new evidence)

Understanding the relationship between alpha oscillations and visual perception

Recommended by ORCID_LOGO based on reviews by Chris Allen, Luca Ronconi and Alexander Jones
For nearly a century, rhythmic patterns in electrical brain activity have been of major interest in neuroscience and electrophysiology, but much remains to be discovered about their causal contribution to cognition and behaviour. Low-frequency oscillations in the alpha band (~8-13 Hz) have been suggested to facilitate the organisation and delivery of visual information to higher-level systems, including those involved in perception and decision-making. If so, visual perception should also operate in cycles that are synchronous with – and determined by – the phase of ongoing low-frequency oscillatory activity.
 
In this #EEGManyLabs study, Ruzzoli et al. (2023) propose a large-scale, multi-lab investigation (9 labs; N=315 human participants) of the relationship between the phase of alpha oscillations and visual perception. The authors focus in particular on replicating a formative study by Mathewson et al. (2009) which reported that during high-amplitude alpha fluctuations, stimulus visibility depended on the time the stimulus was presented relative to the phase of the pre-stimulus alpha activity. In addition, the amplitude of visual evoked potentials recorded with EEG was larger when the target was presented at peaks in pre-stimulus alpha. To explain their findings, Mathewson proposed an influential pulsed inhibition hypothesis in which low alpha power boosts both cortical excitability and stimulus processing (and hence perception), while high alpha power makes stimulus processing dependent on the phase during the alpha cycle at which the stimulus is presented.
 
In the first of (up to) two studies, the authors will seek to directly replicate the key finding of Mathewson et al: that when alpha power is high, the oscillatory phase determines perceptual performance and event-related electrophysiological correlates in a masked visual detection task. Specifically, (a) alpha oscillations are predicted to modulate the probability of perceiving a target stimulus within a single oscillatory cycle, with detection rate associated with separated (and potentially opposite) phase angles, and (b) alpha phase at the onset of the stimulus should drive electrophysiological correlates of stimulus processing (including the amplitude and/or latency of the N1 ERP component).
 
Provided the results of this first study do not conclusively disconfirm these hypotheses, the authors will then conduct a follow-up study in which the temporal predictability of the target onset (in relation to a fixation stimulus) is reduced to test the more severe hypothesis that the observed correlations between alpha phase and perception are linked directly to ongoing oscillations, independent of temporal expectations.
 
The Stage 1 manuscript was evaluated over two rounds of in-depth review. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
 
URL to the preregistered Stage 1 protocol: https://osf.io/scqj8​ (under temporary private embargo)
 
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA. 
 
List of eligible PCI RR-friendly journals:
 
 
References
 
1. Ruzzoli, M., Cuello, M. T., Molinaro, N., Benwell, C. S. Y., Berkowitz, D., Brignani, D., Falciati, L., Harris, A. M., Keitel, C., Kopčanová, M., Madan, C. R., Mathewson, K., Mishra, S., Morucci, P., Myers, N., Nannetti, F., Nara, S., Pérez-Navarro, J., Ro, T., Schaworonkow, N., Snyder, J. S., Soto-Faraco, S., Srinivasan, N., Trübutschek, D., Zazio, A., Mushtaq, F., Pavlov, Y. G., & Veniero, D. (2023). In principle acceptance of Version 2 by Peer Community in Registered Reports. https://osf.io/scqj8​
 
2. Mathewson, K. E., Gratton, G., Fabiani, M., Beck, D. M., & Ro, T. (2009). To see or not to see: prestimulus α phase predicts visual awareness. Journal of Neuroscience, 29, 2725-2732. https://doi.org/10.1523/JNEUROSCI.3963-08.2009
An #EEGManyLabs study to test the role of the alpha phase on visual perception (a replication and new evidence)Manuela Ruzzoli, Mireia Torralba Cuello, Nicola Molinaro, Christopher S.Y. Benwell, Daniel Berkowitz, Debora Brignani, Luca Falciati, Anthony M. Harris, Christian Keitel, Martina Kopčanová, Christopher R. Madan, Kyle Mathewson, Sudhakar Mishra, Pi...<p>Several studies have suggested that low-frequency brain oscillations could be key to understanding how the brain samples sensory information via rhythmic alternation of low and high excitability periods. However, this hypothesis has recently be...Humanities, Social sciencesChris Chambers2023-08-03 12:59:33 View
07 Apr 2023
STAGE 1
toto

Psychological predictors of long-term esports success: A Registered Report

What psychological factors predict long-term success in esports?

Recommended by and ORCID_LOGO based on reviews by Justin Bonny and Maciej Behnke
Electronic sports (esports), the competitive play of video games, has seen a large surge in popularity over the past few decades. Millions of people nowadays participate in esports as a hobby, and many consider becoming professional esports athletes as a potential career path. However, psychological factors that may predict one's long-term success in esports have remained unclear.

In the current study, Martončik and colleagues (2023) propose to examine potential predictors of long-term esports success, in three currently most impactful PC esports games, namely League of Legends, Counter Strike: Global Offensive, and Fortnite. Based on an extensive review of the literature and four pilot studies, the authors will examine to what extent naive practice and deliberate practice, as well as other psychological factors such as attention, speed of decision-making, reaction time, teamwork, intelligence and persistence, can predictor player's highest rank in the past 12 months, as an indicator of long-term success. Deliberate practice has been proposed to play an essential role in the development of expertise in other domains, and the current study offers a test of the role of both naive and deliberate practice in long-term esports success. The novel measurement on naive and deliberate practice, developed as part of the current investigation, will also be a valuable contribution to future research on esports. Lastly, from an applied perspective, the results of the current study will be of great interest to individuals who are considering pursuing a professional career in esports, as well as professional and semi-professional esports teams and coaches.

This Stage 1 manuscript was evaluated over two rounds of in-depth review. Based on the comprehensive responses to the reviewers' feedback, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
 
URL to the preregistered Stage 1 protocol: https://osf.io/84zbv
 
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.
 
List of eligible PCI RR-friendly journals: 
 
References
 
Martončik, M., Karhulahti, V.-M., Jin, Y. & Adamkovič, M. (2023). Psychological predictors of long-term esports success: A Registered Report, in principle acceptance of Version 1.4 by Peer Community in Registered Reports. https://osf.io/84zbv
Psychological predictors of long-term esports success: A Registered ReportMarcel Martončik, Veli-Matti Karhulahti, Yaewon Jin, Matúš Adamkovič<p>The competitive play of digital games, esports, has attracted worldwide attention of hundreds of millions of young people. Although esports players are known to practice in similar ways to other athletes, it remains largely unknown what factors...Social sciencesZhang Chen2022-08-17 12:12:51 View
26 Feb 2024
STAGE 2
(Go to stage 1)
toto

Psychological predictors of long-term esports success: A Registered Report

Psychological predictors of long-term success in esports

Recommended by and ORCID_LOGO based on reviews by Justin Bonny and Maciej Behnke
The competitive play of digital games known as ‘esports’ has surged in popularity over the past few decades. Millions of people nowadays participate in esports as a hobby, and many consider becoming professional esports athletes as a potential career path. However, psychological factors that may predict one's long-term success in esports are not entirely clear.
 
The current Registered Report by Martončik and colleagues (2024) offered a comprehensive test of potential predictors of long-term success in the two currently most impactful PC esports games, namely League of Legends (LoL) and Counter Strike: Global Offensive (CSGO). A wide range of predictors were examined, including native and deliberate practice, attention, intelligence, reaction time, and persistence etc. In both LoL and CSGO, deliberate practice did not meaningfully predict players' highest rank in the past 12 months, as an indicator of long-term success. Younger age predicted better performance in both titles though. Lastly, two title-specific predictors emerged: in LoL, more non-deliberate practice hours predicted better performance, while in CSGO better attention predicted better performance.
 
To explain these findings, the authors proposed the information density theory. Different games differ in the amount of knowledge that is required for achieving long-term success. For information-heavy games such as LoL, naive practice hours may be more essential for players to acquire game-relevant information via playing, compared to information-light games such as CSGO. This might also explain why deliberative practice did not meaningfully predict performance in LoL and CSGO. While this theory still needs to be further tested, the current results will be useful to individuals who are considering pursuing a professional career in esports, as well as professional and semi-professional esports teams and coaches.
 
This Stage 2 manuscript was assessed over two rounds of in-depth review. The recommenders judged the responses to the reviewers' comments were satisfactory, and that the manuscript met the Stage 2 criteria for recommendation.
 
URL to the preregistered Stage 1 protocol: https://osf.io/84zbv
 
Level of bias control achieved: Level 6. No part of the data or evidence that was used to answer the research question was generated until after IPA.
 
List of eligible PCI RR-friendly journals: 
 
References
 
Martončik, M., Karhulahti, V.-M., Jin, Y. & Adamkovič, M. (2023). Psychological predictors of long-term esports success: A Registered Report [Stage 2]. Acceptance of Version 1.7 by Peer Community in Registered Reports. https://osf.io/b6vdf
Psychological predictors of long-term esports success: A Registered ReportMarcel Martončik, Veli-Matti Karhulahti, Yaewon Jin, Matúš Adamkovič<p>The competitive play of digital games, esports, has attracted worldwide attention of hundreds of millions of young people. Although esports players are known to practice in similar ways to other athletes, it remains largely unknown what factors...Social sciencesZhang Chen2023-09-26 07:15:41 View
11 Apr 2024
STAGE 1
toto

Does retrieval practice protect memory against stress? A meta-analysis [Stage 1 Registered Report]

Can retrieval practice prevent the negative impact of acute stress on memory performance?

Recommended by ORCID_LOGO based on reviews by Chris Hartgerink (they/them) and Adrien Fillon
There are a number of broad assumptions about memory which have penetrated societal understanding and mostly reflect supporting academic evidence e.g., that acute stress can compromise memory performance (Shields et al., 2017) and that practicing recalling critical information can help retain that knowledge (Moriera et al., 2019). The evidence base is less consistent when evaluating whether retrieval practice can protect against the negative effects of acute stress on memory, despite it being highly important for educators as to whether this specific strategy for supporting memorisation can be evidenced as especially effective under stressful conditions. A rigorous review of this mixed evidence base could provide the basis for developments in memory theory and research practice, with potential for direct educational applications.
 
Meta-analyses can play a critical role in furthering our understanding of complex cognitive mechanisms where the evidence base includes a wide range of methods, factors and effect size estimates. Furthermore, there is a lack of rigorous meta-analyses that prioritise open and reproducible processes (Topor et al., 2022) which help role-model good practice. In the current Registered Report, Mihaylova et al. (2024) have proposed a rigorous meta-analysis to systematically review and synthesise the evidence on the effects of retrieval practice for memory performance under acute stress. The work looks to be especially valuable for a) informing future research directions through a structured risk of bias evaluation, and b) generating theoretical developments through a range of confirmatory moderators (including stressor types, memory strategies, time of delay and task type). The findings of the planned analyses are expected to be of immediate interest to educational and occupational domains where memory recall is a priority.
 
The Stage 1 manuscript was evaluated over two rounds of in-depth review. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
 
URL to the preregistered Stage 1 protocol: https://osf.io/pkrzb
 
Level of bias control achieved: Level 3. At least some data/evidence that will be used to the answer the research question has been previously accessed by the authors (e.g. downloaded or otherwise received), but the authors certify that they have not yet observed ANY part of the data/evidence.
 
List of eligible PCI RR-friendly journals:
 
 
References
 
1. Mihaylova, M., Kliegel, M, & Rothen, N. (2024). Does retrieval practice protect memory against stress? A meta-analysis. In principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/pkrzb
 
2. Moreira, B. F. T., Pinto, T. S. S., Starling, D. S. V., & Jaeger, A. (2019). Retrieval practice in classroom settings: A review of applied research. In Frontiers in Education (Vol. 4, p. 5). Frontiers Media SA. https://doi.org/10.3389/feduc.2019.00005 
 
3. Shields, G. S., Sazma, M. A., McCullough, A. M., & Yonelinas, A. P. (2017). The effects of acute stress on episodic memory: A meta-analysis and integrative review. Psychological Bulletin, 143, 636–675. https://doi.org/10.1037/bul0000100 
 
4. Topor, M. K., Pickering, J. S., Mendes, A. B., Bishop, D., Büttner, F., Elsherif, M. M., ... & Westwood, S. (2022). An integrative framework for planning and conducting Non-Intervention, Reproducible, and Open Systematic Reviews (NIRO-SR). Meta-Psychology. https://osf.io/preprints/metaarxiv/8gu5z
Does retrieval practice protect memory against stress? A meta-analysis [Stage 1 Registered Report]Mariela Mihaylova, Matthias Kliegel, Nicolas Rothen<p>[Note: This is a Stage 1 Registered Report. All placeholders will be replaced with actual results by Stage 2.]</p> <p><br>Stressors such as test anxiety (TA) are known to decrease memory retrieval, whereas retrieval practice (RP) is the phenom...Humanities, Social sciencesThomas Evans2023-02-16 14:39:06 View
05 Aug 2022
STAGE 1
toto

Through the lens of Developmental Coordination Disorder (DCD): experiences of a late diagnosis

Developmental Coordination Disorder Diagnosis as Part of Evolving Self-Concepts

Recommended by ORCID_LOGO based on reviews by Moin Syed, Gill Waters and Catherine Purcell
Although developmental coordination disorder (DCD) is a common neurodevelopmental disorder with an estimated prevalence of up to 6% in children (APA, 2013), many DCD diagnoses are not made before late adulthood. Receiving a neurodevelopmental disorder diagnosis has been found adding to people’s self-concepts, for instance, with autism spectrum disorder (Tan, 2018), but it is not well known if and how such events unfold in late DCD diagnoses. In this Stage 1 Registered Report, Topor et al. (2022) present a careful plan to qualitatively investigate the lived experiences of individuals with a late DCD diagnosis in order to map out the variety of emotional responses to diagnoses and their effects on self-concepts.

Topor et al. (2022) will carry out 10–15 semi-structured interviews with participants who received a DCD diagnosis at the age of 30 or after. They commit to realist epistemology when utilizing thematic analysis; namely, instructions have been preregistered for two separate analysts who will code the transcript data independently. At the same time, the methodology involves reflexive components. The authors have prepared strong positionality statements through which their analyses will be carried out with post-analysis reflections to be written at Stage 2. The coding process will explicitly involve a data analysis log that pursues interpretive transparency. The data and materials will be shared, which adds to the work's value in the context of open qualitative psychology in general.   
 
The study will help us better understand the process of receiving (late) DCD diagnoses and, specifically, how the emotional aftermath is potentially related to one’s evolving self-concept. In addition to making a clear contribution to cumulative scientific knowledge, the findings can be useful for professionals working with DCD-diagnosed individuals as well as for the development of related support services. The Registered Report format allowed the research design to be reviewed in three rounds before data collection. Initially, three experts representing developmental psychology and DCD reviewed the Stage 1 manuscript, after which the recommender carried out two iterations with further requested revisions. This was followed by in-principle acceptance.
 
URL to the preregistered Stage 1 protocol: https://osf.io/67h3f
 
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA. 
 
List of eligible PCI RR-friendly journals:
 
 
References
 
1. APA (2013) Diagnostic and statistical manual of mental disorders, 5th ed, American Psychiatric Association, Washington, DC.

2. Tan, C. D. (2018). “I'm a normal autistic person, not an abnormal neurotypical”: Autism Spectrum Disorder diagnosis as biographical illumination.” Social Science & Medicine, 197, 161-167.
 
3. Topor, M., Armstrong, G., Gentle, J. (2022). Through the lens of Developmental Coordination Disorder (DCD): experiences of a late diagnosis, in principle acceptance of Version 4 by Peer Community in Registered Reports. https://osf.io/67h3f
Through the lens of Developmental Coordination Disorder (DCD): experiences of a late diagnosisMarta Topor, Gemma Armstrong, Judith Gentle<p>A late diagnosis of a lifelong neurodevelopmental condition has been shown to be an important life event with strong emotional consequences and deep personal reflections. &nbsp; Developmental Coordination Disorder (DCD/Dyspraxia) is a common, y...Medical Sciences, Social sciencesVeli-Matti Karhulahti2022-01-11 21:48:18 View
18 May 2023
STAGE 1
toto

A multilab investigation into the N2pc as an indicator of attentional selectivity: Direct replication of Eimer (1996)

Is the N2pc a correlate of attentional selection? An #EEGManyLabs multi-lab registered replication of Eimer (1996)

Recommended by ORCID_LOGO based on reviews by Reny Baykova and Clayton Hickey
The N2pc is a lateralised ERP component that is often interpreted as a marker of attentional allocation, so much so that it is frequently used a tool in the attention literature for inferring that a stimulus was attentionally processed. This interpretation of N2pc can be traced back to the seminal work of Eimer (1996), which has been conceptually replicated many times but has never been replicated directly.
 
This registered direct replication by Constant et al. (2023) forms part of a larger series of large-scale, multi-lab replications of highly influential EEG papers by the #EEGManyLabs project (Pavlov et al., 2021). Seven labs (with the potential for more to sign up later), will conduct high-powered replications of the critical Experiment 2 of Eimer (1996), where in the crucial conditions, participants discriminate a target letter (M vs W) or colour (blue vs green) in the presence of a distractor. Using four preprocessing pipelines, including the original, the authors will test whether the N2pc is observed over parieto-occipital electrodes contralateral to target presentation.  
 
The Stage 1 manuscript was evaluated over one round of in-depth review and one additional round of minor corrections. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
 
URL to the preregistered Stage 1 protocol: https://osf.io/dw68r
 
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA (so-called “primary RR”)
 
List of eligible PCI RR-friendly journals:
 
 
References
 
1. Constant, M., Mandal, A., Asanowicz, D., Yamaguchi, M., Gillmeister, H., Kerzel, D., Luque, D., Pesciarelli, F., Fehr, T., Mushtaq, F., Pavlov, Y. G. & Liesefeld, H. R. (2023). A multilab investigation into the N2pc as an indicator of attentional selectivity: Direct replication of Eimer (1996), in principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/dw68r
 
2. Eimer, M. (1996). The N2pc component as an indicator of attentional selectivity. Electroencephalography and Clinical Neurophysiology, 99, 225-234. https://doi.org/10.1016/0013-4694(96)95711-9
 
3. Pavlov, Y. G., Adamian, N., Appelhoff, S., Arvaneh, M., Benwell, C. S., Beste, C., ... & Mushtaq, F. (2021). #EEGManyLabs: Investigating the replicability of influential EEG experiments. Cortex, 144, 213-229. https://doi.org/10.1016/j.cortex.2021.03.013
A multilab investigation into the N2pc as an indicator of attentional selectivity: Direct replication of Eimer (1996)Martin Constant, Ananya Mandal, Dariusz Asanowicz, Motonori Yamaguchi, Helge Gillmeister, Dirk Kerzel, David Luque, Francesca Pesciarelli, Thorsten Fehr, Faisal Mushtaq, Yuri G. Pavlov, Heinrich R. Liesefeld<p>The N2pc is widely employed as an electrophysiological marker of an attention allocation. This interpretation was in no small part driven by the observation of an N2pc elicited by an isolated relevant target object, which was reported as Experi...Life Sciences, Social sciencesMaxine Sherman2023-02-24 11:41:52 View