Please note that we will be CLOSED to ALL SUBMISSIONS from 1 December 2024 through 12 January 2025 to give our recommenders and reviewers a holiday break.
We are recruiting recommenders (editors) from all research fields!
Your feedback matters! If you have authored or reviewed a Registered Report at Peer Community in Registered Reports, then please take 5 minutes to leave anonymous feedback about your experience, and view community ratings.
Latest recommendations
| Id | Title * | Authors * | Abstract * ▲ | Picture | Thematic fields * | Recommender | Reviewers | Submission date | |
|---|---|---|---|---|---|---|---|---|---|
Genetically-modified animals as models of neurodevelopmental conditions: a review of systematic review reporting qualityEvidence for mixed quality of systematic reviews in preclinical animal studies of neurodevelopmental conditionsRecommended by Chris Chambers based on reviews by Marietta Papadatou-Pastou
Single gene alterations have been estimated to account for nearly half of neurodevelopmental conditions (NDCs), providing a crucial opportunity for animal models to understand the underlying mechanisms, causes and potential treatments. The use of systematic reviews (SRs) can, in principle, provide a powerful means to synthesise this evidence-base; however, the reporting quality of previous SRs in preclinical animal research has been found lacking (Hunniford et al., 2021). In the current study, Wilson et al. (2023) will undertook a review of systematic reviews to assess the characteristics and reporting quality of SRs that, in turn, synthesise research in genetically-modified animals to model NDCs. In particular, the authors extracted key features of reviews (including, among others, the aim and primary research questions, relevant animal model, and number of studies in the SR), in addition to quality indicators such as risk of bias and completeness of reporting. In doing so, the authors aimed to enhance guidance on the conduct and reporting of systematic reviews in this area.
Of twelve publications that met the preregistered search criteria, the completeness and quality of reporting was variable. Among the better reported characteristics were search strategies (9 of 12 articles), reporting of funding sources (10 of 12 articles) and use of animal data (11 of 12 articles). In contrast, only two articles reported whether the study protocol was preregistered, only three articles reported methods for assessing risk of bias, and just one included methods to analyse publication bias. In addition, the authors identified 19 review registrations via PROSPERO, most of which remained unpublished after their anticipated end dates. Overall, the results highlight the importance of adherence to reporting guidelines for increasing the transparency and reproducibility of SRs in this field.
The Stage 2 manuscript was evaluated over one round of in-depth review. Based on detailed responses by the authors, the recommender judged that the manuscript met the Stage 2 criteria and awarded a positive recommendation.
URL to the preregistered Stage 1 protocol: https://osf.io/952qk Level of bias control achieved: Level 4. At least some of the data/evidence that was used to answer the research question already existed prior to IPA and was accessible in principle to the authors, but the authors certify that they did not access any part of that data/evidence prior to IPA.
List of eligible PCI RR-friendly journals: References
1. Hunniford V. T., Montroy J., Fergusson D. A., Avey M. T., Wever K. E., McCann S. K., Foster M., Fox G., Lafreniere M., Ghaly M., Mannell S., Godwinska K., Gentles A., Selim S., MacNeil J., Sikora L., Sena E. S., Page M. J., Macleod M., Moher D., & Lalu M. M. (2021). Epidemiology and reporting characteristics of preclinical systematic reviews. PLOS Biology, 19:e3001177. https://doi.org/10.1371/journal.pbio.3001177
2. Wilson, E., Currie, G., Macleod, M., Kind, P. & Sena, E. S. (2023). Genetically-modified animals as models of neurodevelopmental conditions: a review of systematic review reporting quality [Stage 2]. Acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/s5xd4
| Genetically-modified animals as models of neurodevelopmental conditions: a review of systematic review reporting quality | Emma Wilson, Gillian Currie, Malcolm Macleod, Peter Kind, and Emily S Sena | <p><strong>Objective</strong><br>Using genetically-modified animals to model neurodevelopmental conditions (NDCs) helps better our understanding of biology underlying these conditions. Animal research has unique characteristics not shared with cli... | Medical Sciences | Chris Chambers | 2023-11-22 10:26:44 | |||
23 Jan 2023
STAGE 1
Genetically-modified animals as models of neurodevelopmental conditions: an umbrella reviewEvaluating the quality of systematic reviews in preclinical animal studies of neurodevelopmental conditionsRecommended by Chris Chambers based on reviews by Marietta Papadatou-Pastou and Richel Bilderbeek
Single gene alterations have been estimated to account for nearly half of neurodevelopmental conditions (NDCs), providing a crucial opportunity for animal models to understand the underlying mechanisms, causes and potential treatments. The use of systematic reviews (SRs) can, in principle, provide a powerful means to synthesise this evidence-base; however, the reporting quality of previous SRs in preclinical animal research has been found lacking (Hunniford et al., 2021). In the current study, Wilson et al. (2023) will undertake an umbrella review – a systematic review of systematic reviews – to assess the characteristics and reporting quality of SRs that, in turn, synthesise research in genetically-modified animals to model NDCs. In particular, the authors will extract key features of reviews (including, among others, the aim and primary research questions, relevant animal model, and number of studies in the SR), in addition to quality indicators such as risk of bias and completeness of reporting. In doing so, the authors aim to enhance guidance on the conduct and reporting of systematic reviews in this area.
The Stage 1 manuscript was evaluated over two rounds of in-depth review. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
URL to the preregistered Stage 1 protocol: https://osf.io/952qk Level of bias control achieved: Level 4. At least some of the data/evidence that will be used to answer the research question already exists AND is accessible in principle to the authors BUT the authors certify that they have not yet accessed any part of that data/evidence.
List of eligible PCI RR-friendly journals:
References
1. Hunniford V. T., Montroy J., Fergusson D. A., Avey M. T., Wever K. E., McCann S. K., Foster M., Fox G., Lafreniere M., Ghaly M., Mannell S., Godwinska K., Gentles A., Selim S., MacNeil J., Sikora L., Sena E. S., Page M. J., Macleod M., Moher D., & Lalu M. M. (2021). Epidemiology and reporting characteristics of preclinical systematic reviews. PLOS Biology, 19:e3001177. https://doi.org/10.1371/journal.pbio.3001177
2. Wilson, E., Currie, G., Macleod, M., Kind, P. & Sena, E. S. (2023). Genetically-modified animals as models of neurodevelopmental conditions: an umbrella review, in principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/952qk
| Genetically-modified animals as models of neurodevelopmental conditions: an umbrella review | Emma Wilson; Gillian Currie; Malcolm Macleod; Peter Kind; Emily S Sena | <p><strong>Objective</strong><br>Using genetically-modified animals to model neurodevelopmental conditions (NDCs) helps better our understanding of their underlying biology. In vivo research has unique characteristics not shared with clinical rese... | Life Sciences | Chris Chambers | 2022-08-29 12:08:51 | |||
07 Dec 2023
STAGE 1
Investigating individual differences in linguistic statistical learning and their relation to rhythmic and cognitive abilities: A speech segmentation experiment with online neural trackingIndividual differences in linguistic statistical learning and the relationship to rhythm perceptionRecommended by Elizabeth Wonnacott based on reviews by 2 anonymous reviewers
Previous research has demonstrated that experimental participants – both adults and infants – can track syllable co-occurrences in an artificial speech stream. This statistical learning (SL) is thought to support word segmentation and to be a core component of language acquisition. There is also some evidence that SL, as measured through artificial language tasks, is related to individual differences in language learning. What is not well understood is the underpinnings of individual differences in SL. In the current study, van der Wulp et al. (2023) will investigate the relationship between auditory SL and musical – specifically rhythmic – abilities. This work takes advantage of recent methodological innovations which allow online assessment of SL via electroencephalography (EEG) measures of neural entrainment. Up to N=105 participants will be recruited (using a well specified optional stopping procedure) and will be exposed to an artificial language using this EEG method to measure their response to the language through the exposure phase. In addition, post-tests will assess participants’ learning of the artificial language using behavioural tasks, as well as their abilities in a battery of tasks measuring rhythmic, musical, and cognitive abilities, and their vocabulary size. Core analyses will investigate whether the neural signature of statistical learning is found at a group level (i.e. replicating previous work) and whether at the individual level this is related to rhythm perception. Bayes factors will be used to assess the extent of evidence for these hypothesized relationships over the null. Exploratory analyses will explore other relationships, including with working memory and vocabulary size.
The topic of individual differences in language learning and is important, but work in this area is often underpowered, and the correlational nature of the research makes it vulnerable to HARKing. In this context, the current RR looks set to make an important contribution. The Stage 1 manuscript was evaluated over two rounds of in-depth review by the recommender and two expert reviewers, and one additional round of review by the recommender, before issuing in-principle acceptance.
URL to the preregistered Stage 1 protocol: https://osf.io/2y6sx
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA. List of eligible PCI RR-friendly journals: References
1. van der Wulp, I. M., Struiksma, M. E., Batterink, L. J., & Wijnen, F. N. K. (2023). Investigating individual differences in linguistic statistical learning and their relation to rhythmic and cognitive abilities: A speech segmentation experiment with online neural tracking. In principle acceptance of Version 4 by Peer Community in Registered Reports. https://osf.io/2y6sx | Investigating individual differences in linguistic statistical learning and their relation to rhythmic and cognitive abilities: A speech segmentation experiment with online neural tracking | Iris van der Wulp, Marijn Struiksma, Laura Batterink, Frank Wijnen | <p><strong>Objective:</strong> Statistical Learning (SL) is an essential mechanism for speech segmentation. Importantly, individual differences in SL ability are associated with language acquisition. For instance, better SL correlated with a large... | Humanities, Social sciences | Elizabeth Wonnacott | 2023-05-03 10:53:51 | |||
Functional MRI brain state occupancy in the presence of cerebral small vessel disease -- a pre-registered replication analysis of the Hamburg City Health StudyReplicable dynamic functional connectivity and cognitive correlates of cerebral small vessel disease in the Hamburg City Health StudyRecommended by Robert McIntosh based on reviews by 1 anonymous reviewer
In a previous analysis of data from 988 participants in the Hamburg City Health Study (HCHS), Schlemm and colleagues (2022) reported significant associations between the extent of cerebral small vessel disease (cSVD) and dynamic functional connectivity measures from resting state fMRI. Specifically, the volume of white matter hyperintensities of presumed vascular origin, a structural indicator of cSVD, was negatively related to the proportion of time (‘fractional occupancy’) spent in the two most occupied functional brain states. Reduced fractional occupancy was also associated with longer times to complete part B of the Trail Making Test.
In the present Registered Report, Ingwersen and colleagues (2023) successfully replicated these associations between structural, functional and cognitive measures in a sample of 1651 HCHS participants not included in the earlier study. An exploratory multiverse analysis found that the associations were generally robust to different brain parcellation and confound regression strategies. These replicable patterns reinforce the idea that cSVD may disrupt the brain’s ability to enter and maintain distinct functional modes, and that these changes in functional dynamics are predictive of cognitive impairment.
The Stage 2 manuscript was assessed over one round of in-depth review. The recommender judged that responses to reviewer comments were appropriate, and that the manuscript met the Stage 2 criteria for recommendation.
URL to the preregistered Stage 1 protocol: https://osf.io/9yhzc
Level of bias control achieved: Level 2. At least some data/evidence that was used to answer the research question had been accessed and partially observed by the authors prior to Stage 1 in-principle acceptance, but the authors certify that they had not yet observed the key variables within the data that were used to answer the research question AND they took additional steps to maximise bias control and rigour. List of eligible PCI RR-friendly journals:
References
1. Schlemm, E., Frey, B. M., Mayer, C., Petersen, M., Fiehler, J., Hanning, U., Kühn, S., Twerenbold, R., Gallinat, J., Gerloff, C., Thomalla, G. & Cheng, B. (2022). Equalization of brain state occupancy accompanies cognitive impairment in cerebral small vessel disease. Biological Psychiatry, 92, 592-602. https://doi.org/10.1016/j.biopsych.2022.03.019
2. Ingwersen, T., Mayer, C., Petersen, M., Frey, B. M., Fiehler, J., Hanning, U., Kühn, S., Gallinat, J., Twerenbold, R., Gerloff, C., Cheng, B., Thomalla, G. & Schlemm, E. (2023). Functional MRI brain state occupancy in the presence of cerebral small vessel disease -- a pre-registered replication analysis of the Hamburg City Health Study. Acceptance of Version 2.01 by Peer Community in Registered Reports. https://github.com/csi-hamburg/HCHS-brain-states-RR/blob/f9d00adbbcf9593d8d191bf5b93912141b80ab1b/manuscript/build/main.pdf
| Functional MRI brain state occupancy in the presence of cerebral small vessel disease -- a pre-registered replication analysis of the Hamburg City Health Study | Thies Ingwersen, Carola Mayer, Marvin Petersen, Benedikt M. Frey, Jens Fiehler, Uta Hanning, Simone Kühn, Jürgen Gallinat, Raphael Twerenbold, Christian Gerloff, Bastian Cheng, Götz Thomalla, Eckhard Schlemm, | <p><strong>Objective</strong>: To replicate recent findings on the association between the extent of cerebral small vessel disease (cSVD), functional brain network dedifferentiation, and cognitive impairment.</p> <p><strong>Methods:</strong> We a... | Life Sciences, Medical Sciences | Robert McIntosh | 2023-10-17 09:53:02 | |||
07 Apr 2023
STAGE 1
The WEIRD problem in a “non-WEIRD” context: A meta-research on the representativeness of human subjects in Chinese psychological researchHow well do "non-WEIRD" participants in multi-lab studies represent their local population?Recommended by Yuki Yamada based on reviews by Zoltan Dienes, Patrick Forscher and Kai Hiraishi
In this protocol, Yue et al. (2023) aim to clarify whether the sample of non-WEIRD countries included in multi-lab studies is actually representative of those countries and cultures. Focusing on China, this study will compare Chinese samples in several multi-lab studies with participants in studies published in leading national Chinese journals on various aspects, including demographic data and geographic information. This work will provide useful information on the extent to which multi-lab studies are able to deal with generalizability, especially as they intend to address the generalizability problem.
The Stage 1 manuscript was reviewed by three experts, including two with an interest in the WEIRD problem and a wealth of experience in open science and multi-lab research, plus an expert in Bayesian statistics, which this manuscript uses. Following multilpe rounds of peer review, and based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
URL to the preregistered Stage 1 protocol: https://osf.io/ehw54 Level of bias control achieved: Level 4. At least some of the data/evidence that will be used to answer the research question already exists AND is accessible in principle to the authors (e.g. residing in a public database or with a colleague) BUT the authors certify that they have not yet accessed any part of that data/evidence.
List of eligible PCI RR-friendly journals:
References
Yue, L., Zuo, X.-N., & Hu, C.-P. (2023) The WEIRD problem in a “non-WEIRD” context: A meta-research on the representativeness of human subjects in Chinese psychological research, in principle acceptance of Version 7 by Peer Community in Registered Reports. https://osf.io/ehw54 | The WEIRD problem in a “non-WEIRD” context: A meta-research on the representativeness of human subjects in Chinese psychological research | YUE Lei, ZUO Xi-Nian, HU Chuan-Peng | <p><strong></strong><strong>Psychological science aims at understanding human mind and behavior, but it primarily relies on subjects from Western, Educated, Industrialized, Rich, and Democratic regions, i.e., the WEIRD problem. This lack of d... | Social sciences | Yuki Yamada | Zoltan Dienes | 2021-09-07 11:25:52 | ||
Cue-based modulation of pain stimulus expectation: do ongoing oscillations reflect changes in pain perception? A Registered ReportUnderstanding oscillatory correlates of pain expectationRecommended by Gemma Learmonth based on reviews by Zoltan Dienes, Chris Chambers and Markus Ploner
Recent studies using an EEG frequency tagging approach have reported modulations of alpha, beta and theta bands at the stimulation frequency during nociceptive/painful thermal stimulation compared to non-nociceptive/non-painful vibrotactile stimulation. Prior expectations of the intensity of upcoming painful stimuli are known to strongly modulate the subjective experience of those stimuli. Thus, modulating the expectation of pain should result in a change in the modulation of oscillations if these factors are indeed linked.
In this study, Leu, Glineur and Liberati modulated expectations of pain (low or high intensity) in 40 participants prior to delivering thermal cutaneous stimulation (low, medium or high intensity). They recorded how intense participants expected the pain to be, and how intense they felt it to be, as well as EEG to assess oscillatory differences across the expectation and intensity conditions.
The results confirmed that there was a strong effect of expectation on the perceived stimulus intensity. However, contrary to the hypotheses, this was not reflected in the cortical oscillations. Overall this indicates a possible dissociation between perceived pain and modulation of ongoing oscillations in the theta, alpha and beta bands.
The Stage 2 manuscript was evaluated over one round of in-depth review. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 2 criteria and awarded a positive recommendation.
URL to the preregistered Stage 1 protocol: https://osf.io/y6fb8
Level of bias control achieved: Level 6. No part of the data or evidence that was used to answer the research question was generated until after IPA. List of eligible PCI RR-friendly journals: References
1. Leu, C., Glineur, E. & Liberati, G. (2023). Cue-based modulation of pain stimulus expectation: do ongoing oscillations reflect changes in pain perception? [Stage 2] Acceptance of Version 2 by Peer Community in Registered Reports. https://osf.io/awrge | Cue-based modulation of pain stimulus expectation: do ongoing oscillations reflect changes in pain perception? A Registered Report | Chiara Leu, Esther Glineur, Giulia Liberati | <p style="text-align: justify;">A promising stream of investigations is targeting ongoing neural oscillations and whether their modulation could be related to the perception of pain. Using an electroencephalography (EEG) frequency tagging approach... | Life Sciences, Medical Sciences | Gemma Learmonth | 2024-01-23 19:35:39 | |||
17 Jan 2022
STAGE 1
Identifying Gaming Disorders by Ontology: A Nationally Representative Registered ReportDo different screening instruments for ‘gaming disorder’ measure the same or different construct(s)?Recommended by Charlotte Pennington based on reviews by Daniel Dunleavy, Linda Kaye, David Ellis and 1 anonymous reviewer
There is considerable debate regarding the relationship between excessive gaming and mental health problems. Whilst the diagnostic classification of “gaming disorder” has now been included in the WHO’s International Classification of Diseases (ICD-11), the APA decided not to include this diagnosis in their Diagnostic and Statistical Manual of Mental Disorders (DSM-5) because the literature “suffers from a lack of a standard definition from which to derive prevalence data” (APA 2013, p. 796). Furthermore, screening instruments that aim to provide diagnostic classifications derive from different ontologies and it is not known whether they identify equivalent prevalence rates of ‘gaming disorder’ or even the same individuals. In this Stage 1 Registered Report, Karhulahti et al. (2022) aim to assess how screening instruments that derive from different ontologies differ in identifying associated problem groups. A nationally representative sample of 8000 Finnish individuals will complete four screening measures to assess the degree of overlap between identified prevalence (how many?), who they identify (what characteristics?) and the health of their identified groups (how healthy?). If these four ontologically diverse instruments operate similarly, this will support the notion of a single “gaming disorder” construct. If, however, the instruments operate differently, this will suggest that efforts should be directed toward assessing the clinical (ir)relevance of multiple constructs. This rigorous study will therefore have important implications for the conceptualisation and measurement of “gaming disorder”, contributing to the debate around the mixed findings of gaming-related health problems. Four expert reviewers with field expertise assessed the Stage 1 manuscript over three rounds of in-depth review. Based on detailed and informed responses to the reviewers' comments, the recommender decided that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA). URL to the preregistered Stage 1 protocol: https://osf.io/usj5b Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA. List of eligible PCI RR-friendly journals:
References
| Identifying Gaming Disorders by Ontology: A Nationally Representative Registered Report | Veli-Matti Karhulahti, Jukka Vahlo, Marcel Martončik, Matti Munukka, Raine Koskimaa, Mikaela von Bonsdorff | <p style="text-align: justify;">Gaming-related health problems have been researched since the 1980s with numerous different “ontologies” as reference systems, from self-assessed “game addiction” to “pathological gambling” (in the DSM-IV), “interne... | | Medical Sciences, Social sciences | Charlotte Pennington | 2021-08-25 23:08:26 | ||
21 Feb 2022
STAGE 1
Recommended by Benoit Pujol based on reviews by Jean-François Gerard, Rachel Harrison and 1 anonymous reviewer
This submission has been withdrawn (see notice below)Sex-biased dispersal is widely acknowledged to influence range expansion and the geographic limits of species (Trochet et al. 2016). Evidence is accruing that suggests an impact of the learning ability of species on their capacity to colonise new habitats because the ability to learn provides an advantage when confronted to novel challenges (Lee and Thornton 2021). Whether these two mechanisms interact to shape range expansion remains however unknown. One could expect this interaction because both dispersal and the ability to learn are linked to related behaviours (e.g., exploration, Lee and Thornton 2021). In their study entitled “Investigating sex differences in learning in a range-expanding bird”, Alexis J. Breen and Dominik Deffner (Breen and Deffner 2022) propose to test this hypothesis in range-expanding great-tailed grackles (Quiscalus mexicanus) by exploring the individual variation of several behavioural traits (e.g., exploration, neophobia, problem solving, Logan 2016) linked to their learning ability. They will use a colour-reward reinforcement experimental approach to compare the learning performance between male and female great-tailed grackles in three study sites and evaluate whether sex-biased learning ability interacts with sex-biased dispersal. Data will be analysed by a Bayesian reinforcement learning model (Deffner et al. 2020), which was validated. This Stage 1 registered report was evaluated over one round of in-depth review by Jean-François Gerard, Rachel Harrison and one anonymous reviewer, and another round of review by Jean-François Gerard and Rachel Harrison. Based on detailed responses to the comments and the modifications brought to the manuscript by the authors, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA). Withdrawal notice: The Stage 2 manuscript associated with this accepted Stage 1 protocol was submitted to PCI RR on 22 July 2022. On 25 July 2022, the Managing Board offered the opportunity for the authors to revise the manuscript prior to in-depth review. On 7 Sep 2022, the authors withdrew the Stage 2 manuscript from consideration due to time constraints.URL to the preregistered Stage 1 protocol: https://osf.io/v3wxb
Level of bias control achieved: Level 2. At least some data/evidence that will be used to answer the research question has been accessed and partially observed by the authors, but the authors certify that they have not yet observed the key variables within the data that will be used to answer the research question AND they have taken additional steps to maximise bias control and rigour.
List of eligible PCI RR-friendly journals:
References Trochet, A., Courtois, E. A., Stevens, V. M., Baguette, M., Chaine, A., Schmeller, D. S., Clobert, J., & Wiens, J. J. (2016). Evolution of sex-biased dispersal. The Quarterly Review of Biology, 91(3), 297–320. https://doi.org/10.1086/688097 Lee, V. E., & Thornton, A. (2021). Animal cognition in an urbanised world. Frontiers in Ecology and Evolution, 9, 120. https://doi.org/10.3389/fevo.2021.633947 Logan, C. J. (2016b). Behavioral flexibility in an invasive bird is independent of other behaviors. PeerJ, 4, e2215. https://doi.org/10.7717/peerj.2215 Deffner, D., Kleinow, V., & McElreath, R. (2020). Dynamic social learning in temporally and spatially variable environments. Royal Society Open Science, 7(12), 200734. https://doi.org/10.1098/rsos.200734 Breen, A. J. & Deffner D. (2022). Investigating sex differences in learning in a range-expanding bird., https://github.com/alexisbreen/Sex-differences-in-grackles-learning, in principle acceptance of version 2 by Peer Community in Registered Reports. https://osf.io/v3wxb | [WITHDRAWN]: Investigating sex differences in learning in a range-expanding bird | Alexis J. Breen & Dominik Deffner | <p style="text-align: justify;">How might differences in dispersal and learning interact in range expansion dynamics? To begin to answer this question, in this preregistration we detail the background, hypothesis plus associated predictions, and m... | | Life Sciences | Benoit Pujol | Rachel Harrison, Kate Cross, Jean-François Gerard | 2021-11-10 13:12:04 | |
29 Sep 2021
STAGE 1
Evaluating the pedagogical effectiveness of study preregistration in the undergraduate dissertation: A Registered ReportDoes incorporating open research practices into the undergraduate curriculum decrease questionable research practices?Recommended by Corina Logan and Chris Chambers based on reviews by Kelsey McCune, Neil Lewis, Jr., Lisa Spitzer and 1 anonymous reviewer
In a time when open research practices are becoming more widely used to combat questionable research practices (QRPs) in academia, this Stage 1 Registered Report by Pownall and colleagues (2021) will empirically investigate the practice of preregistering study plans, which will allow us to better understand to what degree such practices increase awareness of QRPs and whether experience with preregistration helps reduce engagement in QRPs. This investigation is timely because results from these kinds of studies are only recently becoming available and the conclusions are providing evidence that open research practices can improve research quality and reliability (e.g., Soderberg et al. 2020, Chambers & Tzavella 2021). The authors crucially focus on the effect of preregistering the undergraduate senior thesis (of psychology students in the UK), which is a key stage in the development of an academic. This data will help shape the future of how we should teach open research practices and what effect we as teachers can have on budding research careers. The five expert peer reviews were of an extremely high quality and were very thorough. The authors did an excellent job of addressing all of the comments in their responses and revised manuscript versions, which resulted in only one round of peer review, plus a second revision based on Recommender feedback. As such, this registered report meets the Stage 1 criteria and is therefore awarded in-principle acceptance (IPA). We wish the authors the best of luck with the study and we look forward to seeing the results. URL to the preregistered Stage 1 protocol: https://osf.io/9hjbw Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA. List of eligible PCI RR-friendly journals:
References
| Evaluating the pedagogical effectiveness of study preregistration in the undergraduate dissertation: A Registered Report | Madeleine Pownall; Charlotte R. Pennington; Emma Norris; Kait Clark | <p style="text-align: justify;">Research shows that questionable research practices (QRPs) are present in undergraduate final-year dissertation projects. One entry-level Open Science practice proposed to mitigate QRPs is ‘study preregistration’, t... | Life Sciences, Social sciences | Corina Logan | 2021-07-08 15:27:24 | |||
08 Sep 2023
STAGE 1
Evaluation of spatial learning and wayfinding in a complex maze using immersive virtual reality. A registered reportEvaluation of an immersive virtual reality wayfinding taskRecommended by Robert McIntosh based on reviews by Conor Thornberry, Gavin Buckingham and 1 anonymous reviewer
The Virtual Maze Task (VMT) is a digital desktop 2D spatial learning task that has been used for research into the effect of sleep and dreaming on memory consolidation (e.g. Wamsley et al, 2010). One limitation of this task has been low rates of reported dream incorporation. Eudave and colleagues (2023) have created an immersive virtual reality (iVR) version of the VMT, which they believe might be more likely to be incorporated into dreams. As an initial step in validating this task for research, they propose a within-subjects study to compare three measures of spatial learning between the 2D desktop and iVR versions. Based on a review of relevant literature, the prediction is that performance will be similar between the two task versions. The planned sample size (n = 62) is sufficient for a .9 power test of equivalence within effect size bounds of d = -.47 to .47. Additional independent variables (gender, perspective-taking ability) and dependent measures (self-reported cybersickness and sense of presence) will be recorded for exploratory analyses.
The study plan was refined across four rounds of review, with input from two external reviewers and the recommender, after which it was judged to satisfy the Stage 1 criteria for in-principle acceptance (IPA).†
URL to the preregistered Stage 1 protocol: https://osf.io/wba2v
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA. List of eligible PCI RR-friendly journals:
References
Eudave, L., Martínez, M., Valencia, M., & Roth D. (2023). Evaluation of spatial learning and wayfinding in a complex maze using immersive virtual reality. A registered report. In principle acceptance of Version 5 by Peer Community in Registered Reports.
Wamsley, E. J., Tucker, M., Payne, J. D., Benavides, J. A., & Stickgold, R. (2010). Dreaming of a learning task is associated with enhanced sleep-dependent memory consolidation. Current Biology, 20, 850–855. https://doi.org/10.1016/j.cub.2010.03.027
† There is one minor change that the authors should make to the Methods section, which is sufficiently small that it can be incorporated at Stage 2: "if both tests reject the null hypothesis (observed data is less/greater than the lower/upper equivalence bounds), conditions are considered statistically equivalent" >> suggest changing "less/greater" to "greater/lesser" for correct correspondence with "lower/upper".
| Evaluation of spatial learning and wayfinding in a complex maze using immersive virtual reality. A registered report | Eudave L., Martínez M., Valencia M., Roth D. | <p style="text-align: justify;"><strong>Objectives</strong>: Mazes have traditionally been used as tools for evaluating spatial learning and navigational abilities in humans. They have been also utilized in sleep and dream research, as wayfinding ... | Life Sciences | Robert McIntosh | 2023-03-31 17:21:20 |
