Submit a report

Announcements

Please note: To accommodate reviewer and recommender holiday schedules, we will be closed to submissions from 1st July — 1st September. During this time, reviewers will be able to submit reviews and recommenders will issue decisions, but no new or revised submissions can be made by authors. The one exception to this rule is that authors using the scheduled track who submit their initial Stage 1 snapshot prior to 1st July can choose a date within the shutdown period to submit their full Stage 1 manuscript.

We are recruiting recommenders (editors) from all research fields!

Your feedback matters! If you have authored or reviewed a Registered Report at Peer Community in Registered Reports, then please take 5 minutes to leave anonymous feedback about your experience, and view community ratings.


 

Latest recommendationsrssmastodon

IdTitleAuthorsAbstractPictureThematic fieldsRecommenderReviewersSubmission date
16 Mar 2022
STAGE 1

Neuroanatomical Correlates of System-justifying Ideologies: A Pre-registered Voxel-based Morphometry Study on Right-Wing Authoritarianism and Social Dominance Orientation

What are the neuranatomical correlates of system-justifying ideologies?

Recommended by ORCID_LOGO based on reviews by Bonni Crawford and 2 anonymous reviewers

Under the tenets of system justification theory, system-justifying ideologies are beliefs held by individuals to defend and justify the status quo, even when doing do perpetuates social inequalities (Jost and Hunyady, 2005). Two such well-studied ideologies to emerge from political science and social psychology are social dominance orientation (SDO) – the belief that some social groups are superior to others – and right wing authoritarianism (RWA) – the belief that people should follow conventional traditions and authorities, avoiding rebellious ideas. Although considered to be stable traits that may have a heritable basis, there has been little investigation of the neural correlates of SDO and RWA, and it remains unknown whether they are associated with common or distinct brain systems.

In the current study, Balagtas et al propose a novel investigation of the neuroanatomical correlates of both SDO and RWA in a Chinese Singaporean sample using voxel-based morphometry. Based on previous research, the authors focus especially on relationships between SDO, RWA and the volume of the amygdala, ventromedial prefrontal cortex, and anterior insula. 

The Stage 1 manuscript was evaluated over three rounds of in-depth review. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).

URL to the preregistered Stage 1 protocol: https://osf.io/btkwq

Level of bias control achieved: Level 4. At least some of the data/evidence that will be used to answer the research question already exists AND is accessible in principle to the authors (e.g. residing in a public database or with a colleague), BUT the authors certify that they have not yet accessed any part of that data/evidence.

List of eligible PCI RR-friendly journals:

References

1. Jost, J. T., & Hunyady, O. (2005). Antecedents and consequences of system-justifying ideologies. Current Directions in Psychological Science, 14, 260-265. https://doi.org/10.1111%2Fj.0963-7214.2005.00377.x

2. Balagtas, P. M., Tolomeo, S., Ragunath, B., Rigo, P., Bornstein, M. H. & Esposito, G. (2022). Neuroanatomical Correlates of System-justifying Ideologies: A Pre-registered Voxel-based Morphometry Study on Right-Wing Authoritarianism and Social Dominance Orientation in principle acceptance of version 4 by Peer Community in Registered Reports. https://osf.io/btkwq

Neuroanatomical Correlates of System-justifying Ideologies: A Pre-registered Voxel-based Morphometry Study on Right-Wing Authoritarianism and Social Dominance OrientationJan Paolo M. Balagtas, Serenella Tolomeo, Bindiya L. Ragunath, Paolo Rigo, Marc H. Bornstein & Gianluca Esposito<p style="text-align: justify;">System-justifying ideologies are a cluster of ideals that perpetuate a hierarchical social system despite being fraught with inequalities. Right Wing Authoritarianism (RWA) and Social Dominance Orientation (SDO) are...Social sciencesChris Chambers2021-08-19 09:48:02 View
21 Feb 2022
STAGE 1
article picture

Recommended by ORCID_LOGO based on reviews by Jean-François Gerard, Rachel Harrison and 1 anonymous reviewer

This submission has been withdrawn (see notice below)

Sex-biased dispersal is widely acknowledged to influence range expansion and the geographic limits of species (Trochet et al. 2016). Evidence is accruing that suggests an impact of the learning ability of species on their capacity to colonise new habitats because the ability to learn provides an advantage when confronted to novel challenges (Lee and Thornton 2021). Whether these two mechanisms interact to shape range expansion remains however unknown. One could expect this interaction because both dispersal and the ability to learn are linked to related behaviours (e.g., exploration, Lee and Thornton 2021). 

In their study entitled “Investigating sex differences in learning in a range-expanding bird”, Alexis J. Breen and Dominik Deffner (Breen and Deffner 2022) propose to test this hypothesis in range-expanding great-tailed grackles (Quiscalus mexicanus) by exploring the individual variation of several behavioural traits (e.g., exploration, neophobia, problem solving, Logan 2016) linked to their learning ability. They will use a colour-reward reinforcement experimental approach to compare the learning performance between male and female great-tailed grackles in three study sites and evaluate whether sex-biased learning ability interacts with sex-biased dispersal. Data will be analysed by a Bayesian reinforcement learning model (Deffner et al. 2020), which was validated. 

This Stage 1 registered report was evaluated over one round of in-depth review by Jean-François Gerard, Rachel Harrison and one anonymous reviewer, and another round of review by Jean-François Gerard and Rachel Harrison. 

Based on detailed responses to the comments and the modifications brought to the manuscript by the authors, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).

Withdrawal notice: The Stage 2 manuscript associated with this accepted Stage 1 protocol was submitted to PCI RR on 22 July 2022. On 25 July 2022, the Managing Board offered the opportunity for the authors to revise the manuscript prior to in-depth review. On 7 Sep 2022, the authors withdrew the Stage 2 manuscript from consideration due to time constraints.

 
URL to the preregistered Stage 1 protocol: https://osf.io/v3wxb
 
Level of bias control achieved: Level 2. At least some data/evidence that will be used to answer the research question has been accessed and partially observed by the authors, but the authors certify that they have not yet observed the key variables within the data that will be used to answer the research question AND they have taken additional steps to maximise bias control and rigour.
 
List of eligible PCI RR-friendly journals:

References

Trochet, A., Courtois, E. A., Stevens, V. M., Baguette, M., Chaine, A., Schmeller, D. S., Clobert, J., & Wiens, J. J. (2016). Evolution of sex-biased dispersal. The Quarterly Review of Biology, 91(3), 297–320. https://doi.org/10.1086/688097

Lee, V. E., & Thornton, A. (2021). Animal cognition in an urbanised world. Frontiers in Ecology and Evolution, 9, 120. https://doi.org/10.3389/fevo.2021.633947

Logan, C. J. (2016b). Behavioral flexibility in an invasive bird is independent of other behaviors. PeerJ, 4, e2215. https://doi.org/10.7717/peerj.2215

Deffner, D., Kleinow, V., & McElreath, R. (2020). Dynamic social learning in temporally and spatially variable environments. Royal Society Open Science, 7(12), 200734. https://doi.org/10.1098/rsos.200734

Breen, A. J. & Deffner D. (2022). Investigating sex differences in learning in a range-expanding bird., https://github.com/alexisbreen/Sex-differences-in-grackles-learning, in principle acceptance of version 2 by Peer Community in Registered Reports. https://osf.io/v3wxb

[WITHDRAWN]: Investigating sex differences in learning in a range-expanding birdAlexis J. Breen & Dominik Deffner<p style="text-align: justify;">How might differences in dispersal and learning interact in range expansion dynamics? To begin to answer this question, in this preregistration we detail the background, hypothesis plus associated predictions, and m...Life SciencesBenoit Pujol Rachel Harrison, Kate Cross, Jean-François Gerard2021-11-10 13:12:04 View
15 Feb 2022
STAGE 1

Does alleviating poverty increase cognitive performance? Short- and long- term evidence from a randomized controlled trial

Understanding the effect of unconditional cash transfers on cognition

Recommended by ORCID_LOGO based on reviews by Charlotte Pennington and Matúš Adamkovič

Over the last decade, a growing body of evidence has revealed potential benefits of unconditional cash transfers (UCTs) on a variety of outcomes, including self-reported happiness and life satisfaction (Haushofer & Shapiro, 2016), economic and financial well-being (Blattman et al., 2013; Baird et al., 2018) and educational attainment (Baird et al., 2016). Although the effects of UCTs do not always out-perform rigorous control conditions (Whillans & West, 2022), these findings prompt the question of whether the alleviation of poverty via UCTs can also influence cognitive processing and performance.

In the current study, Szaszi et al. propose to analyse the results of a previous randomised trial of UCTs by Blattman et al. (2017) to test whether a $200 lump sum administered to a sample of young men in Liberia carries both short- and long-term benefits for a range of executive functions, including attention, response inhibition, and working memory capacity. 

The Stage 1 manuscript was evaluated over two rounds of in-depth review. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).

URL to the preregistered Stage 1 protocol: https://osf.io/k56yv

Level of bias control achieved: Level 2. At least some data/evidence that will be used to answer the research question has been accessed and partially observed by the authors, but the authors certify that they have not yet observed the key variables within the data that will be used to answer the research question AND they have taken additional steps to maximise bias control and rigour.

List of eligible PCI RR-friendly journals:

References

1. Haushofer, J. & Shapiro, J.  (2016). The short-term impact of unconditional cash transfers to the poor: Experimental evidence from Kenya. Quarterly Journal of Economics, 13, 1973–2042. https://doi.org/10.1093/qje/qjw025
 
2. Blattman, C., Fiala, N. & Martinez, S. (2013) Generating skilled self-employment in developing countries: Experimental evidence from Uganda. Quarterly Journal of Economics, 129, 697–752. https://doi.org/10.1093/qje/qjt057
 
3. Baird, S., McKenzie, D., & Özler, B. (2018). The effects of cash transfers on adult labor market outcomes. IZA Journal of Development and Migration, 8, 1-20. https://doi.org/10.1186/s40176-018-0131-9
 
4. Baird, S., Chirwa, E., De Hoop, J., & Özler, B. (2016). Girl power: cash transfers and adolescent welfare: evidence from a cluster-randomized experiment in Malawi. In African Successes, Volume II: Human Capital (pp. 139-164). University of Chicago Press. https://www.nber.org/system/files/chapters/c13380/c13380.pdf
 
5. Whillans, A., & West, C. (2022). Alleviating time poverty among the working poor: A pre-registered longitudinal field experiment. Scientific Reports, 12(1), 1-17. https://doi.org/10.1038/s41598-021-04352-y
 
6. Szaszi, B., Palfi, B., Neszveda, G., Taka, A., Szecsi, P., Blattman, C., Jamison, J. C., & Sheridan, M. (2022). Does alleviating poverty increase cognitive performance? Short- and long- term evidence from a randomized controlled trial, in principle acceptance of version 3 by Peer Community in Registered Reports. https://osf.io/k56yv
 
7. Blattman, C., Jamison, J. C. & Sheridan, M. (2017). Reducing crime and violence: Experimental evidence from cognitive behavioral therapy in Liberia. American Economic Review, 107, 1165–1206. http://doi.org/10.1257/aer.20150503
Does alleviating poverty increase cognitive performance? Short- and long- term evidence from a randomized controlled trialBarnabas Szaszi, Bence Palfi, Gabor Neszveda, Aikaterini Taka, Peter Szecsi, Christopher Blattman, Julian C. Jamison, Margaret Sheridan<p>Recent findings suggest that poverty has a deteriorating effect on cognitive functioning which can reinforce existing social inequalities. In this Registered Report, we will investigate the impact of a poverty alleviation program on cognitive p...Social sciencesChris Chambers2021-07-22 20:34:50 View
14 Feb 2022
STAGE 1

Minimal mindfulness of the world as an active control for a full mindfulness of mental states intervention: A Registered Report and Pilot study

Testing the metacognitive basis and benefits of mindfulness training

Recommended by ORCID_LOGO based on reviews by Chris Noone and Julieta Galante

Mindfulness is inherently metacognitive in that it requires monitoring of one’s own thoughts and attention in order to remain on task. Mindfulness practice is especially metacognitive when focused on internal mental states, rather than on the external world. This Registered Report will compare remote training in mindfulness of mental states with remote training in mindfulness of the world, and a wait list control, to test the idea that mindfulness of mental states has an additional metacognitive component, and that this has benefits for (self-reported) mental health. A comparison of participant expectancies between mindfulness conditions will be used to establish whether mindfulness of the world can be considered a true ‘active control’ condition. Additional comparisons will test whether this mindfulness control has benefits over the (inactive) waiting list condition. The study plan is informed by prior research, including pilot data presented in the Stage 1 report, and a sample of up to 300 participants will be tested.

The Stage 1 plan has been evaluated through two round of signed external review, and a further two rounds of minor revisions, with the recommender obtaining specialist advice on key points from a relevant external expert. The recommender has judged that the manuscript now meets all Stage 1 criteria, and has awarded In Principle Acceptance (IPA).

URL to the preregistered Stage 1 protocol: https://osf.io/tx54k

Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.

List of eligible PCI RR-friendly journals:

References

Lovell, M., & Dienes, Z. (2022). Minimal mindfulness of the world as an active control for a full mindfulness of mental states intervention: A Registered Report and Pilot study, in principle acceptance of version 4 by Peer Community in Registered Reports. https://osf.io/tx54k

Minimal mindfulness of the world as an active control for a full mindfulness of mental states intervention: A Registered Report and Pilot studyMax Lovell, Zoltan Dienes<p>Mindfulness is a continual renewal of non-elaborative attention on an object of focus, without clinging or aversion, and with equanimity. As this requires the capacity to monitor and control the extent to which one is on task, it is a metacogni...Social sciencesRobert McIntosh2021-06-21 16:49:39 View
08 Feb 2022
STAGE 1

Motivational Control of Habits: A Preregistered fMRI Study

Putting the Expected Value of Control (EVC) theory to the test in explaining habitual action

Recommended by ORCID_LOGO based on reviews by 2 anonymous reviewers

What are the neurocognitive mechanisms underlying the formation of habits? In this Stage 1 Registered Report, Eder and colleagues propose an fMRI study to test a key prediction of the Expected Value of Control (EVC) theory: that the dorsal anterior cingulate cortex (dACC) – a region heavily implicated in reward processing, cognitive control, and action selection – will show increased activity during the presentation of Pavlovian cues that are associated with devalued outcomes. In combination with a series of behavioural positive controls, this observation would provide evidence in support of EVC theory, whereas failure to do so may support alternative accounts that propose independence of habits from the representations of outcomes.

The Stage 1 manuscript was evaluated over two rounds of in-depth specialist review. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA). This IPA recommendation was issued on 8 Feb 2022, and was initially provisional due to lack of ethics approval. The recommendation was then updated and confirmed on 21 Feb 2022 following confirmation that ethics approval had been granted.

URL to the preregistered Stage 1 protocol: https://osf.io/k8ygb

Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.

List of eligible PCI RR-friendly journals:

References

Eder, A. B., Dignath, D. & Gamer, M. (2022). Motivational Control of Habits: A Preregistered fMRI Study. Stage 1 preregistration, in principle acceptance of version 3 by Peer Community in Registered Reports. https://osf.io/k8ygb

Motivational Control of Habits: A Preregistered fMRI StudyAndreas B. Eder, David Dignath, Matthias Gamer<p>Habitual action is typically distinguished from goal-directed action by its insensitivity to changes in the reward value. There is an ongoing discussion whether this insensitivity is an intrinsic design feature of habits or, rather, a function ...Social sciencesChris Chambers2021-10-05 11:51:08 View
08 Feb 2022
STAGE 1
article picture

Arithmetic deficits in Parkinson's Disease? A registered report

Getting the numbers right in Parkinson's disease?

Recommended by ORCID_LOGO based on reviews by Pia Rotshtein, Ann Dowker, Stephanie Rossit and 1 anonymous reviewer

Everyday life, including for patients taking different types of medicine, involves dealing with numbers. Even though Parkinson's disease may ordinarily be thought of as primarily being a motor disorder, there is evidence that numerical abilities decline as Parkinson's disease progresses. Further, the brain areas involved in arithmetic operations overlap with the areas that degenerate in Parkinson's disease.

In this Stage 1 Registered Report, Loenneker et al. (2022) will test healthy  controls, Parkinson disease patients with normal  cognition, and Parkinson disease patients with mild cognitive impairment on general working memory tasks as well as arithmetic performance on the four basic  operations (addition, subtraction, multiplication, division). The study aims to test whether or not there is a deficit in each operation, and the relation of any deficits to general working memory capacity.

The Stage 1 manuscript was evaluated over four rounds of review (including two rounds of in-depth specialist review). Based on comprehensive responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).

URL to the preregistered Stage 1 protocol: https://osf.io/nb5fj

Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.

List of eligible PCI RR-friendly journals:

References

Loenneker, H. D., Liepelt-Scarfone, I., Willmes, K., Nuerk, H.-C., & Artemenko, C. (2022). Arithmetic deficits in Parkinson’s Disease? A Registered Report. Stage 1 preregistration, in principle acceptance of version 4 by Peer Community in Registered Reports. https://osf.io/nb5fj

Arithmetic deficits in Parkinson's Disease? A registered reportHannah D. Loenneker, Inga Liepelt-Scarfone, Klaus Willmes, Hans-Christoph Nuerk, & Christina Artemenko<p>Elderly people and patients with neurodegenerative diseases such as Parkinson’s Disease (PD) immensely rely on arithmetic skills to lead an independent life. Activities such as medication management, financial transactions or using public trans...Life SciencesZoltan Dienes2021-06-29 19:23:53 View
25 Jan 2022
STAGE 1

To help or hinder: Do the labels and models used to describe problematic substance use influence public stigma?

Understanding the role of health condition, aetiological labels, and attributional judgements in public stigma toward problematic substance use

Recommended by ORCID_LOGO based on reviews by Nicholas Sinclair-House and Roger Giner-Sorolla

People suffering from substance misuse problems are often stigmatised. Such public stigma may impair such people obtaining help and the quality of help that they receive. For this reason, previous research has investigated the factors that may reduce stigma. Evidence has been found, but not consistently, for the claim that labelling the condition as "chronically relapsing brain disease" vs a "problem" reduces stigma; as does "a health concern" vs " drug use". Another potentially relevant difference that may explain different previous results is describing how effective treatment can be.

In this Stage 1 Registered Report, Pennington et al. (2022) describe how they will investigate if any of these factors affect two different measures of stigma used in previous work, with a study well powered for testing whether the 99% CI lies outside or inside an equivalence region. While the CI being outside the region will straightforwardly justify concluding an effect of interest, a CI within the region will need to be interpreted with due regard to the fact that some effects within the region may be interesting.

The Stage 1 manuscript was evaluated over two rounds of review (including one round of in-depth specialist review). Based on comprehensive responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).

URL to the preregistered Stage 1 protocol: https://osf.io/4vscg

Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.

List of eligible PCI RR-friendly journals:

References

Pennington, C. R., Monk, R. L., Heim, D., Rose, A. K., Gough, T., Clarke, R., Knibb, G.,  & Jones, A. (2022). To help or hinder: Do the labels and models used to describe problematic substance use influence public stigma? Stage 1 preregistration, in principle acceptance of version 2 by Peer Community in Registered Reports. https://osf.io/4vscg

To help or hinder: Do the labels and models used to describe problematic substance use influence public stigma?Charlotte R. Pennington, Rebecca L. Monk, Derek Heim, Abi K. Rose, Thomas Gough, Ross Clarke, Graeme Knibb, and Andrew Jones.<p>Objectives: Problematic substance use is one of the most stigmatised health conditions, leading research to examine how the labels and models used to describe it influence public stigma. Two recent studies examine whether beliefs in a disease m...Social sciencesZoltan Dienes2021-10-28 13:26:28 View
17 Jan 2022
STAGE 1
article picture

Identifying Gaming Disorders by Ontology: A Nationally Representative Registered Report

Do different screening instruments for ‘gaming disorder’ measure the same or different construct(s)?

Recommended by ORCID_LOGO based on reviews by Daniel Dunleavy, Linda Kaye, David Ellis and 1 anonymous reviewer

There is considerable debate regarding the relationship between excessive gaming and mental health problems. Whilst the diagnostic classification of “gaming disorder” has now been included in the WHO’s International Classification of Diseases (ICD-11), the APA decided not to include this diagnosis in their Diagnostic and Statistical Manual of Mental Disorders (DSM-5) because the literature “suffers from a lack of a standard definition from which to derive prevalence data” (APA 2013, p. 796). Furthermore, screening instruments that aim to provide diagnostic classifications derive from different ontologies and it is not known whether they identify equivalent prevalence rates of ‘gaming disorder’ or even the same individuals.

In this Stage 1 Registered Report, Karhulahti et al. (2022) aim to assess how screening instruments that derive from different ontologies differ in identifying associated problem groups. A nationally representative sample of 8000 Finnish individuals will complete four screening measures to assess the degree of overlap between identified prevalence (how many?), who they identify (what characteristics?) and the health of their identified groups (how healthy?). If these four ontologically diverse instruments operate similarly, this will support the notion of a single “gaming disorder” construct. If, however, the instruments operate differently, this will suggest that efforts should be directed toward assessing the clinical (ir)relevance of multiple constructs. This rigorous study will therefore have important implications for the conceptualisation and measurement of “gaming disorder”, contributing to the debate around the mixed findings of gaming-related health problems.

Four expert reviewers with field expertise assessed the Stage 1 manuscript over three rounds of in-depth review. Based on detailed and informed responses to the reviewers' comments, the recommender decided that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).

URL to the preregistered Stage 1 protocol: https://osf.io/usj5b

Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.

List of eligible PCI RR-friendly journals:

References

  1. APA (American Psychiatric Association. (2013). Diagnostic and Statistical Manual of Mental Disorders (5th Edition). APA.
  2. Karhulahti V-M, Vahlo J, Martončik M, Munukka M, Koskimaa R and Bonsdorff M (2022). Identifying Gaming Disorders by Ontology: A Nationally Representative Registered Report. OSF mpz9q, Stage 1 preregistration, in principle acceptance of version 4 by Peer Community in Registered Reports. https://osf.io/mpz9q/
Identifying Gaming Disorders by Ontology: A Nationally Representative Registered ReportVeli-Matti Karhulahti, Jukka Vahlo, Marcel Martončik, Matti Munukka, Raine Koskimaa, Mikaela von Bonsdorff<p style="text-align: justify;">Gaming-related health problems have been researched since the 1980s with numerous different “ontologies” as reference systems, from self-assessed “game addiction” to “pathological gambling” (in the DSM-IV), “interne...Medical Sciences, Social sciencesCharlotte Pennington2021-08-25 23:08:26 View
28 Dec 2021
STAGE 1
article picture

Sight vs. sound in the judgment of music performance: Cross-cultural evidence from classical piano and Tsugaru shamisen competitions

Understanding the role of visual and auditory information in evaluating musical performance

Recommended by ORCID_LOGO based on reviews by David Hughes and Kyoshiro Sasaki

In this Stage 1 Registered Report, Chiba and colleagues (2021) aim to investigate how people use information from visual and auditory modalities when evaluating musical performances. Previous studies, mainly using Western music, have reported a visual dominance, but this has not yet been clearly and consistently reported. Thus, the authors propose to evaluate both the reproducibility and generalizability of the previous findings by conducting a replication study using the methodology of the previous studies and by introducing a new experimental condition in which the Tsugaru-shamisen, a unique Japanese musical instrument, is also performed. This study could represent an important turning point in the research context of performance evaluation and would be of considerable value.

This manuscript was peer-reviewed by two experts in scientific methodology and Japanese traditional music, respectively, and during the two-round peer-review process they made a number of important points, but eventually awarded the manuscript a highly positive response. I am therefore pleased to recommend that this Stage 1 Registered Report meets our Stage 1 criteria and is worthy of in-principle acceptance. I look forward to seeing the results and discussion reported in Stage 2, with the expectation that the experiment conducted by the authors will be in strict accordance with this protocol.

*The following is a very minor comment, which I hope the authors will find helpful in the future. Of course, this is not related to hypothesis construction and does not require revision: The "Blind Audition" study cited in the introduction is very impactful, but has recently been called into question, so I am at least a little cautious when citing this study. This article may be useful. https://www.wsj.com/articles/blind-spots-in-the-blind-audition-study-11571599303

URL to the preregistered Stage 1 protocol: https://osf.io/ry2b6

Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.

List of eligible PCI RR-friendly journals:

References

  1. Chiba G, Ozaki Y, Fujii S, Savage PE (2021) Sight vs. sound in the judgment of music performance: Cross-cultural evidence from classical piano and Tsugaru shamisen competitions [Stage 1 Registered Report].  Psyarxiv, xky4j, stage 1 preregistration, in-principle acceptance of version 5 by Peer Community in Registered Reports. https://doi.org/10.31234/osf.io/xky4jhttps://doi.org/10.17605/OSF.IO/RY2B6
Sight vs. sound in the judgment of music performance: Cross-cultural evidence from classical piano and Tsugaru shamisen competitions Gakuto Chiba, Yuto Ozaki, Shinya Fujii, Patrick E. Savage<p style="text-align: justify;">​​Which information dominates in evaluating performance in music? Both experts and laypeople consistently report believing that sound should be the most important domain when judging music competitions, but experime...Social sciencesYuki Yamada Kyoshiro Sasaki2021-09-24 08:59:26 View
29 Sep 2021
STAGE 1

Evaluating the pedagogical effectiveness of study preregistration in the undergraduate dissertation: A Registered Report

Does incorporating open research practices into the undergraduate curriculum decrease questionable research practices?

Recommended by ORCID_LOGO and ORCID_LOGO based on reviews by Kelsey McCune, Neil Lewis, Jr., Lisa Spitzer and 1 anonymous reviewer

In a time when open research practices are becoming more widely used to combat questionable research practices (QRPs) in academia, this Stage 1 Registered Report by Pownall and colleagues (2021) will empirically investigate the practice of preregistering study plans, which will allow us to better understand to what degree such practices increase awareness of QRPs and whether experience with preregistration helps reduce engagement in QRPs. This investigation is timely because results from these kinds of studies are only recently becoming available and the conclusions are providing evidence that open research practices can improve research quality and reliability (e.g., Soderberg et al. 2020, Chambers & Tzavella 2021). The authors crucially focus on the effect of preregistering the undergraduate senior thesis (of psychology students in the UK), which is a key stage in the development of an academic. This data will help shape the future of how we should teach open research practices and what effect we as teachers can have on budding research careers. The five expert peer reviews were of an extremely high quality and were very thorough. The authors did an excellent job of addressing all of the comments in their responses and revised manuscript versions, which resulted in only one round of peer review, plus a second revision based on Recommender feedback. As such, this registered report meets the Stage 1 criteria and is therefore awarded in-principle acceptance (IPA). We wish the authors the best of luck with the study and we look forward to seeing the results.

URL to the preregistered Stage 1 protocol: https://osf.io/9hjbw

Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.

List of eligible PCI RR-friendly journals:

References

  1. Pownall M, Pennington CR, Norris E, Clark K. 2021. Evaluating the pedagogical effectiveness of study preregistration in the undergraduate dissertation: A Registered Report. OSF, stage 1 preregistration, in principle acceptance of version 1 by Peer Community in Registered Reports.   https://doi.org/10.17605/OSF.IO/9HJBW
  2. Chambers C, Tzavella L (2021). The past, present, and future of Registered Reports. https://doi.org/10.31222/osf.io/43298
  3. Soderberg CK, Errington TM, Schiavone SR, Bottesini J, Thorn FS, Vazire S, Esterling KM, Nosek BA (2021) Initial evidence of research quality of registered reports compared with the standard publishing model. Nature Human Behaviour, 5, 990–997. https://doi.org/10.1038/s41562-021-01142-4
Evaluating the pedagogical effectiveness of study preregistration in the undergraduate dissertation: A Registered Report Madeleine Pownall; Charlotte R. Pennington; Emma Norris; Kait Clark <p style="text-align: justify;">Research shows that questionable research practices (QRPs) are present in undergraduate final-year dissertation projects. One entry-level Open Science practice proposed to mitigate QRPs is ‘study preregistration’, t...Life Sciences, Social sciencesCorina Logan2021-07-08 15:27:24 View