Submit a report

Announcements

Please note that we will be CLOSED to ALL SUBMISSIONS from 1 December 2024 through 12 January 2025 to give our recommenders and reviewers a holiday break.

We are recruiting recommenders (editors) from all research fields!

Your feedback matters! If you have authored or reviewed a Registered Report at Peer Community in Registered Reports, then please take 5 minutes to leave anonymous feedback about your experience, and view community ratings.

Latest recommendationsrssmastodon

Id▼Title * Authors * Abstract * PictureThematic fields * RecommenderReviewersSubmission date
28 Dec 2021
STAGE 1
article picture

Sight vs. sound in the judgment of music performance: Cross-cultural evidence from classical piano and Tsugaru shamisen competitions

Understanding the role of visual and auditory information in evaluating musical performance

Recommended by ORCID_LOGO based on reviews by David Hughes and Kyoshiro Sasaki

In this Stage 1 Registered Report, Chiba and colleagues (2021) aim to investigate how people use information from visual and auditory modalities when evaluating musical performances. Previous studies, mainly using Western music, have reported a visual dominance, but this has not yet been clearly and consistently reported. Thus, the authors propose to evaluate both the reproducibility and generalizability of the previous findings by conducting a replication study using the methodology of the previous studies and by introducing a new experimental condition in which the Tsugaru-shamisen, a unique Japanese musical instrument, is also performed. This study could represent an important turning point in the research context of performance evaluation and would be of considerable value.

This manuscript was peer-reviewed by two experts in scientific methodology and Japanese traditional music, respectively, and during the two-round peer-review process they made a number of important points, but eventually awarded the manuscript a highly positive response. I am therefore pleased to recommend that this Stage 1 Registered Report meets our Stage 1 criteria and is worthy of in-principle acceptance. I look forward to seeing the results and discussion reported in Stage 2, with the expectation that the experiment conducted by the authors will be in strict accordance with this protocol.

*The following is a very minor comment, which I hope the authors will find helpful in the future. Of course, this is not related to hypothesis construction and does not require revision: The "Blind Audition" study cited in the introduction is very impactful, but has recently been called into question, so I am at least a little cautious when citing this study. This article may be useful. https://www.wsj.com/articles/blind-spots-in-the-blind-audition-study-11571599303

URL to the preregistered Stage 1 protocol: https://osf.io/ry2b6

Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.

List of eligible PCI RR-friendly journals:

References

  1. Chiba G, Ozaki Y, Fujii S, Savage PE (2021) Sight vs. sound in the judgment of music performance: Cross-cultural evidence from classical piano and Tsugaru shamisen competitions [Stage 1 Registered Report].  Psyarxiv, xky4j, stage 1 preregistration, in-principle acceptance of version 5 by Peer Community in Registered Reports. https://doi.org/10.31234/osf.io/xky4jhttps://doi.org/10.17605/OSF.IO/RY2B6
Sight vs. sound in the judgment of music performance: Cross-cultural evidence from classical piano and Tsugaru shamisen competitions Gakuto Chiba, Yuto Ozaki, Shinya Fujii, Patrick E. Savage<p style="text-align: justify;">​​Which information dominates in evaluating performance in music? Both experts and laypeople consistently report believing that sound should be the most important domain when judging music competitions, but experime...Social sciencesYuki Yamada Kyoshiro Sasaki2021-09-24 08:59:26 View
07 Apr 2023
STAGE 1

The WEIRD problem in a “non-WEIRD” context: A meta-research on the representativeness of human subjects in Chinese psychological research

How well do "non-WEIRD" participants in multi-lab studies represent their local population?

Recommended by ORCID_LOGO based on reviews by Zoltan Dienes, Patrick Forscher and Kai Hiraishi
In this protocol, Yue et al. (2023) aim to clarify whether the sample of non-WEIRD countries included in multi-lab studies is actually representative of those countries and cultures. Focusing on China, this study will compare Chinese samples in several multi-lab studies with participants in studies published in leading national Chinese journals on various aspects, including demographic data and geographic information. This work will provide useful information on the extent to which multi-lab studies are able to deal with generalizability, especially as they intend to address the generalizability problem.
 
The Stage 1 manuscript was reviewed by three experts, including two with an interest in the WEIRD problem and a wealth of experience in open science and multi-lab research, plus an expert in Bayesian statistics, which this manuscript uses. Following multilpe rounds of peer review, and based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
 
URL to the preregistered Stage 1 protocol: https://osf.io/ehw54
 
Level of bias control achieved: Level 4. At least some of the data/evidence that will be used to answer the research question already exists AND is accessible in principle to the authors (e.g. residing in a public database or with a colleague) BUT the authors certify that they have not yet accessed any part of that data/evidence.
 
List of eligible PCI RR-friendly journals: 
 
 
References
 
Yue, L., Zuo, X.-N., & Hu, C.-P. (2023) The WEIRD problem in a “non-WEIRD” context: A meta-research on the representativeness of human subjects in Chinese psychological research, in principle acceptance of Version 7 by Peer Community in Registered Reports. https://osf.io/ehw54
The WEIRD problem in a “non-WEIRD” context: A meta-research on the representativeness of human subjects in Chinese psychological researchYUE Lei, ZUO Xi-Nian, HU Chuan-Peng<p><strong>​​​​</strong><strong>​Psychological science aims at understanding human mind and behavior, but it primarily relies on subjects from Western, Educated, Industrialized, Rich, and Democratic regions, i.e., the WEIRD problem. This lack of d...Social sciencesYuki Yamada Zoltan Dienes2021-09-07 11:25:52 View
17 Jan 2022
STAGE 1
article picture

Identifying Gaming Disorders by Ontology: A Nationally Representative Registered Report

Do different screening instruments for ‘gaming disorder’ measure the same or different construct(s)?

Recommended by ORCID_LOGO based on reviews by Daniel Dunleavy, Linda Kaye, David Ellis and 1 anonymous reviewer

There is considerable debate regarding the relationship between excessive gaming and mental health problems. Whilst the diagnostic classification of “gaming disorder” has now been included in the WHO’s International Classification of Diseases (ICD-11), the APA decided not to include this diagnosis in their Diagnostic and Statistical Manual of Mental Disorders (DSM-5) because the literature “suffers from a lack of a standard definition from which to derive prevalence data” (APA 2013, p. 796). Furthermore, screening instruments that aim to provide diagnostic classifications derive from different ontologies and it is not known whether they identify equivalent prevalence rates of ‘gaming disorder’ or even the same individuals.

In this Stage 1 Registered Report, Karhulahti et al. (2022) aim to assess how screening instruments that derive from different ontologies differ in identifying associated problem groups. A nationally representative sample of 8000 Finnish individuals will complete four screening measures to assess the degree of overlap between identified prevalence (how many?), who they identify (what characteristics?) and the health of their identified groups (how healthy?). If these four ontologically diverse instruments operate similarly, this will support the notion of a single “gaming disorder” construct. If, however, the instruments operate differently, this will suggest that efforts should be directed toward assessing the clinical (ir)relevance of multiple constructs. This rigorous study will therefore have important implications for the conceptualisation and measurement of “gaming disorder”, contributing to the debate around the mixed findings of gaming-related health problems.

Four expert reviewers with field expertise assessed the Stage 1 manuscript over three rounds of in-depth review. Based on detailed and informed responses to the reviewers' comments, the recommender decided that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).

URL to the preregistered Stage 1 protocol: https://osf.io/usj5b

Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.

List of eligible PCI RR-friendly journals:

References

  1. APA (American Psychiatric Association. (2013). Diagnostic and Statistical Manual of Mental Disorders (5th Edition). APA.
  2. Karhulahti V-M, Vahlo J, Martončik M, Munukka M, Koskimaa R and Bonsdorff M (2022). Identifying Gaming Disorders by Ontology: A Nationally Representative Registered Report. OSF mpz9q, Stage 1 preregistration, in principle acceptance of version 4 by Peer Community in Registered Reports. https://osf.io/mpz9q/
Identifying Gaming Disorders by Ontology: A Nationally Representative Registered ReportVeli-Matti Karhulahti, Jukka Vahlo, Marcel Martončik, Matti Munukka, Raine Koskimaa, Mikaela von Bonsdorff<p style="text-align: justify;">Gaming-related health problems have been researched since the 1980s with numerous different “ontologies” as reference systems, from self-assessed “game addiction” to “pathological gambling” (in the DSM-IV), “interne...Medical Sciences, Social sciencesCharlotte Pennington2021-08-25 23:08:26 View
16 Mar 2022
STAGE 1

Neuroanatomical Correlates of System-justifying Ideologies: A Pre-registered Voxel-based Morphometry Study on Right-Wing Authoritarianism and Social Dominance Orientation

What are the neuranatomical correlates of system-justifying ideologies?

Recommended by ORCID_LOGO based on reviews by Bonni Crawford and 2 anonymous reviewers

Under the tenets of system justification theory, system-justifying ideologies are beliefs held by individuals to defend and justify the status quo, even when doing do perpetuates social inequalities (Jost and Hunyady, 2005). Two such well-studied ideologies to emerge from political science and social psychology are social dominance orientation (SDO) – the belief that some social groups are superior to others – and right wing authoritarianism (RWA) – the belief that people should follow conventional traditions and authorities, avoiding rebellious ideas. Although considered to be stable traits that may have a heritable basis, there has been little investigation of the neural correlates of SDO and RWA, and it remains unknown whether they are associated with common or distinct brain systems.

In the current study, Balagtas et al propose a novel investigation of the neuroanatomical correlates of both SDO and RWA in a Chinese Singaporean sample using voxel-based morphometry. Based on previous research, the authors focus especially on relationships between SDO, RWA and the volume of the amygdala, ventromedial prefrontal cortex, and anterior insula. 

The Stage 1 manuscript was evaluated over three rounds of in-depth review. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).

URL to the preregistered Stage 1 protocol: https://osf.io/btkwq

Level of bias control achieved: Level 4. At least some of the data/evidence that will be used to answer the research question already exists AND is accessible in principle to the authors (e.g. residing in a public database or with a colleague), BUT the authors certify that they have not yet accessed any part of that data/evidence.

List of eligible PCI RR-friendly journals:

References

1. Jost, J. T., & Hunyady, O. (2005). Antecedents and consequences of system-justifying ideologies. Current Directions in Psychological Science, 14, 260-265. https://doi.org/10.1111%2Fj.0963-7214.2005.00377.x

2. Balagtas, P. M., Tolomeo, S., Ragunath, B., Rigo, P., Bornstein, M. H. & Esposito, G. (2022). Neuroanatomical Correlates of System-justifying Ideologies: A Pre-registered Voxel-based Morphometry Study on Right-Wing Authoritarianism and Social Dominance Orientation in principle acceptance of version 4 by Peer Community in Registered Reports. https://osf.io/btkwq

Neuroanatomical Correlates of System-justifying Ideologies: A Pre-registered Voxel-based Morphometry Study on Right-Wing Authoritarianism and Social Dominance OrientationJan Paolo M. Balagtas, Serenella Tolomeo, Bindiya L. Ragunath, Paolo Rigo, Marc H. Bornstein & Gianluca Esposito<p style="text-align: justify;">System-justifying ideologies are a cluster of ideals that perpetuate a hierarchical social system despite being fraught with inequalities. Right Wing Authoritarianism (RWA) and Social Dominance Orientation (SDO) are...Social sciencesChris Chambers2021-08-19 09:48:02 View
17 Nov 2022
STAGE 1

Removing barriers to plant-based diets: assisting doctors with vegan patients

Stage 1 acceptance (IPA)

Recommended by ORCID_LOGO based on reviews by Joshua Tasoff, Bence Palfi and Alaa Aldoh

Thank you for your careful response to the points of myself and the reviewers. I am now happy to award in principle acceptance (IPA). As requested, your submission is being awarded a private Stage 1 acceptance, which will not appear yet on the PCI RR website. Your Stage 1 manuscript has also been registered under the requested 4-year private embargo on the OSF (link below).

URL to the preregistered Stage 1 protocol: https://osf.io/fc9gp

Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.

List of eligible PCI RR-friendly journals:

Removing barriers to plant-based diets: assisting doctors with vegan patientsRomain Espinosa, Thibaut Arpinon, Paco Maginot, Sébastien Demange, and Florimond Peureux<div style="text-align: justify;">Shifting to plant-based diets can alleviate many of the externalities associated with the current food system. Spontaneous shifts in diet are often hindered by consumers’ imperfect knowledge about the health risks...Medical Sciences, Social sciencesZoltan Dienes2021-08-16 16:50:43 View
06 Jun 2022
STAGE 1

Communicating dynamic norms with visual cues

Can dynamic norm information reduce indicators of meat consumption?

Recommended by ORCID_LOGO based on reviews by Gabriela Jiga-Boy and 1 anonymous reviewer
Human meat consumption is associated with a variety of risks to health, animal welfare, sustainability, and the environment (including greenhouse gas emissions and loss of biodiversity), prompting a growing research effort to develop psychological interventions to reduce it and encourage alternative diets. At the same time, although meat consumption remains the majority choice in the UK, its prevalence is declining, with the proportion of vegetarians and vegans increasing substantially over the last two decades.
 
One potential tool to accelerate behaviour change is to expose people to “dynamic norm” messaging, which, rather than providing static descriptive information about the prevalence of a desired behaviour, emphasises how the desired behaviour is changing over time so that people can begin to conform to the emerging trend. Although promising in theory, previous research offers mixed evidence on the effectiveness of dynamic norms in encouraging a reduction in meat consumption, with some studies suggesting benefits and others showing no effect or even counterproductive effects. The methodological rigour of some studies is also in question.
 
In the present study, Aldoh et al. (2022) will investigate the effectiveness of dynamic norm information (compared to static norms) on several indicators of meat consumption, including interest, attitudes, and intentions toward reducing meat consumption, as well as self-reported meat consumption itself. Using an online sample up to 1500 participants, the authors will also test the role of visual cues (including data trend graphics) in causing any effects and will explore the potential longevity of the intervention over a period of 7 days.
 
The Stage 1 manuscript was evaluated over two rounds of in-depth review. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
 
URL to the preregistered Stage 1 protocol: https://osf.io/txzvm
 
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA. 
 
List of eligible PCI RR-friendly journals:
 
References
  
1. Aldoh, A., Sparks, P. & Harris, P. R. (2022). Communicating dynamic norm information, in principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/txzvm
Communicating dynamic norms with visual cuesAlaa Aldoh, Paul Sparks, Peter R Harris<p>While decreasing meat consumption is one of the most impactful behaviours an individual may do to reduce their carbon emissions, it is still a minority behaviour in many parts of the world. Research suggests that communicating information about...Social sciencesChris Chambers2021-08-11 18:52:41 View
13 May 2023
STAGE 1

Personal factors and group creativity characteristics: A correlational meta-analysis

Which personal factors are associated with group creativity?

Recommended by ORCID_LOGO and ORCID_LOGO based on reviews by Evan Carter and Greg Feist
What determines whether groups of people can come up with ideas that are both original and useful? Since the 1960s, this question has been intensively studied with the help of more or less structured group creativity activities such as brainstorming or creative problem solving, with subsequent rating of the generated ideas.
 
In this line of research, personal factors—such as personality traits, and other interindividual differences in emotion and cognition—have received substantial attention as potential correlates of creative outcomes of group activities. This has spawned a sprawling literature that, to date, has not yet been synthesized. Thus, empirical findings in this literature, which are also sometimes contradictory, have not yet been well-integrated.
 
In the present study, Fillon et al. (2022) will conduct the first meta-analysis of correlations between personal factors and group creativity outcomes. The authors will search and synthesize the existing (published and unpublished) literature according to predetermined criteria to (1) assess the overall relationship between a broad list of personal factors and creativity outcomes in group settings and (2) explore potential moderators of these relationships. The latter research question includes substantive moderators, such as familiarity between group members, group size, and type of task, but also publication status.
 
The Stage 1 manuscript was evaluated over five rounds of in depth-review. Based on detailed responses to reviewers’ and the recommenders’ comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance.
 
URL to the preregistered Stage 1 protocol: https://osf.io/nybg6
 
Level of bias control achieved: Level 3. At least some data/evidence that will be used to the answer the research question has been previously accessed by the authors (e.g. downloaded or otherwise received), but the authors certify that they have not yet observed ANY part of the data/evidence. 
 
List of eligible PCI RR-friendly journals:
 

 

References

1. Fillon, A. A., Girandola, F., Bonnardel, N., Kenworth, J. B., Wiernik. B. M. & Souchet, L. (2022). Personal factors and group creativity characteristics: A correlational meta-analysis, in principle acceptance of Version 4 by Peer Community in Registered Reports. https://osf.io/nybg6

Personal factors and group creativity characteristics: A correlational meta-analysisAdrien A. Fillon, Fabien Girandola, Nathalie Bonnardel, Jared B. Kenworthy, Brenton M. Wiernik & Lionel Souchet<p>Previous research has investigated the relationship between personal factors and group creativity outcomes. On one side, they showed that individual differences play a role in group creativity. On the other side, they showed that group creativi...Social sciencesJulia M. Rohrer2021-08-03 16:32:23 View
15 Feb 2022
STAGE 1

Does alleviating poverty increase cognitive performance? Short- and long- term evidence from a randomized controlled trial

Understanding the effect of unconditional cash transfers on cognition

Recommended by ORCID_LOGO based on reviews by Charlotte Pennington and Matúš Adamkovič

Over the last decade, a growing body of evidence has revealed potential benefits of unconditional cash transfers (UCTs) on a variety of outcomes, including self-reported happiness and life satisfaction (Haushofer & Shapiro, 2016), economic and financial well-being (Blattman et al., 2013; Baird et al., 2018) and educational attainment (Baird et al., 2016). Although the effects of UCTs do not always out-perform rigorous control conditions (Whillans & West, 2022), these findings prompt the question of whether the alleviation of poverty via UCTs can also influence cognitive processing and performance.

In the current study, Szaszi et al. propose to analyse the results of a previous randomised trial of UCTs by Blattman et al. (2017) to test whether a $200 lump sum administered to a sample of young men in Liberia carries both short- and long-term benefits for a range of executive functions, including attention, response inhibition, and working memory capacity. 

The Stage 1 manuscript was evaluated over two rounds of in-depth review. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).

URL to the preregistered Stage 1 protocol: https://osf.io/k56yv

Level of bias control achieved: Level 2. At least some data/evidence that will be used to answer the research question has been accessed and partially observed by the authors, but the authors certify that they have not yet observed the key variables within the data that will be used to answer the research question AND they have taken additional steps to maximise bias control and rigour.

List of eligible PCI RR-friendly journals:

References

1. Haushofer, J. & Shapiro, J.  (2016). The short-term impact of unconditional cash transfers to the poor: Experimental evidence from Kenya. Quarterly Journal of Economics, 13, 1973–2042. https://doi.org/10.1093/qje/qjw025
 
2. Blattman, C., Fiala, N. & Martinez, S. (2013) Generating skilled self-employment in developing countries: Experimental evidence from Uganda. Quarterly Journal of Economics, 129, 697–752. https://doi.org/10.1093/qje/qjt057
 
3. Baird, S., McKenzie, D., & Özler, B. (2018). The effects of cash transfers on adult labor market outcomes. IZA Journal of Development and Migration, 8, 1-20. https://doi.org/10.1186/s40176-018-0131-9
 
4. Baird, S., Chirwa, E., De Hoop, J., & Özler, B. (2016). Girl power: cash transfers and adolescent welfare: evidence from a cluster-randomized experiment in Malawi. In African Successes, Volume II: Human Capital (pp. 139-164). University of Chicago Press. https://www.nber.org/system/files/chapters/c13380/c13380.pdf
 
5. Whillans, A., & West, C. (2022). Alleviating time poverty among the working poor: A pre-registered longitudinal field experiment. Scientific Reports, 12(1), 1-17. https://doi.org/10.1038/s41598-021-04352-y
 
6. Szaszi, B., Palfi, B., Neszveda, G., Taka, A., Szecsi, P., Blattman, C., Jamison, J. C., & Sheridan, M. (2022). Does alleviating poverty increase cognitive performance? Short- and long- term evidence from a randomized controlled trial, in principle acceptance of version 3 by Peer Community in Registered Reports. https://osf.io/k56yv
 
7. Blattman, C., Jamison, J. C. & Sheridan, M. (2017). Reducing crime and violence: Experimental evidence from cognitive behavioral therapy in Liberia. American Economic Review, 107, 1165–1206. http://doi.org/10.1257/aer.20150503
Does alleviating poverty increase cognitive performance? Short- and long- term evidence from a randomized controlled trialBarnabas Szaszi, Bence Palfi, Gabor Neszveda, Aikaterini Taka, Peter Szecsi, Christopher Blattman, Julian C. Jamison, Margaret Sheridan<p>Recent findings suggest that poverty has a deteriorating effect on cognitive functioning which can reinforce existing social inequalities. In this Registered Report, we will investigate the impact of a poverty alleviation program on cognitive p...Social sciencesChris Chambers2021-07-22 20:34:50 View
16 Sep 2022
STAGE 1

Action-Inaction Asymmetries in Emotions and Counterfactual ‎Thoughts: Meta-Analysis of the Action Effect‎

Charting meta-analytic evidence for the action-effect

Recommended by ORCID_LOGO based on reviews by Dan Quintana, Emiel Cracco and priyali rajagopal

Winston Churchill once famously quipped, “I never worry about action, but only inaction.” Churchill, however, may have been an exception to the rule, with psychological research suggesting that people are more concerned about the consequences of actions than inactions. During the so-called “action-effect”, first reported by Kahneman and Tversky (1982), people regret an action leading to a bad outcome more than they do an inaction leading to the same bad outcome

In the current study, Yeung and Feldman (2022) propose a wide-ranging meta-analysis to characterise evidence for the action-effect, focusing in particular on emotions and counterfactual thoughts – that is, mental representations of alternative decisions (or “what if” thoughts). Consistent with the expected consequences of the action-effect on emotion, they predict that action will be associated with stronger negative emotions than inaction (when outcomes are negative), and with stronger positive emotions than inaction (when outcomes are positive). The authors also expect action to be associated with a greater abundance of counterfactual thought compared to inaction.

In addition to examining the overall reliability of the action-effect (plus a range of exploratory questions), the study will also examine the extent to which the action-effect is moderated by temporal distance (with more recent events or behaviours predicted to associated with a stronger action effect), the type of study design, prior outcomes and social norms, the specificity (vs. generality) of the prior event, and whether the study employed a hypothetical scenario or a real-life event.

The Stage 1 manuscript was evaluated over two rounds of in-depth review. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and awarded in-principle acceptance (IPA).

URL to the preregistered Stage 1 protocol: https://osf.io/4pvs6

Level of bias control achieved: Level 2. At least some data/evidence that will be used to answer the research question has been accessed and partially observed by the authors, but the authors certify that they have not yet observed the key variables within the data that will be used to answer the research question
 
List of eligible PCI RR-friendly journals:
 

References 
 
1. Kahneman, D., & Tversky, A. (1982). The psychology of preferences. Scientific American, 246(1), 160-173. https://doi.org/10.1038/scientificamerican0182-160
 
2. Yeung, S. K. & Feldman, G. (2022). Action-Inaction Asymmetries in Emotions and Counterfactual ‎Thoughts: Meta-Analysis of the Action Effect‎, in principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/4pvs6

Action-Inaction Asymmetries in Emotions and Counterfactual ‎Thoughts: Meta-Analysis of the Action Effect‎Siu Kit Yeung, Gilad Feldman<p>Action-effect refers to the phenomenon in which people experience, associate, or attribute stronger emotions for action compared to inaction. In this registered report, we conducted a meta-analysis of the action effect literature (k = [enter nu...Social sciencesChris Chambers2021-07-16 14:02:56 View
29 Sep 2021
STAGE 1

Evaluating the pedagogical effectiveness of study preregistration in the undergraduate dissertation: A Registered Report

Does incorporating open research practices into the undergraduate curriculum decrease questionable research practices?

Recommended by ORCID_LOGO and ORCID_LOGO based on reviews by Kelsey McCune, Neil Lewis, Jr., Lisa Spitzer and 1 anonymous reviewer

In a time when open research practices are becoming more widely used to combat questionable research practices (QRPs) in academia, this Stage 1 Registered Report by Pownall and colleagues (2021) will empirically investigate the practice of preregistering study plans, which will allow us to better understand to what degree such practices increase awareness of QRPs and whether experience with preregistration helps reduce engagement in QRPs. This investigation is timely because results from these kinds of studies are only recently becoming available and the conclusions are providing evidence that open research practices can improve research quality and reliability (e.g., Soderberg et al. 2020, Chambers & Tzavella 2021). The authors crucially focus on the effect of preregistering the undergraduate senior thesis (of psychology students in the UK), which is a key stage in the development of an academic. This data will help shape the future of how we should teach open research practices and what effect we as teachers can have on budding research careers. The five expert peer reviews were of an extremely high quality and were very thorough. The authors did an excellent job of addressing all of the comments in their responses and revised manuscript versions, which resulted in only one round of peer review, plus a second revision based on Recommender feedback. As such, this registered report meets the Stage 1 criteria and is therefore awarded in-principle acceptance (IPA). We wish the authors the best of luck with the study and we look forward to seeing the results.

URL to the preregistered Stage 1 protocol: https://osf.io/9hjbw

Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.

List of eligible PCI RR-friendly journals:

References

  1. Pownall M, Pennington CR, Norris E, Clark K. 2021. Evaluating the pedagogical effectiveness of study preregistration in the undergraduate dissertation: A Registered Report. OSF, stage 1 preregistration, in principle acceptance of version 1 by Peer Community in Registered Reports.   https://doi.org/10.17605/OSF.IO/9HJBW
  2. Chambers C, Tzavella L (2021). The past, present, and future of Registered Reports. https://doi.org/10.31222/osf.io/43298
  3. Soderberg CK, Errington TM, Schiavone SR, Bottesini J, Thorn FS, Vazire S, Esterling KM, Nosek BA (2021) Initial evidence of research quality of registered reports compared with the standard publishing model. Nature Human Behaviour, 5, 990–997. https://doi.org/10.1038/s41562-021-01142-4
Evaluating the pedagogical effectiveness of study preregistration in the undergraduate dissertation: A Registered Report Madeleine Pownall; Charlotte R. Pennington; Emma Norris; Kait Clark <p style="text-align: justify;">Research shows that questionable research practices (QRPs) are present in undergraduate final-year dissertation projects. One entry-level Open Science practice proposed to mitigate QRPs is ‘study preregistration’, t...Life Sciences, Social sciencesCorina Logan2021-07-08 15:27:24 View