Submit a report

Announcements

We are recruiting recommenders (editors) from all research fields!

Your feedback matters! If you have authored or reviewed a Registered Report at Peer Community in Registered Reports, then please take 5 minutes to leave anonymous feedback about your experience, and view community ratings.


 

Latest recommendationsrssmastodon

IdTitle▲AuthorsAbstractPictureThematic fieldsRecommenderReviewersSubmission date
27 Mar 2024
STAGE 1
toto

Registered Report: Are anticipatory predictions enhanced in tinnitus and independent of hearing loss?

Can predictive coding explain subjective tinnitus?

Recommended by ORCID_LOGO based on reviews by Will Sedley, Pia Brinkmann and Emilie Cardon
Subjective tinnitus is a common disorder in which people experience a persistent sound in the absence of any external source. The underlying causes of tinnitus are debated – although the condition is strongly associated with hearing loss resulting from auditory damage, much remains to be understood about the neural processes that give rise to the phantom perception. Various classes of neurophysiological theories have been proposed, including the “altered gain” model – in which neurons in the auditory pathway increase their responsiveness to compensate for reduced auditory input following hearing loss – and the “noise cancellation” model –  in which disrupted feedback connections from limbic regions are unable to tune out phantom signals. Although these theories account for much observed data, they have not been conclusively supported, and their ability to explain tinnitus is limited by the fact that hearing loss and tinnitus can arise independently and at different times.
 
In the current study, Reisinger et al. (2023) will test an emerging alternative theory based on a Bayesian predictive-coding framework (Sedley et al., 2016) in which the alteration of perceptual priors leads the auditory system to expect a sound that, if functioning normally, it should not expect. Using magnetoencephalography (MEG) in a sample of tinnitus patients (and carefully-matched controls for age, gender, and level of hearing loss), they will ask whether tinnitus is associated with anticipatory brain activation, tuned to the carrier-frequency of an expected auditory stimulus. Specifically, the authors predict that if the predictive-coding framework is correct then individuals with tinnitus should show different regularity-dependent pre-activations of carrier- frequency-specific information compared to the control group, while tone carrier-frequencies should be processed normally in tinnitus patients. They also predict that any such pre-activations should not be related to levels of reported subjective tinnitus distress, as measured with the short version of the Tinnitus Questionnaire (mini-TQ).
 
The Stage 1 manuscript was evaluated over two rounds of in-depth review. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
 
URL to the preregistered Stage 1 protocol: https://osf.io/6gvpy
 
Level of bias control achieved: Level 3. At least some data/evidence that will be used to the answer the research question has been previously accessed by the authors (e.g. downloaded or otherwise received), but the authors certify that they have not yet observed ANY part of the data/evidence.
 
List of eligible PCI RR-friendly journals: 
 
 
References
 
Reisinger, L., Demarchi, G., Rösch, , S., Trinka, E., Obleser, L., & Weisz, N.  (2023). Registered Report: Are anticipatory predictions enhanced in tinnitus and independent of hearing loss? In principle acceptance of Version 4 by Peer Community in Registered Reports. https://osf.io/6gvpy
 
Sedley, W., Friston, K. J., Gander, P. E., Kumar, S., & Griffiths, T. D. (2016). An integrative tinnitus model based on sensory precision. Trends in Neurosciences, 39, 799-812. https://doi.org/10.1016/j.tins.2016.10.004
Registered Report: Are anticipatory predictions enhanced in tinnitus and independent of hearing loss?L. Reisinger, G. Demarchi, S. Rösch, E. Trinka, J. Obleser, N. Weisz<p>Phantom perceptions occur without any identifiable environmental or bodily source. The mechanisms and key drivers behind phantom perceptions like tinnitus are not well understood. The dominant view suggests that tinnitus results from hyperactiv...Life SciencesChris Chambers2023-01-03 08:35:12 View
17 Oct 2022
STAGE 1
toto

Relationship between creativity and depression: the role of reappraisal and rumination

Understanding the relationship between creativity and depressive traits

Recommended by ORCID_LOGO based on reviews by Kate Button and 1 anonymous reviewer
For centuries, the relationship between creativity and mental health has been a subject of fascination, propelled by the impression that many of the most famous artists in history likely suffered from mood disorders or other mental illnesses. However, with the advent of psychological science – including more precise and diagnostic clinical measures – the empirical evidence for an association between creativity and depressive symptoms has been mixed, with some studies suggesting a positive relationship and others showing either no effect or indicating that the link, if there is one, may be driven by other personality characteristics (Verhaeghen et al., 2005).
 
In the current study, Lam and Saunders will use an online design in 200 participants to ask whether creativity is associated with higher depressive traits, and further, whether that relationship depends on two additional variables that could explain an observed positive correlation: self-reflective rumination (repetitive thoughts that maintain a negative mood state) and the frequency with which individuals engage in reappraisal (a regulation strategy that involves reinterpreting an event or situation to diminish its negative impact). If justified by the main confirmatory findings, the authors will also explore the moderating role of gender and how any observed associations are reflected in more fine-grained measures of creativity. The results promise to shed light on not only the basic question of whether creativity is related to depressive traits, but the extent to which that association depends on related determinants of mental health.
 
Following two rounds of in-depth review, the recommender judged that the manuscript met the Stage 1 criteria and awarded in-principle acceptance (IPA).  
 
URL to the preregistered Stage 1 protocol: https://osf.io/yub7n
 
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA. 
 
List of eligible PCI RR-friendly journals:
 
References
 
1. Verhaeghen, P., Joormann, J., & Khan, R. (2005). Why we sing the blues: The relation between self-reflective rumination, mood, and creativity. Emotion, 5(2), 226-232. https://doi.org/10.1037/1528-3542.5.2.226
 
2. Lam, C. Y. & Saunders, J. A. (2022). Relationship between creativity and depression: the role of reappraisal and rumination, in principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/yub7n
Relationship between creativity and depression: the role of reappraisal and ruminationChin Yui Lam and Jeffrey Allen Saunders<p>Previous research has found mixed evidence about whether increased creativity is associated with higher depression. We investigated the relationship between creativity and depression, and the role of two emotion regulation strategies: ruminatio...Social sciencesChris Chambers2022-01-27 10:53:10 View
08 Nov 2023
STAGE 2
(Go to stage 1)
toto

Relationship between creativity and depression: the role of reappraisal and rumination

Evidence for a weak relationship between creativity and depressive traits

Recommended by ORCID_LOGO
For centuries, the relationship between creativity and mental health has been a subject of fascination, propelled by the impression that many of the most famous artists in history likely suffered from mood disorders or other mental illnesses. However, with the advent of psychological science – including more precise and diagnostic clinical measures – the empirical evidence for an association between creativity and depressive symptoms has been mixed, with some studies suggesting a positive relationship and others showing either no effect or indicating that the link, if there is one, may be driven by other personality characteristics (Verhaeghen et al., 2005).
 
In the current study, Lam and Saunders used an online design in 201 participants to ask whether creativity is associated with higher depressive traits, and further, whether that relationship depends on two additional variables that could explain an observed positive correlation: self-reflective rumination (repetitive thoughts that maintain a negative mood state) and the frequency with which individuals engage in reappraisal (a regulation strategy that involves reinterpreting an event or situation to diminish its negative impact).
 
Results showed mixed support for the hypotheses. Contrary to expectations, the relationship between creativity and depression was significantly negative rather than positive. However, even though the directionality of this relationship was opposite to predicted, the hypothesis that the association between creativity and depression is mediated by self-reflective rumination was supported. Finally, the results disconfirmed the hypothesis that reappraisal frequency contributes to the relationship between creativity and depression. Exploratory analyses indicated no reliable moderating role of gender. Overall, these findings suggest that creativity and depression may be only weakly related, and that self-reflective rumination could account for that relationship.
 
The Stage 2 manuscript was evaluated over one round of review provided by the recommender and Managing Board, as the Stage 1 reviewers were no longer available. Based on additional changes to the manuscript, the recommender judged that the manuscript met the Stage 2 criteria and awarded a positive recommendation.
 
URL to the preregistered Stage 1 protocol: https://osf.io/yub7n
 
Level of bias control achieved: Level 6. No part of the data or evidence that was used to answer the research question was generated until after IPA. 
 
List of eligible PCI RR-friendly journals:
 
References
 
1. Verhaeghen, P., Joormann, J., & Khan, R. (2005). Why we sing the blues: The relation between self-reflective rumination, mood, and creativity. Emotion, 5, 226-232. https://doi.org/10.1037/1528-3542.5.2.226
 
2. Lam, C. Y. & Saunders, J. A. (2023). Relationship between creativity and depression: the role of reappraisal and rumination [Stage 2 Registered Report]. Acceptance of Version 2 by Peer Community in Registered Reports. https://osf.io/z3ap5
Relationship between creativity and depression: the role of reappraisal and ruminationChin Yui Lam and Jeffrey Allen Saunders<p>Previous research has found mixed evidence about whether increased creativity is associated with higher depression. We investigated the relationship between creativity and depression, and the role of two emotion regulation strategies: ruminatio...Social sciencesChris Chambers2023-07-27 11:42:43 View
17 Nov 2022
STAGE 1
toto

Removing barriers to plant-based diets: assisting doctors with vegan patients

Stage 1 acceptance (IPA)

Recommended by ORCID_LOGO based on reviews by Joshua Tasoff, Bence Palfi and Alaa Aldoh

Thank you for your careful response to the points of myself and the reviewers. I am now happy to award in principle acceptance (IPA). As requested, your submission is being awarded a private Stage 1 acceptance, which will not appear yet on the PCI RR website. Your Stage 1 manuscript has also been registered under the requested 4-year private embargo on the OSF (link below).

URL to the preregistered Stage 1 protocol: https://osf.io/fc9gp

Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.

List of eligible PCI RR-friendly journals:

Removing barriers to plant-based diets: assisting doctors with vegan patientsRomain Espinosa, Thibaut Arpinon, Paco Maginot, Sébastien Demange, and Florimond Peureux<div style="text-align: justify;">Shifting to plant-based diets can alleviate many of the externalities associated with the current food system. Spontaneous shifts in diet are often hindered by consumers’ imperfect knowledge about the health risks...Medical Sciences, Social sciencesZoltan Dienes2021-08-16 16:50:43 View
17 Nov 2022
STAGE 2
(Go to stage 1)
toto

Removing barriers to plant-based diets: assisting doctors with vegan patients

Informing doctors of the evidence on plant-based diets

Recommended by ORCID_LOGO based on reviews by Alaa Aldoh, Joshua Tasoff and Bence Palfi
What the best diet is has always been an area of contention. But one thing is clear: Meat is not necessary for health or fitness, and a diet high in plant proteins may well be especially healthy (e.g. Herpich et al., 2022). Further, plant- rather than animal-based diets leave a lower carbon footprint. So what might hold people back from adopting a plant-based diet? One reason is that people may understandably approach their doctor for advice; and the doctor may advise against it, given that many doctors are not well trained in nutrition (Crowley et al., 2019).

Espinosa et al. (2022) conducted a randomised control trial on French general practitioners with 200 doctors given a leaflet and access to an online platform, and 200 controls. The information in the materials concerned the health benefits of plant-based diets, and what nutrients (e.g. B12) may be deficient and what may not be. Attitudes towards and knowledge about plant-based diets was assessed. On a scale of 0-100% expressing whether they would advise for or against (0 = not at all, 100 = absolutely), the intervention shifted attitudes making them more positive about plant based diets by 17 percentage points. However, knowledge of specifically what is worth testing for (e.g. is zinc deficiency more probable or not?) did not change much. The research shows just what can be achieved by a small leaflet (shifting attitudes) and what may require more extensive training (knowledge of relevant medical practice).

The Stage 2 manuscript was evaluated over one round of in-depth review. Based on the responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 2 criteria and awarded a positive recommendation.
 
URL to the preregistered Stage 1 protocol: https://osf.io/fc9gp
 
Level of bias control achieved: Level 6. No part of the data or evidence that was used to answer the research question existed prior to Stage 1 in-principle acceptance.
 
List of eligible PCI RR-friendly journals:
 

References

1. Crowley, J., Ball, L. & Hiddink, G. J. (2019.) Nutrition in medical education: a systematic review. Lancet Planetary Health. 3, e379–e389. https://doi.org/10.1016/S2542-5196(19)30171-8
 
2. Herpich, C., Müller-Werdan, U., & Norman, K. (2022). Role of plant-based diets in promoting health and longevity. Maturitas, 165, 47-51. https://doi.org/10.1016/j.maturitas.2022.07.003
 
3. Espinosa, R., Arpinon, T., Maginot, P., Demange, S. & Peureux, F. (2022). Removing barriers to plant-based diets: assisting doctors with vegan patients, acceptance of Version 2 by Peer Community in Registered Reports. https://osf.io/kq6eh?view_only=66eab29c7acb4aebbcec4631cbcb9217
Removing barriers to plant-based diets: assisting doctors with vegan patientsRomain Espinosa, Thibaut Arpinon, Paco Maginot, Sébastien Demange, and Florimond Peureux<p>Shifting to plant-based diets can alleviate many of the externalities associated with the current food<br>system. Spontaneous shifts in diet are often hindered by consumers’ imperfect knowledge about the<br>health risks and benefits, which lead...Medical Sciences, Social sciencesZoltan Dienes2022-08-27 11:01:32 View
21 Oct 2022
STAGE 1
toto

Replicating the facilitatory effects of transcranial random noise stimulation on motion processing: A registered report

Testing the facilitatory effect of high-frequency transcranial random noise stimulation through enhancement of global motion processing

Recommended by ORCID_LOGO based on reviews by Sam Westwood and Filippo Ghin
High frequency transcranial random noise stimulation (hf-tRNS) is a relatively novel form of non-invasive brain stimulation, thought to enhance neural excitability and facilitate processing in targeted brain areas. The evidence for the efficacy of hf-tRNS is mixed, so a high-powered test of the proposed facilitatory effects would be of value to the field. This Registered Report will target the human middle temporal complex (hMT+), an area with a well-established critical role in global motion processing. The protocol is adapted from a study by Ghin and colleagues (2018) but focusing on a sub-set of the original experimental conditions and using a fully within-subjects design (n=42). Global motion processing will be operationalised in terms of the coherence threshold for identification of the dominant direction of random-dot motion. The experiment will test the predicted facilitation of contralateral motion processing (reduced coherence threshold) during hf-tRNS to the left hMT+. The specificity of this effect will be tested by comparison to a sham stimulation control condition and an active stimulation control condition (left forehead). By targeting a brain area with a well-established critical role in behaviour, this study will provide important information about the replicability and specificity of the facilitatory effects of hf-tRNS.
 
Following two rounds of in-depth review, the recommender judged that the manuscript met the Stage 1 criteria and awarded in-principle acceptance (IPA).  
 
URL to the preregistered Stage 1 protocol: https://osf.io/bce7u
 
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA. 
 
List of eligible PCI RR-friendly journals:
 
References
 
1. Ghin, F., Pavan, A., Contillo, A., & Mather, G. (2018). The effects of high-frequency transcranial random noise stimulation (hf-tRNS) on global motion processing: an equivalent noise approach. Brain Stimulation, 11, 1263–75.
 
2. Caroll, M. B., Edwards, G. & Baker, C. I. (2022). Replicating the facilitatory effects of transcranial random noise stimulation on motion processing: A registered report, in principle acceptance of Version 7 by Peer Community in Registered Reports. https://osf.io/bce7u
Replicating the facilitatory effects of transcranial random noise stimulation on motion processing: A registered reportMica B. Carroll*, Grace Edwards*, Chris I. Baker<p>Non-invasive brain stimulation (NIBS) techniques have the potential to demonstrate the causal impact of targeted brain regions on specific behaviors, and to regulate or facilitate behavior in clinical applications. Transcranial random noise sti...Life SciencesRobert McIntosh2022-06-02 21:25:02 View
11 Sep 2023
STAGE 1
toto

Researcher Predictions of Effect Generalizability Across Global Samples

Can psychology researchers predict which effects will generalise across cultures?

Recommended by ORCID_LOGO based on reviews by Michèle Nuijten, Ian Hussey, Jim Grange and Matthias Stefan
Compared to the wealth of debate surrounding replicability and transparency, relatively little attention has been paid to the issue of generalisability – the extent to which research findings hold across different samples, cultures, and other parameters. Existing research suggests that researchers in psychology are prone to generalisation bias, relying on narrow samples (e.g. drawn predominantly from US or European undergraduate samples) to draw broad conclusions about the mind and behaviour. While recent attempts to address generalisability concerns have been made – such as journals requiring explicit statements acknowledging constraints on generality – addressing this bias at root, and developing truly generalisable methods and results, requires a deeper understanding of how researchers perceive generalisability in the first place.
 
In the current study, Schmidt et al. (2023) tackle the issue of cross-cultural generalisability using four large-scale international studies that are being conducted as part of the Psychological Science Accelerator (PSA) – a globally distributed network of researchers in psychology that coordinates crowdsourced research projects across six continents. Specifically, participants (who will be PSA research members) will estimate the probability that an expected focal effect will be observed both overall and within regional subsamples of the PSA studies. They will also predict the size of these focal effects overall and by region.
 
Using this methodology, the authors plan to ask two main questions: first whether researchers can accurately predict the generalisability of psychological phenomena in upcoming studies, and second whether certain researcher characteristics (including various measures of expertise, experience, and demographics) are associated with the accuracy of generalisability predictions. Based on previous evidence that scientists can successfully predict the outcomes of research studies, the authors expect to observe a positive association between predicted and actual outcomes and effect sizes. In secondary analyses, the authors will also test if researchers can predict when variables that capture relevant cultural differences will moderate the focal effects – if so, this would suggest that at least some researchers have a deeper understanding as to why the effects generalise (or not) across cultural contexts.
 
The Stage 1 manuscript was evaluated over two rounds of in-depth review. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
 
URL to the preregistered Stage 1 protocol: https://osf.io/vwqsa (under temporary private embargo)
 
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.
 
List of eligible PCI RR-friendly journals:
 
 
References
 
1. Schmidt, K., Silverstein, P. & Chartier, C. R. (2023). Registered Report: Researcher Predictions of Effect Generalizability Across Global Samples. In principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/vwqsa
Researcher Predictions of Effect Generalizability Across Global SamplesKathleen Schmidt, Priya Silverstein, & Christopher R. Chartier<p>The generalizability of effects is an increasing concern among researchers in psychological science. Traditionally, the field has relied on university samples from Europe and North America to make claims about humans writ large. The proposed re...Social sciencesChris Chambers2023-02-16 03:49:35 View
08 Nov 2023
STAGE 2
(Go to stage 1)
toto

Responding to Online Toxicity: Which Strategies Make Others Feel Freer to Contribute, Believe That Toxicity Will Decrease, and Believe that Justice Has Been Restored?

Benevolent correction may provide a promising antidote to online toxicity

Recommended by ORCID_LOGO based on reviews by Corina Logan and Marcel Martončik
Social media is a popular tool for online discussion and debate, bringing with it various forms of hostile interactions –  from offensive remarks and insults, to harassment and threats of physical violence. The nature of such online toxicity has been well studied, but much remains to be understood regarding strategies to reduce it. Existing theory and evidence suggests that a range of responses – including those that emphasise prosociality and empathy – might be effective at mitigating online toxicity. But do such strategies work in practice?
 
In the current study, Young Reusser et al (2023) tested the effectiveness of three types of responses to online toxicity – benevolent correction (including disagreement), benevolent going along (including joking/agreement) and retaliation (additional toxicity) – on how able participants feel to contribute to conversations, their belief that the toxicity would be reduced by the intervention, and their belief that justice had been restored.
 
The results showed the benevolent correction – while an uncommon strategy in online communities – was most effective in helping participants feel freer to contribute to online discussions. Benevolent correction was also the preferred approach for discouraging toxicity and restoring justice. Overall, the findings suggest that responding to toxic commenters with empathy and understanding while (crucially) also correcting their toxicity may be an effective intervention for bystanders seeking to improve the health of online interaction. The authors note that future research should focus on whether benevolent correction actually discourages toxicity, which wasn't tested in the current experiment, and if so how the use of benevolent corrections might be encouraged.
 
Following one round of review and revisions, the recommender judged that the manuscript met the Stage 2 criteria and awarded a positive recommendation.
 
URL to the preregistered Stage 1 protocol: https://osf.io/hfjnb
 
Level of bias control achieved: Level 6. No part of the data or evidence that was used to answer the research question was generated until after IPA. 
 
List of eligible PCI RR-friendly journals:
 
References
 
1. Young Reusser, A. I., Veit, K. M., Gassin, E. A., & Case, J. P. (2023). Responding to Online Toxicity: 
Which Strategies Make Others Feel Freer to Contribute, Believe That Toxicity Will Decrease, and Believe that Justice Has Been Restored? [Stage 2 Registered Report] Acceptance of Version 2 by Peer Community in Registered Reports. https://osf.io/k46e8
Responding to Online Toxicity: Which Strategies Make Others Feel Freer to Contribute, Believe That Toxicity Will Decrease, and Believe that Justice Has Been Restored?Alison I. Young Reusser, Kristian M. Veit, Elizabeth A. Gassin, and Jonathan P. Case<p>When we encounter toxic comments online, how might individual efforts to reply to those comments improve others’ experiences conversing in that forum? Is it more helpful for others to publicly, but benevolently (with a polite tone, demonstrated...Social sciencesChris Chambers2023-08-02 05:30:37 View
23 Jan 2023
STAGE 1
toto

Responding to Online Toxicity: Which Strategies Make Others Feel Freer to Contribute, Believe That Toxicity Will Decrease, and Believe that Justice Has Been Restored?

Testing antidotes to online toxicity

Recommended by ORCID_LOGO based on reviews by Corina Logan and Marcel Martončik
Social media is a popular tool for online discussion and debate, bringing with it various forms of hostile interactions –  from offensive remarks and insults, to harassment and threats of physical violence. The nature of such online toxicity has been well studied, but much remains to be understood regarding strategies to reduce it. Existing theory and evidence suggests that a range of responses – including those that emphasise prosociality and empathy – might be effective at mitigating online toxicity. But do such strategies work in practice?
 
In the current study, Young Reusser et al (2023) propose an experiment to test the effectiveness of three types of responses to online toxicity – Benevolent Correction (including disagreement), Benevolent Going Along (including joking/agreement), or Retaliation (additional toxicity) – on how able participants feel to contribute to conversations, their belief that the toxicity would be reduced by the intervention, and their belief that justice had been restored. The findings promise to shed light on approaches for improving the health of online discourse.
 
The Stage 1 manuscript was evaluated over two rounds of in-depth review. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
 
URL to the preregistered Stage 1 protocol: https://osf.io/hfjnb (under temporary private embargo)
 
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA. 
 
List of eligible PCI RR-friendly journals:
 
References
 
1. Young Reusser, A. I., Veit, K. M., Gassin, E. A., & Case, J. P. (2023). Responding to Online Toxicity: Which Strategies Make Others Feel Freer to Contribute, Believe That Toxicity Will Decrease, and Believe that Justice Has Been Restored? In principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/hfjnb
Responding to Online Toxicity: Which Strategies Make Others Feel Freer to Contribute, Believe That Toxicity Will Decrease, and Believe that Justice Has Been Restored?Alison I. Young Reusser, Houghton University; Kristian Veit, Olivet Nazarene University; Lisa Gassin, Olivet Nazarene University; Jonathan Case, Houghton University<p>When we encounter toxic comments online, how might individual efforts to reply to those comments improve others’ experiences conversing in that forum? Is it more helpful for others to publicly, but benevolently (with a polite tone, demonstrated...Social sciencesChris Chambers2022-06-08 18:35:48 View
14 Feb 2024
STAGE 1
article picture

Restriction of researcher degrees of freedom through the Psychological Research Preregistration-Quantitative (PRP-QUANT) Template

Examining the restrictiveness of the PRP-QUANT Template

Recommended by ORCID_LOGO based on reviews by Marjan Bakker and 1 anonymous reviewer
The Psychological Research Preregistration-Quantitative Template has been created in 2022 to provide more structure and detail to preregistrations. The goal of the current study is to test if the PRP-QUANT template indeed provides greater restriction of the flexibility in a study for preregistered hypotheses than other existing templates. This question is important because one concern that has been raised about the practice of preregistration is that the quality of preregistrations is often low. Metascientific research has shown that preregistrations are often of low quality (Bakker et al., 2020), and hypothesis tests from preregistrations are still selectively reported (van den Akker, van Assen, Enting, et al., 2023). It is important to improve the quality of preregistrations, and if a better template can help, it is a cost-effective approach to improve quality if the wider adoption of the better template can be promoted. 
 
In the current study, Spitzer and Mueller (2024) will follow the procedure of a previous meta-scientific study by Heirene et al. (2021). 74 existing preregistrations with the PRP-QUANT template are available, and will be compared with an existing dataset coded by Bakker and colleagues (2020). The sample size is limited, but allows detecting some differences that would be considered large enough to matter, even though there might be smaller differences that would not be detectable based on the currently available sample size. Nevertheless, given that there is a need for improvement, even preliminary data might already be useful to provide tentative recommendations. Restrictiveness will be coded in 23 items, and adherence to or deviations from the preregistration are coded as well. As such deviations are common, the question whether this template reduced the likelihood of deviations is important. Two coders will code all studies. 
 
The study should provide a useful initial evaluation of the PRP-QUANT template, and has the potential to have practical implications if the PRP-QUANT template shows clear benefits. Both authors have declared COI's related to the PRP-QUANT template, making the Registered Report format a fitting approach to prevent confirmation bias from influencing the reported results. 
 
This Stage 1 manuscript was evaluated over two rounds of in-depth review by two expert reviewers and the recommender. After the revisions, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
 
URL to the preregistered Stage 1 protocol: https://osf.io/vhezj
 
Level of bias control achieved: Level 3. At least some data/evidence that will be used to the answer the research question has been previously accessed by the authors (e.g. downloaded or otherwise received), but the authors certify that they have not yet observed ANY part of the data/evidence.
 
List of eligible PCI RR-friendly journals:
 
 
References
 
1. van den Akker, O. R., van Assen, M. A. L. M., Bakker, M., Elsherif, M., Wong, T. K., & Wicherts, J. M. (2023). Preregistration in practice: A comparison of preregistered and non-preregistered studies in psychology. Behavior Research Methods. https://doi.org/10.3758/s13428-023-02277-0
 
2. Bakker, M., Veldkamp, C. L. S., Assen, M. A. L. M. van, Crompvoets, E. A. V., Ong, H. H., Nosek, B. A., Soderberg, C. K., Mellor, D., & Wicherts, J. M. (2020). Ensuring the quality and specificity of preregistrations. PLOS Biology, 18(12), e3000937. https://doi.org/10.1371/journal.pbio.3000937
 
3. Spitzer, L. & Mueller, S. (2024). Stage 1 Registered Report: Restriction of researcher degrees of freedom through the Psychological Research Preregistration-Quantitative (PRP-QUANT) Template. In principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/vhezj
 
4. Heirene, R., LaPlante, D., Louderback, E. R., Keen, B., Bakker, M., Serafimovska, A., & Gainsbury, S. M. (2021). Preregistration specificity & adherence: A review of preregistered gambling studies & cross-disciplinary comparison. PsyArXiv. https://doi.org/10.31234/osf.io/nj4es
Restriction of researcher degrees of freedom through the Psychological Research Preregistration-Quantitative (PRP-QUANT) TemplateLisa Spitzer & Stefanie Mueller<p>Preregistration can help to restrict researcher degrees of freedom and thereby ensure the integrity of research findings. However, its ability to restrict such flexibility depends on whether researchers specify their study plan in sufficient de...Social sciencesDaniel Lakens2023-06-01 10:39:20 View