Submit a report

Announcements

We are recruiting recommenders (editors) from all research fields!

Your feedback matters! If you have authored or reviewed a Registered Report at Peer Community in Registered Reports, then please take 5 minutes to leave anonymous feedback about your experience, and view community ratings.

Latest recommendations

IdTitle * Authors * Abstract * PictureThematic fields * RecommenderReviewersSubmission date
24 Oct 2022
STAGE 1

Does childhood adversity alter opioid drug reward? A conceptual replication in outpatients before surgery

Is childhood adversity associated with a heightened response to opioids?

Recommended by ORCID_LOGO based on reviews by Zoltan Dienes, Yuki Yamada and 1 anonymous reviewer
A convergence of evidence suggests that early life adversity may cause dysfunction in opioid-sensitive reward systems. Childhood adversity is associated with opioid use, potentially by altering reward and motivation networks, and experimental models in animals have found that early life adversity increases and consolidates opioid seeking behaviours. Further, in a recent controlled experiment, Carlyle et al. (2021) found that opioid administration produced stronger positive responses, and weaker negative responses, in adults with a history of childhood abuse and neglect.
 
In the current study, Carlyle et al. seek to test the generalisability of these previous findings in a pre-operative clinical setting. Using partially observed data from an existing cohort study (N=155), the authors will test whether patients with greater experience of childhood trauma in turn exhibit a larger mood boost and express greater subjective pleasure following opioid administration. Although not a randomised experimental design, this study provides the opportunity to examine the relationship between opioid response and history of childhood adversity in a naturalistic setting, and thus has the potential to either support or cast doubt on the theory that adversity elevates risk of opioid addiction by altering sensitivity to subjectively pleasurable effects.
 
Following three rounds of in-depth review, the recommender judged that the manuscript met the Stage 1 criteria and awarded in-principle acceptance (IPA).
 
URL to the preregistered Stage 1 protocol: https://osf.io/7ymts
 
Level of bias control achieved: Level 2. At least some data/evidence that will be used to answer the research question has been accessed and partially observed by the authors, but the authors certify that they have not yet observed the key variables within the data that will be used to answer the research question AND they have taken additional steps to maximise bias control and rigour. 
 
List of eligible PCI RR-friendly journals:
 
References
 
1. Carlyle M., Broomby R., Simpson G., Hannon R., Fawaz L., Mollaahmetoglu O.M., Drain, J., Mostazir, M., & Morgan C. (2021). A randomised, double‐blind study investigating the relationship between early childhood trauma and the rewarding effects of morphine. Addiction Biology, 26(6):e13047.
 
2. Carlyle, M., Kvande, M., Leknes, S., Meier, I., Buen, K., Jensen, E. N., Ernst, G. & Eikemo, M. (2022). Does childhood adversity alter opioid drug reward? A conceptual replication in outpatients before surgery, in principle acceptance of Version 4 by Peer Community in Registered Reports. https://osf.io/7ymts
Does childhood adversity alter opioid drug reward? A conceptual replication in outpatients before surgeryMolly Carlyle*, Malin Kvande*, Siri Leknes, Isabell Meier, Kaja Buen, Eira Nordeng Jensen, Gernot Ernst, Marie Eikemo. *denotes equal contribution. <p>PCI-RR Snapshot only</p>Life Sciences, Medical Sciences, Social sciencesChris Chambers2022-03-15 10:07:29 View
30 May 2024
STAGE 1
article picture

The role of resource dynamics in the distribution of life cycles within a female human population

An agent-based model of the role of resource dynamics and the environment in human female life cycles

Recommended by ORCID_LOGO based on reviews by Cecilia Padilla-Iglesias and 1 anonymous reviewer
Among primates, the human female life cycle appears special. Aspects of these life cycles have been linked to the acquisition and distribution of resources and to environmental factors, as well as to individual differences across human females. Many questions remain regarding the causal roles that these (or also other) factors might have played in the evolution of human female life cycles – and also whether generalizing statements about these life cycles can adequately capture the wide range of the observed phenomena.
 
In the current study, Varas Enriquez et al. (2024) outline a plan for an agent-based model approach to study the factors that guide and channel variability in female life cycles in humans (within biological constraints), via the effects that their model will capture. The authors’ model has a particular eye towards the effects of resource dynamics (resource production and resource transfers) and environmental conditions – and their interplay. The results of this agent based model will be thoroughly analysed to better understand the evolution of the specific female human life cycle range.
 
The study plan was refined after one round of review, which led to input from two external reviewers and the recommender. The revised (second) version was judged to satisfy the Stage 1 criteria for in-principle acceptance.
 
URL to the preregistered Stage 1 protocol: https://osf.io/24c7z
 
Level of bias control achieved: Level 2. At least some data/evidence that will be used to answer the research question has been accessed and partially observed by the authors, but the authors certify that they have not yet observed the key variables within the data that will be used to answer the research question AND they have taken additional steps to maximise bias control and rigour (e.g. conservative statistical threshold; recruitment of a blinded analyst; robustness testing, multiverse/specification analysis, or other approach)
 
List of eligible PCI RR-friendly journals:
 
 
References
 
Varas Enríquez, P. J., Lukas, D., Colleran, H, Mulder, M. B., & Redhead, D. (2024) The role of resource dynamics in the distribution of life cycles within a female human population. In principle acceptance of Version 2 by Peer Community in Registered Reports. https://osf.io/24c7z
The role of resource dynamics in the distribution of life cycles within a female human populationPablo J. Varas Enríquez, Daniel Redhead, Monique Borgerhoff Mulder, Heidi Colleran, Dieter Lukas<p>The evolution of the female human life cycle, which is characterised by having a reproductive career nested within juvenile and post-reproductive periods, has been linked to the surplus of adult resource production and downwards inter-generatio...Life Sciences, Medical Sciences, Social sciencesClaudio Tennie2023-11-13 15:45:52 View
29 Sep 2021
STAGE 1

Evaluating the pedagogical effectiveness of study preregistration in the undergraduate dissertation: A Registered Report

Does incorporating open research practices into the undergraduate curriculum decrease questionable research practices?

Recommended by ORCID_LOGO and ORCID_LOGO based on reviews by Kelsey McCune, Neil Lewis, Jr., Lisa Spitzer and 1 anonymous reviewer

In a time when open research practices are becoming more widely used to combat questionable research practices (QRPs) in academia, this Stage 1 Registered Report by Pownall and colleagues (2021) will empirically investigate the practice of preregistering study plans, which will allow us to better understand to what degree such practices increase awareness of QRPs and whether experience with preregistration helps reduce engagement in QRPs. This investigation is timely because results from these kinds of studies are only recently becoming available and the conclusions are providing evidence that open research practices can improve research quality and reliability (e.g., Soderberg et al. 2020, Chambers & Tzavella 2021). The authors crucially focus on the effect of preregistering the undergraduate senior thesis (of psychology students in the UK), which is a key stage in the development of an academic. This data will help shape the future of how we should teach open research practices and what effect we as teachers can have on budding research careers. The five expert peer reviews were of an extremely high quality and were very thorough. The authors did an excellent job of addressing all of the comments in their responses and revised manuscript versions, which resulted in only one round of peer review, plus a second revision based on Recommender feedback. As such, this registered report meets the Stage 1 criteria and is therefore awarded in-principle acceptance (IPA). We wish the authors the best of luck with the study and we look forward to seeing the results.

URL to the preregistered Stage 1 protocol: https://osf.io/9hjbw

Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.

List of eligible PCI RR-friendly journals:

References

  1. Pownall M, Pennington CR, Norris E, Clark K. 2021. Evaluating the pedagogical effectiveness of study preregistration in the undergraduate dissertation: A Registered Report. OSF, stage 1 preregistration, in principle acceptance of version 1 by Peer Community in Registered Reports.   https://doi.org/10.17605/OSF.IO/9HJBW
  2. Chambers C, Tzavella L (2021). The past, present, and future of Registered Reports. https://doi.org/10.31222/osf.io/43298
  3. Soderberg CK, Errington TM, Schiavone SR, Bottesini J, Thorn FS, Vazire S, Esterling KM, Nosek BA (2021) Initial evidence of research quality of registered reports compared with the standard publishing model. Nature Human Behaviour, 5, 990–997. https://doi.org/10.1038/s41562-021-01142-4
Evaluating the pedagogical effectiveness of study preregistration in the undergraduate dissertation: A Registered Report Madeleine Pownall; Charlotte R. Pennington; Emma Norris; Kait Clark <p style="text-align: justify;">Research shows that questionable research practices (QRPs) are present in undergraduate final-year dissertation projects. One entry-level Open Science practice proposed to mitigate QRPs is ‘study preregistration’, t...Life Sciences, Social sciencesCorina Logan2021-07-08 15:27:24 View
22 Nov 2022
STAGE 1

Estimating the Effect of Reward on Sleep-Dependent Memory Consolidation – A Registered Report

How does reward influence the effect of sleep on memory?

Recommended by ORCID_LOGO based on reviews by 2 anonymous reviewers
Sleep and reward each have an important role in human memory. According to the active system consolidation hypothesis, memory consolidation during sleep originates from the repeated reactivation of memory representations that were encoded during wake (Rasch & Born, 2013). Research has also consistently shown that memory performance is enhanced for items or stimuli associated with higher vs. lower rewards. While these lines of evidence are relatively clear, the role of sleep in shaping the interaction between reward and memory is more opaque, likely due to a combination of methodological variation between studies but also due to the field’s reliance on small-N designs and biased reporting practices. Clarifying this three-way relationship, and setting field benchmarks for effect sizes, is crucial not only for building richer neurocognitive models of memory, but for clinical applications such as targeted sleep interventions to treat addiction and other forms of mental illness. 
 
Using a large, stratified online German sample (N=1750), Morgan et al. (2022) will study the three-way relationship between sleep, reward and memory by asking whether, and if so how, reward influences the magnitude of sleep-dependent memory consolidation. Using an AM:PM-PM:AM design in combination with a motivated learning task, the authors will address three main questions: first, whether sleep yields greater memory performance compared to an equivalent period of wake; second whether information associated with higher reward leads to greater memory performance compared to lower reward; and third, the crucial interaction of whether sleep causes greater recognition memory performance for higher vs. lower reward items. The design also includes a series of rigorous positive controls to confirm testability of the hypotheses, while measuring a host of additional moderating variables for exploratory analyses (including age, education status, mental health, and more).
 
The Stage 1 manuscript was evaluated over two rounds of in-depth review. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
 
URL to the preregistered Stage 1 protocol: https://osf.io/q5pk8
 
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA. 
 
List of eligible PCI RR-friendly journals:
 
References
 
1. Rasch, B. & Born, J. (2013). About Sleep's Role in Memory. Physiological Revews, 93, 681–766. https://doi.org/10.1152%2Fphysrev.00032.2012
 
2. Morgan, D. P., Nagel, J., Cagatay Gürsoy, N., Kern, S. & Feld, G. B. (2022). Estimating the effect of reward on sleep-dependent memory consolidation – A Registered Report, in principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/q5pk8
Estimating the Effect of Reward on Sleep-Dependent Memory Consolidation – A Registered ReportDavid P. Morgan, Juliane Nagel, N. Cagatay Gürsoy, Simon Kern & Gordon B. Feld<p>Rewards play an important role in guiding which memories are formed. Dopamine has been shown to be an important neuromodulator mediating the effect of rewards on memory. In rodents dopaminergic activity during learning has been shown to enhance...Life Sciences, Social sciencesChris Chambers2022-05-16 10:12:18 View
04 Dec 2023
STAGE 1

Cerebral laterality as assessed by functional transcranial Doppler ultrasound in left-and right-handers: A comparison between handwriting and writing using a smartphone

Does typing on a smartphone involve the same neural mechanisms as writing by hand?

Recommended by ORCID_LOGO based on reviews by Todd Richards and Dorothy Bishop
Language production is associated with a distinct lateralised pattern of brain activation biased toward the left cerebral hemisphere. This also applies to writing. It has also been shown to be modulated by handedness, with less pronounced lateralisation in left-handers. However, in recent decades the use of handwriting has declined significantly while the use of smartphones has exploded. To date, no study has explored whether the same neural correlates of written language production found for handwriting also hold for typing on a smartphone.
 
In the current study, Samsouris et al. (2023) will use functional transcranial Doppler ultrasound (fTCD) to measure blood flow velocity within cerebral hemispheres to investigate this question. This technique is particularly suited for this purpose because it provides better control for the movement confounds associated with a writing task and the technical challenges of using a smart device than other neuroimaging techniques like fMRI or M/EEG. The authors hypothesise that there will be no difference in left cerebral lateralisation for handwriting and typing on a smartphone. They also expect to replicate previous findings of weaker lateralisation in left-handers in written language production when typing on a smartphone. To isolate the effect of written language production, both these conditions will be corrected for their corresponding motor component using control conditions without a linguistic component.
 
The Stage 1 manuscript was evaluated over 6 rounds of in-depth review by the recommender and two expert reviewers, before issuing in-principle acceptance.
 
URL to the preregistered Stage 1 protocol: https://osf.io/j7egz
 
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.
 
List of eligible PCI RR-friendly journals:
 
References
 
1. Samsouris, C., Badcock, N. A., Vlachos, F., & Papadatou-Pastou, M. (2023). Cerebral laterality as assessed by functional transcranial Doppler ultrasound in left-and right-handers: A comparison between handwriting and writing using a smartphone. In principle acceptance of Version 7 by Peer Community in Registered Reports. https://osf.io/j7egz
Cerebral laterality as assessed by functional transcranial Doppler ultrasound in left-and right-handers: A comparison between handwriting and writing using a smartphoneChristos Samsouris, Nicholas A. Badcock, Filippos Vlachos, Marietta Papadatou-Pastou<p>Neuroscientific studies of traditional handwriting have revealed a left cerebral lateralization pattern for written language production, with distinct patterns between left- and right-handers. However, no study to date has investigated the cere...Life Sciences, Social sciencesD. Samuel Schwarzkopf2022-11-01 10:27:39 View
20 Apr 2023
STAGE 1

Oxytocin, individual differences, and trust game behavior: a registered large-scale replication

Does oxytocin enhance pro-social behaviors?

Recommended by ORCID_LOGO based on reviews by Thibaut Arpinon and 1 anonymous reviewer
Trust is a fundamental element for the well-functioning of our society. By achieving large levels of trust, societies can reduce monitoring costs (e.g., contract supervision, conflict resolution) and increase investments in more profitable but socially riskier projects. Trust serves as a way to foster cooperation among individuals and can benefit the entire social group.
 
As a result, numerous researchers have sought to explore the biological foundations of trust. In particular, several research teams have tried to explore the role of oxytocin in modulating prosocial behaviors. However, previous research findings obtained mixed findings, and several methodological issues, such as low statistical power, have hindered the development of a definite view on the matter.
 
In the current study, Kroll et al. (2023) seek to replicate the seminal study of Kosfeld et al. (2005). Kosfeld and co-authors originally found that the intranasal administration of oxytocin can significantly increase trust among individuals. However, recent replication evidence shows no general effect of oxytocin on pro-social behaviors or suggests that the effect might be heterogeneous among social groups (Declerck et al., 2020). The objective of the current study of Kroll et al. (2023) is twofold. First, the authors propose to replicate the original study of Kosfeld et al. (2005) and to investigate whether the lack of replication can be due to an overall effect that is smaller than the original findings suggest. Second, the authors propose to replicate recent but exploratory results on the heterogeneous effect of oxytocin on pro-social choices. 
 
The Stage 1 manuscript was evaluated over one round of in-depth review. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
 
URL to the preregistered Stage 1 protocol: https://osf.io/h5gdp
 
Level of bias control achieved: Level 4. At least some of the data/evidence that will be used to answer the research question already exists AND is accessible in principle to the authors (e.g. residing in a public database or with a colleague) BUT the authors certify that they have not yet accessed any part of that data/evidence.
 
List of eligible PCI RR-friendly journals:
 
 
References:
 
1. Declerck, C. H., Boone, C., Pauwels, L., Vogt, B., & Fehr, E. (2020). A registered replication study on oxytocin and trust. Nature Human Behaviour, 4(6), 646–655. https://doi.org/10.1038/s41562-020-0878-x
 
2. Kosfeld, M., Heinrichs, M., Zak, P. J., Fischbacher, U., & Fehr, E. (2005). Oxytocin increases trust in humans. Nature, 435(7042), 673–676. https://doi.org/10.1038/nature03701
 
3. Kroll, C. F., Schruers, K., Viechtbauer, W., Vingerhoets, C., Seidel, L., Riedl, A. & Hernaus, D. (2023). Oxytocin, individual differences, and trust game behavior: a registered large-scale replication, in principle acceptance of Version 2 by Peer Community in Registered Reports. https://osf.io/h5gdp
Oxytocin, individual differences, and trust game behavior: a registered large-scale replicationCharlotte F. Kroll, Koen Schruers, Wolfgang Viechtbauer, Claudia Vingerhoets, Leonie Seidel, Arno Riedl, and Dennis Hernaus<p>The neuropeptide oxytocin (OXT) is thought to modulate important aspects of prosocial behavior. In a seminal paper, Kosfeld et al. (2005) reported that intranasally administered OXT modulated trusting behavior in an economic trust game. Several...Life Sciences, Social sciencesRomain Espinosa2022-11-25 18:07:23 View
25 Jun 2023
STAGE 1

Cortical plasticity of the tactile mirror system in borderline personality disorder

Is borderline personality disorder linked to impairment of the tactile mirror system?

Recommended by ORCID_LOGO based on reviews by Zoltan Dienes and 2 anonymous reviewers
Borderline personality disorder (BPD) is a mental illness affecting ~1 in 100 people (Ellison et al., 2018), characterised by emotional dysregulation, impulsivity, a distorted sense of self, and a long-term pattern of unstable interpersonal relationships. Among this heterogenous range of symptoms is difficulty in the cognitive dimension of empathy, in particular understanding the perspectives of others, which in turn has been suggested to rely on the mirror neuron system, both in the motor and somatosensory domains. The integrity of the mirror system has therefore been a focus for understanding the possible causes or consequences of the disorder, with preliminary studies pointing to hypoactivity of neuronal areas associated with the mirror system in BPD (Mier et al., 2013).
 
In the current study, Zazio et al. (2023) will use crossmodal paired associative stimulation (cm-PAS) in which an image of a hand being touched is repeatedly paired with transcranial magnetic stimulation (TMS) of the primary somatosensory cortex (S1) to test the hypothesis that BPD is associated with a specific deficit in the tactile mirror system. In healthy controls, the close temporal coupling (20ms) between the visual depiction of tactile stimulation and TMS of S1 is expected boost tactile acuity and elevate the performance cost of incongruence in a task that manipulates visuo-tactile spatial congruity (VTSC) – effects that are thought to reflect the fidelity of the tactile mirror system.
 
In BPD patients, however, the authors make the crucial prediction that impairment of the tactile mirror system (if present) will lead to a reduced (or even non-existent) effect of cm-PAS on tactile acuity and VTSC task performance compared to healthy controls. To help ensure a severe test of this hypothesis, the design includes a variety of controls, including an attention check, control cm-PAS in which the inter-stimulus interval is increased to 100ms to break the close temporal coupling between visual stimulation and TMS, and a positive control to confirm that active cm-PAS (compared to control cm-PAS) produces the expected boost in tactile acuity in healthy controls.
 
The Stage 1 manuscript was evaluated over three rounds of in-depth review. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
 
URL to the preregistered Stage 1 protocol: https://osf.io/sqnwd
 
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.
 
List of eligible PCI RR-friendly journals:
 
References
 
1. Ellison, W. D., Rosenstein, L. K., Morgan, T. A., & Zimmerman, M. (2018). Community and clinical epidemiology of borderline personality disorder. Psychiatric Clinics, 41, 561-573. https://doi.org/10.1016/j.psc.2018.07.008

2. Mier, D., Lis, S., Esslinger, C., Sauer, C., Hagenhoff, M., Ulferts, J., Gallhofer, B. & Kirsch, P. (2013). Neuronal correlates of social cognition in borderline personality disorder. Social Cognitive and Affective Neuroscience, 8, 531-537. https://doi.org/10.1093/scan/nss028
 
2. Zazio, A., Guidali, G., Rossi, R., Bolognini, N. & Bortoletto, A. (2023). Cortical plasticity of the tactile mirror system in borderline personality disorder, in principle acceptance of Version 4 by Peer Community in Registered Reports. https://osf.io/sqnwd
Cortical plasticity of the tactile mirror system in borderline personality disorderAgnese Zazio, Giacomo Guidali, Roberta Rossi, Nadia Bolognini, Marta Bortoletto<p>People with borderline personality disorder (BPD) show alterations in empathic abilities, which may involve automatic simulation processes relying on mirror-like mechanisms in the somatosensory domain. In the tactile mirror system, the observat...Life Sciences, Social sciencesChris Chambers2023-01-05 21:50:15 View
31 Dec 2024
STAGE 1

How Does Model (Mis)Specification Impact Statistical Power, Type I Error Rate, and Parameter Bias in Moderated Mediation?

Dependence of power and type I error on model misspecification for mediated moderation

Recommended by ORCID_LOGO based on reviews by Mijke Rhemtulla, Pier-Olivier Caron and Reny Baykova
Researchers are often interested in moderated mediation. A predictor variable, such as number of counselling sessions, may predict an outcome, such as approach to a feared object, by way of a mediator, for example number of times the object was described in counselling. The strength of mediation in turn may depend on a moderator, such as vividness of imagery: Counselling reduces fear by way of imaginative exposure, particularly in those with vivid imagery. There may be a number of mediators ("indirect" paths), and any or all of these mediators may be moderated. In testing moderated mediation, a statistical model is specified which may or may not match the data generating process; in particular, there may or may not be moderators in the model corresponding to moderators that may or may not exist in the real data generating process, resulting in overspecification (more moderators of the indirect paths in the model than reality), underspecification (less moderators of indirect paths in the model than reality) or complete misspecification (where the moderated indirect paths in the model are not moderated in reality, and vice versa).

Researchers rely on the validity of tests (correct type I error rates), if they use frequentist statistics. Model misspecification may impact the validity of inferential tests for moderated mediation. Similarly, researchers need to be able to assess power for any analysis. In simulating power for mediated moderation, it may be important to know the possible extent to which the model is misspecified, and take this into account in planning numbers of participants. Fossum et al. (2024) will address this important problem with a series of simulations to determine if power is reduced meaningfully with over or under specification, or type I error and parameter estimates are biased for complete misspecification.
 
The Stage 1 manuscript was evaluated over two rounds of in-depth review. Based on ​detailed responses to reviewers’ and the recommender’s comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance.​​​
 
URL to the preregistered Stage 1 protocol: https://osf.io/8gwfu

Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.
 
List of eligible PCI-RR-friendly journals:
 
 
References
 
Fossum, J. L., Montoya, A. K., & Anderson, S. F. (2024). How Does Model (Mis)Specification Impact Statistical Power, Type I Error Rate, and Parameter Bias in Moderated Mediation? A Registered Report. In principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/8gwfu
How Does Model (Mis)Specification Impact Statistical Power, Type I Error Rate, and Parameter Bias in Moderated Mediation?Jessica L. Fossum, Amanda K. Montoya, and Samantha F. Anderson<p>Moderated mediation models are commonly used in psychological research and other academic fields to model when and how effects occur. Researchers must choose which paths in the mediation model are moderated when specifying this type of model. W...Life Sciences, Social sciencesZoltan Dienes2023-02-04 00:13:10 View
18 May 2023
STAGE 1

A multilab investigation into the N2pc as an indicator of attentional selectivity: Direct replication of Eimer (1996)

Is the N2pc a correlate of attentional selection? An #EEGManyLabs multi-lab registered replication of Eimer (1996)

Recommended by ORCID_LOGO based on reviews by Reny Baykova and Clayton Hickey
The N2pc is a lateralised ERP component that is often interpreted as a marker of attentional allocation, so much so that it is frequently used a tool in the attention literature for inferring that a stimulus was attentionally processed. This interpretation of N2pc can be traced back to the seminal work of Eimer (1996), which has been conceptually replicated many times but has never been replicated directly.
 
This registered direct replication by Constant et al. (2023) forms part of a larger series of large-scale, multi-lab replications of highly influential EEG papers by the #EEGManyLabs project (Pavlov et al., 2021). Seven labs (with the potential for more to sign up later), will conduct high-powered replications of the critical Experiment 2 of Eimer (1996), where in the crucial conditions, participants discriminate a target letter (M vs W) or colour (blue vs green) in the presence of a distractor. Using four preprocessing pipelines, including the original, the authors will test whether the N2pc is observed over parieto-occipital electrodes contralateral to target presentation.  
 
The Stage 1 manuscript was evaluated over one round of in-depth review and one additional round of minor corrections. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
 
URL to the preregistered Stage 1 protocol: https://osf.io/dw68r
 
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA (so-called “primary RR”)
 
List of eligible PCI RR-friendly journals:
 
 
References
 
1. Constant, M., Mandal, A., Asanowicz, D., Yamaguchi, M., Gillmeister, H., Kerzel, D., Luque, D., Pesciarelli, F., Fehr, T., Mushtaq, F., Pavlov, Y. G. & Liesefeld, H. R. (2023). A multilab investigation into the N2pc as an indicator of attentional selectivity: Direct replication of Eimer (1996), in principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/dw68r
 
2. Eimer, M. (1996). The N2pc component as an indicator of attentional selectivity. Electroencephalography and Clinical Neurophysiology, 99, 225-234. https://doi.org/10.1016/0013-4694(96)95711-9
 
3. Pavlov, Y. G., Adamian, N., Appelhoff, S., Arvaneh, M., Benwell, C. S., Beste, C., ... & Mushtaq, F. (2021). #EEGManyLabs: Investigating the replicability of influential EEG experiments. Cortex, 144, 213-229. https://doi.org/10.1016/j.cortex.2021.03.013
A multilab investigation into the N2pc as an indicator of attentional selectivity: Direct replication of Eimer (1996)Martin Constant, Ananya Mandal, Dariusz Asanowicz, Motonori Yamaguchi, Helge Gillmeister, Dirk Kerzel, David Luque, Francesca Pesciarelli, Thorsten Fehr, Faisal Mushtaq, Yuri G. Pavlov, Heinrich R. Liesefeld<p>The N2pc is widely employed as an electrophysiological marker of an attention allocation. This interpretation was in no small part driven by the observation of an N2pc elicited by an isolated relevant target object, which was reported as Experi...Life Sciences, Social sciencesMaxine Sherman2023-02-24 11:41:52 View
18 Aug 2023
STAGE 2
(Go to stage 1)

Evaluating the Pedagogical Effectiveness of Study Preregistration in the Undergraduate Dissertation

Incorporating open research practices into the undergraduate curriculum increases understanding of such practices

Recommended by ORCID_LOGO based on reviews by Kelsey McCune, Neil Lewis, Jr., Lisa Spitzer and 1 anonymous reviewer
In a time when open research practices are becoming more widely used to combat questionable research practices (QRPs) in academia, this Registered Report by Pownall and colleagues (2023) empirically investigated the practice of preregistering study plans, which allows us to better understand to what degree such practices increase awareness of QRPs and whether experience with preregistration helps reduce engagement in QRPs. This investigation is timely because results from these kinds of studies are only recently becoming available and the conclusions are providing evidence that open research practices can improve research quality and reliability (e.g., Soderberg et al. 2021, Chambers & Tzavella 2022). The authors crucially focused on the effect of preregistering the undergraduate senior thesis (of psychology students in the UK), which is a key stage in the development of an academic.
 
Pownall and colleagues found that preregistration did not affect attitudes toward QRPs, but it did improve student understanding of open research practices. Using exploratory analyses, they additionally found that those who preregistered were those students who reported that they had more opportunity, motivation, and greater capability. This shows how important it is to incorporate the teaching of open research practices such that students can increase their capability, motivation, and opportunity to pursue such practices, whether it is preregistration or other practices that are better known to reduce QRPs (such as registered reports; Krypotos et al. 2022). 
 
After four rounds of review and revisions, the recommender judged that the manuscript met the Stage 2 criteria and awarded a positive recommendation.
 
URL to the preregistered Stage 1 protocol: https://osf.io/9hjbw
 
Level of bias control achieved: Level 6. No part of the data or evidence that was used to answer the research question was generated until after IPA.
 
List of eligible PCI RR-friendly journals:
 
 
References
 
1. Chambers C. D. & Tzavella, L. (2022). The past, present, and future of Registered Reports. Nature Human Behaviour, 6, 29-42. https://doi.org/10.1038/s41562-021-01193-7
 
2. Krypotos, A. M., Mertens, G., Klugkist, I., & Engelhard, I. M. (2022). Preregistration: Definition, advantages, disadvantages, and how it can help against questionable research practices. In Avoiding Questionable Research Practices in Applied Psychology (pp. 343-357). Cham: Springer International Publishing.
 
3. Pownall, M., Pennington, C. R., Norris, E., Juanchich, M., Smaile, D., Russell, S., Gooch, D., Rhys Evans, T., Persson, S., Mak, M. H. C., Tzavella, L., Monk, R., Gough, T., Benwell, C. S. Y., Elsherif, M., Farran, E., Gallagher-Mitchell, T., Kendrick, L. T., Bahnmueller, J., Nordmann, E., Zaneva, M., Gilligan-Lee, K., Bazhydai, M., Jones, A., Sedgmond, J., Holzleitner, I., Reynolds, J., Moss, J., Farrelly, D., Parker, A. J. & Clark, K. (2023). Evaluating the pedagogical effectiveness of study preregistration in the undergraduate dissertation [Stage 2 Registered Report], acceptance of Version 4 by Peer Community in Registered Reports. https://psyarxiv.com/xg2ah
 
4. Soderberg C. K., Errington T. M., Schiavone S. R., Bottesini J., Thorn F. S., Vazire S., Esterling K. M. & Nosek B. A. (2021) Initial evidence of research quality of registered reports compared with the standard publishing model. Nature Human Behaviour, 5, 990–997. https://doi.org/10.1038/s41562-021-01142-4
Evaluating the Pedagogical Effectiveness of Study Preregistration in the Undergraduate DissertationMadeleine Pownall, Charlotte R. Pennington, Emma Norris, Marie Juanchich, David Smaile, Sophie Russell, Debbie Gooch, Thomas Rhys Evans, Sofia Persson, Matthew HC Mak, Loukia Tzavella, Rebecca Monk, Thomas Gough, Christopher SY Benwell, Mahmoud El...<p>Research shows that questionable research practices (QRPs) are present in undergraduate final-year dissertation projects. One entry-level Open Science practice proposed to mitigate QRPs is ‘study preregistration’, through which researchers outl...Life Sciences, Social sciencesCorina Logan2023-03-25 11:38:54 View