We are recruiting recommenders (editors) from all research fields!
Your feedback matters! If you have authored or reviewed a Registered Report at Peer Community in Registered Reports, then please take 5 minutes to leave anonymous feedback about your experience, and view community ratings.
Latest recommendations
| Id | Title * | Authors * | Abstract * | Picture | Thematic fields * ▼ | Recommender | Reviewers | Submission date | |
|---|---|---|---|---|---|---|---|---|---|
Genetically-modified animals as models of neurodevelopmental conditions: a review of systematic review reporting qualityEvidence for mixed quality of systematic reviews in preclinical animal studies of neurodevelopmental conditionsRecommended by Chris Chambers based on reviews by Marietta Papadatou-Pastou
Single gene alterations have been estimated to account for nearly half of neurodevelopmental conditions (NDCs), providing a crucial opportunity for animal models to understand the underlying mechanisms, causes and potential treatments. The use of systematic reviews (SRs) can, in principle, provide a powerful means to synthesise this evidence-base; however, the reporting quality of previous SRs in preclinical animal research has been found lacking (Hunniford et al., 2021). In the current study, Wilson et al. (2023) will undertook a review of systematic reviews to assess the characteristics and reporting quality of SRs that, in turn, synthesise research in genetically-modified animals to model NDCs. In particular, the authors extracted key features of reviews (including, among others, the aim and primary research questions, relevant animal model, and number of studies in the SR), in addition to quality indicators such as risk of bias and completeness of reporting. In doing so, the authors aimed to enhance guidance on the conduct and reporting of systematic reviews in this area.
Of twelve publications that met the preregistered search criteria, the completeness and quality of reporting was variable. Among the better reported characteristics were search strategies (9 of 12 articles), reporting of funding sources (10 of 12 articles) and use of animal data (11 of 12 articles). In contrast, only two articles reported whether the study protocol was preregistered, only three articles reported methods for assessing risk of bias, and just one included methods to analyse publication bias. In addition, the authors identified 19 review registrations via PROSPERO, most of which remained unpublished after their anticipated end dates. Overall, the results highlight the importance of adherence to reporting guidelines for increasing the transparency and reproducibility of SRs in this field.
The Stage 2 manuscript was evaluated over one round of in-depth review. Based on detailed responses by the authors, the recommender judged that the manuscript met the Stage 2 criteria and awarded a positive recommendation.
URL to the preregistered Stage 1 protocol: https://osf.io/952qk Level of bias control achieved: Level 4. At least some of the data/evidence that was used to answer the research question already existed prior to IPA and was accessible in principle to the authors, but the authors certify that they did not access any part of that data/evidence prior to IPA.
List of eligible PCI RR-friendly journals: References
1. Hunniford V. T., Montroy J., Fergusson D. A., Avey M. T., Wever K. E., McCann S. K., Foster M., Fox G., Lafreniere M., Ghaly M., Mannell S., Godwinska K., Gentles A., Selim S., MacNeil J., Sikora L., Sena E. S., Page M. J., Macleod M., Moher D., & Lalu M. M. (2021). Epidemiology and reporting characteristics of preclinical systematic reviews. PLOS Biology, 19:e3001177. https://doi.org/10.1371/journal.pbio.3001177
2. Wilson, E., Currie, G., Macleod, M., Kind, P. & Sena, E. S. (2023). Genetically-modified animals as models of neurodevelopmental conditions: a review of systematic review reporting quality [Stage 2]. Acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/s5xd4
| Genetically-modified animals as models of neurodevelopmental conditions: a review of systematic review reporting quality | Emma Wilson, Gillian Currie, Malcolm Macleod, Peter Kind, and Emily S Sena | <p><strong>Objective</strong><br>Using genetically-modified animals to model neurodevelopmental conditions (NDCs) helps better our understanding of biology underlying these conditions. Animal research has unique characteristics not shared with cli... | Medical Sciences | Chris Chambers | 2023-11-22 10:26:44 | |||
31 Dec 2024
STAGE 1
Allostatic Interoception in Frontotemporal Dementia: A Scoping Review ProtocolWhat is the evidence for interoceptive and allostatic dysfunction in frontotemporal dementia?Recommended by Mateo Leganes-Fonteneau based on reviews by Mallory Feldman, Eliza Bliss-Moreau and 1 anonymous reviewer
Frontotemporal dementia (FTD) refers to a range of neurodegenerative diseases involving progressive deterioration of frontal and temporal brain networks. This scoping review protocol by Carneiro et al. (2024) promises to make a valuable contribution to the conceptualization of dysregulated interoception (the ability to sense and interpret internal bodily signals) and allostasis (anticipation and adjustment of energy use in response to environmental demands) in the context of FTD. The work also has broader implications, potentially offering key insights into the interplay between sensory and regulatory signals, which hold relevance not only for dementia but also for other mental disorders characterized by maladaptive allostatic adaptations, such as addiction. This broader applicability underscores the potential impact of the review across multiple domains of mental health research.
The Stage 1 manuscript was evaluated over two rounds of in-depth review. Based on detailed responses to reviewers’ and the recommender’s comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance.
URL to the preregistered Stage 1 protocol: https://osf.io/skebz Level of bias control achieved: Level 2. At least some data/evidence that will be used to answer the research question has been accessed and partially observed by the authors, but the authors certify that they have not yet observed the key variables within the data that will be used to answer the research question. List of eligible PCI-RR-friendly journals: References Carneiro, F., Hazelton, J. L., Campos, C., Ibáñez, A., & Ferreira-Santos, F. (2024). Allostatic interoception in frontotemporal dementia: a scoping review protocol. In principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/skebz
| Allostatic Interoception in Frontotemporal Dementia: A Scoping Review Protocol | Fábio Carneiro, Jessica L. Hazelton, Carlos Campos, Agustín Ibáñez, Fernando Ferreira-Santos | <p>Frontotemporal dementia (FTD) encompasses a spectrum of disorders characterized by distinct behavioral, cognitive, and motor symptoms. Deficits in interoception and allostasis have garnered attention, considering the involvement of the allostat... | Medical Sciences | Mateo Leganes-Fonteneau | 2024-03-08 19:37:35 | |||
08 Mar 2025
STAGE 1
Noninvasive Neuromodulation of Visual Perception and Neural Connectivity in Body Dysmorphic Disorder: A Registered ReportUnderstanding the combined effects of brain stimulation and visual attention modification in body dysmorphic disorderRecommended by Anna Elisabeth Fürtjes based on reviews by Samuel Westwood and 1 anonymous reviewer
This study by Diaz-Fong et al. (2025) plans to investigate body dysmorphic disorder (BDD), an understudied psychiatric condition marked by distortions in the perception of a patients’ physical appearance. The authors build on evidence that perceptual symptoms in BDD are underpinned by attentional biases, which may relate to abnormal visual processing and neural connectivity in the dorsal visual stream (DVS; reduced activation) and the ventral visual stream (VVS; increased activation). Prior evidence suggests that activation in the DVS and the VVS may be modifiable by both non-invasive neuromodulation (including transcranial magnetic stimulation), as well as behavioural interventions such as the Visual Modification (ModV) paradigm, which has been suggested to reduce patients’ foveal attention to perceived bodily defects. The ModV paradigm has been specifically linked with altered VVS and DVS activation and connectivity.
Here the authors will test in a within-subject crossover design (N = 40) whether neural connectivity and visual perceptual biases in BDD and subclinical BDD can be modified by combining the effects of altered visual attention in the ModV paradigm with repetitive transcranial magnetic stimulation (continuous and intermittent theta burst stimulation; cTBS and iTBS). By combining a behavioural and an exogenous intervention, the authors predict an increase in the magnitude of clinically meaningful improvements in attentional biases in BDD, with iTBS expected to enhance, and cTBS expected to inhibit the effects of visual attention modification through ModV on neural connectivity (measured using fMRI) and visual processing. More specifically, the effect of TBS is hypothesised to be stronger after patients perform ModV.
The Stage 1 manuscript was evaluated by two experts who performed in-depth peer review across multiple rounds of revisions. The authors were responsive in editing their manuscript based on the reviewers’ comments and dedicated much effort to increasing the clarity and interpretability of their power analyses. The revised manuscript was judged to meet the Stage 1 criteria and was awarded in-principle acceptance (IPA).
URL to the preregistered Stage 1 protocol: https://osf.io/ks425 (under temporary private embargo)
Level of bias control achieved: Level 3. At least some data/evidence that will be used to the answer the research question has been previously accessed by the authors (e.g. downloaded or otherwise received), but the authors certify that they have not yet observed any part of the data/evidence. List of eligible PCI RR-friendly journals:
References
Diaz-Fong, J. P., Lewis, M., Qian, J., Wong, W.-W., Leuchter, A. F., Tadayonnejad, R., Voineskos, D., Konstantinou, G., Lam, E., Blumberger, D. M., Feusner, J. D. (2025). Noninvasive neuromodulation of visual perception and neural connectivity in body dysmorphic disorder: a registered report. In principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/ks425
| Noninvasive Neuromodulation of Visual Perception and Neural Connectivity in Body Dysmorphic Disorder: A Registered Report | Joel P. Diaz-Fong, Madison Lewis, Jessica Qian, Wan-Wa Wong, Andrew F. Leuchter, Reza Tadayonnejad, Daphne Voineskos, Gerasimos Konstantinou, Eileen Lam, Daniel M. Blumberger, Jamie D. Feusner | <p>Body dysmorphic disorder is a debilitating and understudied psychiatric condition characterized by perceptual distortions pertaining to one’s physical appearance. Current evidence suggests that abnormalities in visual processing likely underlie... | Medical Sciences | Anna Elisabeth Fürtjes | Samuel Westwood, Andreas Horn, Song Luan, Philip Lewis, Tim Constandinou, Micheal Fox, Yang Dan, Paul Fitzgerald, Biyu He, David A. McCormick, Steven Cohen, Anonymous | 2024-05-02 01:31:43 | ||
29 Sep 2021
STAGE 1
Evaluating the pedagogical effectiveness of study preregistration in the undergraduate dissertation: A Registered ReportDoes incorporating open research practices into the undergraduate curriculum decrease questionable research practices?Recommended by Corina Logan and Chris Chambers based on reviews by Kelsey McCune, Neil Lewis, Jr., Lisa Spitzer and 1 anonymous reviewer
In a time when open research practices are becoming more widely used to combat questionable research practices (QRPs) in academia, this Stage 1 Registered Report by Pownall and colleagues (2021) will empirically investigate the practice of preregistering study plans, which will allow us to better understand to what degree such practices increase awareness of QRPs and whether experience with preregistration helps reduce engagement in QRPs. This investigation is timely because results from these kinds of studies are only recently becoming available and the conclusions are providing evidence that open research practices can improve research quality and reliability (e.g., Soderberg et al. 2020, Chambers & Tzavella 2021). The authors crucially focus on the effect of preregistering the undergraduate senior thesis (of psychology students in the UK), which is a key stage in the development of an academic. This data will help shape the future of how we should teach open research practices and what effect we as teachers can have on budding research careers. The five expert peer reviews were of an extremely high quality and were very thorough. The authors did an excellent job of addressing all of the comments in their responses and revised manuscript versions, which resulted in only one round of peer review, plus a second revision based on Recommender feedback. As such, this registered report meets the Stage 1 criteria and is therefore awarded in-principle acceptance (IPA). We wish the authors the best of luck with the study and we look forward to seeing the results. URL to the preregistered Stage 1 protocol: https://osf.io/9hjbw Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA. List of eligible PCI RR-friendly journals:
References
| Evaluating the pedagogical effectiveness of study preregistration in the undergraduate dissertation: A Registered Report | Madeleine Pownall; Charlotte R. Pennington; Emma Norris; Kait Clark | <p style="text-align: justify;">Research shows that questionable research practices (QRPs) are present in undergraduate final-year dissertation projects. One entry-level Open Science practice proposed to mitigate QRPs is ‘study preregistration’, t... | Life Sciences, Social sciences | Corina Logan | 2021-07-08 15:27:24 | |||
22 Nov 2022
STAGE 1
Estimating the Effect of Reward on Sleep-Dependent Memory Consolidation – A Registered ReportHow does reward influence the effect of sleep on memory?Recommended by Chris Chambers based on reviews by 2 anonymous reviewers
Sleep and reward each have an important role in human memory. According to the active system consolidation hypothesis, memory consolidation during sleep originates from the repeated reactivation of memory representations that were encoded during wake (Rasch & Born, 2013). Research has also consistently shown that memory performance is enhanced for items or stimuli associated with higher vs. lower rewards. While these lines of evidence are relatively clear, the role of sleep in shaping the interaction between reward and memory is more opaque, likely due to a combination of methodological variation between studies but also due to the field’s reliance on small-N designs and biased reporting practices. Clarifying this three-way relationship, and setting field benchmarks for effect sizes, is crucial not only for building richer neurocognitive models of memory, but for clinical applications such as targeted sleep interventions to treat addiction and other forms of mental illness.
Using a large, stratified online German sample (N=1750), Morgan et al. (2022) will study the three-way relationship between sleep, reward and memory by asking whether, and if so how, reward influences the magnitude of sleep-dependent memory consolidation. Using an AM:PM-PM:AM design in combination with a motivated learning task, the authors will address three main questions: first, whether sleep yields greater memory performance compared to an equivalent period of wake; second whether information associated with higher reward leads to greater memory performance compared to lower reward; and third, the crucial interaction of whether sleep causes greater recognition memory performance for higher vs. lower reward items. The design also includes a series of rigorous positive controls to confirm testability of the hypotheses, while measuring a host of additional moderating variables for exploratory analyses (including age, education status, mental health, and more).
The Stage 1 manuscript was evaluated over two rounds of in-depth review. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
URL to the preregistered Stage 1 protocol: https://osf.io/q5pk8
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA. List of eligible PCI RR-friendly journals: References
1. Rasch, B. & Born, J. (2013). About Sleep's Role in Memory. Physiological Revews, 93, 681–766. https://doi.org/10.1152%2Fphysrev.00032.2012
2. Morgan, D. P., Nagel, J., Cagatay Gürsoy, N., Kern, S. & Feld, G. B. (2022). Estimating the effect of reward on sleep-dependent memory consolidation – A Registered Report, in principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/q5pk8
| Estimating the Effect of Reward on Sleep-Dependent Memory Consolidation – A Registered Report | David P. Morgan, Juliane Nagel, N. Cagatay Gürsoy, Simon Kern & Gordon B. Feld | <p>Rewards play an important role in guiding which memories are formed. Dopamine has been shown to be an important neuromodulator mediating the effect of rewards on memory. In rodents dopaminergic activity during learning has been shown to enhance... | Life Sciences, Social sciences | Chris Chambers | 2022-05-16 10:12:18 | |||
04 Dec 2023
STAGE 1
Cerebral laterality as assessed by functional transcranial Doppler ultrasound in left-and right-handers: A comparison between handwriting and writing using a smartphoneDoes typing on a smartphone involve the same neural mechanisms as writing by hand?Recommended by D. Samuel Schwarzkopf based on reviews by Todd Richards and Dorothy Bishop
Language production is associated with a distinct lateralised pattern of brain activation biased toward the left cerebral hemisphere. This also applies to writing. It has also been shown to be modulated by handedness, with less pronounced lateralisation in left-handers. However, in recent decades the use of handwriting has declined significantly while the use of smartphones has exploded. To date, no study has explored whether the same neural correlates of written language production found for handwriting also hold for typing on a smartphone.
In the current study, Samsouris et al. (2023) will use functional transcranial Doppler ultrasound (fTCD) to measure blood flow velocity within cerebral hemispheres to investigate this question. This technique is particularly suited for this purpose because it provides better control for the movement confounds associated with a writing task and the technical challenges of using a smart device than other neuroimaging techniques like fMRI or M/EEG. The authors hypothesise that there will be no difference in left cerebral lateralisation for handwriting and typing on a smartphone. They also expect to replicate previous findings of weaker lateralisation in left-handers in written language production when typing on a smartphone. To isolate the effect of written language production, both these conditions will be corrected for their corresponding motor component using control conditions without a linguistic component.
The Stage 1 manuscript was evaluated over 6 rounds of in-depth review by the recommender and two expert reviewers, before issuing in-principle acceptance.
URL to the preregistered Stage 1 protocol: https://osf.io/j7egz
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA. List of eligible PCI RR-friendly journals:
References
1. Samsouris, C., Badcock, N. A., Vlachos, F., & Papadatou-Pastou, M. (2023). Cerebral laterality as assessed by functional transcranial Doppler ultrasound in left-and right-handers: A comparison between handwriting and writing using a smartphone. In principle acceptance of Version 7 by Peer Community in Registered Reports. https://osf.io/j7egz
| Cerebral laterality as assessed by functional transcranial Doppler ultrasound in left-and right-handers: A comparison between handwriting and writing using a smartphone | Christos Samsouris, Nicholas A. Badcock, Filippos Vlachos, Marietta Papadatou-Pastou | <p>Neuroscientific studies of traditional handwriting have revealed a left cerebral lateralization pattern for written language production, with distinct patterns between left- and right-handers. However, no study to date has investigated the cere... | Life Sciences, Social sciences | D. Samuel Schwarzkopf | 2022-11-01 10:27:39 | |||
20 Apr 2023
STAGE 1
Oxytocin, individual differences, and trust game behavior: a registered large-scale replicationDoes oxytocin enhance pro-social behaviors?Recommended by Romain Espinosa based on reviews by Thibaut Arpinon and 1 anonymous reviewer
Trust is a fundamental element for the well-functioning of our society. By achieving large levels of trust, societies can reduce monitoring costs (e.g., contract supervision, conflict resolution) and increase investments in more profitable but socially riskier projects. Trust serves as a way to foster cooperation among individuals and can benefit the entire social group.
As a result, numerous researchers have sought to explore the biological foundations of trust. In particular, several research teams have tried to explore the role of oxytocin in modulating prosocial behaviors. However, previous research findings obtained mixed findings, and several methodological issues, such as low statistical power, have hindered the development of a definite view on the matter.
In the current study, Kroll et al. (2023) seek to replicate the seminal study of Kosfeld et al. (2005). Kosfeld and co-authors originally found that the intranasal administration of oxytocin can significantly increase trust among individuals. However, recent replication evidence shows no general effect of oxytocin on pro-social behaviors or suggests that the effect might be heterogeneous among social groups (Declerck et al., 2020). The objective of the current study of Kroll et al. (2023) is twofold. First, the authors propose to replicate the original study of Kosfeld et al. (2005) and to investigate whether the lack of replication can be due to an overall effect that is smaller than the original findings suggest. Second, the authors propose to replicate recent but exploratory results on the heterogeneous effect of oxytocin on pro-social choices.
The Stage 1 manuscript was evaluated over one round of in-depth review. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
URL to the preregistered Stage 1 protocol: https://osf.io/h5gdp
Level of bias control achieved: Level 4. At least some of the data/evidence that will be used to answer the research question already exists AND is accessible in principle to the authors (e.g. residing in a public database or with a colleague) BUT the authors certify that they have not yet accessed any part of that data/evidence.
List of eligible PCI RR-friendly journals:
References:
1. Declerck, C. H., Boone, C., Pauwels, L., Vogt, B., & Fehr, E. (2020). A registered replication study on oxytocin and trust. Nature Human Behaviour, 4(6), 646–655. https://doi.org/10.1038/s41562-020-0878-x
2. Kosfeld, M., Heinrichs, M., Zak, P. J., Fischbacher, U., & Fehr, E. (2005). Oxytocin increases trust in humans. Nature, 435(7042), 673–676. https://doi.org/10.1038/nature03701
3. Kroll, C. F., Schruers, K., Viechtbauer, W., Vingerhoets, C., Seidel, L., Riedl, A. & Hernaus, D. (2023). Oxytocin, individual differences, and trust game behavior: a registered large-scale replication, in principle acceptance of Version 2 by Peer Community in Registered Reports. https://osf.io/h5gdp
| Oxytocin, individual differences, and trust game behavior: a registered large-scale replication | Charlotte F. Kroll, Koen Schruers, Wolfgang Viechtbauer, Claudia Vingerhoets, Leonie Seidel, Arno Riedl, and Dennis Hernaus | <p>The neuropeptide oxytocin (OXT) is thought to modulate important aspects of prosocial behavior. In a seminal paper, Kosfeld et al. (2005) reported that intranasally administered OXT modulated trusting behavior in an economic trust game. Several... | Life Sciences, Social sciences | Romain Espinosa | 2022-11-25 18:07:23 | |||
25 Jun 2023
STAGE 1
Cortical plasticity of the tactile mirror system in borderline personality disorderIs borderline personality disorder linked to impairment of the tactile mirror system?Recommended by Chris Chambers based on reviews by Zoltan Dienes and 2 anonymous reviewers
Borderline personality disorder (BPD) is a mental illness affecting ~1 in 100 people (Ellison et al., 2018), characterised by emotional dysregulation, impulsivity, a distorted sense of self, and a long-term pattern of unstable interpersonal relationships. Among this heterogenous range of symptoms is difficulty in the cognitive dimension of empathy, in particular understanding the perspectives of others, which in turn has been suggested to rely on the mirror neuron system, both in the motor and somatosensory domains. The integrity of the mirror system has therefore been a focus for understanding the possible causes or consequences of the disorder, with preliminary studies pointing to hypoactivity of neuronal areas associated with the mirror system in BPD (Mier et al., 2013).
In the current study, Zazio et al. (2023) will use crossmodal paired associative stimulation (cm-PAS) in which an image of a hand being touched is repeatedly paired with transcranial magnetic stimulation (TMS) of the primary somatosensory cortex (S1) to test the hypothesis that BPD is associated with a specific deficit in the tactile mirror system. In healthy controls, the close temporal coupling (20ms) between the visual depiction of tactile stimulation and TMS of S1 is expected boost tactile acuity and elevate the performance cost of incongruence in a task that manipulates visuo-tactile spatial congruity (VTSC) – effects that are thought to reflect the fidelity of the tactile mirror system.
In BPD patients, however, the authors make the crucial prediction that impairment of the tactile mirror system (if present) will lead to a reduced (or even non-existent) effect of cm-PAS on tactile acuity and VTSC task performance compared to healthy controls. To help ensure a severe test of this hypothesis, the design includes a variety of controls, including an attention check, control cm-PAS in which the inter-stimulus interval is increased to 100ms to break the close temporal coupling between visual stimulation and TMS, and a positive control to confirm that active cm-PAS (compared to control cm-PAS) produces the expected boost in tactile acuity in healthy controls.
The Stage 1 manuscript was evaluated over three rounds of in-depth review. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
URL to the preregistered Stage 1 protocol: https://osf.io/sqnwd
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA. List of eligible PCI RR-friendly journals:
References
1. Ellison, W. D., Rosenstein, L. K., Morgan, T. A., & Zimmerman, M. (2018). Community and clinical epidemiology of borderline personality disorder. Psychiatric Clinics, 41, 561-573. https://doi.org/10.1016/j.psc.2018.07.008
2. Mier, D., Lis, S., Esslinger, C., Sauer, C., Hagenhoff, M., Ulferts, J., Gallhofer, B. & Kirsch, P. (2013). Neuronal correlates of social cognition in borderline personality disorder. Social Cognitive and Affective Neuroscience, 8, 531-537. https://doi.org/10.1093/scan/nss028 2. Zazio, A., Guidali, G., Rossi, R., Bolognini, N. & Bortoletto, A. (2023). Cortical plasticity of the tactile mirror system in borderline personality disorder, in principle acceptance of Version 4 by Peer Community in Registered Reports. https://osf.io/sqnwd
| Cortical plasticity of the tactile mirror system in borderline personality disorder | Agnese Zazio, Giacomo Guidali, Roberta Rossi, Nadia Bolognini, Marta Bortoletto | <p>People with borderline personality disorder (BPD) show alterations in empathic abilities, which may involve automatic simulation processes relying on mirror-like mechanisms in the somatosensory domain. In the tactile mirror system, the observat... | Life Sciences, Social sciences | Chris Chambers | 2023-01-05 21:50:15 | |||
31 Dec 2024
STAGE 1
How Does Model (Mis)Specification Impact Statistical Power, Type I Error Rate, and Parameter Bias in Moderated Mediation?Dependence of power and type I error on model misspecification for mediated moderationRecommended by Zoltan Dienes based on reviews by Mijke Rhemtulla, Pier-Olivier Caron and Reny Baykova
Researchers are often interested in moderated mediation. A predictor variable, such as number of counselling sessions, may predict an outcome, such as approach to a feared object, by way of a mediator, for example number of times the object was described in counselling. The strength of mediation in turn may depend on a moderator, such as vividness of imagery: Counselling reduces fear by way of imaginative exposure, particularly in those with vivid imagery. There may be a number of mediators ("indirect" paths), and any or all of these mediators may be moderated. In testing moderated mediation, a statistical model is specified which may or may not match the data generating process; in particular, there may or may not be moderators in the model corresponding to moderators that may or may not exist in the real data generating process, resulting in overspecification (more moderators of the indirect paths in the model than reality), underspecification (less moderators of indirect paths in the model than reality) or complete misspecification (where the moderated indirect paths in the model are not moderated in reality, and vice versa).
Researchers rely on the validity of tests (correct type I error rates), if they use frequentist statistics. Model misspecification may impact the validity of inferential tests for moderated mediation. Similarly, researchers need to be able to assess power for any analysis. In simulating power for mediated moderation, it may be important to know the possible extent to which the model is misspecified, and take this into account in planning numbers of participants. Fossum et al. (2024) will address this important problem with a series of simulations to determine if power is reduced meaningfully with over or under specification, or type I error and parameter estimates are biased for complete misspecification. The Stage 1 manuscript was evaluated over two rounds of in-depth review. Based on detailed responses to reviewers’ and the recommender’s comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance.
URL to the preregistered Stage 1 protocol: https://osf.io/8gwfu
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA. List of eligible PCI-RR-friendly journals:
References Fossum, J. L., Montoya, A. K., & Anderson, S. F. (2024). How Does Model (Mis)Specification Impact Statistical Power, Type I Error Rate, and Parameter Bias in Moderated Mediation? A Registered Report. In principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/8gwfu
| How Does Model (Mis)Specification Impact Statistical Power, Type I Error Rate, and Parameter Bias in Moderated Mediation? | Jessica L. Fossum, Amanda K. Montoya, and Samantha F. Anderson | <p>Moderated mediation models are commonly used in psychological research and other academic fields to model when and how effects occur. Researchers must choose which paths in the mediation model are moderated when specifying this type of model. W... | Life Sciences, Social sciences | Zoltan Dienes | 2023-02-04 00:13:10 | |||
18 May 2023
STAGE 1
A multilab investigation into the N2pc as an indicator of attentional selectivity: Direct replication of Eimer (1996)Is the N2pc a correlate of attentional selection? An #EEGManyLabs multi-lab registered replication of Eimer (1996)Recommended by Maxine Sherman based on reviews by Reny Baykova and Clayton Hickey
The N2pc is a lateralised ERP component that is often interpreted as a marker of attentional allocation, so much so that it is frequently used a tool in the attention literature for inferring that a stimulus was attentionally processed. This interpretation of N2pc can be traced back to the seminal work of Eimer (1996), which has been conceptually replicated many times but has never been replicated directly.
This registered direct replication by Constant et al. (2023) forms part of a larger series of large-scale, multi-lab replications of highly influential EEG papers by the #EEGManyLabs project (Pavlov et al., 2021). Seven labs (with the potential for more to sign up later), will conduct high-powered replications of the critical Experiment 2 of Eimer (1996), where in the crucial conditions, participants discriminate a target letter (M vs W) or colour (blue vs green) in the presence of a distractor. Using four preprocessing pipelines, including the original, the authors will test whether the N2pc is observed over parieto-occipital electrodes contralateral to target presentation.
The Stage 1 manuscript was evaluated over one round of in-depth review and one additional round of minor corrections. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
URL to the preregistered Stage 1 protocol: https://osf.io/dw68r
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA (so-called “primary RR”)
List of eligible PCI RR-friendly journals:
References
1. Constant, M., Mandal, A., Asanowicz, D., Yamaguchi, M., Gillmeister, H., Kerzel, D., Luque, D., Pesciarelli, F., Fehr, T., Mushtaq, F., Pavlov, Y. G. & Liesefeld, H. R. (2023). A multilab investigation into the N2pc as an indicator of attentional selectivity: Direct replication of Eimer (1996), in principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/dw68r
2. Eimer, M. (1996). The N2pc component as an indicator of attentional selectivity. Electroencephalography and Clinical Neurophysiology, 99, 225-234. https://doi.org/10.1016/0013-4694(96)95711-9
3. Pavlov, Y. G., Adamian, N., Appelhoff, S., Arvaneh, M., Benwell, C. S., Beste, C., ... & Mushtaq, F. (2021). #EEGManyLabs: Investigating the replicability of influential EEG experiments. Cortex, 144, 213-229. https://doi.org/10.1016/j.cortex.2021.03.013
| A multilab investigation into the N2pc as an indicator of attentional selectivity: Direct replication of Eimer (1996) | Martin Constant, Ananya Mandal, Dariusz Asanowicz, Motonori Yamaguchi, Helge Gillmeister, Dirk Kerzel, David Luque, Francesca Pesciarelli, Thorsten Fehr, Faisal Mushtaq, Yuri G. Pavlov, Heinrich R. Liesefeld | <p>The N2pc is widely employed as an electrophysiological marker of an attention allocation. This interpretation was in no small part driven by the observation of an N2pc elicited by an isolated relevant target object, which was reported as Experi... | Life Sciences, Social sciences | Maxine Sherman | 2023-02-24 11:41:52 |
