We are recruiting recommenders (editors) from all research fields!
Your feedback matters! If you have authored or reviewed a Registered Report at Peer Community in Registered Reports, then please take 5 minutes to leave anonymous feedback about your experience, and view community ratings.
Latest recommendations
| Id | Title * | Authors * | Abstract * | Picture | Thematic fields * | Recommender | Reviewers | Submission date | |
|---|---|---|---|---|---|---|---|---|---|
06 Sep 2024
STAGE 1
Registered Report: Do individual differences in cognitive ability or personality predict noticing in inattentional blindness tasks?Are individual difference in inattentional blindness related to cognitive abilities or personality traits?Recommended by Gidon Frischkorn based on reviews by Ruben Arslan and 1 anonymous reviewer
Despite inattentional blindness being a widely recognized and researched phenomenon — popularized by experiments like the invisible gorilla — the evidence on how individual differences affect the occurrence of inattentional blindness has remained inconsistent, largely due to small sample sizes and methodological variations.
In this context, Daniel J. Simons, known for his role in bringing public attention to inattentional blindness, along with Yifan Ding, Connor M. Hults, and Brent W. Roberts, presents an ambitious yet well-constructed registered report that addresses this critical gap in the literature. Their report outlines a comprehensive investigation into whether individual differences in cognitive ability or personality traits can predict the likelihood of noticing unexpected objects in various inattentional blindness tasks. The two proposed studies — one focusing on cognitive predictors and the other on personality predictors — arguably represent the most extensive single-sample tests to date on this topic.
The authors propose a robust methodology that includes a total of 2,000 participants (1,000 per study). The study design features three distinct inattentional blindness tasks with varying levels of demand to assess the generalizability of the findings across different experimental contexts. In Study 1, cognitive measures such as matrix reasoning and operation span — both well-established indicators of fluid intelligence and working memory — are utilized. Study 2 incorporates a range of personality measures, including the Big Five personality traits and attention-related traits (e.g., ADHD and obsessive-compulsive characteristics).
The report also presents a detailed analysis plan with pre-specified primary and secondary outcomes, strong justifications for the sample size, and clearly defined criteria for data inclusion and exclusion. The authors intend to employ multiple statistical techniques, such as correlation analyses and regression models, along with rigorous checks for replicability, to explore the relationship between individual differences and inattentional blindness.
Overall, this registered report is a well-justified and meticulously planned investigation into the role of individual differences in inattentional blindness. The proposed studies have the potential to make a significant contribution to our understanding of the cognitive and personality factors that influence the noticing of unexpected objects. The rigorous experimental design, large sample sizes, and adherence to open science practices make this a valuable addition to the literature.
Based on the strengths of the proposal and the authors' responsiveness to the detailed feedback from two reviewers, the recommender justed that the manuscript met the Stage 1 criteria and awarded in-principle acceptance (IPA). URL to the preregistered Stage 1 protocol: https://osf.io/xtwfs (under temporary private embargo) Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA. List of eligible PCI RR-friendly Journals:
References
Simons, D. J., Ding, Y., Hults, C. M., & Roberts, B. W. (2024). Registered Report: Do individual differences in cognitive ability or personality predict noticing in inattentional blindness tasks? In principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/xtwfs
| Registered Report: Do individual differences in cognitive ability or personality predict noticing in inattentional blindness tasks? | Daniel J. Simons, Yifan Ding, Connor M. Hults, Brent W. Roberts | <p>People often fail to notice unexpected objects or events when they focus attention on another task or different aspects of a scene. Recently, a number of studies have examined whether individual differences in cognitive abilities or personality... | Social sciences | Gidon Frischkorn | 2024-03-28 21:52:33 | |||
06 Sep 2024
STAGE 1
The Role of Offender Identifiability in Second- and Third-Party PunishmentPunishing OffendersRecommended by Clare Conry-Murray based on reviews by Gilad Feldman and Rajarshi Majumder
When people are less-well-known to us, it can impact how we treat them. People outside our communities may feel more anonymous or de-personalized to us, and this could impact the empathy we feel for them. Indeed, past research shows that people seem to care more for those who are who are identified to us, especially when they are victims of a crime (Small & Loewenstein, 2003). In addition, past research also shows that anonymizing victims can influence criminal behavior (Walters, 2022). Thus, social cognitive factors related to anonymity appear to affect both positive feelings (engaging in empathy) and negative activities (criminal activity) related to victims. It seems likely that anonymity can also affect how people judge criminals themselves.
This paper by Blanke and Twardawski (2024) examines how even minor identifying features can make individuals react differently to a perpetrator of a crime. A picture or name (information that may appear in the press) may impact how people perceive criminals in terms of punishment, empathy, outrage, and blame.
How people respond to anonymous or identified criminals may depend on whether the impact of the crime on the victim is made salient. Similar to the Black Sheep Effect (Marques & Paez,1994), the current paper expects that people who identify with victims are expected to punish a perpetrator more when the perpetrator’s name and image are known. This is similar to the case with an ingroup member in The Black Sheep Effect, where ingroup members are punished more for transgressions than outgroup members. For people who view the situation as a third party (and are thus less connected to the victim), an identified perpetrator is expected to lead to less punishment (and also less outrage and blame, and more empathy).
The current study focuses on pickpocketing since it is a crime that can be committed without identifying oneself to the victim. Future research should examine how the type of event impacts judgments, especially given the stigma of being a victim of some crimes. Littering and other minor violations may be seen as understandable when you see someone as a person, rather than a anonymous, impersonal criminal. On the other hand, there can be stigma to being a victim in some cases, such as the case of sexual harassment, where, research shows, perpetrators are judged more positively if they are identified, and victims, especially women, are judged more negatively if they are identified (Barak-Corren & Lewinsohn-Zamir, 2019).
People around the world engage in moral and legal transgressions, and if our judgments of them are influenced by minor features such as a photo or name, we should take action to treat people more fairly. This research will help to determine if people are influenced by these factors.
The Stage 1 manuscript underwent one round of thorough review. After considering the detailed responses to the reviewers' comments, the recommender determined that the manuscript met the Stage 1 criteria and granted in-principle acceptance (IPA).
URL to the preregistered Stage 1 protocol: https://osf.io/bxqu6
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA. List of eligible PCI RR-friendly Journals:
References
1. Barak‐Corren, N., & Lewinsohn‐Zamir, D. (2019). What's in a Name? The Disparate Effects of Identifiability on Offenders and Victims of Sexual Harassment. Journal of Empirical Legal Studies, 16, 955-1000. https://doi.org/10.1111/jels.12233
2. Blanke, T. & Twardawski, M. (2024). The Role of Offender Identifiability in Second- and Third-Party Punishment. In principle acceptance of Version 2 by Peer Community in Registered Reports. https://osf.io/bxqu6
3. Marques, J. M., & Paez, D. (1994). The ‘black sheep effect’: Social categorization, rejection of ingroup deviates, and perception of group variability. European Review of Social Psychology, 5, 37-68. https://doi.org/10.1080/14792779543000011
4. Small, D. A., & Loewenstein, G. (2003). Helping a victim or helping the victim: Altruism and identifiability. Journal of Risk and Uncertainty, 26, 5-16. https://doi.org/10.1023/A:1022299422219
5. Walters, G. D. (2022). Crime and social cognition: A meta-analytic review of the developmental roots of adult criminal thinking. Journal of Experimental Criminology, 18, 183-207. https://doi.org/10.1007/s11292-020-09435-w
| The Role of Offender Identifiability in Second- and Third-Party Punishment | Theresa Blanke, Mathias Twardawski | <p>The identifiability effect describes humans' tendency to exhibit different emotional and behavioral responses toward identified as compared to anonymous individuals. This phenomenon has been extensively studied within the identifiable victim ef... | Social sciences | Clare Conry-Murray | Gilad Feldman, Rajarshi Majumder | 2024-03-23 11:02:30 | ||
One and only SNARC? Spatial-Numerical Associations are not fully flexible and depend on both relative and absolute magnitudeA Registered Report demonstration that the SNARC effect depends on absolute as well as relative number magnitudeRecommended by Robert McIntosh based on reviews by Claudia Gianelli
The Spatial-Numerical Association of Response Codes (SNARC) effect refers to the fact that smaller numbers receive faster responses with the left hand, and larger numbers with the right hand (Dehaene et al., 1993). This robust finding implies that numbers are associated with space, being represented on a mental number line that progresses from left to right. The SNARC effect is held to depend on relative number magnitude, with the mental number line dynamically adjusting to the numerical range used in a given context. This characterisation is based on significant effects of relative number magnitude, with no significant influence of absolute number magnitude. However, a failure to reject the null hypothesis is not firm evidence for the absence of an effect. In this Registered Report, Roth and colleagues (2024) report two large-sample online experiments, with a Bayesian statistical approach to confirm—or refute—a role for absolute number magnitude in modulating the classic SNARC effect (smallest effect size of interest, d = 0.15).
Experiment 1 closely followed Dehaene’s (1993) original methods, and found strong evidence for an influence of relative magnitude, and moderate-to-strong evidence against an influence of absolute magnitude. Experiment 2 was designed to exclude some potential confounds in the original method, and this second experiment found strong evidence for both relative and absolute magnitude effects, of comparable effect sizes (in the range of d = .24 to .42). This registered study demonstrates that the SNARC effect is not ‘fully flexible’, in the sense of depending only on relative number magnitude; it is also shaped by absolute magnitude.
This Stage 2 manuscript was evaluated by the recommender and one external reviewer. Following appropriate minor revisions, the recommender judged that the manuscript met the Stage 2 criteria for recommendation.
URL to the preregistered Stage 1 protocol: https://osf.io/ae2c8
Level of bias control achieved: Level 6. No part of the data or evidence that was used to answer the research question was generated until after IPA. List of eligible PCI RR-friendly journals: References 1. Dehaene, S., Bossini, S., & Giraux, P. (1993). The mental representation of parity and number magnitude. Journal of Experimental Psychology: General, 122, 371–396. https://doi.org/10.1037/0096-3445.122.3.371
2. Roth, L., Caffier, J., Reips, U.-D., Nuerk, H.-C., Overlander, A. T. & Cipora, K. (2023). One and only SNARC? Spatial-Numerical Associations are not fully flexible and depend on both relative and absolute magnitude [Stage 2]. Acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/epnd4
| One and only SNARC? Spatial-Numerical Associations are not fully flexible and depend on both relative and absolute magnitude | Lilly Roth, John Caffier, Ulf-Dietrich Reips, Hans-Christoph Nuerk, Annika Tave Overlander, Krzysztof Cipora | <p>Numbers are associated with space, but it is unclear how flexible these associations are. We investigated whether the SNARC effect (Spatial-Numerical Association of Response Codes; Dehaene et al., 1993; i.e., faster responses to small/large num... | Life Sciences | Robert McIntosh | 2024-06-10 15:00:30 | |||
06 Sep 2024
STAGE 1
Barriers and facilitators to the adoption and promotion of Open Science practices in psychology. The case of SlovakiaWhat are the barriers and facilitators to open science practices for researchers, policy makers and media representatives in Slovakia?Recommended by Charlotte Pennington based on reviews by Crystal Steltenpohl, Peter Branney, Andrea E. Abele-Brehm , Emma Norris and 1 anonymous reviewer
Open science practices (OSPS, e.g., preregistration, open materials, code and data) aim to enhance the transparency, integrity, and reproducibility of research. Recent work, however, has highlighted various facilitators and barriers perceived by researchers in implementing these, which can either enhance or hinder their success. Little is known about these barriers in the context of Slovakia, and such perceptions are rarely investigated for policy makers and media representatives who are also embedded in the research ecosystem.
In their Stage 1 Registered Report, Marcel Martončik and colleagues aim to map the perceptions and experiences of barriers and facilitators of OSPs that are unique to different stakeholder groups in Slovakia. They will conduct both semi-structured interviews and focus groups with a diverse sample of postgraduate students, researchers, policymakers, and media representatives from the field of psychology. Reflexive thematic analysis will identify overarching themes regarding such barriers and facilitators which will provide valuable insights into the support required to make OSPs normative across different stakeholder groups.
Four expert reviewers assessed the Stage 1 manuscript across two rounds of in-depth review. Based on the authors' detailed and informed responses to the reviewer’s comments, the recommender judged that the manuscript met the Stage 1 criteria and awarded in principle acceptance (IPA).
URL to the preregistered Stage 1 protocol: https://osf.io/n86um
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA. List of eligible PCI RR-friendly Journals:
References
Martončik, M., Adamkovič, M., Baník G., Fedáková, D., Issmailová, S., Kačmár, P., Kentoš, M., Majdáková, V., Papcunová, J., & Vargová, L. (2024). Barriers and facilitators to the adoption and promotion of Open Science practices in psychology. The case of Slovakia. In principle acceptance of Version 1.1 by Peer Community in Registered Reports. https://osf.io/n86um
| Barriers and facilitators to the adoption and promotion of Open Science practices in psychology. The case of Slovakia | Marcel Martončik, Matúš Adamkovič, Gabriel Baník, Denisa Fedáková, Samar Issmailová, Pavol Kačmár, Michal Kentoš, Viktória Majdáková, Jana Papcunová, Lenka Vargová | <p>Various responsible research practices emphasizing transparency, such as open<br>data, open code, open peer review, and preregistration, have been introduced to<br>enhance the reproducibility and replicability of findings. The ongoing initiativ... | Social sciences | Charlotte Pennington | 2024-04-29 14:39:12 | |||
22 Jul 2024
STAGE 1
Replication of “Carbon-Dot-Based Dual-Emission Nanohybrid Produces a Ratiometric Fluorescent Sensor for In Vivo Imaging of Cellular Copper Ions”Replicating, Revising and Reforming: Unpicking the Apparent Nanoparticle Endosomal Escape ParadoxRecommended by Emily Linnane and Yuki Yamada based on reviews by Cecilia Menard-Moyon and Zeljka Krpetic
Context
Over the past decade there has been an exponential increase in the number of research papers utlising nanoparticles for biological applications such as intracellular sensing [1, 2], theranostics [3-5] and more recently drug delivery and precision medicine [6, 7]. Despite the success stories, there is a disconnect regarding current dogma on issues such as nanoparticle uptake and trafficking, nanoparticle delivery via the enhanced permeability and retention (EPR) effect, and endosomal escape. Critical re-evaluation of these concepts both conceptually and experimentally is needed for continued advancement in the field.
For this preregistration, Said et al. (2024) focus on nanoparticle intracellular trafficking, specifically endosomal escape [8]. The current consensus in the literature is that nanoparticles enter cells via endocytosis [9, 10] but reportedly just 1-2% of nanoparticles/ nanoparticle probes escape endosomes and enter the cytoplasm [11-13]. There is therefore an apparent paradox over how sensing nanoparticles can detect their intended targets in the cytoplasm if they are trapped within the cell endosomes. To address this fundamental issue of nanoparticle endosomal escape, Lévy and coworkers are carrying out replication studies to thoroughly and transparently replicate the most influential papers in the field of nanoparticle sensing. The aim of these replication studies is twofold: to establish a robust methodology to study endosomal escape of nanoparticles, and to encourage discussions, transparency and a step-change in the field.
Replication of “Carbon-Dot-Based Dual-Emission Nanohybrid Produces a Ratiometric Fluorescent Sensor for In Vivo Imaging of Cellular Copper Ions”
For this replication study, the authors classified papers on the topic of nanoparticle sensing and subsequently ranked them by number of citations. Based on this evaluation they selected a paper by Zhu and colleagues [14] entitled “Carbon-Dot-Based Dual-Emission Nanohybrid Produces a Ratiometric Fluorescent Sensor for In Vivo Imaging of Cellular Copper Ions” for their seminal replication study. To determine the reproducibility of the results from Zhu et al., the authors aim to establish the proportion of endosomal escape of the nanoparticles, and to examine the data in a biological context relevant to the application of the probe.
Beyond Replication
The authors plan to replicate the exact conditions reported in the materials and methods section of the selected paper such as nanoparticle probe synthesis of CdSe@C-TPEA nanoparticles, assessment of particle size, stability and reactivity and effect on cells (TEM, pH experiments, fluorescent responsivity to metal ions and cell viability). In addition, Said et al., plan to include further experimental characterisation to complement the existing study by Zhu and colleagues. They will incorporate additional controls and methodology to determine the intracellular location of nanoparticle probes in cells including: quantifying excess fluorescence in the culture medium, live cell imaging analysis, immunofluorescence with endosomal and lysosomal markers, and electron microscopy of cell sections. The authors will also include supplementary viability studies to assess the impact of the nanoparticles on HeLa cells as well as an additional biologically relevant cell line (for use in conjunction with the HeLa cells as per the original paper).
The Stage 1 manuscript underwent two rounds of thorough in-depth review. After considering the detailed responses to the reviewers' comments, the recommenders determined that the manuscript met the Stage 1 criteria and awarded in-principle acceptance (IPA).
The authors have thoughtfully considered their experimental approach to the replication study, whilst acknowledging any potential limitations. Given that conducting such a replication study is novel in the field of Nanotechnology and there is currently no ‘gold standard’ approach in doing so, the authors have showed thoughtful regard of statistical analysis and unbiased methodology where possible.
Based on current information, this study is the first use of preregistration via Peer Community in Registered Reports and the first formalised replication study in Nanotechnology for Biosciences. The outcomes of this of this study will be significant both scientifically and in the wider context in discussion of the scientific method.
URL to the preregistered Stage 1 protocol: https://osf.io/qbxpf
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA. List of eligible PCI RR-friendly Journals:
References
1. Howes, P. D., Chandrawati, R., & Stevens, M. M. (2014). Colloidal nanoparticles as advanced biological sensors. Science, 346(6205), 1247390. https://doi.org/10.1126/science.1247390
2. Liu, C. G., Han, Y. H., Kankala, R. K., Wang, S. B., & Chen, A. Z. (2020). Subcellular performance of nanoparticles in cancer therapy. International Journal of Nanomedicine, 675-704. https://doi.org/10.2147/IJN.S226186
3. Tang, W., Fan, W., Lau, J., Deng, L., Shen, Z., & Chen, X. (2019). Emerging blood–brain-barrier-crossing nanotechnology for brain cancer theranostics. Chemical Society Reviews, 48(11), 2967-3014. https://doi.org/10.1039/C8CS00805A
4. Yoon, Y. I., Pang, X., Jung, S., Zhang, G., Kong, M., Liu, G., & Chen, X. (2018). Smart gold nanoparticle-stabilized ultrasound microbubbles as cancer theranostics. Journal of Materials Chemistry B, 6(20), 3235-3239. https://doi.org/10.1039%2FC8TB00368H
5. Lin, H., Chen, Y., & Shi, J. (2018). Nanoparticle-triggered in situ catalytic chemical reactions for tumour-specific therapy. Chemical Society Reviews, 47(6), 1938-1958. https://doi.org/10.1039/C7CS00471K
6. Hou, X., Zaks, T., Langer, R., & Dong, Y. (2021). Lipid nanoparticles for mRNA delivery. Nature Reviews Materials, 6(12), 1078-1094. https://doi.org/10.1038/s41578-021-00358-0
7. Mitchell, M. J., Billingsley, M. M., Haley, R. M., Wechsler, M. E., Peppas, N. A., & Langer, R. (2021). Engineering precision nanoparticles for drug delivery. Nature Reviews Drug Discovery, 20(2), 101-124. https://doi.org/10.1038/s41573-020-0090-8
8. Said, M., Gharib, M., Zrig, S., & Lévy, R. (2024). Replication of “Carbon-Dot-Based Dual-Emission Nanohybrid Produces a Ratiometric Fluorescent Sensor for In Vivo Imaging of Cellular Copper Ions”. In principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/qbxpf
9. Behzadi, S., Serpooshan, V., Tao, W., Hamaly, M. A., Alkawareek, M. Y., Dreaden, E. C., ... & Mahmoudi, M. (2017). Cellular uptake of nanoparticles: Journey inside the cell. Chemical Society Reviews, 46(14), 4218-4244. https://doi.org/10.1039/C6CS00636A
10. de Almeida, M. S., Susnik, E., Drasler, B., Taladriz-Blanco, P., Petri-Fink, A., & Rothen-Rutishauser, B. (2021). Understanding nanoparticle endocytosis to improve targeting strategies in nanomedicine. Chemical society reviews, 50(9), 5397-5434. https://doi.org/10.1039/D0CS01127D
11. Smith, S. A., Selby, L. I., Johnston, A. P., & Such, G. K. (2018). The endosomal escape of nanoparticles: toward more efficient cellular delivery. Bioconjugate Chemistry, 30(2), 263-272. http://dx.doi.org/10.1021/acs.bioconjchem.8b00732
12. Cupic, K. I., Rennick, J. J., Johnston, A. P., & Such, G. K. (2019). Controlling endosomal escape using nanoparticle composition: current progress and future perspectives. Nanomedicine, 14(2), 215-223. https://doi.org/10.2217/nnm-2018-0326
13. Wang, Y., & Huang, L. (2013). A window onto siRNA delivery. Nature Biotechnology, 31(7), 611-612. https://doi.org/10.1038/nbt.2634
14. Zhu, A., Qu, Q., Shao, X., Kong, B., & Tian, Y. (2012). Carbon-dot-based dual-emission nanohybrid produces a ratiometric fluorescent sensor for in vivo imaging of cellular copper ions. Angewandte Chemie (International ed. in English), 51(29), 7185-7189. https://doi.org/10.1002/anie.201109089
| Replication of “Carbon-Dot-Based Dual-Emission Nanohybrid Produces a Ratiometric Fluorescent Sensor for In Vivo Imaging of Cellular Copper Ions” | Maha Said, Mustafa Gharib, Samia Zrig, Raphaël Lévy | <p>In hundreds of articles published over the past two decades, nanoparticles have been described as probes for sensing and imaging of a variety of intracellular cytosolic targets. However, nanoparticles generally enter cells by endocytosis with o... | | Life Sciences, Medical Sciences, Physical Sciences | Emily Linnane | 2023-11-29 19:14:03 | ||
22 Jul 2024
STAGE 1
Probing the dual-task structure of a metacontrast-masked priming paradigm with subjective visibility judgmentsDo trial-wise visibility reports - and how these reports are made - alter unconscious priming effects?Recommended by D. Samuel Schwarzkopf based on reviews by Markus Kiefer, Thomas Schmidt and 3 anonymous reviewers
Many studies of unconscious processing measure priming effects. Such experiments test whether a prime stimulus can exert an effect on speeded responses to a subsequently presented target stimulus even when participants are unaware of the prime. In some studies, participants are required to report their awareness of the prime in each trial - a dual-task design. Other studies conduct such visibility tests in separate experiments, so that the priming effect is measured via a single task. Both these approaches have pros and cons; however, it remains unclear to what extent they can affect the process of interest. Can the choice of experimental design and its parameters interfere with the priming effect? This could have implications for interpreting such effects, including in previous literature.
In the current study, Wendt and Hesselmann (2024) will investigate the effects of using a dual-task design in a masked priming paradigm, focusing on subjective visibility judgments. Based on power analysis, the study will test 34 participants performing both single-task and several dual-task conditions to measure reaction times and priming effects. Priming is tested via a speeded forced-choice identification of a target. The key manipulation is the non-speeded visibility rating of the prime using a Perceptual Awareness Scale, either with a graded (complex) rating or a dichotomous response. Moreover, participants will either provide their awareness judgement via a keyboard or vocally. Finally, participants will also complete a control condition to test prime visibility by testing the objective identification of the prime. These conditions will be presented in separate blocks, with the order randomised across participants. The authors hypothesise that using a dual-task slows down response times and boosts priming effects. However, they further posit that keyboard responses and graded visibility ratings, respectively, in the dual task reduce priming effects (but also slow response times) compared to vocal responses and dichotomous visibility judgements. In addition to the preregistered hypotheses, the study will also collect EEG data to explore the neural underpinnings of these processes.
The Stage 1 manuscript went through three rounds of review by the recommender and five expert reviewers. While the recommender would have preferred to see targeted, directional hypotheses explicitly specified in the design instead of non-directional main effects/interactions, he nevertheless considers this experimental design ready for commencing data collection, and therefore granted in-principle acceptance.
URL to the preregistered Stage 1 protocol: https://osf.io/ds2w5
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA. List of eligible PCI RR-friendly Journals:
References Wendt, C. & Hesselmann, G. (2024). Probing the dual-task structure of a metacontrast-masked priming paradigm with subjective visibility judgments. In principle acceptance of Version 4 by Peer Community in Registered Reports. https://osf.io/ds2w5 | Probing the dual-task structure of a metacontrast-masked priming paradigm with subjective visibility judgments | Charlott Wendt, Guido Hesselmann | <p>Experiments contrasting conscious and masked stimulus processing have shaped, and continue to shape, cognitive and neurobiological theories of consciousness. However, as shown by Aru et al. (2012) the contrastive approach builds on the untenabl... | Social sciences | D. Samuel Schwarzkopf | 2024-03-02 18:20:03 | |||
22 Jul 2024
STAGE 1
From Thought to Senses: Assessing the Presence of a Relationship Between the Generation Effect and Multisensory FacilitationExploring multi-sensory benefits in the generation effect of memoryRecommended by Gidon Frischkorn based on reviews by Vanessa Loaiza, Sharon Bertsch and Vanessa Loaiza
This study by Ritchie and Wilbiks (2024) investigates whether the generation effect, a memory advantage for self-generated verbal information, is enhanced under multisensory conditions. It is designed to explore a gap in the literature regarding the interplay between the generation effect and multisensory facilitation, with potential applications in educational settings.
Exploring multisensory aspects of the generation effect, the study has the potential to provide new insights into cognitive processing and memory enhancement. It is well rooted in established theories of the generation effect and multisensory facilitation, deducing a reasonable hypothesis that multisensory processing amplifies the generation effect. By implementing a 2 (Task Type: generate vs. read) x 3 (Sensory Modality: auditory, visual, multisensory) factorial design, it ensures a comprehensive evaluation of multisensory benefits in the generation effect. The findings could inform multisensory learning strategies in educational contexts, enhancing teaching methods and learning outcomes. Based on these considerations and two rounds of in-depth review, the recommender awarded in-principle acceptance of the study proposal. Its strong theoretical foundation and well-conceived methodology make it a valuable contribution to the fields of cognitive and educational psychology. URL to the preregistered Stage 1 protocol: https://osf.io/3u7eh
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.
List of eligible PCI RR-friendly journals:
References
Ritchie, M. & Wilbiks, J. (2024). From Thought to Senses: Assessing the Relationship Between the Generation Effect and Multisensory Facilitation. In principle acceptance of Version 4 by Peer Community in Registered Reports. https://osf.io/3u7eh
| From Thought to Senses: Assessing the Presence of a Relationship Between the Generation Effect and Multisensory Facilitation | Michaela Ritchie, Jonathan Wilbiks | <p>The proposed study will investigate the relationship between the generation effect, a memory advantage for self-generated verbal information, and the multisensory facilitation effect, a phenomenon wherein congruent sensory inputs enhance cognit... | Social sciences | Gidon Frischkorn | 2024-02-01 18:34:15 | |||
12 Jul 2024
STAGE 1
Associations between anxiety-related traits and fear acquisition and extinction - an item-based content and meta-analysisIntegrative meta-analysis of anxiety-related traits and fear processing: bridging research to clinical applicationRecommended by Sara Garofalo based on reviews by Yoann Stussi, Luigi Degni, Marco Badioli and 1 anonymous reviewer
The paper aims to bridge gaps in understanding the relationship between anxiety-related traits and fear processing, with a specific focus on fear acquisition and extinction. Fear and safety processing are known to be linked to anxiety symptoms and traits such as neuroticism and intolerance of uncertainty (Lonsdorf et al., 2017; Morriss et al., 2021). However, the diversity in study focus and measurement methods makes it difficult to integrate findings into clinical practice effectively.
To address this issue, Brunsch et al. (2024) propose a systematic literature search and meta-analysis, following PRISMA guidelines, to explore these associations. They plan to use nested random effects models to analyze both psychophysiological and self-report outcome measures. Additionally, they will examine the role of different questionnaires used to assess anxiety-related traits and conduct a content analysis of these tools to evaluate trait overlaps.
Current knowledge from the literature indicates that individuals with anxiety disorders exhibit differences in fear acquisition and extinction compared to those without such disorders (Lonsdorf et al., 2017; Morriss et al., 2021). Previous meta-analyses have shown associations between anxiety traits and fear generalization/extinction, but these studies are limited in their scope and focus.
The primary aim of the research is to provide a comprehensive summary of the associations between anxiety-related traits and conditioned responding during fear acquisition and extinction across multiple measures. Another goal is to investigate whether different anxiety-related trait questionnaires yield different associations with fear and extinction learning. The authors will also conduct a content analysis to better interpret the results of their meta-analysis by examining the overlap in questionnaire content.
A secondary aim of the study is to evaluate how sample characteristics, experimental specifics, and study quality influence the associations between anxiety-related traits and fear acquisition and extinction. By addressing these aims, the study seeks to advance the understanding of fear-related processes in anxiety and inform more targeted prevention and intervention strategies.
The Stage 1 manuscript underwent two rounds of thorough review. After considering the detailed responses to the reviewers' comments, the recommender determined that the manuscript met the Stage 1 criteria and granted in-principle acceptance (IPA).
URL to the preregistered Stage 1 protocol: https://osf.io/4mndj
Level of bias control achieved: Level 3. At least some data/evidence that will be used to the answer the research question has been previously accessed by the authors (e.g. downloaded or otherwise received), but the authors certify that they have not yet observed ANY part of the data/evidence.
List of eligible PCI RR-friendly journals:
References
1. Bruntsch, M., Abend, R., Chalkia, A., Cooper, S. E., Ehlers, M. R., Johnson, D. C., Klingelhöfer-Jens, M., Morriss, J., Zika, O., & Lonsdorf, T. B. (2024). Associations between anxiety-related traits and fear acquisition and extinction - an item-based content and meta-analysis. In principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/4mndj
2. Lonsdorf, T. B., & Merz, C. J. (2017). More than just noise: Inter-individual differences in fear acquisition, extinction and return of fear in humans - Biological, experiential, temperamental factors, and methodological pitfalls. Neuroscience & Biobehavioral Reviews, 80, 703–728. https://doi.org/10.1016/j.neubiorev.2017.07.007
3. Morriss, J., Wake, S., Elizabeth, C., & van Reekum, C. M. (2021). I Doubt It Is Safe: A Meta-analysis of Self-reported Intolerance of Uncertainty and Threat Extinction Training. Biological Psychiatry Global Open Science, 1, 171–179. https://doi.org/10.1016/j.bpsgos.2021.05.011
| Associations between anxiety-related traits and fear acquisition and extinction - an item-based content and meta-analysis | Maria Bruntsch, Samuel E Cooper, Rany Abend, Marian Boor, Anastasia Chalkia, Mana Ehlers, Artur Czeszumski, Dave Johnson, Maren Klingelhöfer-Jens, Jayne Morriss, Erik Mueller, Ondrej Zika, Tina Lonsdorf | <p>Background: Deficits in learning and updating of fear and safety associations have been reported in patients suffering from anxiety- and stress-related disorders. Also in healthy individuals, anxiety-related traits have been linked to altered f... | Life Sciences | Sara Garofalo | Anonymous, Luigi Degni, Marco Badioli, Yoann Stussi | 2024-03-15 14:48:20 | ||
Impact of analytic decisions on test-retest reliability of individual and group estimates in functional magnetic resonance imaging: a multiverse analysis using the monetary incentive delay taskExploring determinants of test-retest reliability in fMRI: a study with the Monetary Incentive Delay TaskRecommended by Dorothy Bishop based on reviews by Xiangzhen Kong and 1 anonymous reviewer
Functional magnetic resonance imaging has been used to explore brain-behaviour relationships for many years, with proliferation of a wide range of sophisticated analytic procedures. However, rather scant attention has been paid to the reliability of findings. Concerns have been growing failures to replicate findings in some fields, but it is hard to know how far this is a consequence of underpowered studies, flexible analytic pipelines, or variability within and between participants. Demidenko et al. (2024) took advantage of the availability of three existing datasets, including the Adolescent Brain Cognitive Development (ABCD) study, the Michigan Longitudinal Study, and the Adolescent Risk Behavior Study, which all included a version of the Monetary Incentive Delay task measured in two sessions. These were entered into a multiverse analysis, which considered how within-subject and between-subject variance varies according to four analytic factors: smoothing (5 levels), motion correction (6 levels), task modelling (3 levels) and task contrasts (4 levels). They also considered how sample size affects estimates of reliability. The results have important implications for the those using fMRI with the Monetary Incentive Delay Task, and also raise questions more broadly about use of fMRI indices to study individual differences. Motion correction had relatively little impact on the ICC, and the effect size of the smoothing kernel was modest. Larger impacts on reliability were associated with choice of contrast (implicit baseline giving larger effects) and task parameterization. But perhaps the most sobering message from this analysis is that although activation maps from group data were reasonably reliable, the ICC, used as an index of reliability for individual levels of activation, was consistently low. This raises questions about the suitability of the Monetary Incentive Delay Task for studying individual differences. Another point is that reliability estimates become more stable as sample size increases; researchers may want to consider whether the trade-off between cost and gain in precision is justified for sample sizes above 250. I did a quick literature search on Web of Science: at the time of writing the search term ("Monetary Delay Task" AND fMRI) yielded 410 returns, indicating that this is a popular method in cognitive neuroscience. The detailed analyses reported here will repay study for those who are planning further research using this task. The Stage 2 manuscript was evaluated over one round of in-depth review. Based on detailed responses to the reviewer's and recommender's comments, the recommender judged that the manuscript met the Stage 2 criteria and awarded a positive recommendation. URL to the preregistered Stage 1 protocol: https://osf.io/nqgeh
Level of bias control achieved: Level 2. At least some data/evidence that was used to answer the research question had been accessed and partially observed by the authors prior to IPA, but the authors certify that they had not yet sufficiently observed the key variables within the data to be able to answer the research questions and they took additional steps to maximise bias control and rigour.
List of eligible PCI RR-friendly journals:
References 1. Demidenko, M. I., Mumford, J. A., & Poldrack, R. A. (2024). Impact of analytic decisions on test-retest reliability of individual and group estimates in functional magnetic resonance imaging: a multiverse analysis using the monetary incentive delay task [Stage 2]. Acceptance of Version 5 by Peer Community in Registered Reports. https://www.biorxiv.org/content/10.1101/2024.03.19.585755v4 | Impact of analytic decisions on test-retest reliability of individual and group estimates in functional magnetic resonance imaging: a multiverse analysis using the monetary incentive delay task | Michael I. Demidenko, Jeanette A. Mumford, Russell A. Poldrack | <p>Empirical studies reporting low test-retest reliability of individual blood oxygen-level dependent (BOLD) signal estimates in functional magnetic resonance imaging (fMRI) data have resurrected interest among cognitive neuroscientists in methods... |  | Life Sciences, Social sciences | Dorothy Bishop | 2024-03-21 02:23:30 | ||
09 Jul 2024
STAGE 1
Test-Retest Reliability in Functional Magnetic Resonance Imaging: Impact of Analytical Decisions on Individual and Group Estimates in the Monetary Incentive Delay TaskExploring determinants of test-retest reliabilty in fMRIRecommended by Dorothy Bishop based on reviews by Xiangzhen Kong and 2 anonymous reviewers
Functional magnetic resonance imaging (fMRI) has been used to explore brain-behaviour relationships for many years, with proliferation of a wide range of sophisticated analytic procedures. However, rather scant attention has been paid to the reliability of findings. Concerns have been growing following failures to replicate findings in some fields, but it is hard to know how far this is a consequence of underpowered studies, flexible analytic pipelines, or variability within and between participants.
Demidenko et al. (2023) plan a study that will be a major step forward in addressing these issues. They take advantage of the availability of three existing datasets, the Adolescent Brain Cognitive Development (ABCD) study, the Michigan Longitudinal Study, and the Adolescent Risk Behavior Study, which all included a version of the Monetary Incentive Delay task measured in two sessions. This gives ample data for a multiverse analysis, which will consider how within-subject and between-subject variance varies according to four analytic factors: smoothing (5 levels), motion correction (6 levels), task modelling (3 levels) and task contrasts (4 levels). They will also consider how sample size affects estimates of reliability. This will involve a substantial amount of analysis.
The study is essentially focused on estimation, although specific predictions are presented regarding the combinations of factors expected to give optimal reliability. The outcome will be a multiverse of results which will allow us to see how different pipeline decisions for this task affect reliability. In many ways, null results – finding that at least some factors have little effect on reliability – would be a positive finding for the field, as it would mean that we could be more relaxed when selecting an analytic pathway. A more likely outcome, however, is that analytic decisions will affect reliability, and this information can then guide future studies and help develop best practice guidelines. As one reviewer noted, we can’t assume that results from this analysis will generalise to other tasks, but this analysis with a widely-used task is an important step towards better and more consistent methods in fMRI.
The researchers present a fully worked out plan of action, with supporting scripts that have been developed in pilot testing. The Stage 1 manuscript received in-depth evaluation from three expert reviewers and the recommender. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
URL to the preregistered Stage 1 protocol: https://osf.io/nqgeh
Level of bias control achieved: Level 2. At least some data/evidence that will be used to answer the research question has been accessed and partially observed by the authors, but the authors certify that they have not yet sufficiently observed the key variables within the data to be able to answer the research questions AND they have taken additional steps to maximise bias control and rigour.
List of eligible PCI RR-friendly journals:
References 1. Demidenko, M. I., Mumford, J. A., & Poldrack, R. A. (2023). Test-Retest Reliability in Functional Magnetic Resonance Imaging: Impact of Analytical Decisions on Individual and Group Estimates in the Monetary Incentive Delay Task. In principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/nqgeh | Test-Retest Reliability in Functional Magnetic Resonance Imaging: Impact of Analytical Decisions on Individual and Group Estimates in the Monetary Incentive Delay Task | Michael I. Demidenko, Jeanette A. Mumford, Russell A. Poldrack | <p>Empirical studies reporting low test-retest reliability of individual neural estimates in functional magnetic resonance imaging (fMRI) data have resurrected interest among cognitive neuroscientists in methods that may improve reliability in fMR... | Life Sciences, Social sciences | Dorothy Bishop | 2023-04-17 22:27:54 |
