Announcements
We are recruiting recommenders (editors) from all research fields!
Your feedback matters! If you have authored or reviewed a Registered Report at Peer Community in Registered Reports, then please take 5 minutes to leave anonymous feedback about your experience, and view community ratings.
Latest recommendations
Id | Title * | Authors * | Abstract * | Picture | Thematic fields * ▲ | Recommender | Reviewers | Submission date | |
---|---|---|---|---|---|---|---|---|---|
09 Jul 2024
STAGE 1
![]() Test-Retest Reliability in Functional Magnetic Resonance Imaging: Impact of Analytical Decisions on Individual and Group Estimates in the Monetary Incentive Delay TaskMichael I. Demidenko, Jeanette A. Mumford, Russell A. Poldrack https://osf.io/rv859?view_only=deaf7a8d461641749f143504b2a3150bExploring determinants of test-retest reliabilty in fMRIRecommended by Dorothy BishopFunctional magnetic resonance imaging (fMRI) has been used to explore brain-behaviour relationships for many years, with proliferation of a wide range of sophisticated analytic procedures. However, rather scant attention has been paid to the reliability of findings. Concerns have been growing following failures to replicate findings in some fields, but it is hard to know how far this is a consequence of underpowered studies, flexible analytic pipelines, or variability within and between participants.
Demidenko et al. (2023) plan a study that will be a major step forward in addressing these issues. They take advantage of the availability of three existing datasets, the Adolescent Brain Cognitive Development (ABCD) study, the Michigan Longitudinal Study, and the Adolescent Risk Behavior Study, which all included a version of the Monetary Incentive Delay task measured in two sessions. This gives ample data for a multiverse analysis, which will consider how within-subject and between-subject variance varies according to four analytic factors: smoothing (5 levels), motion correction (6 levels), task modelling (3 levels) and task contrasts (4 levels). They will also consider how sample size affects estimates of reliability. This will involve a substantial amount of analysis.
The study is essentially focused on estimation, although specific predictions are presented regarding the combinations of factors expected to give optimal reliability. The outcome will be a multiverse of results which will allow us to see how different pipeline decisions for this task affect reliability. In many ways, null results – finding that at least some factors have little effect on reliability – would be a positive finding for the field, as it would mean that we could be more relaxed when selecting an analytic pathway. A more likely outcome, however, is that analytic decisions will affect reliability, and this information can then guide future studies and help develop best practice guidelines. As one reviewer noted, we can’t assume that results from this analysis will generalise to other tasks, but this analysis with a widely-used task is an important step towards better and more consistent methods in fMRI.
The researchers present a fully worked out plan of action, with supporting scripts that have been developed in pilot testing. The Stage 1 manuscript received in-depth evaluation from three expert reviewers and the recommender. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
URL to the preregistered Stage 1 protocol: https://osf.io/nqgeh
Level of bias control achieved: Level 2. At least some data/evidence that will be used to answer the research question has been accessed and partially observed by the authors, but the authors certify that they have not yet sufficiently observed the key variables within the data to be able to answer the research questions AND they have taken additional steps to maximise bias control and rigour.
List of eligible PCI RR-friendly journals:
References 1. Demidenko, M. I., Mumford, J. A., & Poldrack, R. A. (2023). Test-Retest Reliability in Functional Magnetic Resonance Imaging: Impact of Analytical Decisions on Individual and Group Estimates in the Monetary Incentive Delay Task. In principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/nqgeh | Test-Retest Reliability in Functional Magnetic Resonance Imaging: Impact of Analytical Decisions on Individual and Group Estimates in the Monetary Incentive Delay Task | Michael I. Demidenko, Jeanette A. Mumford, Russell A. Poldrack | <p>Empirical studies reporting low test-retest reliability of individual neural estimates in functional magnetic resonance imaging (fMRI) data have resurrected interest among cognitive neuroscientists in methods that may improve reliability in fMR... | Life Sciences, Social sciences | Dorothy Bishop | 2023-04-17 22:27:54 | View | ||
22 Oct 2023
STAGE 1
![]() Michotte's research on perceptual impressions of causality: a pre-registered replication studyPeter A. White https://osf.io/5jx8fGaining confidence in Michotte’s classic studies on the perception of causalityRecommended by Moin SyedMaking causal judgements are part of everyday life, whether seeking to understand the action of complex humans or the relations between inanimate objects in our environments. Albert Michotte’s (1963) classic book, The perception of causality, contained an extensive report of experiments demonstrating not only that observers perceive causality of inanimate shapes, but do so in manifold ways, creating different “causal impressions.” This work has been highly influential across psychology and neuroscience.
In the current study, White (2023) proposes a series of experiments to replicate and extend Michotte’s work. Despite the fact that this research is foundational to current work on perception and understanding of causal relations, it has never been subjected to rigorous replication. Moreover, like many research studies from that era, Michotte was sparse on details about methodology and did not rely on statistical analysis. White has proposed an ambitious set of 14 experiments that directly replicate and, in some cases, extend Michotte’s experiments.
The Stage 1 manuscript was evaluated over three rounds of in-depth review, the first two rounds consisting of detailed comments from two reviewers and the third round consisting of a close read by the recommender. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and was therefore awarded in-principle acceptance (IPA).
URL to the preregistered Stage 1 protocol: https://osf.io/5jx8f
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA. List of eligible PCI-RR-friendly journals:
References
1. Michotte, A. (1963). The perception of causality (T. R. Miles & E. Miles, trans.). London: Methuen. (English translation of Michotte, 1954).
2. White, P. A. (2023). Michotte's research on perceptual impressions of causality: A registered replication study. In principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/5jx8f
| Michotte's research on perceptual impressions of causality: a pre-registered replication study | Peter A. White | <p> Michotte (1946/1954/1963) showed that visual impressions of causality can occur in perception of simple animations of moving geometrical objects. In the launching effect, one object is perceived as maki... | Life Sciences, Social sciences | Moin Syed | 2023-05-03 13:04:00 | View | ||
11 Sep 2023
STAGE 1
![]() Finding the right words to evaluate research: An empirical appraisal of eLife’s assessment vocabularyTom E. Hardwicke, Sarah Schiavone, Beth Clarke, Simine Vazire https://osf.io/e5pkz?view_only=3f65527bb5dc428382f4b9154bfc58e0Understanding the validity of standardised language in research evaluationRecommended by Sarahanne Miranda FieldIn 2023, the journal eLife ended the practice of making binary accept/reject decisions following peer review, instead sharing peer review reports (for manuscripts that are peer-reviewed) and brief “eLife assessments” representing the consensus opinions of editors and peer reviewers. As part of these assessments, the journal draws language from a "common vocabulary" to linguistically rank the significance of findings and strength of empirical support for the article's conclusions. In particular, the significance of findings is described using an ordinal scale of terms from "landmark" → "fundamental" → "important" → "valuable" → "useful", while the strength of support is ranked across six descending levels from "exceptional" down to "inadequate".
In the current study, Hardwicke et al. (2023) question the validity of this taxonomy, noting a range of linguistic ambiguities and counterintuitive characteristics that may undermine the communication of research evaluations to readers. Given the centrality of this common vocabulary to the journal's policy, the authors propose a study to explore whether the language used in the eLife assessments will be interpreted as intended by readers. Using a repeated-measures experimental design, they will tackle three aims: first, to understand the extent to which people share similar interpretations of phrases used to describe scientific research; second, to reveal the extent to which people’s implicit ranking of phrases used to describe scientific research aligns with each other and with the intended ranking; and third, to test whether phrases used to describe scientific research have overlapping interpretations. The proposed study has the potential to make a useful contribution to metascience, as well as being a valuable source of information for other journals potentially interested in following the novel path made by eLife.
The Stage 1 manuscript was evaluated over one round of in-depth review. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
URL to the preregistered Stage 1 protocol: https://osf.io/mkbtp
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA. List of eligible PCI RR-friendly journals:
References
1. Hardwicke, T. E., Schiavone, S., Clarke, B. & Vazire, S. (2023). Finding the right words to evaluate research: An empirical appraisal of eLife’s assessment vocabulary. In principle acceptance of Version 2 by Peer Community in Registered Reports. https://osf.io/mkbtp | Finding the right words to evaluate research: An empirical appraisal of eLife’s assessment vocabulary | Tom E. Hardwicke, Sarah Schiavone, Beth Clarke, Simine Vazire | <p>The journal eLife recently announced that it would abandon binary ‘accept/reject’ decisions and instead focus on sharing both peer review reports and short “eLife assessments” representing the consensus opinions of editors and peer reviewers. F... | Life Sciences, Social sciences | Sarahanne Miranda Field | 2023-06-16 12:11:14 | View | ||
The importance of conceptual knowledge when becoming familiar with faces during naturalistic viewingKira N. Noad and Timothy J. Andrews https://osf.io/thgrzA registered test of the role of contextual information in perceptual learning of facesRecommended by Robert McIntoshWhen we familiarise with new faces over repeated exposures, it is generally in situations that have meaning for us. Seeing a face more often tends to go along with learning more about the person, and their likely contexts and actions. In this Registered Report, Noad and Andrews (2024) tested whether meaningful context during exposure improves the consolidation of faces into long-term memory. Participants were shown video clips from the TV series Life on Mars, either in their original chronological sequence, which provides meaningful context, or in a scrambled sequence. It was expected that the original sequence would provide a better conceptual understanding, and this was confirmed by free recall and structured question tests. Face recognition memory was tested with images of the actor from the original clips (‘in show’) and the same actor from another show (‘out-of-show’), to test whether memory was modulated by the similarity of appearance to that at encoding. Face recognition was tested immediately after exposure and after four weeks, to allow time for consolidation. As expected, recognition memory was better for participants in the meaningful context condition, and for in-show faces. However, meaningful context did not lead to less forgetting of the faces at the follow up test, even for in-show faces, which did not support the original predictions. An exploratory analysis found that a metric of overlap between pairs of participants’ conceptual understanding was related to overlap in the set of faces they recognised. This relationship was stronger after four weeks, which suggests increased interaction of conceptual knowledge and face recognition after consolidation.
The Stage 2 manuscript was assessed over two rounds of review, and the recommender judged that the manuscript met the Stage 2 criteria for recommendation.
URL to the preregistered Stage 1 protocol: https://osf.io/8wp6f
Level of bias control achieved: Level 6. No part of the data or evidence that was used to answer the research question was generated until after IPA. List of eligible PCI RR-friendly journals:
References
1. Noad, K. & Andrews, T. J. (2024). The importance of conceptual knowledge when becoming familiar with faces during naturalistic viewing [Stage 2]. Acceptance of Version 4 by Peer Community in Registered Reports. https://osf.io/thgrz | The importance of conceptual knowledge when becoming familiar with faces during naturalistic viewing | Kira N. Noad and Timothy J. Andrews | <p>Although the ability to recognise familiar faces is a critical part of everyday life, the process by which a face becomes familiar in the real world is not fully understood. Previous research has focussed on the importance of perceptual experie... | Life Sciences, Social sciences | Robert McIntosh | 2024-01-17 16:00:17 | View | ||
Positive Treatment Effects and High Heterogeneity of Hormonal Contraceptive Use on Women's SexualityLaura J. Botzet, Julia M. Rohrer, Lars Penke, Ruben C. Arslan https://osf.io/gz9uhThe Causal Effects of Hormonal Contraceptives on Sexuality OutcomesRecommended by Thomas EvansEnsuring universal access to sexual and reproductive health and reproductive rights is a global concern, exemplified by goal 5.6 of the Sustainable Development Goals (UN General Assembly, 2015). Whilst the range of contraceptive options have increased, our understanding of the impacts of use for women are inadequate and represent a key barrier to positive change in policies and practices. In particular, we have few consensuses on the expected impacts of hormonal contraceptive use on women's sexuality and wellbeing.
In their Stage 1 Report, Botzet et al. (2023) argued that this inconclusive evidence base could be due to the wide heterogeneity in responses, the impacts of this heterogeneity upon attrition, differences in contraceptive methods and dosage effects, confounders, and the potential for reverse causality. Tackling some of these potential factors, Botzet (2023) planned to explore whether hormonal contraceptive use influences sexuality and well-being outcomes, and whether (and to what extent) the effects vary between women. To achieve this they proposed analysis of longitudinal data from the German Family Panel (PAIRFAM) which included annual waves of data collection, with separate Stage 2 submissions planned to report findings based on sexuality and well-being.
This specific Stage 2 Report, Botzet et al. (2025) focus upon the sexuality-based outcomes of the programme of work and found positive effects of hormonal contraceptives on sexual frequency and sexual satisfaction (but not desired sexual frequency), having controlled for a number of potential confounding variables. However, they also found relatively high heterogeneity for individual treatment effects, suggesting that predicting its effect for any given individual may be difficult. This work is a rigorous starting point for better understanding the impacts of hormonal contraceptives and the possibility for tailored approaches to contraception.
The Stage 2 manuscript was evaluated following one round of in-depth review. Based on detailed responses to the reviewers' and recommenders' comments, the recommender judged that the manuscript met the Stage 2 criteria and therefore awarded a positive recommendation.
URL to the preregistered Stage 1 protocol: https://osf.io/kj3h2
Level of bias control achieved: Level 3. At least some of the data/evidence that was used to answer the research question existed and was accessible in principle prior to IPA but the authors certify that they did not access any part of that data/evidence until after IPA. List of eligible PCI-RR-friendly journals:
References
1. Botzet, L. J., Rohrer, J. M., Penke, L. & Arslan, R. C. (2023). Hormonal Contraceptive Use and Women's Sexuality and Well-Being: Estimating Treatment Effects and Their Heterogeneity Based on Longitudinal Data [Stage 1]. In principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/kj3h2
2. Botzet, L. J., Rohrer, J. M., Penke, L. & Arslan, R. C. (2025). Positive Treatment Effects and High Heterogeneity of Hormonal Contraceptive Use on Women's Sexuality [Stage 2]. Acceptance of Version 3 by Peer Community in Registered Reports.
2. UN General Assembly (2015). Transforming our world : the 2030 Agenda for Sustainable Development, 21 October 2015, A/RES/70/1. Available at: https://www.refworld.org/docid/57b6e3e44.html [accessed 27 September 2023]
| Positive Treatment Effects and High Heterogeneity of Hormonal Contraceptive Use on Women's Sexuality | Laura J. Botzet, Julia M. Rohrer, Lars Penke, Ruben C. Arslan | <p>Different women experience hormonal contraceptives differently, reporting side effects on their sexuality that range from negative to positive. But research on such causal effects of hormonal contraceptives on psychological outcomes struggles b... | Life Sciences, Social sciences | Thomas Evans | 2024-03-15 15:07:34 | View | ||
Impact of analytic decisions on test-retest reliability of individual and group estimates in functional magnetic resonance imaging: a multiverse analysis using the monetary incentive delay taskMichael I. Demidenko, Jeanette A. Mumford, Russell A. Poldrack https://doi.org/10.1101/2024.03.19.585755Exploring determinants of test-retest reliability in fMRI: a study with the Monetary Incentive Delay TaskRecommended by Dorothy BishopFunctional magnetic resonance imaging has been used to explore brain-behaviour relationships for many years, with proliferation of a wide range of sophisticated analytic procedures. However, rather scant attention has been paid to the reliability of findings. Concerns have been growing failures to replicate findings in some fields, but it is hard to know how far this is a consequence of underpowered studies, flexible analytic pipelines, or variability within and between participants. Demidenko et al. (2024) took advantage of the availability of three existing datasets, including the Adolescent Brain Cognitive Development (ABCD) study, the Michigan Longitudinal Study, and the Adolescent Risk Behavior Study, which all included a version of the Monetary Incentive Delay task measured in two sessions. These were entered into a multiverse analysis, which considered how within-subject and between-subject variance varies according to four analytic factors: smoothing (5 levels), motion correction (6 levels), task modelling (3 levels) and task contrasts (4 levels). They also considered how sample size affects estimates of reliability. The results have important implications for the those using fMRI with the Monetary Incentive Delay Task, and also raise questions more broadly about use of fMRI indices to study individual differences. Motion correction had relatively little impact on the ICC, and the effect size of the smoothing kernel was modest. Larger impacts on reliability were associated with choice of contrast (implicit baseline giving larger effects) and task parameterization. But perhaps the most sobering message from this analysis is that although activation maps from group data were reasonably reliable, the ICC, used as an index of reliability for individual levels of activation, was consistently low. This raises questions about the suitability of the Monetary Incentive Delay Task for studying individual differences. Another point is that reliability estimates become more stable as sample size increases; researchers may want to consider whether the trade-off between cost and gain in precision is justified for sample sizes above 250. I did a quick literature search on Web of Science: at the time of writing the search term ("Monetary Delay Task" AND fMRI) yielded 410 returns, indicating that this is a popular method in cognitive neuroscience. The detailed analyses reported here will repay study for those who are planning further research using this task. The Stage 2 manuscript was evaluated over one round of in-depth review. Based on detailed responses to the reviewer's and recommender's comments, the recommender judged that the manuscript met the Stage 2 criteria and awarded a positive recommendation. URL to the preregistered Stage 1 protocol: https://osf.io/nqgeh
Level of bias control achieved: Level 2. At least some data/evidence that was used to answer the research question had been accessed and partially observed by the authors prior to IPA, but the authors certify that they had not yet sufficiently observed the key variables within the data to be able to answer the research questions and they took additional steps to maximise bias control and rigour.
List of eligible PCI RR-friendly journals:
References 1. Demidenko, M. I., Mumford, J. A., & Poldrack, R. A. (2024). Impact of analytic decisions on test-retest reliability of individual and group estimates in functional magnetic resonance imaging: a multiverse analysis using the monetary incentive delay task [Stage 2]. Acceptance of Version 5 by Peer Community in Registered Reports. https://www.biorxiv.org/content/10.1101/2024.03.19.585755v4 | Impact of analytic decisions on test-retest reliability of individual and group estimates in functional magnetic resonance imaging: a multiverse analysis using the monetary incentive delay task | Michael I. Demidenko, Jeanette A. Mumford, Russell A. Poldrack | <p>Empirical studies reporting low test-retest reliability of individual blood oxygen-level dependent (BOLD) signal estimates in functional magnetic resonance imaging (fMRI) data have resurrected interest among cognitive neuroscientists in methods... | ![]() | Life Sciences, Social sciences | Dorothy Bishop | 2024-03-21 02:23:30 | View | |
17 Oct 2024
STAGE 1
![]() Is subjective perceptual similarity metacognitive?Ali Moharramipour, William Zhou, Dobromir Rahnev, Hakwan Lau https://doi.org/10.1101/2024.06.13.598769The relationship between perceptual discriminability and subject similarityRecommended by D. Samuel SchwarzkopfMuch of how we use our perception involves judgements on how similar things are: You might vaguely recognise an actor's face in a movie but not immediately recognise where you have seen it before. Some people claim to be "bad with faces". Is that in fact based on objectively poorer ability to recognise faces? Psychophysical lab studies of perception typically use forced-choice discrimination tasks in which participants must make explicit, and usually binary, decisions. Such designs can yield parametric information about underlying perceptual processes, but it is very different from how we use perception in daily life.
Here, Moharramipour and colleagues (2024) seek to better understand the link between such subjective similarity jugdements and objective discrimination ability. They argue that subjective similarity can be considered a metacognitive process, reflecting the person's awareness of their perceptual capacity. Participants will be asked to discriminate face pairs across a spectrum of morphing steps in a classical forced-choice paradigm to estimate perceptual threshold performance, as well as provide subjective ratings of similarity of the face pairs. The researchers hypothesise a correlation between objective perceptual ability and subjective similarity judgements. They will evaluate this at the group level, and also use a resampling approach to determine the specificity of this relationship in individual participants. Confirming this hypothesis would advance our knowledge of how perceptual ability links with our metacognitive introspection of it. Are you really "bad with faces" or do you only think you are?
The Stage 1 manuscript was evaluated over two rounds of in-depth review. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and awarded in-principle acceptance (IPA).
URL to the preregistered Stage 1 protocol: https://osf.io/pzugy
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA. List of eligible PCI RR-friendly journals:
References
Moharramipour, A., Zhou, W., Rahnev, D., & Lau, H. (2024). Is subjective perceptual similarity metacognitive? In principle acceptance of Version 4 by Peer Community in Registered Reports. https://osf.io/pzugy
| Is subjective perceptual similarity metacognitive? | Ali Moharramipour, William Zhou, Dobromir Rahnev, Hakwan Lau | <p>Perceptual similarity is a cornerstone for human learning and generalization. However, in assessing the similarity between two stimuli differing in multiple dimensions, it is not well-defined which feature(s) one should focus on. The problem ha... | Life Sciences, Social sciences | D. Samuel Schwarzkopf | 2024-06-15 15:27:08 | View | ||
Do Ecological Valid Stop Signals Aid Detour Performance? A Comparison of Four Bird SpeciesAnneleen Dewulf, Clara Garcia-Co, Wendt Müller, Joah R. Madden, An Martel, Luc Lens, Frederick Verbruggen https://osf.io/j2k9hWhat is the role of sensory perception in cognitive task performance? An improved replication of detour performance in four different bird speciesRecommended by Dieter LukasThe detour task, where an individual has to go around a see-through barrier in order to reach a goal, is one of the oldest paradigms used in animal cognition research (Kabadayi et al. 2018). While these previous tests have documented variation in the ability of animals to inhibit going straight for the visible reward, the cognitive underpinnings of this behaviour are as yet not fully understood. In the current study, Dewulf et al. (2025) assessed one of the specific cognitive processes that might be involved in this behaviour, the ability to identify the transparent object as a barrier. Through experimental procedures relying on large samples of individuals from four bird species, they compared the role of signal detection in inhibitory response performance in a detour task. The authors found that, unlike suggested in previous work with these four species (Regolin et al. 1994, Zucca et al. 2005), changing the markings on the barriers to potentially better match those experienced by individuals in their natural environments did not improve their performance. Nevertheless, the detailed further explorations suggest that in order to understand variation in how quickly individuals and species solve the detour task, it is important to consider that different cognitive processes are involved. Their work therefore provides a basis to better understand and further investigate why species might differ in their performance in the detour task.
The Stage 2 manuscript was evaluated over two rounds of in-depth review, the first round consisting of detailed comments from two reviewers and the second round consisting of a close read by the recommender. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 2 criteria and awarded a positive recommendation.
Level of bias control achieved: Level 6. No part of the data or evidence that was used to answer the research question was generated until after IPA.
URL to the preregistered Stage 1 protocol: https://osf.io/qvxgh
List of eligible PCI RR-friendly journals:
References
1. Dewulf, A., Garcia-Co, C., Müller, W., Madden, J.R., Martel, A., Lens, L. & Verbruggen, F. (2025). Do Ecological Valid Stop Signals Aid Detour Performance? A Comparison of Four Bird Species [Stage 2]. Acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/j2k9h
2. Kabadayi, C., Bobrowicz, K., & Osvath, M. (2018). The detour paradigm in animal cognition. Animal Cognition, 21, 21-35. https://doi.org/10.1007/s10071-017-1152-0
3. Regolin, L., Vallortigara, G., & Zanforlin, M. (1995). Object and spatial representations in detour problems by chicks. Animal Behaviour, 49, 195-199. https://doi.org/10.1016/0003-3472(95)80167-7
4. Zucca, P., Antonelli, F., & Vallortigara, G. (2005). Detour behaviour in three species of birds: quails (Coturnix sp.), herring gulls (Larus cachinnans) and canaries (Serinus canaria). Animal Cognition, 8, 122-128. https://doi.org/10.1007/s10071-004-0243-x
| Do Ecological Valid Stop Signals Aid Detour Performance? A Comparison of Four Bird Species | Anneleen Dewulf, Clara Garcia-Co, Wendt Müller, Joah R. Madden, An Martel, Luc Lens, Frederick Verbruggen | <p>Response inhibition, or the stopping of actions, is considered a key component of flexible and adaptive behaviour. Across fields, response inhibition is often treated as a unitary cognitive mechanism. However, we propose that response inhibitio... | Life Sciences, Social sciences | Dieter Lukas | 2024-10-22 14:00:30 | View | ||
13 Jul 2023
STAGE 1
![]() Modulatory effects of instructions on extinction efficacy in appetitive and aversive learning: A registered reportLea Busch, Katja Wiech, Matthias Gamer, Balint Kincses, Tamas Spisak, Katharina Schmidt, Ulrike Bingel https://osf.io/cj75pNeurocognitive insights on instructed extinction in the context of painRecommended by Chris ChambersRapid learning in response to pain is a crucial survival mechanism, relying on forming associations between cues in the environment and subsequent pain or injury. Existing evidence suggests that associations between conditioned stimuli (cues) and unconditioned aversive stimuli (such as pain) are learned faster than for appetitive stimuli that signal pain relief. In addition, when the link between a conditioned and unconditioned stimulus is broken (by unpairing them), the extinction of this learning effect is slower for aversive that appetitive stimuli, resulting in a flatter extinction slope. Understanding why extinction slopes are reduced for aversive stimuli is important for advancing theoretical models of learning, and for devising ways of increasing the slope (and thus facilitating extinction learning) could help develop more effective methods of pain relief, particularly in the treatment of chronic pain.
In the current programmatic submission, Busch et al. (2023) will undertake two Registered Reports to test whether a verbal instruction intervention that explicitly informs participants about contingency changes between conditioned and unconditioned stimuli facilitates extinction learning, especially for aversive (painful) stimuli, and how changes in extinction learning relate to neural biomarkers of functional connectivity. In the first Registered Report, they will initially seek to replicate previous findings including faster acquisition of aversive than appetitive conditioned stimuli as well as incomplete extinction of aversive conditioned stimuli without verbal instruction. They will then test how the instruction intervention alters extinction slopes and the completeness of extinction for appetitive and aversive stimuli, using a range of behavioral measures (expectancy and valence ratings) and physiological measures (pupillometry, skin conductance responses). To shed light on the neural correlates of these processes, in the second Registered Report the authors will use functional magnetic resonance imaging (fMRI) to ask firstly how acquisition and extinction of aversive and appetitive conditioned responses are related to resting state brain connectivity within a network that includes ventromedial prefrontal cortex, amygdala, and striatum, and secondly, whether the effectiveness of instruction on extinction learning is associated with differences in resting state connectivity across this network.
The Stage 1 manuscript was evaluated over two rounds of in-depth review. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
URL to the preregistered Stage 1 protocol: https://osf.io/cj75p (under temporary private embargo)
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA. List of eligible PCI RR-friendly journals:
References
1. Busch, L., Wiech, K., Gamer, M., Knicses, B., Spisak, T., Schmidt, K., & Bingel, U. (2023). Modulatory effects of instructions on extinction efficacy in appetitive and aversive learning: A registered report. In principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/cj75p
| Modulatory effects of instructions on extinction efficacy in appetitive and aversive learning: A registered report | Lea Busch, Katja Wiech, Matthias Gamer, Balint Kincses, Tamas Spisak, Katharina Schmidt, Ulrike Bingel | <p>In the context of pain, extinction learning has been shown to be slower or incomplete for aversive compared to appetitive cues (i.e., cues signaling pain exacerbation and pain relief, respectively), potentially due to their higher biological re... | Medical Sciences | Chris Chambers | 2022-10-15 19:45:48 | View | ||
31 May 2023
STAGE 1
![]() Defacing biases in manual and automated quality assessments of structural MRI with MRIQCCéline Provins, Yasser Alemán-Gómez, Jonas Richiardi, Russell A. Poldrack, Patric Hagmann, Oscar Esteban https://osf.io/qcketThe impact of removing facial features on quality measures of structural MRI scansRecommended by D. Samuel SchwarzkopfData sharing is perhaps the most fundamental step for increasing the transparency and reproducibility of scientific research. However, the goals of open science must be tempered by ethical considerations, protecting the privacy and safety of research participants. Bridging this gap causes challenges for many fields, such as human neuroimaging. Brain images, as measured with magnetic resonance imaging (MRI), are unique to the participant and therefore contain identifying information by definition. One way to mitigate the risk to participants arising from public data sharing has been "defacing" the MRI scans, i.e., literally removing the part of the image that contains the face and surrounding tissue, while preserving the brain structure. This procedure however also removes information that is not (or at least minimally) identifiable. It also remains unclear whether defacing the images affects image quality and thus the information necessary for addressing many research questions.
The current study by Provins et al. (2023) seeks to address this question. Leveraging a publicly available "IXI dataset" comprising hundreds of T1-weighted structural MRI scans, they will assess the effect of defacing on manual and automatic estimates of image quality. Specifically, the researchers will compare image quality ratings by experts for a subset of 185 images. They hypothesise that images in which facial features have been removed are typically assigned higher quality ratings. Moreover, using a full data set of 580 images, which have been obtained across three scanning sites, they will also test the impact defacing MRI scans has on automated quality measures obtained with MRIQC software. The results of this study should have important implications for open science policy and for designing the optimal procedures for sharing structural MRI data in an ethical way. For example, if the authors' hypothesis is confirmed, studies relying on MRI quality measures might be better served by a custodianship model where identifiable data is shared under strict conditions, rather than relying on publishing defaced data. More generally, the outcome of this study may have significant legal implications in many jurisdictions.
The Stage 1 manuscript was evaluated at the inital triage stage by the Recommender and PCI:RR team, and another round of in-depth review by two experts. After a detailed response and substantial revisions, the recommender judged the manuscript met the Stage 1 criteria and awarded in-principle acceptance (IPA).
URL to the preregistered Stage 1 protocol: https://osf.io/qcket (under temporary private embargo)
Level of bias control achieved: Level 2. At least some data/evidence that will be used to answer the research question has been accessed and partially observed by the authors, but the authors certify that they have not yet observed the key variables within the data that will be used to answer the research question AND they have taken additional steps to maximise bias control and rigour. List of eligible PCI RR-friendly journals:
References
1. Provins, C., Savary, E., Alemán-Gómez, Y., Richiardi, J., Poldrack, R. A., Hagmann, P. & Esteban, O. (2023). Defacing biases in manual and automated quality assessments of structural MRI with MRIQC, in principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/qcket
| Defacing biases in manual and automated quality assessments of structural MRI with MRIQC | Céline Provins, Yasser Alemán-Gómez, Jonas Richiardi, Russell A. Poldrack, Patric Hagmann, Oscar Esteban | <p>A critical requirement before data-sharing of human neuroimaging is removing facial features to protect individuals’ privacy. However, not only does this process redact identifiable information about individuals, but it also removes non-identif... | Medical Sciences | D. Samuel Schwarzkopf | Catherine Morgan, Cassandra Gould van Praag, Abiola Akinnubi | 2022-11-28 10:59:32 | View |
FOLLOW US
MANAGING BOARD
Chris Chambers
Zoltan Dienes
Corina Logan
Benoit Pujol
Maanasa Raghavan
Emily S Sena
Yuki Yamada