Submit a report

Announcements

Please note that we will be CLOSED to ALL SUBMISSIONS from 1 December 2024 through 12 January 2025 to give our recommenders and reviewers a holiday break.

We are recruiting recommenders (editors) from all research fields!

Your feedback matters! If you have authored or reviewed a Registered Report at Peer Community in Registered Reports, then please take 5 minutes to leave anonymous feedback about your experience, and view community ratings.

Latest recommendationsrssmastodon

IdTitle * Authors * Abstract * PictureThematic fields * RecommenderReviewersSubmission date
13 Jun 2022
STAGE 1

Associations of fear, anger, happiness, and hope with risk judgments: Revisiting appraisal-tendency framework with a replication and extensions of Lerner and Keltner (2001)

Replicating the relationship between emotions and judgments of risk

Recommended by ORCID_LOGO based on reviews by Kelly Wolfe, Max Primbs, Agata Sobków and Karolina Scigala
How do emotions interact with cognition? The last 40 years has witnessed the rise of cognitive-appraisal theories, which propose that emotions can be differentiated along an axis of cognitive dimensions such as certainty, pleasantness, attentional activity, control, anticipated effort, and responsibility (Smith and Ellsworth, 1985). Early tests of such theories focused especially on the impact of the valence – pleasantness/unpleasantness – of emotions on judgment and decision-making, finding, for instance, that negative mood induction can heighten pessimistic estimates of risk (Johnson & Tversky, 1983).
 
The Appraisal-Tendency Framework proposed by Lerner and Keltner (2000) refined cognitive-appraisal theory by proposing that specific emotions trigger a predisposition to appraise future (or hypothetical) events in line with the central appraisal dimensions that triggered the emotion, even when the emotion and the judgment are unrelated. For example, an individual who is triggered to become fearful of a heightened risk, such as nuclear war, may then exhibit heightened pessimism about risks unrelated to war. The Appraisal-Tendency Framework also predicts relationships between traits, such as between fear, anger and risk-taking/risk-seeking tendencies. In an influential paper, Lerner and Keltner (2001) reported direct empirical support for the Appraisal-Tendency Framework, which aside from its influence in cognitive/affective psychology has had considerable impact in behavioural economics, moral psychology, and studies of consumer behaviour.
 
In the current study, Lu and Feldman (2022) propose to replicate three key studies from Lerner and Keltner (2001) in a large online sample. Through a combination of replication and extension, the authors will probe the relationship between various trait emotions (including fear, anger, happiness, and hope) and trait characteristics of risk seeking and optimistic risk assessment. The authors also propose examining how the ambiguity of triggering events moderates the relationship between specific emotions and risk judgments. 
 
The Stage 1 manuscript was evaluated over two rounds of in-depth review. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
 
URL to the preregistered Stage 1 protocol: https://osf.io/8yu2x
 
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA. 
 
List of eligible PCI RR-friendly journals:
 
References
 
1. Smith, C. A., & Ellsworth, P. C. (1985). Patterns of cognitive appraisal in emotion. Journal of Personality and Social Psychology, 48, 813-838. https://doi.org/10.1037/0022-3514.48.4.813
 
2. Johnson, E. J., & Tversky, A. (1983). Affect, generalization, and the perception of risk. Journal of Personality and Social Psychology, 45(1), 20–31. https://doi.org/10.1037/0022-3514.45.1.20
 
3. Lerner, J. S., & Keltner, D. (2000). Beyond valence: Toward a model of emotion-specific influences on judgment and choice. Cognition & Emotion, 14, 473-493. https://doi.org/10.1080/026999300402763 
 
4. Lerner, J. S., & Keltner, D. (2001). Fear, anger, and risk. Journal of Personality and Social Psychology, 81, 146–159. https://doi.org/10.1037/0022-3514.81.1.146
  
5. Lu, S. & Feldman, G. (2022). Associations of fear, anger, happiness, and hope with risk judgments: Revisiting appraisal-tendency framework with a replication and extensions of Lerner and Keltner (2001), in principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/8yu2x
Associations of fear, anger, happiness, and hope with risk judgments: Revisiting appraisal-tendency framework with a replication and extensions of Lerner and Keltner (2001)Sirui Lu; Gilad Feldman<p>This is a scheduled PCI-RR snap shot for a planned project: "Associations of fear, anger, happiness, and hope with risk judgments: &nbsp;Revisiting appraisal-tendency framework with a replication and extensions of Lerner and Keltner (2001)​"</p>Social sciencesChris Chambers2022-01-31 09:36:29 View
12 Jul 2024
STAGE 1

Associations between anxiety-related traits and fear acquisition and extinction - an item-based content and meta-analysis

Integrative meta-analysis of anxiety-related traits and fear processing: bridging research to clinical application

Recommended by ORCID_LOGO based on reviews by Yoann Stussi, Luigi Degni, Marco Badioli and 1 anonymous reviewer
The paper aims to bridge gaps in understanding the relationship between anxiety-related traits and fear processing, with a specific focus on fear acquisition and extinction. Fear and safety processing are known to be linked to anxiety symptoms and traits such as neuroticism and intolerance of uncertainty (Lonsdorf et al., 2017; Morriss et al., 2021). However, the diversity in study focus and measurement methods makes it difficult to integrate findings into clinical practice effectively.
 
To address this issue, Brunsch et al. (2024) propose a systematic literature search and meta-analysis, following PRISMA guidelines, to explore these associations. They plan to use nested random effects models to analyze both psychophysiological and self-report outcome measures. Additionally, they will examine the role of different questionnaires used to assess anxiety-related traits and conduct a content analysis of these tools to evaluate trait overlaps.
 
Current knowledge from the literature indicates that individuals with anxiety disorders exhibit differences in fear acquisition and extinction compared to those without such disorders (Lonsdorf et al., 2017; Morriss et al., 2021). Previous meta-analyses have shown associations between anxiety traits and fear generalization/extinction, but these studies are limited in their scope and focus.
 
The primary aim of the research is to provide a comprehensive summary of the associations between anxiety-related traits and conditioned responding during fear acquisition and extinction across multiple measures. Another goal is to investigate whether different anxiety-related trait questionnaires yield different associations with fear and extinction learning. The authors will also conduct a content analysis to better interpret the results of their meta-analysis by examining the overlap in questionnaire content.
 
A secondary aim of the study is to evaluate how sample characteristics, experimental specifics, and study quality influence the associations between anxiety-related traits and fear acquisition and extinction. By addressing these aims, the study seeks to advance the understanding of fear-related processes in anxiety and inform more targeted prevention and intervention strategies.
 
The Stage 1 manuscript underwent two rounds of thorough review. After considering the detailed responses to the reviewers' comments, the recommender determined that the manuscript met the Stage 1 criteria and granted in-principle acceptance (IPA).
 
URL to the preregistered Stage 1 protocol: https://osf.io/4mndj
 
Level of bias control achieved: Level 3. At least some data/evidence that will be used to the answer the research question has been previously accessed by the authors (e.g. downloaded or otherwise received), but the authors certify that they have not yet observed ANY part of the data/evidence.
 
List of eligible PCI RR-friendly journals:
 
 
References
 
1. Bruntsch, M., Abend, R., Chalkia, A., Cooper, S. E., Ehlers, M. R., Johnson, D. C., Klingelhöfer-Jens, M., Morriss, J., Zika, O., & Lonsdorf, T. B. (2024). Associations between anxiety-related traits and fear acquisition and extinction - an item-based content and meta-analysis. In principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/4mndj
 
2. Lonsdorf, T. B., & Merz, C. J. (2017). More than just noise: Inter-individual differences in fear acquisition, extinction and return of fear in humans - Biological, experiential, temperamental factors, and methodological pitfalls. Neuroscience & Biobehavioral Reviews, 80, 703–728. https://doi.org/10.1016/j.neubiorev.2017.07.007
 
3. Morriss, J., Wake, S., Elizabeth, C., & van Reekum, C. M. (2021). I Doubt It Is Safe: A Meta-analysis of Self-reported Intolerance of Uncertainty and Threat Extinction Training. Biological Psychiatry Global Open Science, 1, 171–179. https://doi.org/10.1016/j.bpsgos.2021.05.011
Associations between anxiety-related traits and fear acquisition and extinction - an item-based content and meta-analysisMaria Bruntsch, Samuel E Cooper, Rany Abend, Marian Boor, Anastasia Chalkia, Mana Ehlers, Artur Czeszumski, Dave Johnson, Maren Klingelhöfer-Jens, Jayne Morriss, Erik Mueller, Ondrej Zika, Tina Lonsdorf <p>Background: Deficits in learning and updating of fear and safety associations have been reported in patients suffering from anxiety- and stress-related disorders. Also in healthy individuals, anxiety-related traits have been linked to altered f...Life SciencesSara GarofaloAnonymous, Luigi Degni, Marco Badioli, Yoann Stussi2024-03-15 14:48:20 View
25 Mar 2024
STAGE 1
article picture

Assessing compliance with UK loot box industry self-regulation on the Apple App Store: a 6-month longitudinal study on the implementation process

Does self regulation by gaming companies for the use of loot boxes work?

Recommended by ORCID_LOGO based on reviews by Chris Chambers, Lukas J. Gunschera and Andy Przybylski
Video games may provide the option of spending real money in exchange for probabilistically receiving game-relevant rewards; in effect, encouraging potentially young teenagers to gamble. The industry has subscribed to a set of regulatory principles to cover the use of such "loot boxes", including 1) that they will prevent loot box purchasing by under 18s unless parental consent is given; 2) that they will make it initially clear that the game contains loot boxes; and 3) that they will clearly disclose the probabilities of receiving different rewards.
 
Can the industry effectively self regulate? Xiao (2024) will evaluate this important question by investigating the 100 top selling games on the Apple App Store and estimating the percentage compliance to these three regulatory principles at two time points 6 months apart.
 
The Stage 1 manuscript was evaluated over one round of in-depth review. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
 
URL to the preregistered Stage 1 protocol: https://osf.io/3knyb
 
Level of bias control achieved: Level 2. At least some data/evidence that will be used to answer the research question has been accessed and partially observed by the authors, but the authors certify that they have not yet observed the key variables within the data that will be used to answer the research question.
 
List of eligible PCI RR-friendly journals:
 
 
References
 
1. Xiao, L. (2024). Assessing compliance with UK loot box industry self-regulation on the Apple App Store: a 6-month longitudinal study on the implementation process. In principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/3knyb
Assessing compliance with UK loot box industry self-regulation on the Apple App Store: a 6-month longitudinal study on the implementation processLeon Y. Xiao<p>Loot boxes in video games can be purchased with real-world money in exchange for random rewards. Stakeholders are concerned about loot boxes’ similarities with gambling and their potential harms (e.g., overspending). The UK Government has decid...Humanities, Social sciencesZoltan Dienes2023-08-27 22:47:03 View
08 Feb 2022
STAGE 1
article picture

Arithmetic deficits in Parkinson's Disease? A registered report

Getting the numbers right in Parkinson's disease?

Recommended by ORCID_LOGO based on reviews by Pia Rotshtein, Ann Dowker, Stephanie Rossit and 1 anonymous reviewer

Everyday life, including for patients taking different types of medicine, involves dealing with numbers. Even though Parkinson's disease may ordinarily be thought of as primarily being a motor disorder, there is evidence that numerical abilities decline as Parkinson's disease progresses. Further, the brain areas involved in arithmetic operations overlap with the areas that degenerate in Parkinson's disease.

In this Stage 1 Registered Report, Loenneker et al. (2022) will test healthy  controls, Parkinson disease patients with normal  cognition, and Parkinson disease patients with mild cognitive impairment on general working memory tasks as well as arithmetic performance on the four basic  operations (addition, subtraction, multiplication, division). The study aims to test whether or not there is a deficit in each operation, and the relation of any deficits to general working memory capacity.

The Stage 1 manuscript was evaluated over four rounds of review (including two rounds of in-depth specialist review). Based on comprehensive responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).

URL to the preregistered Stage 1 protocol: https://osf.io/nb5fj

Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.

List of eligible PCI RR-friendly journals:

References

Loenneker, H. D., Liepelt-Scarfone, I., Willmes, K., Nuerk, H.-C., & Artemenko, C. (2022). Arithmetic deficits in Parkinson’s Disease? A Registered Report. Stage 1 preregistration, in principle acceptance of version 4 by Peer Community in Registered Reports. https://osf.io/nb5fj

Arithmetic deficits in Parkinson's Disease? A registered reportHannah D. Loenneker, Inga Liepelt-Scarfone, Klaus Willmes, Hans-Christoph Nuerk, & Christina Artemenko<p>Elderly people and patients with neurodegenerative diseases such as Parkinson’s Disease (PD) immensely rely on arithmetic skills to lead an independent life. Activities such as medication management, financial transactions or using public trans...Life SciencesZoltan Dienes2021-06-29 19:23:53 View
13 Sep 2024
STAGE 2
(Go to stage 1)

Appreciation of singing and speaking voices is highly idiosyncratic

Exploring the enjoyment of voices

Recommended by ORCID_LOGO based on reviews by Patrick Savage
Beyond the semantics communicated by speech, human vocalisations can convey a wealth of non-verbal information, including the speaker’s identity, body size, shape, health, age, intentions, emotional state, and personality characteristics. While much has been studied about the neurocognitive basis of voice processing and perception, the richness of vocalisations leaves open fundamental questions about the aesthetics of (and across) song and speech, including which factors determine our preference (liking) for different vocal styles.
 
In the current study, Bruder et al. (2024) examined the characteristics that determine the enjoyment of voices in different contexts and the extent to which these preferences are shared across different types of vocalisation. Sixty-two participants reported their degree of liking across a validated stimulus set of naturalistic and controlled vocal performances by female singers performing different melody excerpts as a lullaby, as a pop song and as opera aria, as well as reading the corresponding lyrics aloud as if speaking to an adult audience or to an infant. The authors then asked two main questions: first if there is a difference in the amount of shared taste (interrater agreement) across contrasting vocal styles, and second, as suggested by sexual selection accounts of voice attractiveness, whether the same performers are preferred across styles.
 
Support for the preregistered hypotheses was mixed. Shared taste differed significantly between singing styles, but contrary to the hypothesis that it would be higher for more “natural”/ universal styles (lullabies) than for more “artificial” (operatic) forms of singing (with pop singing in an intermediary position), it was found to be higher for operatic than pop singing. At the same time, the hypothesis of low consistency in preferences for singers across styles was confirmed, contradicting the notion that singing and speaking voices convey the same information about an individual's physical fitness. Overall, the results suggest that enjoyment of singing and speaking is idiosynchratic and prone to substantial individual differences. The authors conclude that a broader approach is needed to studying this question that traverses geographic, linguistic, and cultural contexts.

The Stage 2 manuscript was evaluated over one round of in-depth review. Based on detailed responses to the reviewer's comments, the recommender judged that the manuscript met the Stage 2 criteria and awarded a positive recommendation.
 
URL to the preregistered Stage 1 protocol: https://osf.io/7dvme
 
Level of bias control achieved: Level 6. No part of the data or evidence that was used to answer the research question was generated until after IPA. 
 
List of eligible PCI RR-friendly journals:
 
References
 
1. Bruder, C., Frieler, K. and Larrouy-Maestri, P. (2024). Appreciation of singing and speaking voices is highly idiosyncratic [Stage 2]. Acceptance of Version 2 by Peer Community in Registered Reports. https://osf.io/rp5jx?view_only=506d243a6e7a4d3680c81e696ca81025
Appreciation of singing and speaking voices is highly idiosyncraticCamila Bruder, Klaus Frieler, Pauline Larrouy-Maestri<p>Voice preferences are an integral part of interpersonal interactions and shape how people connect with each other. While a large number of studies has investigated the mechanisms behind (speaking) voice attractiveness, very little research was ...Social sciencesChris Chambers2024-06-04 22:06:03 View
08 Apr 2024
STAGE 2
(Go to stage 1)

Applying a Synergistic Mindsets Intervention to an Esports Context

Synergistic Mindset Intervention in Competitive Situations

Recommended by ORCID_LOGO based on reviews by Lee Moore, Ivan Ropovik and Jacob Keech
Mindset theories suggest that the mere belief in the malleability of human abilities can help one to develop related performance. On the other hand, one and the same performance situation can also be experienced in various affective ways, which differently contribute to performance outcomes. One theoretically justifiable premise is that appraising a performance situation as a “threat” instead of “challenge” is associated with maladaptive responses, such as impaired cardiovascular mobilization. If people could experience performance situations as positive challenges, this might also improve performance outcomes. Drawing from these connected premises, the synergistic mindset intervention was developed and tentatively found to help adolescents in stressful situations (Yeager et al., 2022).
 
In the present registered report, Behnke et al. (2024) built on the above to test whether the synergistic mindset intervention can help individuals in competitive gaming situations. The authors utilized one of the leading esport games, Counter-Strike: Global Offensive​, and recruited its active players (N=300) into randomized control and intervention groups. The participants competed in a cash-prize tournament involving measures of affective experience and cardiovascular responses. Behnke et al. (2024) hypothesized the synergistic mindset group (SMI) to show greater challenge affective responses and superior performance outcomes. 
 
Although the SMI produced a number of positive outcomes such as more beneficial stress mindsets, the hypotheses were not corroborated but the results supported a null. This may be related to the observation that participants generally experienced the intervention positively, which, in turn, limits the potential for improving affective and physiological responses. These rigorous null results are informative by directing the SMI research program toward test designs where more participants experience strong negative stress responses. Moreover, the results encourage researchers to reassess the underlying auxiliary hypotheses regarding affective responses and performance outcomes, the relationships of which may be complicated by situational factors that are not yet fully understood.
 
The Stage 2 manuscript was evaluated over one round of in-depth review. Three out of the four Stage 1 experts returned to review and, due to the study’s exceptionally high level of transparency, the reviewers had only minor requests for revision. As all the requested revisions were implemented carefully, the recommender judged that the manuscript met the Stage 2 criteria and awarded a positive recommendation.
 
URL to the preregistered Stage 1 protocol: https://osf.io/z3adb
 
Level of bias control achieved: Level 6. No part of the data or evidence that was used to answer the research question was generated until after IPA.
 
List of eligible PCI RR-friendly journals: 
 
 
References
 
1. Behnke M., Lakens D., Petrova K., Chwiłkowska P., Kaczmarek L. D., Jamieson J. P., & Gross J. J. (2024) Applying a Synergistic Mindsets Intervention to an Esports Context. Acceptance of Version 2 by Peer Community in Registered Reports https://osf.io/53z8e
 
2. Yeager D.S., Bryan C.J., Gross J.J., Murray J., Krettek D., Santos P., ... & Jamieson J.P. (2022) A synergistic mindsets intervention protects adolescents from stress. Nature 607, 512–520. https://doi.org/10.1038/s41586-022-04907-7
 
Applying a Synergistic Mindsets Intervention to an Esports ContextMaciej Behnke, Daniël Lakens, Kate Petrova, Patrycja Chwiłkowska, Szymon Jęśko Białek, Maciej Kłoskowski, Wadim Krzyżaniak, Patryk Maciejewski, Lukasz D. Kaczmarek, Kacper Szymański, Jeremy P. Jamieson, James J. Gross<p>Affective responses during stressful, high-stakes situations can play an important role in shaping performance. For example, feeling shaky and nervous at a job interview can undermine performance, whereas feeling excited during that same interv...Social sciencesVeli-Matti Karhulahti2024-02-02 17:57:13 View
08 Dec 2023
STAGE 1

An #EEGManyLabs study to test the role of the alpha phase on visual perception (a replication and new evidence)

Understanding the relationship between alpha oscillations and visual perception

Recommended by ORCID_LOGO based on reviews by Chris Allen, Luca Ronconi and Alexander Jones
For nearly a century, rhythmic patterns in electrical brain activity have been of major interest in neuroscience and electrophysiology, but much remains to be discovered about their causal contribution to cognition and behaviour. Low-frequency oscillations in the alpha band (~8-13 Hz) have been suggested to facilitate the organisation and delivery of visual information to higher-level systems, including those involved in perception and decision-making. If so, visual perception should also operate in cycles that are synchronous with – and determined by – the phase of ongoing low-frequency oscillatory activity.
 
In this #EEGManyLabs study, Ruzzoli et al. (2023) propose a large-scale, multi-lab investigation (9 labs; N=315 human participants) of the relationship between the phase of alpha oscillations and visual perception. The authors focus in particular on replicating a formative study by Mathewson et al. (2009) which reported that during high-amplitude alpha fluctuations, stimulus visibility depended on the time the stimulus was presented relative to the phase of the pre-stimulus alpha activity. In addition, the amplitude of visual evoked potentials recorded with EEG was larger when the target was presented at peaks in pre-stimulus alpha. To explain their findings, Mathewson proposed an influential pulsed inhibition hypothesis in which low alpha power boosts both cortical excitability and stimulus processing (and hence perception), while high alpha power makes stimulus processing dependent on the phase during the alpha cycle at which the stimulus is presented.
 
In the first of (up to) two studies, the authors will seek to directly replicate the key finding of Mathewson et al: that when alpha power is high, the oscillatory phase determines perceptual performance and event-related electrophysiological correlates in a masked visual detection task. Specifically, (a) alpha oscillations are predicted to modulate the probability of perceiving a target stimulus within a single oscillatory cycle, with detection rate associated with separated (and potentially opposite) phase angles, and (b) alpha phase at the onset of the stimulus should drive electrophysiological correlates of stimulus processing (including the amplitude and/or latency of the N1 ERP component).
 
Provided the results of this first study do not conclusively disconfirm these hypotheses, the authors will then conduct a follow-up study in which the temporal predictability of the target onset (in relation to a fixation stimulus) is reduced to test the more severe hypothesis that the observed correlations between alpha phase and perception are linked directly to ongoing oscillations, independent of temporal expectations.
 
The Stage 1 manuscript was evaluated over two rounds of in-depth review. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
 
URL to the preregistered Stage 1 protocol: https://osf.io/scqj8​ (under temporary private embargo)
 
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA. 
 
List of eligible PCI RR-friendly journals:
 
 
References
 
1. Ruzzoli, M., Cuello, M. T., Molinaro, N., Benwell, C. S. Y., Berkowitz, D., Brignani, D., Falciati, L., Harris, A. M., Keitel, C., Kopčanová, M., Madan, C. R., Mathewson, K., Mishra, S., Morucci, P., Myers, N., Nannetti, F., Nara, S., Pérez-Navarro, J., Ro, T., Schaworonkow, N., Snyder, J. S., Soto-Faraco, S., Srinivasan, N., Trübutschek, D., Zazio, A., Mushtaq, F., Pavlov, Y. G., & Veniero, D. (2023). In principle acceptance of Version 2 by Peer Community in Registered Reports. https://osf.io/scqj8​
 
2. Mathewson, K. E., Gratton, G., Fabiani, M., Beck, D. M., & Ro, T. (2009). To see or not to see: prestimulus α phase predicts visual awareness. Journal of Neuroscience, 29, 2725-2732. https://doi.org/10.1523/JNEUROSCI.3963-08.2009
An #EEGManyLabs study to test the role of the alpha phase on visual perception (a replication and new evidence)Manuela Ruzzoli, Mireia Torralba Cuello, Nicola Molinaro, Christopher S.Y. Benwell, Daniel Berkowitz, Debora Brignani, Luca Falciati, Anthony M. Harris, Christian Keitel, Martina Kopčanová, Christopher R. Madan, Kyle Mathewson, Sudhakar Mishra, Pi...<p>Several studies have suggested that low-frequency brain oscillations could be key to understanding how the brain samples sensory information via rhythmic alternation of low and high excitability periods. However, this hypothesis has recently be...Humanities, Social sciencesChris Chambers2023-08-03 12:59:33 View
18 May 2023
STAGE 1

A multilab investigation into the N2pc as an indicator of attentional selectivity: Direct replication of Eimer (1996)

Is the N2pc a correlate of attentional selection? An #EEGManyLabs multi-lab registered replication of Eimer (1996)

Recommended by ORCID_LOGO based on reviews by Reny Baykova and Clayton Hickey
The N2pc is a lateralised ERP component that is often interpreted as a marker of attentional allocation, so much so that it is frequently used a tool in the attention literature for inferring that a stimulus was attentionally processed. This interpretation of N2pc can be traced back to the seminal work of Eimer (1996), which has been conceptually replicated many times but has never been replicated directly.
 
This registered direct replication by Constant et al. (2023) forms part of a larger series of large-scale, multi-lab replications of highly influential EEG papers by the #EEGManyLabs project (Pavlov et al., 2021). Seven labs (with the potential for more to sign up later), will conduct high-powered replications of the critical Experiment 2 of Eimer (1996), where in the crucial conditions, participants discriminate a target letter (M vs W) or colour (blue vs green) in the presence of a distractor. Using four preprocessing pipelines, including the original, the authors will test whether the N2pc is observed over parieto-occipital electrodes contralateral to target presentation.  
 
The Stage 1 manuscript was evaluated over one round of in-depth review and one additional round of minor corrections. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
 
URL to the preregistered Stage 1 protocol: https://osf.io/dw68r
 
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA (so-called “primary RR”)
 
List of eligible PCI RR-friendly journals:
 
 
References
 
1. Constant, M., Mandal, A., Asanowicz, D., Yamaguchi, M., Gillmeister, H., Kerzel, D., Luque, D., Pesciarelli, F., Fehr, T., Mushtaq, F., Pavlov, Y. G. & Liesefeld, H. R. (2023). A multilab investigation into the N2pc as an indicator of attentional selectivity: Direct replication of Eimer (1996), in principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/dw68r
 
2. Eimer, M. (1996). The N2pc component as an indicator of attentional selectivity. Electroencephalography and Clinical Neurophysiology, 99, 225-234. https://doi.org/10.1016/0013-4694(96)95711-9
 
3. Pavlov, Y. G., Adamian, N., Appelhoff, S., Arvaneh, M., Benwell, C. S., Beste, C., ... & Mushtaq, F. (2021). #EEGManyLabs: Investigating the replicability of influential EEG experiments. Cortex, 144, 213-229. https://doi.org/10.1016/j.cortex.2021.03.013
A multilab investigation into the N2pc as an indicator of attentional selectivity: Direct replication of Eimer (1996)Martin Constant, Ananya Mandal, Dariusz Asanowicz, Motonori Yamaguchi, Helge Gillmeister, Dirk Kerzel, David Luque, Francesca Pesciarelli, Thorsten Fehr, Faisal Mushtaq, Yuri G. Pavlov, Heinrich R. Liesefeld<p>The N2pc is widely employed as an electrophysiological marker of an attention allocation. This interpretation was in no small part driven by the observation of an N2pc elicited by an isolated relevant target object, which was reported as Experi...Life Sciences, Social sciencesMaxine Sherman2023-02-24 11:41:52 View
11 Sep 2024
STAGE 2
(Go to stage 1)

A Laboratory Experiment on Using Different Financial-Incentivization Schemes in Software-Engineering Experimentation

Bug detection in software engineering: which incentives work best?

Recommended by ORCID_LOGO based on reviews by Edson OliveiraJr
Bug detection is central to software engineering, but what motivates programmers to perform as optimally as possible? Despite a long history of economic experiments on incentivisation, there is surprisingly little research on how different incentives shape software engineering performance.
 
In the current study, Bershadskyy et al. (2024) undertook an experiment to evaluate how the pay-off functions associated with different financial incentives influence the performance of participants in identifying bugs during code review. The authors hypothesised that performance-based incentivisation would result in higher average performance, as defined using the F1-score, and that different incentivisation schemes may also differ in their effectiveness.
 
The results did not support the preregistered predictions, with no statistically significant differences in F1-score observed between groups that received performance-based incentives compared to a control group that received no incentive. Exploratory analyses suggested some potential trends of interest, but the main implication of this work is methodological: that experiments in this field require substantially larger sample sizes to provide definitive tests. The current work is valuable in providing a novel unbiased insight on the magnitude of this challenge, which is now primed for further investigation.
 
The Stage 2 manuscript was evaluated over one round of in-depth review. Based on detailed responses to the recommender and reviewer's comments, the recommender judged that the manuscript met the Stage 2 criteria and awarded a positive recommendation.
 
URL to the preregistered Stage 1 protocol: https://osf.io/s36c2
 
Level of bias control achieved: Level 6. No part of the data or evidence that was used to answer the research question was generated until after IPA. 
 
List of eligible PCI RR-friendly journals:
 
 
References
 
Bershadskyy, D., Krüger, J., Çalıklı, G., Siegmar, O., Zabel, S., Greif, J. and Heyer, R. (2024). A Laboratory Experiment on Using Different Financial-Incentivization Schemes in Software-Engineering Experimentation. Acceptance of Version 8 by Peer Community in Registered Reports. https://arxiv.org/pdf/2202.10985
A Laboratory Experiment on Using Different Financial-Incentivization Schemes in Software-Engineering ExperimentationDmitri Bershadskyy, Jacob Krüger, Gül Çalıklı, Siegmar Otto, Sarah Zabel, Jannik Greif, Robert Heyer<p>In software-engineering research, many empirical studies are conducted with open-source or industry developers. However, in contrast to other research communities like economics or psychology, only few experiments use financial incentives (i.e....Computer scienceChris Chambers2024-03-20 07:44:51 View
16 Sep 2022
STAGE 1

Action-Inaction Asymmetries in Emotions and Counterfactual ‎Thoughts: Meta-Analysis of the Action Effect‎

Charting meta-analytic evidence for the action-effect

Recommended by ORCID_LOGO based on reviews by Dan Quintana, Emiel Cracco and priyali rajagopal

Winston Churchill once famously quipped, “I never worry about action, but only inaction.” Churchill, however, may have been an exception to the rule, with psychological research suggesting that people are more concerned about the consequences of actions than inactions. During the so-called “action-effect”, first reported by Kahneman and Tversky (1982), people regret an action leading to a bad outcome more than they do an inaction leading to the same bad outcome

In the current study, Yeung and Feldman (2022) propose a wide-ranging meta-analysis to characterise evidence for the action-effect, focusing in particular on emotions and counterfactual thoughts – that is, mental representations of alternative decisions (or “what if” thoughts). Consistent with the expected consequences of the action-effect on emotion, they predict that action will be associated with stronger negative emotions than inaction (when outcomes are negative), and with stronger positive emotions than inaction (when outcomes are positive). The authors also expect action to be associated with a greater abundance of counterfactual thought compared to inaction.

In addition to examining the overall reliability of the action-effect (plus a range of exploratory questions), the study will also examine the extent to which the action-effect is moderated by temporal distance (with more recent events or behaviours predicted to associated with a stronger action effect), the type of study design, prior outcomes and social norms, the specificity (vs. generality) of the prior event, and whether the study employed a hypothetical scenario or a real-life event.

The Stage 1 manuscript was evaluated over two rounds of in-depth review. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and awarded in-principle acceptance (IPA).

URL to the preregistered Stage 1 protocol: https://osf.io/4pvs6

Level of bias control achieved: Level 2. At least some data/evidence that will be used to answer the research question has been accessed and partially observed by the authors, but the authors certify that they have not yet observed the key variables within the data that will be used to answer the research question
 
List of eligible PCI RR-friendly journals:
 

References 
 
1. Kahneman, D., & Tversky, A. (1982). The psychology of preferences. Scientific American, 246(1), 160-173. https://doi.org/10.1038/scientificamerican0182-160
 
2. Yeung, S. K. & Feldman, G. (2022). Action-Inaction Asymmetries in Emotions and Counterfactual ‎Thoughts: Meta-Analysis of the Action Effect‎, in principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/4pvs6

Action-Inaction Asymmetries in Emotions and Counterfactual ‎Thoughts: Meta-Analysis of the Action Effect‎Siu Kit Yeung, Gilad Feldman<p>Action-effect refers to the phenomenon in which people experience, associate, or attribute stronger emotions for action compared to inaction. In this registered report, we conducted a meta-analysis of the action effect literature (k = [enter nu...Social sciencesChris Chambers2021-07-16 14:02:56 View