Announcements
Please note that we will be CLOSED to ALL SUBMISSIONS from 1 December 2024 through 12 January 2025 to give our recommenders and reviewers a holiday break.
We are recruiting recommenders (editors) from all research fields!
Your feedback matters! If you have authored or reviewed a Registered Report at Peer Community in Registered Reports, then please take 5 minutes to leave anonymous feedback about your experience, and view community ratings.
234 records found
Latest recommendations
Id | Title * | Authors * | Abstract * | Picture▲ | Thematic fields * | Recommender | Reviewers | Submission date | |
---|---|---|---|---|---|---|---|---|---|
22 Jul 2024
STAGE 1
From Thought to Senses: Assessing the Presence of a Relationship Between the Generation Effect and Multisensory FacilitationMichaela Ritchie, Jonathan Wilbiks https://osf.io/preprints/psyarxiv/mk75jExploring multi-sensory benefits in the generation effect of memoryRecommended by Gidon Frischkorn based on reviews by Vanessa Loaiza, Sharon Bertsch and Vanessa LoaizaThis study by Ritchie and Wilbiks (2024) investigates whether the generation effect, a memory advantage for self-generated verbal information, is enhanced under multisensory conditions. It is designed to explore a gap in the literature regarding the interplay between the generation effect and multisensory facilitation, with potential applications in educational settings.
Exploring multisensory aspects of the generation effect, the study has the potential to provide new insights into cognitive processing and memory enhancement. It is well rooted in established theories of the generation effect and multisensory facilitation, deducing a reasonable hypothesis that multisensory processing amplifies the generation effect. By implementing a 2 (Task Type: generate vs. read) x 3 (Sensory Modality: auditory, visual, multisensory) factorial design, it ensures a comprehensive evaluation of multisensory benefits in the generation effect. The findings could inform multisensory learning strategies in educational contexts, enhancing teaching methods and learning outcomes. Based on these considerations and two rounds of in-depth review, the recommender awarded in-principle acceptance of the study proposal. Its strong theoretical foundation and well-conceived methodology make it a valuable contribution to the fields of cognitive and educational psychology. URL to the preregistered Stage 1 protocol: https://osf.io/3u7eh
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.
List of eligible PCI RR-friendly journals:
References
Ritchie, M. & Wilbiks, J. (2024). From Thought to Senses: Assessing the Relationship Between the Generation Effect and Multisensory Facilitation. In principle acceptance of Version 4 by Peer Community in Registered Reports. https://osf.io/3u7eh
| From Thought to Senses: Assessing the Presence of a Relationship Between the Generation Effect and Multisensory Facilitation | Michaela Ritchie, Jonathan Wilbiks | <p>The proposed study will investigate the relationship between the generation effect, a memory advantage for self-generated verbal information, and the multisensory facilitation effect, a phenomenon wherein congruent sensory inputs enhance cognit... | Social sciences | Gidon Frischkorn | 2024-02-01 18:34:15 | View | ||
17 Jun 2024
STAGE 1
Neophobia across social contexts in juvenile Herring gullsReinoud Allaert, Sophia Knoch, An Martel, Wendt Müller, Eric Stienen, Luc Lens, Frederick Verbruggen https://osf.io/ht3wx?view_only=a654d6b5737543f8b240a9e1122649bcDoes social context influence neophobia in juvenile herring gulls (Larus argentatus)?Recommended by Ljerka Ostojic based on reviews by 2 anonymous reviewersMany animals are increasingly reliant on living close or in urban environments. For them, neophobia – a trait that denotes the fearfulness of novelty (Mettke-Hoffmann, 2022) – may influence how well the species but also individuals of the same species adjust to the (human-induced) changes that characterise these environments (Lowry et al., 2013).
Typically, neophobia in non-human animals is assessed through behavioural tests, most often by measuring the time it takes an individual to approach a novel object or food that is positioned next to a novel object. Increasingly, resarchers are acknowledging that the social context may influence the behaviour of individuals in such situations, and several hypotheses have been proposed to explain a potential influence of social context on neophobic responses.
In the current study, Allaert et al. (2024) will use a within-subject design to test three hypotheses with juvenile herring gulls (Larus argentatus): 1) the risk dilution hypothesis, accoding to which gulls will exhibit smaller neophobic responses when tested in a group than when tested alone, 2) the negotiation hypothesis, according to which gulls will exhibit stronger neophobic responses when tested in a group than when tested alone, and 3) the social conformity hypothesis, according to which those more neophobic individuals will show a smaller neohobic response when tested in a group than when tested alone while less neophobic individuals will exhibit the opposite pattern.
The Stage 1 manuscript was evaluated by two reviewers over two rounds of revisions. During the revisions, the authors clarified the conceptual arguments of the manuscript (including why juveniles are being tested), and edited the methods, including timing of testing, adjustments to the way that the experimental and control conditions will be run, how the planned sample size will be ensured given that at the time of testing, some chicks may be of a different species (this will become evident later on), how relatedness between the chicks will be dealt with, as well as how the behavioural coding will be conducted. Thus, the recommender judged that the manuscript met the Stage 1 criteria and awarded in-principle acceptance (IPA).
URL to the preregistered Stage 1 protocol: https://osf.io/u4b7q
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA. List of eligible PCI RR-friendly journals:
References
1. Mettke-Hofmann, C. (2022). Neophobia. In: Vonk, J., Shackelford, T.K. (eds) Encyclopedia of Animal Cognition and Behavior. Springer, Cham. https://doi.org/10.1007/978-3-319-55065-7_908
2. Lowry, H., Lill, A., & Wong, B. B. (2013). Behavioural responses of wildlife to urban environments. Biological Reviews, 88, 537-549. https://doi.org/10.1111/brv.12012
3. Allaert, R., Knoch, S., Braem, S., Debeer, D, Martel, A., Müller, W., Stienen E., Lens, L., & Verbruggen. F. (2024) In principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/u4b7q
| Neophobia across social contexts in juvenile Herring gulls | Reinoud Allaert, Sophia Knoch, An Martel, Wendt Müller, Eric Stienen, Luc Lens, Frederick Verbruggen | <p>Neophobia, the fear or avoidance of the unfamiliar, can have significant fitness consequences. It is typically assessed by exposing individuals to unfamiliar objects when they are alone, but in social species the presence of conspecifics can in... | Life Sciences | Ljerka Ostojic | 2024-02-16 14:50:02 | View | ||
Licensing via credentials: Replication Registered Report of Monin and Miller (2001) with extensions investigating the domain-specificity of moral credentials and associations with trait reputational concernQinyu Xiao, Lok Ching Li, Ying Lam Au, Wing Tung Chung, See Ngueh Tan, Gilad Feldman https://doi.org/10.17605/OSF.IO/PHYM3No reliable evidence of a 'moral credential' effectRecommended by Chris Chambers based on reviews by Marek Vranka and Štěpán BahníkDoes being good free people up to be bad? A large literature in social psychology suggests that it might, with evidence that moral licensing gives people a perception that actions deemed morally questionable, or socially undesirable, will be tolerated more readily if they have demonstrated a past history of praiseworthy, moral behaviour. In a formative study, Monin and Miller (2001) reported that having a track record of moral credentials as being nonprejudiced (e.g. non-sexist or non-racist) increased the willingness of participants to later express a prejudiced attitude. For example, in their Study 2 they found that participants who built up their moral credit by selecting a Black woman in a hypothetical recruitment task were then more willing to prefer a White man for a second job, compared to participants who did not have the opportunity to initially recommend a Black woman. These results have prompted a burgeoning literature on moral licensing, albeit one that is mixed and has been found to exhibit substantial publication bias.
In the current study, Xiao et al. (2024) undertook a large online replication of Study 2 in Monin and Miller (2001), asking whether previous moral behaviours that furnish participants with moral credentials make them more likely to then engage in morally questionable behaviours (N=932). The authors also extended earlier work by testing whether moral credentials license immoral behaviours more effectively in the same domain (e.g. within sex) than in a different domain (e.g. across sex and race), asking whether there is a negative relationship between expression of prejudice and trait reputational concern (fear of negative evaluation), and whether moral credentials attenuate any such observed relationship.
The results constitute a resounding non-replication, revealing no reliable evidence of a moral credential effect, no evidence that higher trait reputational concern predicts the expression of potentially problematic preferences, and no evidence that moral credentials moderate any such association. In discussing the implications of their findings, the authors call for further replication attempts and investigations of the effectiveness of experimental manipulations of moral licensing.
The Stage 2 manuscript was evaluated over one round of in-depth review. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 2 criteria and therefore awarded a positive recommendation.
URL to the preregistered Stage 1 protocol: https://osf.io/uxgrk
Level of bias control achieved: Level 6. No part of the data or evidence that was used to answer the research question was generated until after IPA. List of eligible PCI RR-friendly journals:
References
1. Monin, B., & Miller, D. T. (2001). Moral credentials and the expression of prejudice. Journal of Personality and Social Psychology, 81, 33-43. https://psycnet.apa.org/doi/10.1037/0022-3514.81.1.33
2. Xiao, Q., Ching Li, L., Au, Y. L., Chung, W. T., Tan, S. N. & Feldman, G. (2024). Licensing via credentials: Replication Registered Report of Monin and Miller (2001) with extensions investigating the domain-specificity of moral credentials and associations with trait reputational concern [Stage 2]. Acceptance of Version 7 by Peer Community in Registered Reports. https://osf.io/zgf8y | Licensing via credentials: Replication Registered Report of Monin and Miller (2001) with extensions investigating the domain-specificity of moral credentials and associations with trait reputational concern | Qinyu Xiao, Lok Ching Li, Ying Lam Au, Wing Tung Chung, See Ngueh Tan, Gilad Feldman | <p>The moral credential effect is the phenomenon where an initial behavior that presumably establishes one as moral “licenses” the person to subsequently engage in morally questionable behaviors. In line with this effect, Monin and Miller (2001, S... | Social sciences | Chris Chambers | 2024-02-21 05:58:59 | View | ||
Registered Report: Are anticipatory auditory predictions enhanced in tinnitus and independent of hearing loss?L. Reisinger, G. Demarchi, S. Rösch, E. Trinka, J. Obleser, N. Weisz https://osf.io/9wqjhEvidence for the role of predictive coding in subjective tinnitusRecommended by Chris Chambers based on reviews by Will Sedley, Pia Brinkmann and Emilie CardonSubjective tinnitus is a common disorder in which people experience a persistent sound in the absence of any external source. The underlying causes of tinnitus are debated – although the condition is strongly associated with hearing loss resulting from auditory damage, much remains to be understood about the neural processes that give rise to the phantom perception. Various classes of neurophysiological theories have been proposed, including the “altered gain” model – in which neurons in the auditory pathway increase their responsiveness to compensate for reduced auditory input following hearing loss – and the “noise cancellation” model – in which disrupted feedback connections from limbic regions are unable to tune out phantom signals. Although these theories account for much observed data, they have not been conclusively supported, and their ability to explain tinnitus is limited by the fact that hearing loss and tinnitus can arise independently and at different times.
In the current study, Reisinger et al. (2024) tested an emerging alternative theory based on a Bayesian predictive-coding framework (Sedley et al., 2016) in which the alteration of perceptual priors leads the auditory system to expect a sound that, if functioning normally, it should not expect. Using magnetoencephalography (MEG) in a sample of tinnitus patients (and carefully-matched controls for age, gender, and level of hearing loss), they asked whether tinnitus is associated with anticipatory brain activation, tuned to the carrier-frequency of an expected auditory stimulus. Specifically, the authors predicted that if the predictive-coding framework is correct then individuals with tinnitus should show different regularity-dependent pre-activations of carrier- frequency-specific information compared to the control group, while tone carrier-frequencies should be processed normally in tinnitus patients. They also predicted that any such pre-activations should not be related to levels of reported subjective tinnitus distress, as measured with the short version of the Tinnitus Questionnaire (mini-TQ).
The results broadly confirmed the hypotheses, with some caveats. Statistically significant differences in regularity-dependent pre-activations were observed between the tinnitus and control groups, however – curiously – the effects appear to be driven by below-chance decoding in the control group, complicating the interpretration. At the same time, consistent with expectations, frequency processing did not differ significantly between individuals with and without tinnitus, and the observed pre-activations were not significantly related to tinnitus distress. Overall, the findings cautiously support the conclusion that chronic tinnitus is associated with maladaptively upregulated predictive neural processing, and that this phenomenon is unlikely to be explained by either tinnitus distress or hearing loss.
The Stage 2 manuscript was evaluated over one round of in-depth review. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 2 criteria and awarded a positive recommendation.
URL to the preregistered Stage 1 protocol: https://osf.io/6gvpy
Level of bias control achieved: Level 3. At least some data/evidence that was used to the answer the research question had been previously accessed by the authors (e.g. downloaded or otherwise received), but the authors certify that they had yet observed any part of the data/evidence prior to Stage 1 IPA.
List of eligible PCI RR-friendly journals:
References
1. Reisinger, L., Demarchi, G., Rösch, , S., Trinka, E., Obleser, L., & Weisz, N. (2024). Registered Report: Are anticipatory auditory predictions enhanced in tinnitus and independent of hearing loss? [Stage 2] Acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/9wqjh
2. Sedley, W., Friston, K. J., Gander, P. E., Kumar, S., & Griffiths, T. D. (2016). An integrative tinnitus model based on sensory precision. Trends in Neurosciences, 39, 799-812. https://doi.org/10.1016/j.tins.2016.10.004
| Registered Report: Are anticipatory auditory predictions enhanced in tinnitus and independent of hearing loss? | L. Reisinger, G. Demarchi, S. Rösch, E. Trinka, J. Obleser, N. Weisz | <p>Phantom perceptions occur without any identifiable environmental or bodily source. The mechanisms and key drivers behind phantom perceptions like tinnitus are not well understood. The dominant “altered-gain”-framework suggests that tinnitus res... | Life Sciences | Chris Chambers | 2024-02-21 16:17:33 | View | ||
Managing Disclosure Outcomes in Intelligence InterviewsDavid A. Neequaye, Timothy J. Luke, Kristina Kollback https://doi.org/10.31234/osf.io/tfp2cManaging costs and rewards when choosing to disclose informationRecommended by Zoltan Dienes based on reviews by Yikang Zhang and Tyler JacobsAn interviewee in an intelligence interview can face competing interests in disclosing information: The value in cooperating because, for example, information given leads to the arrest of a narcotics gang, making the neighbourhood safer; and the risk that disclosing the information leads to reprisals from the gang. Different pieces of information will compete with each other for disclosure, depending on this balance of risks to self-interest. According to the disclosure-outcomes management model of Neequaye et al., information will be disclosed more with a high than low probability of reward, as might be straightforwardly expected, but this difference will be larger when there is a low probability of cost rather than a high probability. The high probability of cost will induce more a variable response to the possible benefits.
Neequaye et al. (2024) invited participants to assume the role of an informant, with the goal of maximizing their points according to stated probabilities of costs and benefits of disclosing pieces of information relating to given scenarios. The degree to which each type of information was disclosed in a subsequent interview wase assessed. Perceived benefits positively influenced the likelihood of disclosing information. The crucial interaction, obtained in a Pilot study, was not significant in the pre-registered replication. The study had decent power to pick up an interaction the same size as found in the pilot, but not half the size, which would still have been interesting. The Stage 2 manuscript was evaluated over one round of in-depth review. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 2 criteria.
URL to the preregistered Stage 1 protocol: https://osf.io/ru8j5
Level of bias control achieved: Level 6. No part of the data or evidence that was used to answer the research question was generated until after IPA. List of eligible PCI RR-friendly journals:
References
Neequaye, D. A., Luke, T. J., & Kollback, K. (2024). Managing Disclosure Outcomes in Intelligence Interviews [Stage 2]. Acceptance of Version 11 by Peer Community in Registered Reports. https://doi.org/10.31234/osf.io/tfp2c
| Managing Disclosure Outcomes in Intelligence Interviews | David A. Neequaye, Timothy J. Luke, Kristina Kollback | <p>We introduce the disclosure-outcomes management model. The model views disclosure in intelligence interviews as a behavior interviewees use to profitably navigate self-interest dilemmas. We theorized that interviewees compare the potential outc... | Social sciences | Zoltan Dienes | 2024-02-29 17:26:19 | View | ||
22 Jul 2024
STAGE 1
Probing the dual-task structure of a metacontrast-masked priming paradigm with subjective visibility judgmentsCharlott Wendt, Guido Hesselmann https://osf.io/9gakq?view_only=a5e90e4db4b545e9956b8359595c013bDo trial-wise visibility reports - and how these reports are made - alter unconscious priming effects?Recommended by D. Samuel Schwarzkopf based on reviews by Markus Kiefer, Thomas Schmidt and 3 anonymous reviewersMany studies of unconscious processing measure priming effects. Such experiments test whether a prime stimulus can exert an effect on speeded responses to a subsequently presented target stimulus even when participants are unaware of the prime. In some studies, participants are required to report their awareness of the prime in each trial - a dual-task design. Other studies conduct such visibility tests in separate experiments, so that the priming effect is measured via a single task. Both these approaches have pros and cons; however, it remains unclear to what extent they can affect the process of interest. Can the choice of experimental design and its parameters interfere with the priming effect? This could have implications for interpreting such effects, including in previous literature.
In the current study, Wendt and Hesselmann (2024) will investigate the effects of using a dual-task design in a masked priming paradigm, focusing on subjective visibility judgments. Based on power analysis, the study will test 34 participants performing both single-task and several dual-task conditions to measure reaction times and priming effects. Priming is tested via a speeded forced-choice identification of a target. The key manipulation is the non-speeded visibility rating of the prime using a Perceptual Awareness Scale, either with a graded (complex) rating or a dichotomous response. Moreover, participants will either provide their awareness judgement via a keyboard or vocally. Finally, participants will also complete a control condition to test prime visibility by testing the objective identification of the prime. These conditions will be presented in separate blocks, with the order randomised across participants. The authors hypothesise that using a dual-task slows down response times and boosts priming effects. However, they further posit that keyboard responses and graded visibility ratings, respectively, in the dual task reduce priming effects (but also slow response times) compared to vocal responses and dichotomous visibility judgements. In addition to the preregistered hypotheses, the study will also collect EEG data to explore the neural underpinnings of these processes.
The Stage 1 manuscript went through three rounds of review by the recommender and five expert reviewers. While the recommender would have preferred to see targeted, directional hypotheses explicitly specified in the design instead of non-directional main effects/interactions, he nevertheless considers this experimental design ready for commencing data collection, and therefore granted in-principle acceptance.
URL to the preregistered Stage 1 protocol: https://osf.io/ds2w5
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA. List of eligible PCI RR-friendly Journals:
References Wendt, C. & Hesselmann, G. (2024). Probing the dual-task structure of a metacontrast-masked priming paradigm with subjective visibility judgments. In principle acceptance of Version 4 by Peer Community in Registered Reports. https://osf.io/ds2w5 | Probing the dual-task structure of a metacontrast-masked priming paradigm with subjective visibility judgments | Charlott Wendt, Guido Hesselmann | <p>Experiments contrasting conscious and masked stimulus processing have shaped, and continue to shape, cognitive and neurobiological theories of consciousness. However, as shown by Aru et al. (2012) the contrastive approach builds on the untenabl... | Social sciences | D. Samuel Schwarzkopf | 2024-03-02 18:20:03 | View | ||
12 Jul 2024
STAGE 1
Associations between anxiety-related traits and fear acquisition and extinction - an item-based content and meta-analysisMaria Bruntsch, Samuel E Cooper, Rany Abend, Marian Boor, Anastasia Chalkia, Mana Ehlers, Artur Czeszumski, Dave Johnson, Maren Klingelhöfer-Jens, Jayne Morriss, Erik Mueller, Ondrej Zika, Tina Lonsdorf https://osf.io/preprints/psyarxiv/unx7wIntegrative meta-analysis of anxiety-related traits and fear processing: bridging research to clinical applicationRecommended by Sara Garofalo based on reviews by Yoann Stussi, Luigi Degni, Marco Badioli and 1 anonymous reviewerThe paper aims to bridge gaps in understanding the relationship between anxiety-related traits and fear processing, with a specific focus on fear acquisition and extinction. Fear and safety processing are known to be linked to anxiety symptoms and traits such as neuroticism and intolerance of uncertainty (Lonsdorf et al., 2017; Morriss et al., 2021). However, the diversity in study focus and measurement methods makes it difficult to integrate findings into clinical practice effectively.
To address this issue, Brunsch et al. (2024) propose a systematic literature search and meta-analysis, following PRISMA guidelines, to explore these associations. They plan to use nested random effects models to analyze both psychophysiological and self-report outcome measures. Additionally, they will examine the role of different questionnaires used to assess anxiety-related traits and conduct a content analysis of these tools to evaluate trait overlaps.
Current knowledge from the literature indicates that individuals with anxiety disorders exhibit differences in fear acquisition and extinction compared to those without such disorders (Lonsdorf et al., 2017; Morriss et al., 2021). Previous meta-analyses have shown associations between anxiety traits and fear generalization/extinction, but these studies are limited in their scope and focus.
The primary aim of the research is to provide a comprehensive summary of the associations between anxiety-related traits and conditioned responding during fear acquisition and extinction across multiple measures. Another goal is to investigate whether different anxiety-related trait questionnaires yield different associations with fear and extinction learning. The authors will also conduct a content analysis to better interpret the results of their meta-analysis by examining the overlap in questionnaire content.
A secondary aim of the study is to evaluate how sample characteristics, experimental specifics, and study quality influence the associations between anxiety-related traits and fear acquisition and extinction. By addressing these aims, the study seeks to advance the understanding of fear-related processes in anxiety and inform more targeted prevention and intervention strategies.
The Stage 1 manuscript underwent two rounds of thorough review. After considering the detailed responses to the reviewers' comments, the recommender determined that the manuscript met the Stage 1 criteria and granted in-principle acceptance (IPA).
URL to the preregistered Stage 1 protocol: https://osf.io/4mndj
Level of bias control achieved: Level 3. At least some data/evidence that will be used to the answer the research question has been previously accessed by the authors (e.g. downloaded or otherwise received), but the authors certify that they have not yet observed ANY part of the data/evidence.
List of eligible PCI RR-friendly journals:
References
1. Bruntsch, M., Abend, R., Chalkia, A., Cooper, S. E., Ehlers, M. R., Johnson, D. C., Klingelhöfer-Jens, M., Morriss, J., Zika, O., & Lonsdorf, T. B. (2024). Associations between anxiety-related traits and fear acquisition and extinction - an item-based content and meta-analysis. In principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/4mndj
2. Lonsdorf, T. B., & Merz, C. J. (2017). More than just noise: Inter-individual differences in fear acquisition, extinction and return of fear in humans - Biological, experiential, temperamental factors, and methodological pitfalls. Neuroscience & Biobehavioral Reviews, 80, 703–728. https://doi.org/10.1016/j.neubiorev.2017.07.007
3. Morriss, J., Wake, S., Elizabeth, C., & van Reekum, C. M. (2021). I Doubt It Is Safe: A Meta-analysis of Self-reported Intolerance of Uncertainty and Threat Extinction Training. Biological Psychiatry Global Open Science, 1, 171–179. https://doi.org/10.1016/j.bpsgos.2021.05.011
| Associations between anxiety-related traits and fear acquisition and extinction - an item-based content and meta-analysis | Maria Bruntsch, Samuel E Cooper, Rany Abend, Marian Boor, Anastasia Chalkia, Mana Ehlers, Artur Czeszumski, Dave Johnson, Maren Klingelhöfer-Jens, Jayne Morriss, Erik Mueller, Ondrej Zika, Tina Lonsdorf | <p>Background: Deficits in learning and updating of fear and safety associations have been reported in patients suffering from anxiety- and stress-related disorders. Also in healthy individuals, anxiety-related traits have been linked to altered f... | Life Sciences | Sara Garofalo | Anonymous, Luigi Degni, Marco Badioli, Yoann Stussi | 2024-03-15 14:48:20 | View | |
A Laboratory Experiment on Using Different Financial-Incentivization Schemes in Software-Engineering ExperimentationDmitri Bershadskyy, Jacob Krüger, Gül Çalıklı, Siegmar Otto, Sarah Zabel, Jannik Greif, Robert Heyer https://arxiv.org/pdf/2202.10985Bug detection in software engineering: which incentives work best?Recommended by Chris Chambers based on reviews by Edson OliveiraJrBug detection is central to software engineering, but what motivates programmers to perform as optimally as possible? Despite a long history of economic experiments on incentivisation, there is surprisingly little research on how different incentives shape software engineering performance.
In the current study, Bershadskyy et al. (2024) undertook an experiment to evaluate how the pay-off functions associated with different financial incentives influence the performance of participants in identifying bugs during code review. The authors hypothesised that performance-based incentivisation would result in higher average performance, as defined using the F1-score, and that different incentivisation schemes may also differ in their effectiveness.
The results did not support the preregistered predictions, with no statistically significant differences in F1-score observed between groups that received performance-based incentives compared to a control group that received no incentive. Exploratory analyses suggested some potential trends of interest, but the main implication of this work is methodological: that experiments in this field require substantially larger sample sizes to provide definitive tests. The current work is valuable in providing a novel unbiased insight on the magnitude of this challenge, which is now primed for further investigation.
The Stage 2 manuscript was evaluated over one round of in-depth review. Based on detailed responses to the recommender and reviewer's comments, the recommender judged that the manuscript met the Stage 2 criteria and awarded a positive recommendation.
URL to the preregistered Stage 1 protocol: https://osf.io/s36c2 Level of bias control achieved: Level 6. No part of the data or evidence that was used to answer the research question was generated until after IPA.
List of eligible PCI RR-friendly journals: References
Bershadskyy, D., Krüger, J., Çalıklı, G., Siegmar, O., Zabel, S., Greif, J. and Heyer, R. (2024). A Laboratory Experiment on Using Different Financial-Incentivization Schemes in Software-Engineering Experimentation. Acceptance of Version 8 by Peer Community in Registered Reports. https://arxiv.org/pdf/2202.10985
| A Laboratory Experiment on Using Different Financial-Incentivization Schemes in Software-Engineering Experimentation | Dmitri Bershadskyy, Jacob Krüger, Gül Çalıklı, Siegmar Otto, Sarah Zabel, Jannik Greif, Robert Heyer | <p>In software-engineering research, many empirical studies are conducted with open-source or industry developers. However, in contrast to other research communities like economics or psychology, only few experiments use financial incentives (i.e.... | Computer science | Chris Chambers | 2024-03-20 07:44:51 | View | ||
06 Sep 2024
STAGE 1
The Role of Offender Identifiability in Second- and Third-Party PunishmentTheresa Blanke, Mathias Twardawski https://osf.io/7qzvaPunishing OffendersRecommended by Clare Conry-Murray based on reviews by Gilad Feldman and Rajarshi MajumderWhen people are less-well-known to us, it can impact how we treat them. People outside our communities may feel more anonymous or de-personalized to us, and this could impact the empathy we feel for them. Indeed, past research shows that people seem to care more for those who are who are identified to us, especially when they are victims of a crime (Small & Loewenstein, 2003). In addition, past research also shows that anonymizing victims can influence criminal behavior (Walters, 2022). Thus, social cognitive factors related to anonymity appear to affect both positive feelings (engaging in empathy) and negative activities (criminal activity) related to victims. It seems likely that anonymity can also affect how people judge criminals themselves.
This paper by Blanke and Twardawski (2024) examines how even minor identifying features can make individuals react differently to a perpetrator of a crime. A picture or name (information that may appear in the press) may impact how people perceive criminals in terms of punishment, empathy, outrage, and blame.
How people respond to anonymous or identified criminals may depend on whether the impact of the crime on the victim is made salient. Similar to the Black Sheep Effect (Marques & Paez,1994), the current paper expects that people who identify with victims are expected to punish a perpetrator more when the perpetrator’s name and image are known. This is similar to the case with an ingroup member in The Black Sheep Effect, where ingroup members are punished more for transgressions than outgroup members. For people who view the situation as a third party (and are thus less connected to the victim), an identified perpetrator is expected to lead to less punishment (and also less outrage and blame, and more empathy).
The current study focuses on pickpocketing since it is a crime that can be committed without identifying oneself to the victim. Future research should examine how the type of event impacts judgments, especially given the stigma of being a victim of some crimes. Littering and other minor violations may be seen as understandable when you see someone as a person, rather than a anonymous, impersonal criminal. On the other hand, there can be stigma to being a victim in some cases, such as the case of sexual harassment, where, research shows, perpetrators are judged more positively if they are identified, and victims, especially women, are judged more negatively if they are identified (Barak-Corren & Lewinsohn-Zamir, 2019).
People around the world engage in moral and legal transgressions, and if our judgments of them are influenced by minor features such as a photo or name, we should take action to treat people more fairly. This research will help to determine if people are influenced by these factors.
The Stage 1 manuscript underwent one round of thorough review. After considering the detailed responses to the reviewers' comments, the recommender determined that the manuscript met the Stage 1 criteria and granted in-principle acceptance (IPA).
URL to the preregistered Stage 1 protocol: https://osf.io/7qzva
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA. List of eligible PCI RR-friendly Journals:
References
1. Barak‐Corren, N., & Lewinsohn‐Zamir, D. (2019). What's in a Name? The Disparate Effects of Identifiability on Offenders and Victims of Sexual Harassment. Journal of Empirical Legal Studies, 16, 955-1000. https://doi.org/10.1111/jels.12233
2. Blanke, T. & Twardawski, M. (2024). The Role of Offender Identifiability in Second- and Third-Party Punishment. In principle acceptance of Version 2 by Peer Community in Registered Reports. https://osf.io/7qzva
3. Marques, J. M., & Paez, D. (1994). The ‘black sheep effect’: Social categorization, rejection of ingroup deviates, and perception of group variability. European Review of Social Psychology, 5, 37-68. https://doi.org/10.1080/14792779543000011
4. Small, D. A., & Loewenstein, G. (2003). Helping a victim or helping the victim: Altruism and identifiability. Journal of Risk and Uncertainty, 26, 5-16. https://doi.org/10.1023/A:1022299422219
5. Walters, G. D. (2022). Crime and social cognition: A meta-analytic review of the developmental roots of adult criminal thinking. Journal of Experimental Criminology, 18, 183-207. https://doi.org/10.1007/s11292-020-09435-w
| The Role of Offender Identifiability in Second- and Third-Party Punishment | Theresa Blanke, Mathias Twardawski | <p>The identifiability effect describes humans' tendency to exhibit different emotional and behavioral responses toward identified as compared to anonymous individuals. This phenomenon has been extensively studied within the identifiable victim ef... | Social sciences | Clare Conry-Murray | Gilad Feldman, Rajarshi Majumder | 2024-03-23 11:02:30 | View | |
Insufficient evidence of a positive association between chronic loneliness and anthropomorphism: Replication and extension Registered Report of Epley et al. (2008)Qinyu Xiao, Mahmoud Elsherif, Hoi Yan Chu, Ming Chun Tang, Ting Hin (Angus) Wong, Yiming Wu, Christina Pomareda, Gilad Feldman https://doi.org/10.17605/OSF.IO/2SB7XWeak-to-no evidence for a positive link between loneliness and anthropomorphismRecommended by Chris Chambers based on reviews by John ProtzkoAnthropomorphism is a widespread phenomenon in which people instil non-human entities or objects with human-like characteristics, such as motivations, intentions, and goals. Although common, the tendency to anthropomorphise varies between people, and a growing body of psychological research has examined the importance of various individual differences. One major theoretical account of anthropomorphism (Epley et al. 2007) suggests that sociality motivation – the drive to establish social relationships – is a key moderator of the phenomenon. In support of this account, some evidence suggests that people who experience greater loneliness (a proposed marker of sociality motivation) are more likely to anthropomorphise. In an influential series of studies, Epley et al. (2008) found that anthropomorphism and loneliness were positively correlated and that inducing participants experimentally to feel more lonely led to greater anthropomorphism. Later studies, however, produced more mixed results, particularly concerning the effectiveness of the experimental interventions.
In the current study, Elsherif et al. (2024) undertook a partial replication of Epley et al. (2008), focusing on the correlational relationship between anthropomorphism and loneliness, with extensions to examine free will beliefs, anthropomorphism for supernatural beings (in addition to objects/gadgets), and the extent to which participants judged objects/gadgets to be controllable. The results revealed no reliable evidence for a positive relationship between anthropomorphism and loneliness. Analyses of the extended questions revealed that the perceived controllability of gadgets was associated negatively with anthropomorphism and that free will belief was associated positively with belief in anthropomorphism of supernatural beings. Broadly, the current findings constitute a non-replication of Epley et al. (2008). The authors conclude by calling for more direct and conceptual replications to establish the link (if any) between sociality motivation and anthropomorphism.
The Stage 2 manuscript was evaluated over one round of in-depth review. Based on detailed responses to the reviewer's and recommender's comments, the recommender judged that the manuscript met the Stage 2 criteria and awarded a positive recommendation.
URL to the preregistered Stage 1 protocol: https://osf.io/by89c Level of bias control achieved: Level 6. No part of the data or evidence that was used to answer the research question was generated until after IPA.
List of eligible PCI RR-friendly journals:
References
1. Epley, N., Waytz, A., & Cacioppo, J. T. (2007). On seeing human: A three-factor theory of anthropomorphism. Psychological Review, 114, 864–886. https://doi.org/10.1037/0033-295X.114.4.864
2. Epley, N., Akalis, S., Waytz, A., & Cacioppo, J. T. (2008). Creating social connection through inferential reproduction: Loneliness and perceived agency in gadgets, Gods, and greyhounds. Psychological Science, 19, 114–120. https://doi.org/10.1111/j.1467-9280.2008.02056.x
3. Elsherif, M., Pomareda, C., Xiao, Q., Chu, H. Y., Tang, M. C., Wong, T. H., Wu, Y. & Feldman, G. (2024). Insufficient evidence of a positive association between chronic loneliness and anthropomorphism: Replication and extension Registered Report of Epley et al. (2008) [Stage 2]. Acceptance of Version 6 by Peer Community in Registered Reports. https://osf.io/x96kn
| Insufficient evidence of a positive association between chronic loneliness and anthropomorphism: Replication and extension Registered Report of Epley et al. (2008) | Qinyu Xiao, Mahmoud Elsherif, Hoi Yan Chu, Ming Chun Tang, Ting Hin (Angus) Wong, Yiming Wu, Christina Pomareda, Gilad Feldman | <p>Human beings have a fundamental need to connect with others. Epley, Akalis, et al. (2008) found that people higher in chronic loneliness had a stronger tendency to anthropomorphize non-human objects, presumably for fulfilling unmet needs for so... | Social sciences | Chris Chambers | 2024-03-27 16:17:16 | View |
MANAGING BOARD
Chris Chambers
Zoltan Dienes
Corina Logan
Benoit Pujol
Maanasa Raghavan
Emily S Sena
Yuki Yamada