BAHNÍK Štěpán's profile
avatar

BAHNÍK ŠtěpánORCID_LOGO

  • Department of Management, Faculty of Business Administration, Prague University of Economics and Business, Prague, Czech Republic
  • Social sciences

Recommendations:  0

Reviews:  3

Areas of expertise
moral psychology, judgment and decision-making, methodology

Reviews:  3

11 Apr 2024
STAGE 2
(Go to stage 1)
toto

Licensing via credentials: Replication Registered Report of Monin and Miller (2001) with extensions investigating the domain-specificity of moral credentials and associations with trait reputational concern

No reliable evidence of a 'moral credential' effect

Recommended by based on reviews by Marek Vranka and Štěpán Bahník
Does being good free people up to be bad? A large literature in social psychology suggests that it might, with evidence that moral licensing gives people a perception that actions deemed morally questionable, or socially undesirable, will be tolerated more readily if they have demonstrated a past history of praiseworthy, moral behaviour. In a formative study, Monin and Miller (2001) reported that having a track record of moral credentials as being nonprejudiced (e.g. non-sexist or non-racist) increased the willingness of participants to later express a prejudiced attitude. For example, in their Study 2 they found that participants who built up their moral credit by selecting a Black woman in a hypothetical recruitment task were then more willing to prefer a White man for a second job, compared to participants who did not have the opportunity to initially recommend a Black woman. These results have prompted a burgeoning literature on moral licensing, albeit one that is mixed and has been found to exhibit substantial publication bias.
 
In the current study, Xiao et al. (2024) undertook a large online replication of Study 2 in Monin and Miller (2001), asking whether previous moral behaviours that furnish participants with moral credentials make them more likely to then engage in morally questionable behaviours (N=932). The authors also extended earlier work by testing whether moral credentials license immoral behaviours more effectively in the same domain (e.g. within sex) than in a different domain (e.g. across sex and race), asking whether there is a negative relationship between expression of prejudice and trait reputational concern (fear of negative evaluation), and whether moral credentials attenuate any such observed relationship.
 
The results constitute a resounding non-replication, revealing no reliable evidence of a moral credential effect, no evidence that higher trait reputational concern predicts the expression of potentially problematic preferences, and no evidence that moral credentials moderate any such association. In discussing the implications of their findings, the authors call for further replication attempts and investigations of the effectiveness of experimental manipulations of moral licensing.
 
The Stage 2 manuscript was evaluated over one round of in-depth review. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 2 criteria and therefore awarded a positive recommendation.
 
URL to the preregistered Stage 1 protocol: https://osf.io/uxgrk
 
Level of bias control achieved: Level 6. No part of the data or evidence that was used to answer the research question was generated until after IPA.
 
List of eligible PCI RR-friendly journals:
 
 
References
 
1. Monin, B., & Miller, D. T. (2001). Moral credentials and the expression of prejudice. Journal of Personality and Social Psychology, 81, 33-43. https://psycnet.apa.org/doi/10.1037/0022-3514.81.1.33

2. Xiao, Q., Ching Li, L., Au, Y. L., Chung, W. T., Tan, S. N. & Feldman, G. (2024). Licensing via credentials: Replication Registered Report of Monin and Miller (2001) with extensions investigating the domain-specificity of moral credentials and associations with trait reputational concern [Stage 2]. Acceptance of Version 7 by Peer Community in Registered Reports. https://osf.io/zgf8y
11 Sep 2023
STAGE 1
toto

Finding the right words to evaluate research: An empirical appraisal of eLife’s assessment vocabulary

Understanding the validity of standardised language in research evaluation

Recommended by and based on reviews by Chris Hartgerink (they/them), Veli-Matti Karhulahti, Štěpán Bahník and Ross Mounce
In 2023, the journal eLife ended the practice of making binary accept/reject decisions following peer review, instead sharing peer review reports (for manuscripts that are peer-reviewed) and brief “eLife assessments” representing the consensus opinions of editors and peer reviewers. As part of these assessments, the journal draws language from a "common vocabulary" to linguistically rank the significance of findings and strength of empirical support for the article's conclusions. In particular, the significance of findings is described using an ordinal scale of terms from "landmark" → "fundamental" → "important" → "valuable" → "useful", while the strength of support is ranked across six descending levels from "exceptional" down to "inadequate".
 
In the current study, Hardwicke et al. (2023) question the validity of this taxonomy, noting a range of linguistic ambiguities and counterintuitive characteristics that may undermine the communication of research evaluations to readers. Given the centrality of this common vocabulary to the journal's policy, the authors propose a study to explore whether the language used in the eLife assessments will be interpreted as intended by readers. Using a repeated-measures experimental design, they will tackle three aims: first, to understand the extent to which people share similar interpretations of phrases used to describe scientific research; second, to reveal the extent to which people’s implicit ranking of phrases used to describe scientific research aligns with each other and with the intended ranking; and third, to test whether phrases used to describe scientific research have overlapping interpretations. The proposed study has the potential to make a useful contribution to metascience, as well as being a valuable source of information for other journals potentially interested in following the novel path made by eLife.
 
The Stage 1 manuscript was evaluated over one round of in-depth review. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
 
URL to the preregistered Stage 1 protocol: https://osf.io/mkbtp
 
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.
 
List of eligible PCI RR-friendly journals:
 
References
 
1. Hardwicke, T. E., Schiavone, S., Clarke, B. & Vazire, S. (2023). Finding the right words to evaluate research: An empirical appraisal of eLife’s assessment vocabulary. In principle acceptance of Version 2 by Peer Community in Registered Reports. https://osf.io/mkbtp
16 Jun 2023
STAGE 1
toto

Licensing via credentials: Replication of Monin and Miller (2001) with extensions investigating the domain-specificity of moral credentials and the association between the credential effect and trait reputational concern

Revisiting moral licensing

Recommended by based on reviews by Corey Cusimano, Marek Vranka, Štěpán Bahník and Ethan Meyers
Does being good free people up to be bad? A large literature in social psychology suggests that it might, with evidence that “moral licensing” gives people a perception that actions deemed morally questionable, or socially undesirable, will be tolerated more readily if they have demonstrated a past history of praiseworthy, moral behaviour. In a formative study, Monin and Miller (2001) reported that having a track record of moral credentials as being nonprejudiced (e.g. non-sexist or non-racist) increased the willingness of participants to later express a prejudiced attitude. For example, in their Study 2 they found that participants who built up their moral credit by selecting a Black woman in a hypothetical recruitment task were then more willing to then prefer a White man for a second job, compared to participants who did not have the opportunity to initially recommend a Black woman. These results have prompted a burgeoning literature on moral licensing, albeit one that is mixed and has been found to exhibit substantial publication bias.
 
In the current study, Xiao et al. (2023) propose a large online replication of Study 2 in Monin and Miller (2001), asking whether previous moral behaviours that furnish participants with moral credentials make them more likely to then engage in morally questionable behaviours. The authors will also extend earlier work by testing whether moral credentials license immoral behaviours more effectively in the same domain (e.g. within sex) than in a different domain (e.g. across sex and race), asking whether there is a negative relationship between expression of prejudice and trait reputational concern (fear of negative evaluation), and whether moral credentials attenuate any such observed relationship.
 
The Stage 1 manuscript was evaluated over three rounds of in-depth review. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
 
URL to the preregistered Stage 1 protocol: https://osf.io/uxgrk
 
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.
 
List of eligible PCI RR-friendly journals:
 
 
References
 
1. Monin, B., & Miller, D. T. (2001). Moral credentials and the expression of prejudice. Journal of Personality and Social Psychology, 81, 33-43. https://psycnet.apa.org/doi/10.1037/0022-3514.81.1.33

2. Xiao, Q., Ching Li, L., Au, Y. L., Chung, W. T., Tan, S. N. & Feldman, G. (2023). Licensing via credentials: Replication of Monin and Miller (2001) with extensions investigating the domain-specificity of moral credentials and the association between the credential effect and trait reputational concern, in principle acceptance of Version 5 by Peer Community in Registered Reports. https://osf.io/uxgrk
avatar

BAHNÍK ŠtěpánORCID_LOGO

  • Department of Management, Faculty of Business Administration, Prague University of Economics and Business, Prague, Czech Republic
  • Social sciences

Recommendations:  0

Reviews:  3

Areas of expertise
moral psychology, judgment and decision-making, methodology