Submit a report

Announcements

We are recruiting recommenders (editors) from all research fields!

Your feedback matters! If you have authored or reviewed a Registered Report at Peer Community in Registered Reports, then please take 5 minutes to leave anonymous feedback about your experience, and view community ratings.

Latest recommendations

IdTitle * Authors * Abstract * PictureThematic fields * RecommenderReviewersSubmission date
28 Jan 2025
STAGE 2
(Go to stage 1)

Unveiling the Positivity Bias on Social Media: A Registered Experimental Study On Facebook, Instagram, And X

Social media positivity bias, or just positivity bias?

Recommended by ORCID_LOGO based on reviews by Marcel Martončik, Julius Klingelhoefer and 1 anonymous reviewer
Both research and public debates around social media use tend to involve a premise of positivity bias, which refers to presenting one’s life in an overly positive light by various different means. This premise contributes to multiple potentially important follow-up hypotheses, such as the fear of missing out and low self-image effects, due to repeated consumption of positive social media content (e.g., Bayer et al. 2020, for a review). The positivity bias of social media use, itself, has received limited research attention. 
 
In the present study, Masciantonio and colleagues (2025) tested positivity bias in the context of three social media platforms: Facebook, Instagram, and X. The experiment involved recruiting participants (n=312) into platform-specific user groups and crafting posts to be shared with friends as well as respective social media audiences. For social media positivity bias to differ from everyday positivity bias, posts in the former should introduce more positive valence in comparison to offline sharing—and if the platforms differ in their encouragement of positivity bias, they should introduce significant between-platform differences in valence.
 
Based on how the participants reported events, the study found no significant differences between everyday and social media positivity bias, but messages posted on Twitter/X had a more negative valence than posts in other social media platforms. The results would be consistent with the implication that people's positive actions in social media simply follow the natural human tendency to present oneself positively to others—a hypothesis that should be investigated in follow-up work. More research attention should also be given to specific design features, which may contribute to platform-specific differences in user habits, as suggested by the distinct valence rate found in relation to Twitter/X.
 
The Stage 2 manuscript was evaluated by three experts (areas: experimental methods, social media, statistics) via in-depth peer review across two rounds, with one reviewer returning to validate analysis code and methdological accuracy on a final round. Based on the authors’ careful responses and revisions, the revised manuscript was judged to meet the Stage 2 criteria and was awarded a positive recommendation. 
 
URL to the preregistered Stage 1 protocol: https://osf.io/9z6hm
 
Level of bias control achieved: Level 6. No part of the data or evidence that was used to answer the research question was generated until after IPA.  
 
List of eligible PCI RR-friendly journals:
 
 
References
 
1. Bayer, J. B., Triệu, P., & Ellison, N. B. (2020). Social media elements, ecologies, and effects. Annual review of psychology, 71, 471-497. https:// doi.org/10.1146/annurev-psych-010419-050944
 
2. Masciantonio, A., Heiser, N., & Cherbonnier, A. (2025). Unveiling the Positivity Bias on Social Media: A Registered Experimental Study On Facebook, Instagram, And X [Stage 2]. Acceptance of Version 2 by Peer Community in Registered Reports. https://osf.io/s93yu 
Unveiling the Positivity Bias on Social Media: A Registered Experimental Study On Facebook, Instagram, And XAlexandra Masciantonio, Neele Heiser, Anthony Cherbonnier<p>Social media has transformed how people engage with the world around them. The positivity bias on social media, in particular, warrants in-depth investigation. This is particularly true as previous research has concentrated on one specific plat...Social sciencesVeli-Matti Karhulahti Marcel Martončik2024-09-23 11:20:07 View
30 Mar 2025
STAGE 2
(Go to stage 1)

Can adults automatically process and translate between numerical representations?

The role of working memory in translating between different number processing systems

Recommended by ORCID_LOGO based on reviews by Hannah Dorothea Loenneker and Xinru Yao
People can represent quantities in different ways. Numbers can be represented non-symbolically through an Object Tracking System (for small quantities, when one immediately perceives how many objects are there) and an Approximate Number System (for large quantities), and symbolically, for example with Arabic symbols or words. One unresolved question is the extent to which using these numerical representations, and transferring between them, can be done automatically, or rather involves components of working memory. Key relevant working memory components are the phonological loop and the visuospatial sketchpad.
 
In this study, Xenidou-Dervou and colleagues (2025) asked subjects to perform a dot comparison task with small and large numbers, to engage the non-symbolic systems, and a digit comparison task, to engage the symbolic system, and a cross modal task to engage translation between the systems. Participants either performed these tasks alone or with a secondary task, one that loaded either the phonological loop or else the visuospatial sketchpad. In the comparison of symbolic numerals, the visual secondary task itself was performed more poorly in dual rather than single task conditions, indicating the involvement of the visual spatial sketchpad in use of symbolic numerals. The visual secondary task interfered with non-symbolic number judgements, indicating involvement of the visuospatial sketch pad with the non-symbolic system as well. Finally, the translation between the systems also involved the visuospatial sketchpad, as shown by the secondary task itself suffering dual task interference. In sum, there was evidence for the visuospatial sketchpad, but not for the phonological loop, playing a role in simple comparisons using either or both of the symbolic and non-symbolic number systems. 

The Stage 2 manuscript was evaluated over two rounds of in-depth review. Based on detailed responses to the reviewers’ comments and edits to the Stage 2 report, the recommender judged that the manuscript met the Stage 2 criteria for recommendation.
 
URL to the preregistered Stage 1 protocol: https://osf.io/32qdw
 
Level of bias control achieved: Level 6. No part of the data or evidence that was used to answer the research question was generated until after IPA.
 
List of eligible PCI RR-friendly journals:
 
 
References
 
Xenidou-Dervou, I., Appleton, C., Rossi, S., Guy, N., & Gilmore, C. (2025). Can adults automatically process and translate between numerical representations? [Stage 2]. Acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/me6tn
Can adults automatically process and translate between numerical representations?I. Xenidou-Dervou, C. Appleton, S. Rossi, N. Guy, C. Gilmore<p>Arithmetic, and the ability to use numbers, is an important skill. Numbers can be represented in three ways: through number words, Arabic symbols or non-symbolically. Much research attention has focused on how associations form between these th...Social sciencesZoltan Dienes2024-09-27 12:50:27 View
29 Jan 2025
STAGE 2
(Go to stage 1)

Michotte's research on perceptual impressions of causality: a registered replication study

Michotte’s classic studies on the perception of causality: Replications, extensions and a sound base for further research

Recommended by ORCID_LOGO based on reviews by Maxine Sherman and 1 anonymous reviewer
Making causal judgements are part of everyday life, whether seeking to understand the action of complex humans or the relations between inanimate objects in our environments. Albert Michotte’s (1963) classic book, The perception of causality, contained an extensive report of experiments demonstrating not only that observers perceive causality of inanimate shapes, but do so in manifold ways, creating different “causal impressions.” This work has been highly influential across psychology and neuroscience. 
 
In the current study, White (2025) conducted 14 experiments aimed at replicating and extending Michotte’s work. Despite the fact that this research is foundational to current work on perception and understanding of causal relations, it has never been subject to rigorous replication. Moreover, like many research studies from that era, Michotte was sparse on details about methodology and did not rely on statistical analysis. White carried out an ambitious set of 14 experiments and 18 hypotheses that directly replicated and, in some cases, extended Michotte’s experiments. The results of the experiments were mixed, with the hypotheses evenly divided among being supported, partially supported, and not supported. The current effort by White not only brings rigorous contemporary data to classic studies of perceptual impressions of causality, but the results point to important new directions for future study on the topic. In particular, the findings suggest a need to broaden our investigations of causal explanations of movement beyond launching (i.e., contact of one object leading to motion of another) to also consider entraining (i.e., joint movement following contact) and pulling. The collected studies provide fertile ground for further testing a variety of mechanisms that explain different perceptual impressions of causality. 
 
The Stage 2 manuscript was evaluated over three rounds of in-depth review, the first two rounds consisting of detailed comments from two reviewers and the third round consisting of a close read by the recommender. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 2 criteria and awarded a positive recommendation.
 
URL to the preregistered Stage 1 protocol: https://osf.io/5jx8f
 
Level of bias control achieved: Level 6. No part of the data or evidence that was used to answer the research question was generated until after IPA.
 
List of eligible PCI-RR-friendly journals:
 
 
References
 
1. Michotte, A. (1963). The perception of causality (T. R. Miles & E. Miles, trans.). London: Methuen. (English translation of Michotte, 1954). 
 
2. White, P. A. (2025). Michotte's research on perceptual impressions of causality: A registered replication study [Stage 2]. Acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/jdac7
Michotte's research on perceptual impressions of causality: a registered replication studyPeter A. White<p>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;Michotte (1946/1954/1963) showed that visual impressions of causality can occur in perception of simple animations of moving geometrical objects. In the launching effect, one object is perceived a...Social sciencesMoin Syed2024-10-07 10:53:33 View
02 Apr 2025
STAGE 1

Impact of Acute Stress Exposure on Reactivity to Loss of Control Over Threat

How does stress influence psychological and biological responses to uncontrollable threat?

Recommended by ORCID_LOGO and ORCID_LOGO based on reviews by Mariela Mihaylova, Laura Meine and Genisius Hartanto
One of the key drivers of how organisms respond to stressful events or situations is the controllability of the stressor – the extent to which the individual has (or believes) they can control the stress-inducing event or situation. A considerable literature has explored controllability and the effects of aversive events, with the general finding that uncontrollable situations more strongly impair emotion and cognition while increasing stress responses (Maier & Seligman, 1976). In a key review, Foa et al. (1992) evaluated the effects of unpredictable and uncontrollable aversive events that caused disturbance in animals. Although it remains unclear, longevity of stress exposure may play a role in responsiveness when exposed to uncontrollable threats in humans.
 
Here, Dudziak et al. (2025) examine whether acute stress exposure impacts reactivity to a subsequent loss of control over threat. Participants (N=128) will be assigned to a stress or a no-stress group, undergoing an acute stress induction or a non-stressful control procedure, followed by a behavioural loss-of-control task. By assessing salivary cortisol and salivary alpha-amylase assays, blood pressure measurements, and self-report ratings they hypothesize that participants exposed to acute stress will show stronger biological and psychological responses to the loss of control over threat than those in the no-stress group. The authors will also test whether individual differences in childhood adversity are associated with heightened stress responses. Overall, the findings promise to shed light on the directional relationship between threat controllability and stress reactivity, and will therefore be relevant across a range of research areas in clinical psychology, biological psychology, and associated domains.
 
The Stage 1 manuscript was evaluated by three expert reviewers who performed in-depth and constructive evaluation across multiple rounds of revisions. The authors were responsive in amending their manuscript based on the reviewers’ comments and dedicated much effort to increasing the clarity and interpretability of their design and sampling plan. The revised manuscript was judged to meet the Stage 1 criteria and was awarded in-principle acceptance (IPA).
 
URL to the preregistered Stage 1 protocol: https://osf.io/dca3g
 
Level of bias control achieved: Level 6. Data collection began during the final round of Stage 1 peer review. Since no substantive revisions to the design or analysis were made after this review round, the risk of bias due to prior data observation remained zero, and the manuscript therefore qualified for Level 6.
 
List of eligible PCI RR-friendly journals:
 

References
 
1. Dudziak, M., Smeets, T., Vervliet, B., & Beckers, T. (2025). Impact of acute stress exposure on reactivity to loss of control over threat. In principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/dca3g
 
2. Foa, E. B., Zinbarg, R., & Rothbaum, B. O. (1992). Uncontrollability and unpredictability in post-traumatic stress disorder: An animal model. Psychological Bulletin, 112, 218-238. https://doi.org/10.1037/0033-2909.112.2.218
 
3. Maier, S. F., & Seligman, M. E. (1976). Learned helplessness: Theory and evidence. Journal of Experimental Psychology: General, 105, 3-46. https://doi.org/10.1037/0096-3445.105.1.3
 
Impact of Acute Stress Exposure on Reactivity to Loss of Control Over ThreatMichalina Dudziak, Tom Smeets, Bram Vervliet, Tom Beckers<p>Uncontrollable negative events yield increased stress responses compared to situations over which we have control. Previous studies have assessed the impact of uncontrollability of threat on stress reactivity. Less is known about whether and ho...Social sciencesSaeed Shafiei Sabet2024-10-22 17:53:28 View
27 Mar 2025
STAGE 2
(Go to stage 1)

The effects of false feedback on state memory distrust toward commission and omission, and recognition memory errors

Exploring how feedback on memory accuracy shifts criteria

Recommended by ORCID_LOGO based on reviews by Dan Wright, Romuald Polczyk, Greg Neil and 1 anonymous reviewer
We may not believe what our memory tells us: Memory may deliver a compelling recollection we believe did not happen (we know we were not there at the time); and we may know an event happened that we fail to remember. That is, there can be distrust in remembering and distrust in forgetting. Previous work by the authors has looked at this through a signal detection lens, reporting in separate studies that people who have distrust in remembering have either a high or low criterion for saying "old" (Zhang et al, 2023, 2024). A plausible explanation for these contrasting results is that the criterion can either be the means by which false memories are generated enabling the distrust (low criterion); or rather, in conditions where accuracy is at stake, the means for compensating for the distrust (high criterion).
 
In the current study by Zhang et al (2025), participants were incentivised to be as accurate as possible, and in a memory test given feedback about commission errors or, in another group, ommission errors. The manipulation check indicated that the feedback did not increase (by a meaningful amount) distrust in remembering or distrust in forgetting, respectively, compared to a no feedback control group. Nonetheless, the authors found that people adjusted the criterion to say "old" in a compensatory way in each group. The possible mechanisms underlying these criterion shifts are discussed by the authors, who grapple with the distinction between response criterion shifts versus genuine meta-memory belief changes, and for the latter case, whether any memory distrust change could be contextual versus global (the manipulation check measured the latter).
 
The Stage 2 manuscript was evaluated over one round of in-depth review by four reviewers. Based on detailed responses to the reviewers' and recommender's comments, the recommender judged that the manuscript met the Stage 2 criteria for recommendation.
 
URL to the preregistered Stage 1 protocol: https://osf.io/x69qt
 
Level of bias control achieved: Level 6. No part of the data or evidence that was used to answer the research question was generated until after IPA. 
 
List of eligible PCI RR-friendly journals:
 
 
References
 
1. Zhang, Y., Qi, F., Otgaar, H., Nash, R. A., & Jelicic, M. (2023). A Tale of Two Distrusts: Memory Distrust towards Commission and Omission Errors in the Chinese Context. Journal of Applied Research in Memory and Cognition. https://doi.org/10.1037/mac0000134
 
2. Zhang, Y., Otgaar, H., Nash, R. A., & Rosar, L. (2024). Time and memory distrust shape the dynamics of recollection and belief-in-occurrence. Memory, 32, 484–501. https://doi.org/10.1080/09658211.2024.2336166
 
3. Zhang, Y., Otgaar, H., Nash, R. A., & Li, C. (2025). The effects of false feedback on state memory distrust toward commission and omission, and recognition memory errors [Stage 2]. Acceptance of Version 6 by Peer Community in Registered Reports. https://osf.io/z8mv5
The effects of false feedback on state memory distrust toward commission and omission, and recognition memory errorsYikang Zhang, Henry Otgaar, Robert A. Nash, Chunlin Li<p>Memory distrust refers to the subjective appraisal of one’s memory functioning and it has two aspects: distrust over making omission errors (e.g., forgetting) and distrust over making commission errors (e.g., falsely remembering). Although thes...Social sciencesZoltan Dienes2024-11-05 16:42:53 View
03 Mar 2025
STAGE 2
(Go to stage 1)

Is it Worth the Hustle? A Multi-Country Replication of the Effort Moralization Effect and an Extension to Generational Differences in the Appreciation of Effort

Are people who exert more effort in a task seen as more moral?

Recommended by ORCID_LOGO based on reviews by Jared Celniker, Ignazio Ziano and Michael Inzlicht
This study seeks to understand cultural and age differences in the effort moralization effect, a phenomenon in which people who put more effort into a task are considered more moral, regardless of the quality or the morality associated with the task. This is shown in common phrases such as the “great resignation” or “quiet quitting”, which are mostly used against younger members of the population, in particular generation Z.
 
Tissot and Roth (2025) conducted a replication of a study from Celniker et al. (2023) which found evidence for this effect, with new samples from Mexico and Germany, to test potential cultural and age differences. 

The results indicated a generalization of the effort moralization effect in Germany and Mexico, with important heterogeneity in the effect found, and effects sizes that were smaller than in the original study conducted in the USA. However, no effect was found regarding age, as younger individuals judged effort as being important in the same way as older individuals. It is possible, therefore, that the effort moralization effect is a consistent bias that persists regardless of age.
 
The Stage 2 manuscript was evaluated over three rounds of in-depth review. Based on ​detailed responses to the reviewers’ and recommender’s comments, the recommender judged that the manuscript met the Stage 2 criteria and awarded a positive recommendation.
 
URL to the preregistered Stage 1 protocol: https://osf.io/tvgw2
 
Level of bias control achieved: Level 6. No part of the data or evidence that was used to answer the research question was generated until after IPA.
 
List of eligible PCI RR-friendly journals:
 
 
References
 
1. Celniker, J. B., Gregory, A., Koo, H. J., Piff, P. K., Ditto, P. H., & Shariff, A. F. (2023). The moralization of effort. Journal of Experimental Psychology: General, 152, 60–79. https://doi.org/10.1037/xge0001259
 
2. Tissot, T. T. & Roth, L. H. O. (2025). Is it Worth the Hustle? A Multi-Country Replication of the Effort Moralization Effect and an Extension to Generational Differences in the Appreciation of Effort [Stage 2]. Acceptance of Version 6 by Peer Community in Registered Reports. https://doi.org/10.31219/osf.io/ck4st_v6
Is it Worth the Hustle? A Multi-Country Replication of the Effort Moralization Effect and an Extension to Generational Differences in the Appreciation of EffortTassilo T. Tissot, Leopold H. O. Roth<p>Inferring moral character of individuals is an adaptive need for social decision-making. The effort moralization effect describes the finding that people who exert more effort in a task are seen as more moral, even if higher effort does not enh...Social sciencesAdrien Fillon2024-11-15 10:14:56 View
21 Feb 2025
STAGE 2
(Go to stage 1)

Does learning more about others impact liking them?: Replication and extension Registered Report of Norton et al. (2007)’s Lure of Ambiguity

Revisiting ‘less is more’: A failure to replicate the association between increased knowing and decreased liking

Recommended by ORCID_LOGO based on reviews by Philipp Schoenegger and Zoltan Kekecs
Does knowing more about others necessarily lead to greater liking, or might it breed contempt, as suggested by Norton et al. (2007)? In the current study, Horsham et al. (2025) tried to replicate and extend that original question. Collecting data from a large sample of U.S. undergraduates and employing carefully revised designs reviewed at Stage 1, they replicated Norton et al.’s initial studies (1a, 1b, and 2) while also adding new measures. Their primary aim was to see if the “less is more” effect, where increased familiarity decreases liking, would hold under rigorous modern standards, including pre-registration and several open science practices.
 
Results indicated that people indeed believe they will like someone more if they know more about that person, replicating Norton et al.’s initial finding from Studies 1a and 1b. However, the association between greater knowledge and reduced liking, the core of the “less is more” claim, was not consistently observed. Instead, the data showed little evidence that accumulating information inevitably decreases liking. Moreover, an added examination of curiosity as a potential mediator revealed that although curiosity and liking are positively related, curiosity itself was not strongly contingent on the amount of knowledge participants had. These findings help clarify why previous literature has sometimes presented mixed outcomes, and they underline the distinction between what people predict will happen and what actually does happen in forming impressions of others.
 
Peer review involved thorough evaluations by experts. Following multiple revisions through Stages 1 and 2, the manuscript has been deemed a carefully executed Registered Report, providing transparent methods, open data, and full reproducibility. It adds nuance to discussions around how knowledge, familiarity, and curiosity jointly shape our interpersonal attitudes. On this basis, the recommender judged that the manuscript met the Stage 2 criteria and awarded a positive recommendation.​
 
URL to the preregistered Stage 1 protocol: https://osf.io/7mc4y
 
Level of bias control achieved: Level 6. No part of the data or evidence that was used to answer the research question was generated until after IPA.
 
List of eligible PCI RR-friendly journals:
 
 
References
 
1. Norton, M. I., Frost, J. H., & Ariely, D. (2007). Less is more: The lure of ambiguity, or why familiarity breeds contempt. Journal of Personality and Social Psychology, 92, 97-105. https://doi.org/10.1037/0022-3514.92.1.97
 
2. Horsham, Z., Haydock-Symonds, A., Imada, H., Tai, H. C., Lau, W. L., Shum, T. L., Zeng, Y., Chow, K., & Feldman, G. (2025). Does learning more about others impact liking them?: Replication and extension Registered Report of Norton et al. (2007)’s Lure of Ambiguity [Stage 2]. Acceptance of Version 6 by Peer Community in Registered Reports.​ https://osf.io/ygkft
Does learning more about others impact liking them?: Replication and extension Registered Report of Norton et al. (2007)’s Lure of AmbiguityZöe Horsham, Ashleigh Haydock-Symonds, Hirotaka Imada, Hiu Ching Tai, Wing Lam Lau, Tsz Lui Shum, Yuqing Zeng, Hiu Tang Chow, Gilad Feldman<p>Norton et al. (2007) demonstrated a counterintuitive phenomenon that knowing other people better and/or having more information about them is associated with decreased liking. They summarized it as - ambiguity leads to liking, whereas familiari...Social sciencesYuki Yamada Zoltan Kekecs, Philipp Schoenegger2024-11-22 04:27:45 View
11 Feb 2025
STAGE 2
(Go to stage 1)

Action interpretation determines the effects of go/no-go and approach/avoidance actions on food choice

Does interpretation of actions as either avoid or inhibit influence choice behaviour for candy?

Recommended by based on reviews by Alexander MacLellan and Katrijn Houben
Experimental research demonstrates that executing or inhibiting motor responses (or approaching / avoiding) towards a stimulus can alter the valuation of the stimulus (Yang et al., 2022). There are competing theories as to the proposed mechanisms of value change, such as increased response conflict or prediction errors (Houben & Aulbach, 2023). However, research has mostly examined response execution/inhibition and approach/avoidance in isolation and the few studies that have examined these together have focused on stimulus evaluation as an outcome.
 
In the current study Chen et al. (2025) set out to examine how action interpretations (e.g. go vs approach) can impact individuals food-choices. This is important for cognitive bias modification approaches which aim to manipulate these actions to promote behaviour change (Iannazzo et al., 2024; Veling et al., 2021), but also theoretical accounts which suggest certain motor-responses acquire valence. Here there are two groups randomised to receive instructions to either go/no-go or approach/avoid images of candy in novel training task (Chen et al., 2019).
 
The results of the experiment suggested that despite both groups making the same responses (pressing a space bar vs not), the framing of the response as go vs approach and no-go vs avoidance influenced subsequent food-choice (i.e. responses framed as approach increased the probability of choosing approach items over avoidance items, but not go items over no-go items).
 
As the authors state, these findings cast doubt on theoretical models which suggest there are ‘hardwired’ links between specific go/approach responses and appetitive systems or specific no-go/avoidance responses and aversive systems. They also suggest these responses aren’t valenced, but acquire valence through interpretation of the action. These findings can also inform future studies into cognitive bias modification.
 
The Stage 2 manuscript was evaluated over two rounds of in-depth review by two reviewers with expertise in the relevant area, who also assessed the Stage 1 manuscript. Based on the authors’ careful responses and revisions, the revised manuscript was judged to meet the Stage 2 criteria and was awarded a positive recommendation.
 
URL to the preregistered Stage 1 protocol: https://osf.io/bn5xa
 
Level of bias control achieved: Level 6. No part of the data or evidence that was used to answer the research question was generated until after IPA. 
 
List of eligible PCI RR-friendly journals:
 
 
 References
 
1. Chen, Z., Van Dessel, P., Serverius, J., Zhu, D. & Figner, B. (2025). Action interpretation determines the effects of go/no-go and approach/avoidance actions on food choice. Acceptance of Version 2 by Peer Community in Registered Reports. https://doi.org/10.31234/osf.io/6xhw4_v2
 
2. Chen, Z., & Van Dessel, P. (2024). Action Interpretation Determines the Effects of Go/No-Go and Approach/Avoidance Actions on Stimulus Evaluation. Open Mind, 8, 898–923. https://doi.org/10.1162/opmi_a_00151
 
3. Houben, K. and Aulbach, M. (2023). Is there a difference between stopping and avoiding? A review of the mechanisms underlying Go/No-Go and Approach-Avoidance training for food choice. Current Opinion in Behavioral Sciences, 49, 101245. https://doi.org/10.1016/j.cobeha.2022.101245

4. Iannazzo, L. H., Hayden, M. J., Lawrence, N. S., Kakoschke, N., Hughes, L. K., Van Egmond, K., … Staiger, P. K. (2024). Inhibitory control training to reduce appetitive behaviour: a meta-analytic investigation of effectiveness, potential moderators, and underlying mechanisms of change. Health Psychology Review, 1–31. https://doi.org/10.1080/17437199.2024.2410018
 
5. Veling, H., Verpaalen, I. A. M., Liu, H., Mosannenzadeh, F., Becker, D., & Holland, R. W. (2021). How can food choice best be trained? Approach-avoidance versus go/no-go training. Appetite, 163, 105226. https://doi.org/10.1016/j.appet.2021.105226
 
6. Yang, Y., Qi, L., Morys, F., Wu, Q. & Chen, H. (2022). Food-Specific Inhibition Training for Food Devaluation: A Meta-Analysis. Nutrients, 14, 1363. https://doi.org/10.3390/nu14071363
Action interpretation determines the effects of go/no-go and approach/avoidance actions on food choiceZhang Chen, Pieter Van Dessel, Jordi Serverius, Daxun Zhu, Bernd Figner<p>Executing go/no-go and approach/avoidance responses toward objects can increase people's choices of go over no-go items, and of approach over avoidance items. Some theoretical accounts explain these effects as the results of merely executing th...Social sciencesAndrew Jones2024-11-24 11:21:55 View
08 Apr 2025
STAGE 2
(Go to stage 1)

Does Truth Pay? Investigating the Effectiveness of the Bayesian Truth Serum with an Interim Payment: A Registered Report

Do interim payments promote honesty in self-report? A test of the Bayesian Truth Serum

Recommended by ORCID_LOGO based on reviews by Philipp Schoenegger and Sarahanne Miranda Field

Surveys that measure self-report are a workhorse in psychology and the social sciences, providing a vital window into beliefs, attitudes, and emotions, both at the level of groups and individuals. The validity of self-report data, however, is an enduring methodological concern, with self-reports vulnerable to a range of response biases, including (among others) the risk of social desirability bias in which, rather than responding honestly, participants answer questions in a way that they believe will be viewed favorably by others. One proposed solution to socially desirable responding is the so-called Bayesian Truth Serum (BTS), which aims to incentivize truthfulness by taking into account the relationship between an individual’s response and their belief about the dominant (or most likely) response given by other people and then assigning a high truthfulness score to answers that are surprisingly common (Prelec, 2004).

Although valid in theory (under a variety of assumptions), questions remain regarding the empirical utility of the BTS. One area of concern is participants’ uncertainty regarding incentives for truth-telling – if participants don’t understand the extent to which telling the truth is in their own interests (or they don’t believe that it matters) then the validity of the BTS is undermined. 

In the current study, Neville and Williams (2025) tested the role of clarifying incentives, particularly for addressing social desirability bias when answering sensitive questions. The authors administered an experimental survey design (N=877) including sensitive questions, curated from validated scales, that are relevant to current social attitudes and sensitivities (e.g., “Men are not particularly discriminated against”, “Younger people are usually more productive than older people at their jobs”). Three groups of participants completed the survey under different incentive conditions: the BTS delivered alone in a standard format, the BTS with an interim bonus payment that is awarded to participants (based on their BTS score) halfway through the survey to increase certainty in incentives, and a Regular Incentive control group in which participants receive payment without additional incentives.

The authors analyzed the effectiveness of the BTS through two registered hypotheses. First, the authors found that the BTS did not increase agreement with socially undesirable statements (compared to the control group), as theory would suggest, and even observed an opposite effect. This result, which could be confirmed by follow-up studies, raises some concerns about the robustness of the BTS method. Second, the authors conjectured that introducing an interim payment in the BTS mechanism would help reinforce its credibility in the eyes of the participants and would thus magnify its effect. However, the authors failed to detect a statistically significant difference between the standard BTS and interim-payment BTS mechanisms. Overall, the results of Neville and Williams (2025) call for some caution in the use of the BTS and for further work to better understand the contexts in which the BTS might be a useful tool to mitigate social desirability in surveys. 

This Stage 2 manuscript was evaluated over one round of in-depth review by two expert reviewers and a second round of review by the recommender. After the revisions, the recommender judged that the manuscript met the Stage 2 criteria and awarded a positive recommendation.

 
URL to the preregistered Stage 1 protocol: https://osf.io/vuh8b
 
Level of bias control achieved: Level 6. No part of the data or evidence that was used to answer the research question was generated until after IPA.
 
List of eligible PCI-RR-friendly journals:

 
References
 
1. Neville, C. M & Williams, M. N. (2025). Does Truth Pay? Investigating the Effectiveness of the Bayesian
Truth Serum with an Interim Payment: A Registered Report [Stage 2]. Acceptance of Version 4 by Peer Community in Registered Reports. https://doi.org/10.31219/osf.io/s3znc
 
2. Prelec, D. (2004). A Bayesian truth serum for subjective data. Science, 306, 462-466. https://doi.org/10.1126/science.1102081
Does Truth Pay? Investigating the Effectiveness of the Bayesian Truth Serum with an Interim Payment: A Registered Report Claire M. Neville, Matt N. Williams<p>Self-report data is vital in psychological research, but biases like careless responding and socially desirable responding (SDR) can compromise its validity. While various methods are employed to mitigate these biases, they have limitations. Th...Social sciencesRomain Espinosa2025-01-15 01:46:05 View