Submit a report

Announcements

We are recruiting recommenders (editors) from all research fields!

Your feedback matters! If you have authored or reviewed a Registered Report at Peer Community in Registered Reports, then please take 5 minutes to leave anonymous feedback about your experience, and view community ratings.

Latest recommendations

IdTitle * Authors * Abstract * PictureThematic fields * RecommenderReviewersSubmission date▲
27 Mar 2025
STAGE 2
(Go to stage 1)

The effects of false feedback on state memory distrust toward commission and omission, and recognition memory errors

Exploring how feedback on memory accuracy shifts criteria

Recommended by ORCID_LOGO based on reviews by Dan Wright, Romuald Polczyk, Greg Neil and 1 anonymous reviewer
We may not believe what our memory tells us: Memory may deliver a compelling recollection we believe did not happen (we know we were not there at the time); and we may know an event happened that we fail to remember. That is, there can be distrust in remembering and distrust in forgetting. Previous work by the authors has looked at this through a signal detection lens, reporting in separate studies that people who have distrust in remembering have either a high or low criterion for saying "old" (Zhang et al, 2023, 2024). A plausible explanation for these contrasting results is that the criterion can either be the means by which false memories are generated enabling the distrust (low criterion); or rather, in conditions where accuracy is at stake, the means for compensating for the distrust (high criterion).
 
In the current study by Zhang et al (2025), participants were incentivised to be as accurate as possible, and in a memory test given feedback about commission errors or, in another group, ommission errors. The manipulation check indicated that the feedback did not increase (by a meaningful amount) distrust in remembering or distrust in forgetting, respectively, compared to a no feedback control group. Nonetheless, the authors found that people adjusted the criterion to say "old" in a compensatory way in each group. The possible mechanisms underlying these criterion shifts are discussed by the authors, who grapple with the distinction between response criterion shifts versus genuine meta-memory belief changes, and for the latter case, whether any memory distrust change could be contextual versus global (the manipulation check measured the latter).
 
The Stage 2 manuscript was evaluated over one round of in-depth review by four reviewers. Based on detailed responses to the reviewers' and recommender's comments, the recommender judged that the manuscript met the Stage 2 criteria for recommendation.
 
URL to the preregistered Stage 1 protocol: https://osf.io/x69qt
 
Level of bias control achieved: Level 6. No part of the data or evidence that was used to answer the research question was generated until after IPA. 
 
List of eligible PCI RR-friendly journals:
 
 
References
 
1. Zhang, Y., Qi, F., Otgaar, H., Nash, R. A., & Jelicic, M. (2023). A Tale of Two Distrusts: Memory Distrust towards Commission and Omission Errors in the Chinese Context. Journal of Applied Research in Memory and Cognition. https://doi.org/10.1037/mac0000134
 
2. Zhang, Y., Otgaar, H., Nash, R. A., & Rosar, L. (2024). Time and memory distrust shape the dynamics of recollection and belief-in-occurrence. Memory, 32, 484–501. https://doi.org/10.1080/09658211.2024.2336166
 
3. Zhang, Y., Otgaar, H., Nash, R. A., & Li, C. (2025). The effects of false feedback on state memory distrust toward commission and omission, and recognition memory errors [Stage 2]. Acceptance of Version 6 by Peer Community in Registered Reports. https://osf.io/z8mv5
The effects of false feedback on state memory distrust toward commission and omission, and recognition memory errorsYikang Zhang, Henry Otgaar, Robert A. Nash, Chunlin Li<p>Memory distrust refers to the subjective appraisal of one’s memory functioning and it has two aspects: distrust over making omission errors (e.g., forgetting) and distrust over making commission errors (e.g., falsely remembering). Although thes...Social sciencesZoltan Dienes2024-11-05 16:42:53 View
20 Feb 2025
STAGE 2
(Go to stage 1)

The effect of stimulus saliency on the modulation of ongoing neural oscillations related to thermonociception: a Registered Report

Are there oscillatory markers of pain intensity?

Recommended by ORCID_LOGO based on reviews by Markus Ploner and Bjoern Horing
Rhythmic changes in pain can lead to corresponding modulations of EEG amplitudes in theta, alpha, and beta bands. But the question remains open as to whether these modulations are actually tracking pain, or maybe rather saliency or stimulus intensity. The question is of some importance because a marker of pain per se could be useful for tracking felt pain without a verbal response, and could be useful in investigating interventions for treating pain (such as suggestion).  Here, Leu et al. (2025) addressed the question of whether modulations reflect saliency or else the intensity of pain, by using an oddball paradigm in which most trials are a pain stimulus of a certain intensity, and oddball trials will sometimes occur, at either a higher intensity or a lower intensity than the baseline ones. If the modulations reflected salience, the modulation at the frequency of the oddball would be similar for high and low intensity oddballs. However, if the modulations reflected pain intensity, the modulations for the low rather than high oddball condition would be lower.
 
In fact, the baseline and oddball stimulations were found to be perceived significantly differently only in the high oddball condition; and consistantly, the oddballl stimulus significantly modulated ongoing oscillations in only the high oddball condition. Thus, whether oscillations are modulated by pain intensity or salience could not be picked apart in this study. The study does however raise an important isssue, indicate how it could be addressed, and provide data relevant for clearly resolving the issue in the future.
 
The Stage 2 manuscript was evaluated over two rounds of in-depth peer review. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 2 criteria for acceptance.
 
URL to the preregistered Stage 1 protocol: https://osf.io/qbrf2
 
Level of bias control achieved: Level 6. No part of the data or evidence that was used to answer the research question was generated until after IPA.
 
List of eligible PCI RR-friendly journals:
 
 
References
 
1. Leu, C., Forest, S., Legrain, V., & Liberati, G. (2025). The effect of stimulus saliency on the modulation of pain-related ongoing neural oscillations: a Registered Report [Stage 2]. Acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/98edq
The effect of stimulus saliency on the modulation of ongoing neural oscillations related to thermonociception: a Registered ReportChiara Leu, Sébastien Forest, Valéry Legrain, Giulia Liberati<p>Ongoing oscillations have been shown to be modulated in different frequency bands following phasic, tonic as well as periodic thermonociceptive stimulation. Yet, it remains unclear whether these modulations are related to pain perception, salie...Life Sciences, Medical SciencesZoltan Dienes2024-11-11 14:11:31 View
03 Mar 2025
STAGE 2
(Go to stage 1)

Is it Worth the Hustle? A Multi-Country Replication of the Effort Moralization Effect and an Extension to Generational Differences in the Appreciation of Effort

Are people who exert more effort in a task seen as more moral?

Recommended by ORCID_LOGO based on reviews by Jared Celniker, Ignazio Ziano and Michael Inzlicht
This study seeks to understand cultural and age differences in the effort moralization effect, a phenomenon in which people who put more effort into a task are considered more moral, regardless of the quality or the morality associated with the task. This is shown in common phrases such as the “great resignation” or “quiet quitting”, which are mostly used against younger members of the population, in particular generation Z.
 
Tissot and Roth (2025) conducted a replication of a study from Celniker et al. (2023) which found evidence for this effect, with new samples from Mexico and Germany, to test potential cultural and age differences. 

The results indicated a generalization of the effort moralization effect in Germany and Mexico, with important heterogeneity in the effect found, and effects sizes that were smaller than in the original study conducted in the USA. However, no effect was found regarding age, as younger individuals judged effort as being important in the same way as older individuals. It is possible, therefore, that the effort moralization effect is a consistent bias that persists regardless of age.
 
The Stage 2 manuscript was evaluated over three rounds of in-depth review. Based on ​detailed responses to the reviewers’ and recommender’s comments, the recommender judged that the manuscript met the Stage 2 criteria and awarded a positive recommendation.
 
URL to the preregistered Stage 1 protocol: https://osf.io/tvgw2
 
Level of bias control achieved: Level 6. No part of the data or evidence that was used to answer the research question was generated until after IPA.
 
List of eligible PCI RR-friendly journals:
 
 
References
 
1. Celniker, J. B., Gregory, A., Koo, H. J., Piff, P. K., Ditto, P. H., & Shariff, A. F. (2023). The moralization of effort. Journal of Experimental Psychology: General, 152, 60–79. https://doi.org/10.1037/xge0001259
 
2. Tissot, T. T. & Roth, L. H. O. (2025). Is it Worth the Hustle? A Multi-Country Replication of the Effort Moralization Effect and an Extension to Generational Differences in the Appreciation of Effort [Stage 2]. Acceptance of Version 6 by Peer Community in Registered Reports. https://doi.org/10.31219/osf.io/ck4st_v6
Is it Worth the Hustle? A Multi-Country Replication of the Effort Moralization Effect and an Extension to Generational Differences in the Appreciation of EffortTassilo T. Tissot, Leopold H. O. Roth<p>Inferring moral character of individuals is an adaptive need for social decision-making. The effort moralization effect describes the finding that people who exert more effort in a task are seen as more moral, even if higher effort does not enh...Social sciencesAdrien Fillon2024-11-15 10:14:56 View
21 Feb 2025
STAGE 2
(Go to stage 1)

Does learning more about others impact liking them?: Replication and extension Registered Report of Norton et al. (2007)’s Lure of Ambiguity

Revisiting ‘less is more’: A failure to replicate the association between increased knowing and decreased liking

Recommended by ORCID_LOGO based on reviews by Philipp Schoenegger and Zoltan Kekecs
Does knowing more about others necessarily lead to greater liking, or might it breed contempt, as suggested by Norton et al. (2007)? In the current study, Horsham et al. (2025) tried to replicate and extend that original question. Collecting data from a large sample of U.S. undergraduates and employing carefully revised designs reviewed at Stage 1, they replicated Norton et al.’s initial studies (1a, 1b, and 2) while also adding new measures. Their primary aim was to see if the “less is more” effect, where increased familiarity decreases liking, would hold under rigorous modern standards, including pre-registration and several open science practices.
 
Results indicated that people indeed believe they will like someone more if they know more about that person, replicating Norton et al.’s initial finding from Studies 1a and 1b. However, the association between greater knowledge and reduced liking, the core of the “less is more” claim, was not consistently observed. Instead, the data showed little evidence that accumulating information inevitably decreases liking. Moreover, an added examination of curiosity as a potential mediator revealed that although curiosity and liking are positively related, curiosity itself was not strongly contingent on the amount of knowledge participants had. These findings help clarify why previous literature has sometimes presented mixed outcomes, and they underline the distinction between what people predict will happen and what actually does happen in forming impressions of others.
 
Peer review involved thorough evaluations by experts. Following multiple revisions through Stages 1 and 2, the manuscript has been deemed a carefully executed Registered Report, providing transparent methods, open data, and full reproducibility. It adds nuance to discussions around how knowledge, familiarity, and curiosity jointly shape our interpersonal attitudes. On this basis, the recommender judged that the manuscript met the Stage 2 criteria and awarded a positive recommendation.​
 
URL to the preregistered Stage 1 protocol: https://osf.io/7mc4y
 
Level of bias control achieved: Level 6. No part of the data or evidence that was used to answer the research question was generated until after IPA.
 
List of eligible PCI RR-friendly journals:
 
 
References
 
1. Norton, M. I., Frost, J. H., & Ariely, D. (2007). Less is more: The lure of ambiguity, or why familiarity breeds contempt. Journal of Personality and Social Psychology, 92, 97-105. https://doi.org/10.1037/0022-3514.92.1.97
 
2. Horsham, Z., Haydock-Symonds, A., Imada, H., Tai, H. C., Lau, W. L., Shum, T. L., Zeng, Y., Chow, K., & Feldman, G. (2025). Does learning more about others impact liking them?: Replication and extension Registered Report of Norton et al. (2007)’s Lure of Ambiguity [Stage 2]. Acceptance of Version 6 by Peer Community in Registered Reports.​ https://osf.io/ygkft
Does learning more about others impact liking them?: Replication and extension Registered Report of Norton et al. (2007)’s Lure of AmbiguityZöe Horsham, Ashleigh Haydock-Symonds, Hirotaka Imada, Hiu Ching Tai, Wing Lam Lau, Tsz Lui Shum, Yuqing Zeng, Hiu Tang Chow, Gilad Feldman<p>Norton et al. (2007) demonstrated a counterintuitive phenomenon that knowing other people better and/or having more information about them is associated with decreased liking. They summarized it as - ambiguity leads to liking, whereas familiari...Social sciencesYuki Yamada Zoltan Kekecs, Philipp Schoenegger2024-11-22 04:27:45 View
11 Feb 2025
STAGE 2
(Go to stage 1)

Action interpretation determines the effects of go/no-go and approach/avoidance actions on food choice

Does interpretation of actions as either avoid or inhibit influence choice behaviour for candy?

Recommended by based on reviews by Alexander MacLellan and Katrijn Houben
Experimental research demonstrates that executing or inhibiting motor responses (or approaching / avoiding) towards a stimulus can alter the valuation of the stimulus (Yang et al., 2022). There are competing theories as to the proposed mechanisms of value change, such as increased response conflict or prediction errors (Houben & Aulbach, 2023). However, research has mostly examined response execution/inhibition and approach/avoidance in isolation and the few studies that have examined these together have focused on stimulus evaluation as an outcome.
 
In the current study Chen et al. (2025) set out to examine how action interpretations (e.g. go vs approach) can impact individuals food-choices. This is important for cognitive bias modification approaches which aim to manipulate these actions to promote behaviour change (Iannazzo et al., 2024; Veling et al., 2021), but also theoretical accounts which suggest certain motor-responses acquire valence. Here there are two groups randomised to receive instructions to either go/no-go or approach/avoid images of candy in novel training task (Chen et al., 2019).
 
The results of the experiment suggested that despite both groups making the same responses (pressing a space bar vs not), the framing of the response as go vs approach and no-go vs avoidance influenced subsequent food-choice (i.e. responses framed as approach increased the probability of choosing approach items over avoidance items, but not go items over no-go items).
 
As the authors state, these findings cast doubt on theoretical models which suggest there are ‘hardwired’ links between specific go/approach responses and appetitive systems or specific no-go/avoidance responses and aversive systems. They also suggest these responses aren’t valenced, but acquire valence through interpretation of the action. These findings can also inform future studies into cognitive bias modification.
 
The Stage 2 manuscript was evaluated over two rounds of in-depth review by two reviewers with expertise in the relevant area, who also assessed the Stage 1 manuscript. Based on the authors’ careful responses and revisions, the revised manuscript was judged to meet the Stage 2 criteria and was awarded a positive recommendation.
 
URL to the preregistered Stage 1 protocol: https://osf.io/bn5xa
 
Level of bias control achieved: Level 6. No part of the data or evidence that was used to answer the research question was generated until after IPA. 
 
List of eligible PCI RR-friendly journals:
 
 
 References
 
1. Chen, Z., Van Dessel, P., Serverius, J., Zhu, D. & Figner, B. (2025). Action interpretation determines the effects of go/no-go and approach/avoidance actions on food choice. Acceptance of Version 2 by Peer Community in Registered Reports. https://doi.org/10.31234/osf.io/6xhw4_v2
 
2. Chen, Z., & Van Dessel, P. (2024). Action Interpretation Determines the Effects of Go/No-Go and Approach/Avoidance Actions on Stimulus Evaluation. Open Mind, 8, 898–923. https://doi.org/10.1162/opmi_a_00151
 
3. Houben, K. and Aulbach, M. (2023). Is there a difference between stopping and avoiding? A review of the mechanisms underlying Go/No-Go and Approach-Avoidance training for food choice. Current Opinion in Behavioral Sciences, 49, 101245. https://doi.org/10.1016/j.cobeha.2022.101245

4. Iannazzo, L. H., Hayden, M. J., Lawrence, N. S., Kakoschke, N., Hughes, L. K., Van Egmond, K., … Staiger, P. K. (2024). Inhibitory control training to reduce appetitive behaviour: a meta-analytic investigation of effectiveness, potential moderators, and underlying mechanisms of change. Health Psychology Review, 1–31. https://doi.org/10.1080/17437199.2024.2410018
 
5. Veling, H., Verpaalen, I. A. M., Liu, H., Mosannenzadeh, F., Becker, D., & Holland, R. W. (2021). How can food choice best be trained? Approach-avoidance versus go/no-go training. Appetite, 163, 105226. https://doi.org/10.1016/j.appet.2021.105226
 
6. Yang, Y., Qi, L., Morys, F., Wu, Q. & Chen, H. (2022). Food-Specific Inhibition Training for Food Devaluation: A Meta-Analysis. Nutrients, 14, 1363. https://doi.org/10.3390/nu14071363
Action interpretation determines the effects of go/no-go and approach/avoidance actions on food choiceZhang Chen, Pieter Van Dessel, Jordi Serverius, Daxun Zhu, Bernd Figner<p>Executing go/no-go and approach/avoidance responses toward objects can increase people's choices of go over no-go items, and of approach over avoidance items. Some theoretical accounts explain these effects as the results of merely executing th...Social sciencesAndrew Jones2024-11-24 11:21:55 View
20 Feb 2025
STAGE 2
(Go to stage 1)

Neophobia across social contexts in juvenile Herring gulls

Herring gulls exhibit reduced neophobia when tested in groups

Recommended by ORCID_LOGO based on reviews by Claudia Mettke-Hofmann and 1 anonymous reviewer
How well animals may be able to cope with changes of habitat, specifically with rapid changes and thus novelty they encounter in an environment densely populated by humans, may be influenced by how they respond to novelty in general (Batisteli et al., 2022; Biondi et al., 2024; Castano et al., 2024; Heales et al., 2024). In considering this, it may be important to account for any difference in behavioural responses that animals exhibit when encountering a novel situation alone versus when they are doing so as part of a group.
 
Here, Allaert et al. (2025) tested how neophobia – the fear of unfamiliar objects – is affected by the social context in gulls, birds that are increasingly forced to live in urban environments due to the loss of natural coastlines. In this study, in which they reared herring gulls from egg and tested them taking into account that nestmates are not tested within the same groups, the authors found that the birds were faster to eat and spent more time in the zone of interest when they were tested in a group than when they were tested individually, specifically when a novel object was placed next to the food compared to when that object was a familiar one. The birds were also faster to enter the testing area when tested in a group, but this was not specific to the novel object condition. In addition to these changes in the average responses, the authors also report reduced variance when tested in a group in two of their three measures, namely in the latency to enter the testing area and time spent in the zone of interest.
 
The authors interpret their findings as being mostly in line with the ‘risk-dilution’ hypothesis, which is often considered in terms of predation risk (Krause & Buxton, 2002). They discuss possible reasons why other studies, with different species and different methodological setups, found support for alternative explanations.
 
The Stage 2 report was evaluated by the same two reviewers who had also reviewed the Stage 1 manuscript. In the revision, the authors focused on adding sex as a factor in their statistical models, which was the planned procedure for the statistical analyses in the Stage 1 report, and adding information regarding the problems encountered during testing and how these were handled. This specifically refers to the planned sample size (which the authors planned in the Stage 1 report taking into account both mortality and the fact that some birds would be not herring gulls but lesser black-backed gulls, which can only be established after hatching). However, there was higher than expected mortality, leading to a larger-than-planned overall reduction in sample size. During the study, the authors had contacted the recommender and discussed this issue, and the recommender advised on continuing the study and approved of the planned changes in the Stage 2 report. During the revision process, the authors added more information and also conducted an exploratory analysis, which included all birds, i.e. herring gulls and lesser black-backed gulls. This was suggested by a reviewer and the authors present this exploratory analysis in full in the supplemental material, while the main inferences are presented in the main text. In addition, during the Stage 2 review it became apparent that some minor details regarding the procedure would be useful to be included in the Stage 2 report, which the authors included in the Stage 2 revision. This did not alter the procedure as described in the Stage 1 report, but merely added more clarity to the text.
 
Based on detailed engagement with these points and the reviewers' comments, the recommender judged that the manuscript met the Stage 2 criteria and awarded a positive recommendation.
 
URL to the preregistered Stage 1 protocol: https://osf.io/u4b7q
 
Level of bias control achieved: Level 6No part of the data or evidence that was used to answer the research question was generated until after IPA.
 
List of eligible PCI RR-friendly journals:
 
 
References
 
1. Allaert, R., Knoch, S., Braem, S., Debeer, D., Martel, A., Müller, W., Stienen, E., Lens, L., & Verbruggen, F. (2025). Neophobia across social contexts in juvenile Herring gulls [Stage 2]. Acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/b58ha
 
2. Batisteli, A. F., Pizo, M. A., & Sarmento, H. (2022). Female neophobia predicts the use of buildings as nesting sites in a Neotropical songbird. Animal Behaviour, 183, 151-157. https://doi.org/10.1016/j.anbehav.2021.11.008
 
3. Biondi, L. M., Medina, A., Bonetti, E. A., Paterlini, C. A., & Bó, M. S. (2024). Cognitive flexibility in a generalist raptor: a comparative analysis along an urbanization gradient. Behavioral Ecology, 35, arae025. https://doi.org/10.1093/beheco/arae025
 
4. Castano, M. V., Zumpano, F., Biondi, L. M., & García, G. O. (2024). Does urbanization affect behavioral responses to novel objects in marine birds? The Olrog’s Gull as a case of study. Urban Ecosystems, 27, 427-437. https://doi.org/10.1007/s11252-023-01465-2
 
5. Heales, H. E., Flood, N. J., Oud, M. D., Otter, K. A., & Reudink, M. W. (2024). Exploring differences in neophobia and anti-predator behaviour between urban and rural mountain chickadees. Journal of Urban Ecology, 10, juae01. https://doi.org/10.1093/jue/juae014
 
6. Krause, J. & Ruxton, G. (2002). Living in Groups. Oxford University Press, USA.
Neophobia across social contexts in juvenile Herring gullsReinoud Allaert, Sophia Knoch, Simon Braem, Dries Debeer, An Martel, Wendt Müller, Eric Stienen, Luc Lens, Frederick Verbruggen<p>Neophobia, the fear or avoidance of the unfamiliar, can have significant fitness consequences. It is typically assessed by exposing individuals to unfamiliar objects when they are alone, but in social species the presence of conspecifics can in...Life SciencesLjerka Ostojic2024-11-26 13:25:23 View
14 Jan 2025
STAGE 1
article picture

Implementing a rapid geographic range expansion - the role of behavior and habitat changes

The role of behavior and habitat availability on species geographic expansion

Recommended by ORCID_LOGO
Note from the PCI RR Managing Board: This Stage 1 recommendation was originally written by Esther Sebastián González for PCI Ecology on 06 Oct 2020 and was transferred to PCI Registered Reports on 14 Jan 2025 to facilitate the submission and evaluation of the resulting Stage 2 submissions. The link to the original recommendation and review history at PCI Ecology may be found at this link (and in PDF format here).
 
===
 
Understanding the relative importance of species-specific traits and environmental factors in modulating species distributions is an intriguing question in ecology [1]. Both behavioral flexibility (i.e., the ability to change the behavior in changing circumstances) and habitat availability are known to influence the ability of a species to expand its geographic range [2,3]. However, the role of each factor is context and species dependent and more information is needed to understand how these two factors interact. In this pre-registration, Logan et al. [4] explain how they will use Great-tailed grackles (Quiscalus mexicanus), a species with a flexible behavior and a rapid geographic range expansion, to evaluate the relative role of habitat and behavior as drivers of the species’ expansion [4]. The authors present very clear hypotheses, predicted results and also include alternative predictions. The rationales for all the hypotheses are clearly stated, and the methodology (data and analyses plans) are described with detail. The large amount of information already collected by the authors for the studied species during previous projects warrants the success of this study. It is also remarkable that the authors will make all their data available in a public repository, and that the pre-registration in already stored in GitHub, supporting open access and reproducible science. I agree with the three reviewers of this pre-registration about its value and I think its quality has largely improved during the review process. Thus, I am happy to recommend it and I am looking forward to seeing the results.
 
 
Level of bias control achieved: Level 1. At least some of the data/evidence that will be used to the answer the research question has been accessed and observed by the authors, including key variables, but the authors certify that they have not yet performed any of their preregistered analyses, and in addition they have taken stringent steps to reduce the risk of bias.
 
List of eligible PCI-RR-friendly journals:
 
 
References
 
[1] Gaston KJ. 2003. The structure and dynamics of geographic ranges. Oxford series in Ecology and Evolution. Oxford University Press, New York.
 
[2] Sol D, Lefebvre L. 2000. Behavioural flexibility predicts invasion success in birds introduced to new zealand. Oikos. 90(3): 599–605. https://doi.org/10.1034/j.1600-0706.2000.900317.x
 
[3] Hanski I, Gilpin M. 1991. Metapopulation dynamics: Brief history and conceptual domain. Biological journal of the Linnean Society. 42(1-2): 3–16. https://doi.org/10.1111/j.1095-8312.1991.tb00548.x
 
[4] Logan CJ, McCune KB, Chen N, Lukas D. 2020. Implementing a rapid geographic range expansion - the role of behavior and habitat changes (http://corinalogan.com/Preregistrations/gxpopbehaviorhabitat.html) In principle acceptance by PCI Ecology of the version on 16 Dec 2021 https://github.com/corinalogan/grackles/blob/0fb956040a34986902a384a1d8355de65010effd/Files/Preregistrations/gxpopbehaviorhabitat.Rmd
 
=======
 
Full review history: [link]
 
Implementing a rapid geographic range expansion - the role of behavior and habitat changesCorina J Logan, Kelsey B McCune, Nancy Chen, Dieter Lukas<p>It is generally thought that behavioral flexibility, the ability to change behavior when circumstances change, plays an important role in the ability of a species to rapidly expand their geographic range (Chow et al., 2016; Griffin &amp; Guez, ...Life SciencesChris Chambers2025-01-13 12:12:15 View
08 Apr 2025
STAGE 2
(Go to stage 1)

Non-compliance with and non-enforcement of UK loot box industry self-regulation on the Apple App Store: A longitudinal study on poor implementation

Self regulation by gaming companies for the use of loot boxes is not working

Recommended by ORCID_LOGO based on reviews by Chris Chambers
Video games may provide the option of spending real money in exchange for probabilistically receiving game-relevant rewards; in effect, encouraging potentially young teenagers to gamble. The industry has subscribed to a set of regulatory principles to cover the use of such "loot boxes", including 1) that they will prevent loot box purchasing by under 18s unless parental consent is given; 2) that they will make it initially clear that the game contains loot boxes; and 3) that they will clearly disclose the probabilities of receiving different rewards.
 
Can the industry effectively self regulate? Xiao and Lund (2025) evaluated this important question by investigating the 100 top selling games on the Apple App Store and estimating the percentage compliance to these three regulatory principles at two time points 6 months apart. In all cases compliance was minimal, or even non-existent. The authors recommend stricter legal regulations of loot boxes.
 
The Stage 2 manuscript was evaluated over one round of review. The recommender judged that the manuscript met the Stage  2 criteria for recommendation.
 
URL to the preregistered Stage 1 protocol: https://osf.io/3knyb
 
Level of bias control achieved: Level 2. At least some data/evidence that was used to answer the research question had been accessed and partially observed by the authors prior to IPA, but the authors certify that they had not yet observed the key variables within the data that were used to answer the research question.
 
List of eligible PCI RR-friendly journals:
 
 
References
 
Xiao, L. & Lund, M. (2025). Non-compliance with and non-enforcement of UK loot box industry self-regulation on the Apple App Store: A longitudinal study on poor implementation [Stage 2]. Acceptance of Version 2 by Peer Community in Registered Reports. https://osf.io/3re4n
Non-compliance with and non-enforcement of UK loot box industry self-regulation on the Apple App Store: A longitudinal study on poor implementationLeon Y. Xiao, Mie Lund<p>Loot boxes in video games can be purchased with real-world money in exchange for random rewards. Stakeholders are concerned about loot boxes’ similarities with gambling and their potential harms (e.g., overspending money and developing gambling...Humanities, Social sciencesZoltan Dienes2025-01-13 12:43:11 View
08 Apr 2025
STAGE 2
(Go to stage 1)

Does Truth Pay? Investigating the Effectiveness of the Bayesian Truth Serum with an Interim Payment: A Registered Report

Do interim payments promote honesty in self-report? A test of the Bayesian Truth Serum

Recommended by ORCID_LOGO based on reviews by Philipp Schoenegger and Sarahanne Miranda Field

Surveys that measure self-report are a workhorse in psychology and the social sciences, providing a vital window into beliefs, attitudes, and emotions, both at the level of groups and individuals. The validity of self-report data, however, is an enduring methodological concern, with self-reports vulnerable to a range of response biases, including (among others) the risk of social desirability bias in which, rather than responding honestly, participants answer questions in a way that they believe will be viewed favorably by others. One proposed solution to socially desirable responding is the so-called Bayesian Truth Serum (BTS), which aims to incentivize truthfulness by taking into account the relationship between an individual’s response and their belief about the dominant (or most likely) response given by other people and then assigning a high truthfulness score to answers that are surprisingly common (Prelec, 2004).

Although valid in theory (under a variety of assumptions), questions remain regarding the empirical utility of the BTS. One area of concern is participants’ uncertainty regarding incentives for truth-telling – if participants don’t understand the extent to which telling the truth is in their own interests (or they don’t believe that it matters) then the validity of the BTS is undermined. 

In the current study, Neville and Williams (2025) tested the role of clarifying incentives, particularly for addressing social desirability bias when answering sensitive questions. The authors administered an experimental survey design (N=877) including sensitive questions, curated from validated scales, that are relevant to current social attitudes and sensitivities (e.g., “Men are not particularly discriminated against”, “Younger people are usually more productive than older people at their jobs”). Three groups of participants completed the survey under different incentive conditions: the BTS delivered alone in a standard format, the BTS with an interim bonus payment that is awarded to participants (based on their BTS score) halfway through the survey to increase certainty in incentives, and a Regular Incentive control group in which participants receive payment without additional incentives.

The authors analyzed the effectiveness of the BTS through two registered hypotheses. First, the authors found that the BTS did not increase agreement with socially undesirable statements (compared to the control group), as theory would suggest, and even observed an opposite effect. This result, which could be confirmed by follow-up studies, raises some concerns about the robustness of the BTS method. Second, the authors conjectured that introducing an interim payment in the BTS mechanism would help reinforce its credibility in the eyes of the participants and would thus magnify its effect. However, the authors failed to detect a statistically significant difference between the standard BTS and interim-payment BTS mechanisms. Overall, the results of Neville and Williams (2025) call for some caution in the use of the BTS and for further work to better understand the contexts in which the BTS might be a useful tool to mitigate social desirability in surveys. 

This Stage 2 manuscript was evaluated over one round of in-depth review by two expert reviewers and a second round of review by the recommender. After the revisions, the recommender judged that the manuscript met the Stage 2 criteria and awarded a positive recommendation.

 
URL to the preregistered Stage 1 protocol: https://osf.io/vuh8b
 
Level of bias control achieved: Level 6. No part of the data or evidence that was used to answer the research question was generated until after IPA.
 
List of eligible PCI-RR-friendly journals:

 
References
 
1. Neville, C. M & Williams, M. N. (2025). Does Truth Pay? Investigating the Effectiveness of the Bayesian
Truth Serum with an Interim Payment: A Registered Report [Stage 2]. Acceptance of Version 4 by Peer Community in Registered Reports. https://doi.org/10.31219/osf.io/s3znc
 
2. Prelec, D. (2004). A Bayesian truth serum for subjective data. Science, 306, 462-466. https://doi.org/10.1126/science.1102081
Does Truth Pay? Investigating the Effectiveness of the Bayesian Truth Serum with an Interim Payment: A Registered Report Claire M. Neville, Matt N. Williams<p>Self-report data is vital in psychological research, but biases like careless responding and socially desirable responding (SDR) can compromise its validity. While various methods are employed to mitigate these biases, they have limitations. Th...Social sciencesRomain Espinosa2025-01-15 01:46:05 View