Announcements
=============================================================================
IMPORTANT ANNOUNCEMENT: To accommodate reviewer and recommender holiday schedules, we will be closed to ALL submissions from 1st Jul - 1st Sep. During this time, reviewers can submit reviews and recommenders can issue decisions, but no new or revised submissions can be made by authors.
The one exception to this rule is that authors using the scheduled track who submit their initial Stage 1 snapshot prior to 1st Jul can choose a date within the shutdown period to submit their full Stage 1 manuscript.
We recommend that authors submit at least 1-2 weeks prior to commencement of the shutdown period to enable time to make any required revisions prior to in-depth review.
=============================================================================
We are recruiting recommenders (editors) from all research fields!
Your feedback matters! If you have authored or reviewed a Registered Report at Peer Community in Registered Reports, then please take 5 minutes to leave anonymous feedback about your experience, and view community ratings.
Latest recommendations
Id | Title * | Authors * | Abstract * | Picture | Thematic fields * ▼ | Recommender | Reviewers | Submission date | |
---|---|---|---|---|---|---|---|---|---|
16 Jun 2023
STAGE 1
![]() Licensing via credentials: Replication of Monin and Miller (2001) with extensions investigating the domain-specificity of moral credentials and the association between the credential effect and trait reputational concernQinyu Xiao, Lok Ching Li, Ying Lam Au, Wing Tung Chung, See Ngueh Tan, Gilad Feldman https://osf.io/vrsd3Revisiting moral licensingRecommended by Chris ChambersDoes being good free people up to be bad? A large literature in social psychology suggests that it might, with evidence that “moral licensing” gives people a perception that actions deemed morally questionable, or socially undesirable, will be tolerated more readily if they have demonstrated a past history of praiseworthy, moral behaviour. In a formative study, Monin and Miller (2001) reported that having a track record of moral credentials as being nonprejudiced (e.g. non-sexist or non-racist) increased the willingness of participants to later express a prejudiced attitude. For example, in their Study 2 they found that participants who built up their moral credit by selecting a Black woman in a hypothetical recruitment task were then more willing to then prefer a White man for a second job, compared to participants who did not have the opportunity to initially recommend a Black woman. These results have prompted a burgeoning literature on moral licensing, albeit one that is mixed and has been found to exhibit substantial publication bias.
In the current study, Xiao et al. (2023) propose a large online replication of Study 2 in Monin and Miller (2001), asking whether previous moral behaviours that furnish participants with moral credentials make them more likely to then engage in morally questionable behaviours. The authors will also extend earlier work by testing whether moral credentials license immoral behaviours more effectively in the same domain (e.g. within sex) than in a different domain (e.g. across sex and race), asking whether there is a negative relationship between expression of prejudice and trait reputational concern (fear of negative evaluation), and whether moral credentials attenuate any such observed relationship.
The Stage 1 manuscript was evaluated over three rounds of in-depth review. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
URL to the preregistered Stage 1 protocol: https://osf.io/uxgrk
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA. List of eligible PCI RR-friendly journals:
References
1. Monin, B., & Miller, D. T. (2001). Moral credentials and the expression of prejudice. Journal of Personality and Social Psychology, 81, 33-43. https://psycnet.apa.org/doi/10.1037/0022-3514.81.1.33
2. Xiao, Q., Ching Li, L., Au, Y. L., Chung, W. T., Tan, S. N. & Feldman, G. (2023). Licensing via credentials: Replication of Monin and Miller (2001) with extensions investigating the domain-specificity of moral credentials and the association between the credential effect and trait reputational concern, in principle acceptance of Version 5 by Peer Community in Registered Reports. https://osf.io/uxgrk | Licensing via credentials: Replication of Monin and Miller (2001) with extensions investigating the domain-specificity of moral credentials and the association between the credential effect and trait reputational concern | Qinyu Xiao, Lok Ching Li, Ying Lam Au, Wing Tung Chung, See Ngueh Tan, Gilad Feldman | <p>This is a scheduled PCI-RR snap shot for a planned project: "Licensing via credentials: Replications of Monin and Miller (2001) with extensions investigating the domain-specificity of moral credentials and associations with trait reputational c... | Social sciences | Chris Chambers | Marek Vranka, Ethan Meyers, Štěpán Bahník | 2022-02-20 04:49:16 | View | |
15 Jul 2022
STAGE 1
![]() Registered Report: A Laboratory Experiment on Using Different Financial-Incentivization Schemes in Software-Engineering ExperimentationJacob Krüger, Gül Çalıklı, Dmitri Bershadskyy, Robert Heyer, Sarah Zabel, Siegmar Otto https://doi.org/10.48550/arXiv.2202.10985Bug detection in software engineering: which incentives work best?Recommended by Chris ChambersBug detection is central to software engineering, but what motivates programmers to perform as optimally as possible? Despite a long history of economic experiments on incentivisation, there is surprisingly little research on how different incentives shape software engineering performance. In the current study, Krüger et al. (2022) propose an experiment to evaluate how the pay-off functions associated with different financial incentives influence the performance of participants in identifying bugs during code review. The authors hypothesise that performance-based incentivisation will result in higher average performance, as defined using the F1-score, and that different incentivisation schemes may also differ in their effectiveness. As well as testing confirmatory predictions, the authors will explore a range of ancillary strands, including how the different incentivisation conditions influence search and evaluation behaviour (using eye-tracking), and the extent to which any effects are moderated by demographic factors.
The Stage 1 manuscript was evaluated over one round of in-depth review. Based on detailed responses to the recommender and reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
URL to the preregistered Stage 1 protocol: https://osf.io/s36c2 Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.
List of eligible PCI RR-friendly journals: References
1. Krüger, J., Çalıklı, G., Bershadskyy, D., Heyer, R., Zabel, S. & Siegmar, O. (2022). Registered Report: A Laboratory Experiment on Using Different Financial-Incentivization Schemes in Software-Engineering Experimentation, in principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/s36c2
| Registered Report: A Laboratory Experiment on Using Different Financial-Incentivization Schemes in Software-Engineering Experimentation | Jacob Krüger, Gül Çalıklı, Dmitri Bershadskyy, Robert Heyer, Sarah Zabel, Siegmar Otto | <p>Empirical studies in software engineering are often conducted with open-source developers or in industrial collaborations. Seemingly, this resulted in few experiments using financial incentives (e.g., money, vouchers) as a strategy to motivate ... | Social sciences | Chris Chambers | 2022-02-23 09:30:05 | View | ||
23 Jan 2023
STAGE 1
![]() Comparing time versus money in sunk cost effects: Replication of Soman (2001)Nikolay Petrov, Wenkai Song, Yin Kan (Megan) CHAN, Cheuk Nam (Chris) LAU, Tin Ho (Donald) KWOK, Lok Ching (Estelle) CHOW, Wai Yan (Vivian) LO, Gilad Feldman (gfeldman@hku.hk) https://osf.io/twehuAre sunk cost effects weaker for time than money?Recommended by Chris ChambersThe sunk cost fallacy is a cognitive bias in which people persist with a decision that is no longer optimal because of previous resources they have invested (now considered to be spent or “sunk”). Most of us will have heard sunk costs reflected in the saying “throwing good money after bad”, but sunk costs can, in theory, occur more broadly, whether for money, time or any other resource-limited investment. The sunk cost effect for money has been widely studied and appears robust; in contrast, the sunk cost effect for time is more uncertain, and is potentially moderated by the age of respondents (and likely resource availability), the fact that time is irreplaceable, and the tendency for people to account for time less easily than they do for money. In an impactful study, Soman (2001) found that the sunk cost effect for time was indeed weaker than for money, although this finding has not been widely replicated.
In the current study, Petrov et al. (2023) propose a replication of three studies from Soman (2001), asking whether sunk costs are weaker for time than for money, and then testing whether the relative absence of a sunk time cost arises from the inability of participants to account for time or due to more rational beliefs in the evaluation of past time investments.
The Stage 1 manuscript was evaluated over two rounds of in-depth review. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
URL to the preregistered Stage 1 protocol: https://osf.io/65htv Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.
List of eligible PCI RR-friendly journals:
References
1. Soman, D. (2001). The mental accounting of sunk time costs: Why time is not like money. Journal of Behavioral Decision Making,14, 169-185. https://doi.org/10.1002/bdm.370
2. Petrov, N. B., Chan, Y. K., Lau, C. N., Kwok, T. H., Chow, L. C., Lo, W. Y. V, Song W., & Feldman, G. (2023). Sunk cost effects for time versus money: Replication of Soman (2001) [Registered Report Stage 1], in principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/u34zb
| Comparing time versus money in sunk cost effects: Replication of Soman (2001) | Nikolay Petrov, Wenkai Song, Yin Kan (Megan) CHAN, Cheuk Nam (Chris) LAU, Tin Ho (Donald) KWOK, Lok Ching (Estelle) CHOW, Wai Yan (Vivian) LO, Gilad Feldman (gfeldman@hku.hk) | <p>This is a scheduled PCI-RR snap shot for a planned project: "Comparing time versus money in sunk cost effects: Replication of Soman (2001) "</p> | Social sciences | Chris Chambers | 2022-02-23 10:39:42 | View | ||
21 Nov 2022
STAGE 1
![]() Revisiting the motivated denial of mind to animals used for food: Replication and extension of Bastian et al. (2012)Tyler P. Jacobs, Meiying Wang, Stefan Leach, Siu Ho Loong, Mahika Khanna, Ka Wan Chan, Ho Ting Chau, Yuen Yan Tam, Gilad Feldman https://osf.io/gs4u3Does denial of animal minds explain the "meat paradox"?Recommended by Chris ChambersThe psychology of meat-eating offers a fascinating window into moral reasoning, cognition and emotion, as well as applications in the shift toward more sustainable and ethical alternatives to meat consumption. One key observation in this field is the so-called “meat paradox” – the tendency for people to simultaneously eat meat while also caring about animals. One way to resolve this conflict and reduce cognitive dissonance is for people to separate the concept of meat from animals, mentally disengaging from the origins of meat in order to make the act of consumption more ethically acceptable. Another potential explanation is a motivated “denial of mind”, in which people believe that animals lack the mental capacity to experience suffering; therefore, eating an animal is not a harm that the animal will experience. In support of the latter hypothesis, Bastian et al (2012) found that animals judged to have greater mental capacities were also judged to less edible, and that simply reminding meat eaters that an animal was being raised for the purposes of meat consumption led to denial of its mental capacities.
Using a large-scale online design in 1000 participants, Jacobs et al. (2022) propose a replication of two studies from Bastian et al. (2012): asking how the perceived mental capabilities of animals relates to both their perceived edibility and the degree of moral concern they elicit, and whether learning that an animal will be consumed influences perceptions of its mental capabilities. Among various exploratory analyses, the authors will also examine whether the perception of animal minds (in animals consumed for meat) varies systematically according to species.
The Stage 1 manuscript was evaluated over two rounds of in-depth review. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
URL to the preregistered Stage 1 protocol: https://osf.io/cru4z Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.
List of eligible PCI RR-friendly journals:
References
1. Bastian, B., Loughnan, S., Haslam, N., & Radke, H. R. M. (2012). Don’t mind meat? The denial of mind to animals used for human consumption. Personality and Social Psychology Bulletin, 38, 247–256. https://doi.org/10.1177/0146167211424291
2. Jacobs, T. P., Wang, M., Leach, S., Loong, S. H., Khanna, M., Chan, K. W., Chau, H. T., Tam, Y. Y. & Feldman, G. (2022). Revisiting the motivated denial of mind to animals used for food: Replication and extension of Bastian et al. (2012), in principle acceptance of Version 2 by Peer Community in Registered Reports. https://osf.io/cru4z
| Revisiting the motivated denial of mind to animals used for food: Replication and extension of Bastian et al. (2012) | Tyler P. Jacobs, Meiying Wang, Stefan Leach, Siu Ho Loong, Mahika Khanna, Ka Wan Chan, Ho Ting Chau, Yuen Yan Tam, Gilad Feldman | <p>This is a scheduled PCI-RR snap shot for a planned project: "Revisiting the motivated denial of mind to animals used for food: Replication and extension of Bastian et al. (2012) "</p> | Social sciences | Chris Chambers | Florian Lange, Ben De Groeve, Sebastian Berger, Brock Bastian | 2022-03-04 04:21:18 | View | |
20 Apr 2023
STAGE 1
![]() The relationship of memory consolidation with task incorporations into dreams – A registered reportSarah F. Schoch, Somayeh Ataei, Leila Salvesen, Michael Schredl, Jennifer Windt, Giulio Bernardi, Björn Rasch, Nikolai Axmacher, and Martin Dresler https://osf.io/h9t3vAre dreams important for memory consolidation?Recommended by Chris ChambersSleep is known to be crucial for human memory, but what about dreams? Previous research has shown that the content of dreams can be manipulated by specific stimuli or tasks prior to sleep, but whether incorporating tasks into dreams influences memory consolidation is less clear. Some studies have shown an association between incorporating memory tasks into dreams and later memory performance, while others show either no effect or weaker effects. Potential reasons for this variation include the targeting of different stages of sleep – including rapid eye moment (REM) and non-REM stages (NREM) – small sample sizes, and the fact that many previous studies do not employ declarative memory tasks, which have been found to benefit more from sleep compared with tasks that target procedural memory.
In the current study. Schoch et al. (2023) ask whether dreams are an epiphenomenon of sleep-dependent memory processing or, instead, whether they play a key role in memory consolidation – and if so, whether that role differs for subjective experiences during NREM and REM sleep stages. Using a declarative memory task, a serial awakening paradigm (in which participants are woken and tested during NREM or REM stages), and targeted memory reactivation (TMR), the authors will test two main hypotheses: that incorporating picture categories of a declarative memory task leads to immediate (next morning) and sustained (4 days later) improvement in memory performance (especially for NREM dreams); and second, whether TMR influences the reported content of dreams. The authors also build in a range of control analyses to confirm that the task was incorporated successfully into dreams and that TMR benefited memory performance.
The Stage 1 manuscript was evaluated over two rounds of in-depth review, initially at Nature Communications before being transferred to PCI RR for further evaluation (see review history below for details). Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
URL to the preregistered Stage 1 protocol: https://osf.io/7dwjz Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.
List of eligible PCI RR-friendly journals:
References
1. Schoch, S. F., Ataei, S., Salvesen, L., Schredl, M., Windt, J., Bernadi, G., Rasch, B., Axmacher, N., & Desler, M. (2023). The relationship of memory consolidation with task incorporations into dreams – A registered report, in principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/7dwjz
| The relationship of memory consolidation with task incorporations into dreams – A registered report | Sarah F. Schoch, Somayeh Ataei, Leila Salvesen, Michael Schredl, Jennifer Windt, Giulio Bernardi, Björn Rasch, Nikolai Axmacher, and Martin Dresler | <p>Sleep is crucial for memory consolidation, but whether dreams play an essential role in memory consolidation is still unknown. This research will examine if incorporating a memory task into dreams benefits memory strength in a sleep-stage-depen... | Social sciences | Chris Chambers | 2022-03-23 13:49:52 | View | ||
24 Oct 2024
STAGE 1
![]() Knowing why: Children’s reflection on their own uncertainty about an adult’s surprising claim increases their tendency to test that claimTone Hermansen, Kamilla Mathisen, Samuel Ronfard https://osf.io/uq6dwDoes metacognition influence how children test surprising claims?Recommended by Chris ChambersAs children grow, their cognition develops alongside their metacognition – the awareness and understanding of their own thought processes. One important aspect of cognitive development is learning effective strategies for exploring new situations and testing surprising claims, prompting the question of how improvement in cognition and reasoning is related to metacognitive understanding of these processes. For example, as children develop more targeted and efficient exploration strategies to test a surprising claim (e.g. “of these three rocks, the smallest one is the heaviest”), metacognitive understanding of why they are uncertain or skeptical may be crucial to testing the claim effectively and, in the long run, developing more complex reasoning and logical skills.
In this lab-based study of 175 children, Hermansen et al. (2022) will test the role of metacognition in shaping how children search for information to test surprising claims. Using a series of measures – including an experimental task involving comparative claims (e.g. “this rubber duck sinks much faster than this metal button”) – the authors will ask whether older (relative to younger) children express more uncertainty about surprising claims, propose more plausible reasons for their uncertainty, and are more likely to suggest specific empirical tests for a claim. Furthermore, they will investigate whether prompting children to reflect on their uncertainty helps them devise an efficient test for the claim, and whether any such benefit of prompting is greater for younger children.
The Stage 1 manuscript was evaluated over two rounds of in-depth review. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
URL to the preregistered Stage 1 protocol: https://osf.io/uq6dw
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA. List of eligible PCI RR-friendly journals:
References
1. Hermansen T. K., Mathisen, K. F., & Ronfard, S. (2022). Knowing why: Children’s reflection on their own uncertainty about an adult’s surprising claim increases their tendency to test that claim, in principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/uq6dw
| Knowing why: Children’s reflection on their own uncertainty about an adult’s surprising claim increases their tendency to test that claim | Tone Hermansen, Kamilla Mathisen, Samuel Ronfard | <p>Hearing about surprising phenomena triggers exploration, even in young children. This exploration increases and changes with age. It becomes more targeted and efficient with children around 6-years-old clearly exploring with the intent to verif... | Social sciences | Chris Chambers | 2022-05-09 18:10:57 | View | ||
17 Jan 2023
STAGE 1
![]() How long does it take to form a habit?: A Multi-Centre Replicationde Wit, S., Bieleke, M., Fletcher, P.C., Horstmann, A., Schüler, J., Brinkhof, L.P., Gunschera, L.J., Murre, J.M.J. https://osf.io/hpsft/?view_only=c8ec62553146496e8b5e4d100a0f08b5How much practice is needed before daily actions are performed in a way that feels habitual?Recommended by Zoltan DienesEven small changes in daily life can have a significant impact on one’s health, for example going to the gym at regular times and eating a healthy breakfast. But how long must we do something before it becomes a habit? Lally et al. (2010) tracked the subjective automaticity of a novel, daily (eating or exercise-related) routine. Based on 39 participants, they found a median time of 66 days. This estimate has never been replicated with their exact procedure, so the question remains of how well this holds up. Yet the estimate is useful for knowing how long we have to effortfully make ourselves perform an action until we will do it automatically.
In the current study, de Wit et al. (2023) propose a four-centre near-exact replication of Lally et al. (2010), for which they aim to test 800 subjects to provide a precise estimate of the time it takes to form a habit.
The Stage 1 manuscript was evaluated over four rounds of review. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
URL to the preregistered Stage 1 protocol: https://osf.io/bj9r2 Level of bias control achieved: Level 4. At least some of the data/evidence that will be used to answer the research question already exists AND is accessible in principle to the authors (e.g. residing in a public database or with a colleague), BUT the authors certify that they have not yet accessed any part of that data/evidence.
List of eligible PCI RR-friendly journals:
References
1. Lally, P., van Jaarsveld, C. H. M., Potts, H. W. W., & Wardle, J. (2010). How are habits formed: Modelling habit formation in the real world. European Journal of Social Psychology, 40, 998–1009. https://doi.org/10.1002/ejsp.674
2. de Wit, S., Bieleke, M., Fletcher, P. C., Horstmann, A., Schüler, J., Brinkhof, L. P., Gunschera, L. J., AND Murre, J. M. J. (2023). How long does it take to form a habit?: A Multi-Centre Replication, in principle acceptance of Version 4 by Peer Community in Registered Reports. https://osf.io/bj9r2
| How long does it take to form a habit?: A Multi-Centre Replication | de Wit, S., Bieleke, M., Fletcher, P.C., Horstmann, A., Schüler, J., Brinkhof, L.P., Gunschera, L.J., Murre, J.M.J. | <p>How long does it take to form a habit? This question will be addressed by an innovative study by Lally et al. (2010), in which they tracked the subjective automaticity of a novel, daily (eating or exercise-related) routine, using the Self-Repor... | Social sciences | Zoltan Dienes | 2022-05-26 09:54:26 | View | ||
23 Jan 2023
STAGE 1
![]() Responding to Online Toxicity: Which Strategies Make Others Feel Freer to Contribute, Believe That Toxicity Will Decrease, and Believe that Justice Has Been Restored?Alison I. Young Reusser, Houghton University; Kristian Veit, Olivet Nazarene University; Lisa Gassin, Olivet Nazarene University; Jonathan Case, Houghton University https://osf.io/hfjnbTesting antidotes to online toxicityRecommended by Chris ChambersSocial media is a popular tool for online discussion and debate, bringing with it various forms of hostile interactions – from offensive remarks and insults, to harassment and threats of physical violence. The nature of such online toxicity has been well studied, but much remains to be understood regarding strategies to reduce it. Existing theory and evidence suggests that a range of responses – including those that emphasise prosociality and empathy – might be effective at mitigating online toxicity. But do such strategies work in practice?
In the current study, Young Reusser et al (2023) propose an experiment to test the effectiveness of three types of responses to online toxicity – Benevolent Correction (including disagreement), Benevolent Going Along (including joking/agreement), or Retaliation (additional toxicity) – on how able participants feel to contribute to conversations, their belief that the toxicity would be reduced by the intervention, and their belief that justice had been restored. The findings promise to shed light on approaches for improving the health of online discourse.
The Stage 1 manuscript was evaluated over two rounds of in-depth review. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
URL to the preregistered Stage 1 protocol: https://osf.io/hfjnb (under temporary private embargo) Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.
List of eligible PCI RR-friendly journals: References
1. Young Reusser, A. I., Veit, K. M., Gassin, E. A., & Case, J. P. (2023). Responding to Online Toxicity: Which Strategies Make Others Feel Freer to Contribute, Believe That Toxicity Will Decrease, and Believe that Justice Has Been Restored? In principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/hfjnb
| Responding to Online Toxicity: Which Strategies Make Others Feel Freer to Contribute, Believe That Toxicity Will Decrease, and Believe that Justice Has Been Restored? | Alison I. Young Reusser, Houghton University; Kristian Veit, Olivet Nazarene University; Lisa Gassin, Olivet Nazarene University; Jonathan Case, Houghton University | <p>When we encounter toxic comments online, how might individual efforts to reply to those comments improve others’ experiences conversing in that forum? Is it more helpful for others to publicly, but benevolently (with a polite tone, demonstrated... | Social sciences | Chris Chambers | 2022-06-08 18:35:48 | View | ||
Taking A Closer Look At The Bayesian Truth Serum: A Registered ReportPhilipp Schoenegger & Steven Verheyen https://doi.org/10.31219/osf.io/9zvqjReassessing the use of the Bayesian Truth Serum as an incentive-compatible design for self-reportsRecommended by Ljerka OstojicDifferent disciplines and research areas that rely on participants’ self-reports to accrue data on participants’ true preferences are faced with the question to what extent the former can be equated with the latter. Using monetary incentivisation for study participation may influence this relationship, and researchers, especially in economics, have been discussing how to develop and implement incentive-compatible research designs, i.e., those in which the incentivisation yields the best payoff for the participant if they report their true preferences (Hertwig & Ortmann, 2011; Baillon, 2017). The Bayesian Truth Serum, first introduced by Prelec (2004), according to which participants are rewarded based on how surprisingly common their own answers are relative to the actual distribution of answers, has been proposed as a possible incentive-compatible design for survey studies that rely on participants’ self-reports about their true preferences (Schoenegger, 2021).
In this study, Schoenegger and Verheyen (2022) ran a replication of the study by Schoenegger (2021) and assessed whether the effect elicited by the manipulations known as the Bayesian Truth Serum is distinct from its separate constituent parts. The authors report that the manipulation did not yield a significant difference compared to control conditions, which they interpret as a failure to replicate the original results. At the same time, the authors are careful in drawing conclusions as to the usefulness of the Bayesian Truth Serum for self-report studies using Likert-scale items in general, as they emphasise that smaller effect sizes may be of interest and that the results may differ when different items are used.
The Stage 2 manuscript was evaluated by two reviewers, one of whom reviewed the first Stage 1 submission, and the other one of whom reviewed the manuscript specifically to assess statistical questions.
Following a careful revision by the authors, the recommender judged that the manuscript meets the Stage 2 criteria and awarded a positive recommendation.
URL to the preregistered Stage 1 protocol: https://osf.io/dkvms
Level of bias control achieved: Level 6. No part of the data or evidence that was used to answer the research question existed prior to Stage 1 in-principle acceptance.
List of eligible PCI RR-friendly journals:
References
1. Baillon, A. (2017). Bayesian markets to elicit private information. Proceedings of the National Academy of Science, 114(30), 7985-7962. https://doi.org/10.1073/pnas.1703486114
2. Hertwig, R. & Ortmann (2001). Experimental practices in economics: a methodlogical challenge for psychologists? Behavioral and Brain Sciences, 24(3), 383-403. https://doi.org/10.1037/e683322011-032
3. Prelec, D. (2004). A Bayesian Truth Serum for Subjective Data. Science, 306(5695), 462-466. https://doi.org/10.1126/science.1102081
4. Schoenegger, P. (2021). Experimental Philosophy and the Incentivisation Challenge: a Proposed Application of the Bayesian Truth Serum. Review of Philosophy and Psychology https://doi.org/10.1007/s13164-021-00571-4
5. Schoenegger, P., & Verheyen, S. (2022). Taking A Closer Look At The Bayesian Truth Serum: A Registered Report. Stage 2 Registered Report, in principle acceptance of Version 3 by Peer Community in Registered Reports. https://doi.org/10.31219/osf.io/9zvqj
| Taking A Closer Look At The Bayesian Truth Serum: A Registered Report | Philipp Schoenegger & Steven Verheyen | <p>Over the past decade, psychology and its cognate disciplines have undergone substantial scientific reform, ranging from advances in statistical methodology to significant changes in academic norms. One aspect of experimental design that has rec... | Social sciences | Ljerka Ostojic | 2022-06-11 14:39:38 | View | ||
18 Nov 2022
STAGE 1
![]() Fathers learning on the job: Role of Paternity Leave Duration on Paternal Infant-Directed Speech and Preference for Male Infant-Directed Speech in infantsSilje Robberstad, Natalia Kartushina & Julien Mayor https://osf.io/34h6q?view_only=ab6bac8006444a22a5b3ede3ce6a1173Dads and baby talk: understanding the role of paternal interaction in infant-directed speechRecommended by Chris ChambersInfant-directed speech (IDS) – colloquially known as “baby talk” – is a form of speech produced by parents that may be important for emotional bonding with children while also helping infants with early language development. In contrast to adult-directed speech (ADS), IDS is characterised by a higher and broader pitch range, slower speech rate, and shorter/simpler syntax. A significant body of research has studied the dynamics of IDS and shown that infants prefer IDS over ADS, however the great majority of this work has focused on maternal speech, leaving much to be discovered about the differences and similarities between paternal and maternal IDS, the relative preference infants exhibit for paternal IDS compared with ADS, and the role of paternal interaction in shaping these dynamics.
Using a Norwegian sample of 70 fathers and children, the proposed study by Robberstad et al. (2022) takes an important step into this less-explored domain, asking whether (and if so, how) fathers employ IDS when interacting with infants, whether any such modulation of speech is related to the amount of time they spend as a caregiver, whether infants show the same preferences for IDS over ADS in fathers as observed previously in mothers, and whether that preference is related to the amount of exposure the infant has to parental speech. The authors will analyse speech modulation using acoustic analysis, while preference for IDS will be tested using eye-tracking to measure infants’ overt gaze orientation while listening to IDS vs ADS.
The Stage 1 manuscript was evaluated over two rounds of in-depth review. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
URL to the preregistered Stage 1 protocol: https://osf.io/c43xu
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA. List of eligible PCI RR-friendly journals:
References
1. Robberstad, S., Kartushina, N. & Mayor, J. (2022). Fathers learning on the job: Role of paternity leave duration on paternal infant-directed speech and preference for male infant-directed speech in infants, in principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/sjupt
| Fathers learning on the job: Role of Paternity Leave Duration on Paternal Infant-Directed Speech and Preference for Male Infant-Directed Speech in infants | Silje Robberstad, Natalia Kartushina & Julien Mayor | <p>The acoustic properties of infant-directed speech (IDS) and the functions that IDS may serve in language development have been highly debated in research. However, previous research has mostly explored IDS in mothers and the preference for mate... | Social sciences | Chris Chambers | 2022-06-27 20:53:13 | View |
FOLLOW US
MANAGING BOARD
Chris Chambers
Zoltan Dienes
Corina Logan
Benoit Pujol
Maanasa Raghavan
Emily S Sena
Yuki Yamada