Submit a report

Announcements

Please note that we will be CLOSED to ALL SUBMISSIONS from 1 December 2024 through 12 January 2025 to give our recommenders and reviewers a holiday break.

We are recruiting recommenders (editors) from all research fields!

Your feedback matters! If you have authored or reviewed a Registered Report at Peer Community in Registered Reports, then please take 5 minutes to leave anonymous feedback about your experience, and view community ratings.

Latest recommendationsrssmastodon

IdTitle * Authors * Abstract * PictureThematic fields * RecommenderReviewersSubmission date
15 Jul 2022
STAGE 1

Registered Report: A Laboratory Experiment on Using Different Financial-Incentivization Schemes in Software-Engineering Experimentation

Bug detection in software engineering: which incentives work best?

Recommended by ORCID_LOGO based on reviews by Edson OliveiraJr and 1 anonymous reviewer
Bug detection is central to software engineering, but what motivates programmers to perform as optimally as possible? Despite a long history of economic experiments on incentivisation, there is surprisingly little research on how different incentives shape software engineering performance. In the current study, Krüger et al. (2022) propose an experiment to evaluate how the pay-off functions associated with different financial incentives influence the performance of participants in identifying bugs during code review. The authors hypothesise that performance-based incentivisation will result in higher average performance, as defined using the F1-score, and that different incentivisation schemes may also differ in their effectiveness. As well as testing confirmatory predictions, the authors will explore a range of ancillary strands, including how the different incentivisation conditions influence search and evaluation behaviour (using eye-tracking), and the extent to which any effects are moderated by demographic factors.
 
The Stage 1 manuscript was evaluated over one round of in-depth review. Based on detailed responses to the recommender and reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
 
URL to the preregistered Stage 1 protocol: https://osf.io/s36c2
 
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA. 
 
List of eligible PCI RR-friendly journals:
 
 
References
 
1. Krüger, J., Çalıklı, G., Bershadskyy, D., Heyer, R., Zabel, S. & Siegmar, O. (2022). Registered Report: A Laboratory Experiment on Using Different Financial-Incentivization Schemes in Software-Engineering Experimentation, in principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/s36c2
Registered Report: A Laboratory Experiment on Using Different Financial-Incentivization Schemes in Software-Engineering ExperimentationJacob Krüger, Gül Çalıklı, Dmitri Bershadskyy, Robert Heyer, Sarah Zabel, Siegmar Otto<p>Empirical studies in software engineering are often conducted with open-source developers or in industrial collaborations. Seemingly, this resulted in few experiments using financial incentives (e.g., money, vouchers) as a strategy to motivate ...Social sciencesChris Chambers2022-02-23 09:30:05 View
06 Jul 2022
STAGE 2
(Go to stage 1)

Ontological Diversity in Gaming Disorder Measurement: A Nationally Representative Registered Report

Different ontologies, different constructs? Instruments for gaming-related health problems identify different groups of people and measure different problems

Recommended by ORCID_LOGO based on reviews by Daniel Dunleavy and David Ellis
Screening instruments that aim to provide diagnostic classifications of gaming-related health problems derive from different ontologies and it is not known whether they identify equivalent prevalence rates of ‘gaming disorder’ or even the same individuals. Underpinned by this, Karhulahti et al. (2022) assessed how screening instruments that derive from different ontologies differ in identifying associated problem groups. A nationally representative sample of 8217 Finnish participants completed four screening measures to assess the degree of overlap between identified prevalence (how many?), who they identify (what characteristics?) and the health of their identified groups (how healthy?).
 
The results indicate that measures based on the ICD-11, DSM-5, DSM-IV, and self-assessment appear to be associated with lower mental health. However, these measures of gaming-related health problems differed significantly in terms of prevalence and/or overlap, suggesting that they identify different groups of people and that different problems or constructs are being measured by different instruments. These findings are important because they contribute to the rapidly growing literature on the ‘fuzziness’ of  constructs and measures relating to technology use. The authors recommend that researchers working with these measures should: (a) define their construct of interest; and (b) evaluate the construct validity of their instruments. Being able to answer these questions will enhance research quality and contribute to strengthened meta-analyses. Importantly, this will prevent hype around gaming-related disorders, allowing researchers to communicate clearly and appropriately without risk of confusing related yet different constructs.
 
The Stage 2 manuscript was evaluated by two of the reviewers who assessed it at Stage 1. Following revision, the recommender judged that the manuscript met the Stage 2 criteria and awarded a  positive recommendation. To ensure that the manuscript met the requirements of the PCI RR TOP guidelines, prior to this acceptance an email communication was sent to the authors by the recommender to ensure that study data were openly available on a temporary OSF link before the final data archive is full validated by the Finnish Social Sciences Data Archive (FSD). This is noted in the recommended preprint.
 
URL to the preregistered Stage 1 protocol: https://osf.io/usj5b
 
Level of bias control achieved: Level 6. No part of the data or evidence that was used to answer the research question existed prior to Stage 1 in-principle acceptance.
 
List of eligible PCI RR-friendly journals:
 
 
References
 
1. Karhulahti V.-M., Vahlo J., Martončik M., Munukka M., Koskimaa R. and Bonsdorff M. (2022). Ontological Diversity in Gaming Disorder Measurement: A Nationally Representative Registered Report. Peer-reviewed and recommended at Stage 2 by Peer Community in Registered Reports https://psyarxiv.com/qytrs
Ontological Diversity in Gaming Disorder Measurement: A Nationally Representative Registered ReportVeli-Matti Karhulahti, Jukka Vahlo, Marcel Martončik, Matti Munukka, Raine Koskimaa, Mikaela von Bonsdorff<p>Gaming-related health problems have been researched since the 1980s with numerous different “ontologies” as reference systems, from self-assessed “game addiction” to “pathological gambling” (in the DSM-IV), “internet gaming disorder” (in the 3r...Medical Sciences, Social sciencesCharlotte Pennington2022-05-23 16:14:04 View
30 Jun 2022
STAGE 1

Revisiting and updating the risk-benefits link: Replication of Fischhoff et al. (1978) with extensions examining pandemic related factors

Understanding the relationship between the perception of risks and benefits

Recommended by ORCID_LOGO based on reviews by Katherine Fox-Glassman, Bjørn Sætrevik, Richard Brown and Toby Wise
Everyday decisions involve weighing up many kinds of risks and benefits, prompting the question of how our perception of those risks relates to our perception of the associated benefits. Intuitively, we might assume that behaviours or practices that are judged by society as riskier would also be seen as carrying greater potential benefits, in keeping with the expression “high risk, high reward”. The psychology of risk perception, however, appears to be more complex. In a seminal study, Fischhoff et al. (1978) in fact found the opposite pattern: that perceived risk and perceived benefit were negatively correlated – behaviours or practices that were perceived to be higher risk tended to be perceived as carrying lower benefits. This counterintuitive finding has had a significant impact on the field of judgment and decision making, despite being subjected only rarely to close replication.
 
Using a large-scale online design, Frank and Feldman (2022) propose a replication that incorporates key elements of Fischhoff et al. (1978) as well as a recent replication by Fox-Glassman et al. (2016). In particular, the authors will reassess the strength and directionality of the relationship between perceived risks and perceived benefits, and how these relate to both risk characteristics and acceptable levels of risk. As part of a series of exploratory extensions, they will also examine the risk/benefit relationship for policies and practices related to the Covid-19 pandemic, including vaccinations, lockdowns, and social distancing.
 
The Stage 1 manuscript was evaluated over two rounds of in-depth review. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
 
URL to the preregistered Stage 1 protocol: https://osf.io/bx93v
 
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA. 
 
List of eligible PCI RR-friendly journals:
 
References
 
1. Fischhoff, B., Slovic, P., Lichtenstein, S., Read, S., & Combs, B. (1978). How safe is safe enough? A psychometric study of attitudes towards technological risks and benefits. Policy Sciences, 9, 127-152. https://doi.org/10.1007/BF00143739 
 
2. Fox-Glassman, K. T. & Weber, E. U. (2016). What makes risk acceptable? Revisiting the 1978 psychological dimensions of perceptions of technological risks. Journal of Mathematical Psychology, 75, 157-169. https://doi.org/10.1016/j.jmp.2016.05.003
 
3. Frank, J. M. & Feldman, G. (2022). Revisiting and updating the risk-benefits link: Replication of Fischhoff et al. (1978) with extensions examining pandemic related factors, in principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/bx93v
Revisiting and updating the risk-benefits link: Replication of Fischhoff et al. (1978) with extensions examining pandemic related factorsJason M. Frank, Gilad Feldman<p>This is a scheduled PCI-RR snap shot for a planned project: "Revisiting and updating the risk-benefits link: Replication of Fischhoff et al. (1978) with extensions examining pandemic related factors ​"</p>Social sciencesChris Chambers2022-02-15 09:21:15 View
29 Jun 2022
STAGE 1
article picture

Go above and beyond: Does input variability affect children’s ability to learn spatial adpositions in a novel language?

Can discriminative learning theory explain productive generalisation in language?

Recommended by ORCID_LOGO based on reviews by Julien Mayor, Natalia Kartushina, Caroline Rowland and 1 anonymous reviewer
One of the major challenges in studies of language learning is understanding productive generalisation – the ability to use words and linguistic structures in novel settings that the learner has never encountered previously. According to discriminative learning theory, this skill arises from an iterative process of prediction and error-correction that gradually reduces uncertainty, allowing learners to discriminate linguistic outcomes and to identify informative, invariant cues for generalisation to novel cases. In the current study, Viviani et al (2022) use computational modelling to propose a central hypothesis stemming from this theory that children will learn the meaning and use of spatial adpositions (words such as “above” and “below” that describe relative positions) more effectively when there is more variability in the use of the nouns within the spatial sentences. They will also test a range of additional hypotheses, including that learning and generalisation to novel contexts will be enhanced when children learn from skewed distributions that are similar to those found in natural languages.
 
The Stage 1 manuscript was evaluated over two rounds of in-depth review. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
 
URL to the preregistered Stage 1 protocol: https://osf.io/37dxr
 
Level of bias control achieved: Level 6. Some of the data that will be used in the preregistered analyses was obtained in the second of two pilot experiments. However, since no further revisions to the analysis plan were made after this pilot, the risk of bias due to prior data observation remains zero, and the manuscript therefore qualifies for Level 6.
 
List of eligible PCI RR-friendly journals:
 
References
 
1. Viviani, E., Ramscar, M. & Wonnacott, E. (2022). Go above and beyond: Does input variability affect children’s ability to learn spatial adpositions in a novel language? In principle acceptance of Version 4 by Peer Community in Registered Reports. https://osf.io/37dxr
Go above and beyond: Does input variability affect children’s ability to learn spatial adpositions in a novel language?Eva Viviani1, Michael Ramscar2, Elizabeth Wonnacott1 [1: University of Oxford, 2: University of Tübingen]<p>Human language is characterized by productivity, that is, the ability to use words and structures in novel contexts. How do learners acquire these productive systems? Under a <em>discriminative learning approach,</em> language learning involves...Social sciencesChris Chambers2021-11-15 15:04:42 View
21 Jun 2022
STAGE 1

Pathway between Negative Interpretation Biases and Psychological Symptoms: Rumination as a Transdiagnostic Mediator in a Longitudinal Study

Probing the interaction between interpretation bias and repetitive negative thinking in subclinical psychopathology

Recommended by ORCID_LOGO based on reviews by Ariana Castro and Rita Pasion
Research in clinical psychology has found that interpretation bias (perceiving ambiguous information in a systematically negative or hostile way) and repetitive negative thinking (recurrent, prolonged worry or rumination) are associated with a range of psychopathologies – including depression, anxiety and paranoia – but the complex interplay between them in driving symptomatology is unclear. Here, Chung and Cheung (2022) propose a longitudinal examination of the directional relationship between interpretation bias and psychological symptoms in subclinical depression and paranoia, as well as the potential transdiagnostic mediating role of repetitive negative thinking. Using an online three-wave design, they ask whether the association between negative interpretation biases and psychological symptoms is bidirectional, whether negative interpretation biases are associated with repetitive negative thinking over time, and whether repetitive negative thinking is associated with psychological symptoms over time. They will also test whether negative interpretation biases and psychological symptoms exert reciprocal influences across dimensions through repetitive negative thinking, and whether repetitive negative thinking acts as a transdiagnostic mediator for depression and paranoid thoughts. Overall, the study aims to generate a clearer understanding of the relationship between interpretation biases and subclinical symptomatology, as well as clarifying the role of rumination as a transdiagnostic mechanism that mediates psychopathology.
 
The Stage 1 manuscript was evaluated over two rounds of in-depth review. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
 
URL to the preregistered Stage 1 protocol: https://osf.io/89n7u (currently under private embargo)
 
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA. 
 
List of eligible PCI RR-friendly journals:
 
References
 
1. Chung, H.-F. & Cheung, S.-H. (2022). Repetitive negative thinking as a transdiagnostic mediator in the interplay of interpretation biases and psychological symptoms in depression and paranoia: A three-wave longitudinal study, in principle acceptance of Version 4 by Peer Community in Registered Reports. https://osf.io/89n7u
Pathway between Negative Interpretation Biases and Psychological Symptoms: Rumination as a Transdiagnostic Mediator in a Longitudinal StudyChung, Ho-Fung, Cheung, Sing-Hang, <h4>​Background</h4> <p>The association between interpretation biases and content-relevant symptoms have been well-established but no studies have investigated their cause-and-effect relationship in a prospective longitudinal design. To date, the...Social sciencesChris Chambers Ariana Castro, Rita Pasion2022-02-17 05:36:23 View
20 Jun 2022
STAGE 1

Revisiting stigma attributions and reactions to stigma: Replication and extensions of Weiner et al. (1988)

Understanding the psychology of stigmas

Recommended by ORCID_LOGO based on reviews by Charlotte Pennington and Joanne Rathbone
Stigmas are prejudices or discrimination against people based on qualities that vary from the norm, such as a physical or mental illness, disability, sexuality, race, or one of many other personal characteristics. The harm caused by stigmatisation has made understanding the causes and potential solutions a vital area of study in psychology and public health. One of the major focuses of ongoing research is understanding the factors that determine whether a particular characteristic becomes stigmatised, and if so how the stigma might be eliminated. Previous research has found that for disease-based stigmas, the contagiousness, course, and disruptiveness of a disease can be influential. Another key determinant is the perceived cause of the stigmatised condition or characteristic. In a landmark study, Weiner et al. (1988) reported that attributes based on physical health were more likely to be perceived as being uncontrollable, stable and irreversible, prompting feelings of sympathy without anger or judgment. On the other hand, attributes related to mental health and behaviour were more likely to be regarded as controllable and reversible, prompting lack of sympathy coupled with feelings of anger and negative judgement. In a second experiment, they also found that manipulating the perception of controllability can modify emotional responses and judgments – for some stigmas (but not others), providing participants with information that a particular characteristic was controllable vs. uncontrollable was found to increase or decrease negative attributions, respectively.
 
In the current study, Yeung and Feldman (2022) propose to replicate Experiment 2 from Weiner et al. (1988) in a large online sample. In particular, they plan to ask how the source of a stigma is related to perceived controllability and stability, emotional reactions, and willingness to help. They also propose a range of extensions, including the inclusion of additional stigmas that have become relevant since the original study was published over 30 years ago.
 
The Stage 1 manuscript was evaluated over two rounds of in-depth review. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
 
URL to the preregistered Stage 1 protocol: https://osf.io/k957f
 
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA. 
 
List of eligible PCI RR-friendly journals:
 
References
 
1. Weiner, B., Perry, R. P., & Magnusson, J. (1988). An attributional analysis of reactions to stigmas. Journal of Personality and Social Psychology, 55, 738–748. https://doi.org/10.1037/0022-3514.55.5.738
 
2. Yeung, K. Y. & Feldman, G. (2022). Revisiting stigma attributions and reactions to stigma: Replication and extensions of Weiner et al. (1988), in principle acceptance of Version 2 by Peer Community in Registered Reports. https://osf.io/k957f
Revisiting stigma attributions and reactions to stigma: Replication and extensions of Weiner et al. (1988)Kwan Yin (Gladys) Yeung, Gilad Feldman <p>This is a scheduled PCI-RR snap shot for a planned project: "Revisiting stigma attributions and reactions to stigma: Replication and extensions of Weiner et al. (1988) ​"</p>Social sciencesChris Chambers Joanne Rathbone2022-02-15 10:55:13 View
13 Jun 2022
STAGE 1

Revisiting the link between true-self and morality: Replication and extensions of Newman, Bloom and Knobe (2014) Studies 1 and 2

Replicating positive evaluations of our "true selves"

Recommended by ORCID_LOGO based on reviews by Andrew Christy, Cillian McHugh, Caleb Reynolds and Sergio Barbosa
The concept of a “true self” – the deepest and most genuine part of a person’s personality – is fundamental to many aspects of psychology, with influences that extend deep into society and culture. For decades, research in psychology has consistently found that people see their true selves as positive and virtuous. But people also positively regard (and indeed overestimate) many other characteristics related to the self, such as their abilities and achievements, prompting the question of whether there is anything special about the “true self” as a psychological concept. In an influential study, Newman et al. (2014) found that people were more likely to attribute morally good than morally bad changes in the behaviour of other people to their true selves. Crucially, they also found that our tendency to view the true self positively is shaped by our own moral values – in essence, what we regard as morally or politically good, we see in the true selves of others. Newman et al’s findings suggest that the tendency for us to regard our true self in a positive light stems from the specific nature of true self as a concept. 
 
In the current study, Lee and Feldman (2022) propose to replicate two key studies from Newman et al. (2014) in a large online sample. In particular, they will ask whether true-self attributions are higher for changes in behaviour that are morally positive compared to morally negative or neutral, and, further, how true-self attributions are aligned with personal moral/political views. The authors also propose exploring the relationship between true-self attributions and perceived social norms.
 
The Stage 1 manuscript was evaluated over one round of in-depth review. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
 
URL to the preregistered Stage 1 protocol: https://osf.io/v2tpf
 
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA. 
 
List of eligible PCI RR-friendly journals:
 
References
 
1. Newman, G. E., Bloom, P., & Knobe, J. (2014). Value judgments and the true self. Personality and Social Psychology Bulletin, 40, 203–216. https://doi.org/10.1177/0146167213508791
 
2. Lee, S. C. & Feldman, G. (2022). Revisiting the link between true-self and morality: Replication and extension of Newman, Bloom, and Knobe (2014) Studies 1 and 2, in principle acceptance of Version 2 by Peer Community in Registered Reports. https://osf.io/v2tpf
Revisiting the link between true-self and morality: Replication and extensions of Newman, Bloom and Knobe (2014) Studies 1 and 2Shuk Ching (Janet) Lee, Gilad Feldman<p>This is a scheduled PCI-RR snap shot for a planned project: "Revisiting the link between true-self and morality: Replication and extensions of Newman, Bloom and Knobe (2014) Studies 1 and 2"</p>Social sciencesChris Chambers2022-02-15 08:43:21 View
13 Jun 2022
STAGE 1

Associations of fear, anger, happiness, and hope with risk judgments: Revisiting appraisal-tendency framework with a replication and extensions of Lerner and Keltner (2001)

Replicating the relationship between emotions and judgments of risk

Recommended by ORCID_LOGO based on reviews by Kelly Wolfe, Max Primbs, Agata Sobków and Karolina Scigala
How do emotions interact with cognition? The last 40 years has witnessed the rise of cognitive-appraisal theories, which propose that emotions can be differentiated along an axis of cognitive dimensions such as certainty, pleasantness, attentional activity, control, anticipated effort, and responsibility (Smith and Ellsworth, 1985). Early tests of such theories focused especially on the impact of the valence – pleasantness/unpleasantness – of emotions on judgment and decision-making, finding, for instance, that negative mood induction can heighten pessimistic estimates of risk (Johnson & Tversky, 1983).
 
The Appraisal-Tendency Framework proposed by Lerner and Keltner (2000) refined cognitive-appraisal theory by proposing that specific emotions trigger a predisposition to appraise future (or hypothetical) events in line with the central appraisal dimensions that triggered the emotion, even when the emotion and the judgment are unrelated. For example, an individual who is triggered to become fearful of a heightened risk, such as nuclear war, may then exhibit heightened pessimism about risks unrelated to war. The Appraisal-Tendency Framework also predicts relationships between traits, such as between fear, anger and risk-taking/risk-seeking tendencies. In an influential paper, Lerner and Keltner (2001) reported direct empirical support for the Appraisal-Tendency Framework, which aside from its influence in cognitive/affective psychology has had considerable impact in behavioural economics, moral psychology, and studies of consumer behaviour.
 
In the current study, Lu and Feldman (2022) propose to replicate three key studies from Lerner and Keltner (2001) in a large online sample. Through a combination of replication and extension, the authors will probe the relationship between various trait emotions (including fear, anger, happiness, and hope) and trait characteristics of risk seeking and optimistic risk assessment. The authors also propose examining how the ambiguity of triggering events moderates the relationship between specific emotions and risk judgments. 
 
The Stage 1 manuscript was evaluated over two rounds of in-depth review. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
 
URL to the preregistered Stage 1 protocol: https://osf.io/8yu2x
 
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA. 
 
List of eligible PCI RR-friendly journals:
 
References
 
1. Smith, C. A., & Ellsworth, P. C. (1985). Patterns of cognitive appraisal in emotion. Journal of Personality and Social Psychology, 48, 813-838. https://doi.org/10.1037/0022-3514.48.4.813
 
2. Johnson, E. J., & Tversky, A. (1983). Affect, generalization, and the perception of risk. Journal of Personality and Social Psychology, 45(1), 20–31. https://doi.org/10.1037/0022-3514.45.1.20
 
3. Lerner, J. S., & Keltner, D. (2000). Beyond valence: Toward a model of emotion-specific influences on judgment and choice. Cognition & Emotion, 14, 473-493. https://doi.org/10.1080/026999300402763 
 
4. Lerner, J. S., & Keltner, D. (2001). Fear, anger, and risk. Journal of Personality and Social Psychology, 81, 146–159. https://doi.org/10.1037/0022-3514.81.1.146
  
5. Lu, S. & Feldman, G. (2022). Associations of fear, anger, happiness, and hope with risk judgments: Revisiting appraisal-tendency framework with a replication and extensions of Lerner and Keltner (2001), in principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/8yu2x
Associations of fear, anger, happiness, and hope with risk judgments: Revisiting appraisal-tendency framework with a replication and extensions of Lerner and Keltner (2001)Sirui Lu; Gilad Feldman<p>This is a scheduled PCI-RR snap shot for a planned project: "Associations of fear, anger, happiness, and hope with risk judgments: &nbsp;Revisiting appraisal-tendency framework with a replication and extensions of Lerner and Keltner (2001)​"</p>Social sciencesChris Chambers2022-01-31 09:36:29 View
09 Jun 2022
STAGE 1

Revisiting diversification bias and partition dependence: Replication and extensions of Fox, Ratner, and Lieb (2005) Studies 1, 2, and 5

Testing the replicability of diversification bias and partition dependence

Recommended by ORCID_LOGO based on reviews by Craig Fox and Leo Cohen
When offered a range of options and asked to make multiple selections, how do people choose? Over the last 30 years, a key finding to emerge from behavioural economics is that people distribute their choices more evenly than would be considered optimal – a phenomenon termed “diversification bias” or the “diversification heuristic” (Read & Loewenstein, 1995). For example, when filling a plate from a buffet, you might be inclined to choose a relatively even amount of everything on offer, even when you prefer some foods over others. Similarly, when allocating savings among different investment options, people are prone to spreading their money more evenly than would maximise utility.
 
In an influential study, Fox et al. (2005) found that diversification bias can be shaped by so-called “partition dependence” – the tendency to allocate resources differently across options depending on how they are subjectively grouped. Such groupings could be arbitrary; so, for example, to return to the buffet example, people might diversify across high-level categories such as cooked and uncooked, savoury and sweet, or surf and turf, and then diversify across the options within those categories. The nature of level of these subjective (and potentially arbitrary) categorisations can strongly influence the final allocation of resources. Diversification bias and partition dependence have important implications for basic theory in judgment and decision-making as well as applications in behavioral economics and finance.
 
In the current study, Li and Feldman (2022) propose to replicate Studies 1, 2 and 5 from Fox et al. (2002) in a large online sample. In particular, they plan to ask how partitioning influences the allocation of choices between options, and the extent to which partition dependence is reduced in people with greater relevant expertise. The authors also propose extending the original study to explore individual differences in the desire for choice diversity as predictors of partition dependence.
 
The Stage 1 manuscript was evaluated over one round of in-depth review. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
 
URL to the preregistered Stage 1 protocol: https://osf.io/bx8vq
 
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA. 
 
List of eligible PCI RR-friendly journals:
 
 
References
 
1. Read, D., & Loewenstein, G. (1995). Diversification bias: Explaining the discrepancy in variety seeking between combined and separated choices. Journal of Experimental Psychology: Applied, 1, 34-49. https://doi.org/10.1037/1076-898X.1.1.34
 
2. Fox, C. R., Ratner, R. K., & Lieb, D. S. (2005). How subjective grouping of options influences choice and allocation: Diversification bias and the phenomenon of partition dependence. Journal of Experimental Psychology: General, 134, 538-551. https://doi.org/10.1037/0096-3445.134.4.538
  
3. Li, M. Y. & Feldman, G. (2022). Revisiting diversification bias and partition dependence: 
Replication and extension of Fox, Ratner, and Lieb (2005) Studies 1, 2, and 5, in principle acceptance of Version 2 by Peer Community in Registered Reports. https://osf.io/bx8vq
Revisiting diversification bias and partition dependence: Replication and extensions of Fox, Ratner, and Lieb (2005) Studies 1, 2, and 5Mei Yee (Alice) Li, Gilad Feldman<p>This is a scheduled PCI-RR snap shot for a planned project: "Revisiting diversification bias and partition dependence: Replication and extensions of Fox, Ratner, and Lieb (2005) Studies 1, 2, and 5 ​"</p>Social sciencesChris Chambers Craig Fox, Leo Cohen2022-02-15 09:57:51 View
06 Jun 2022
STAGE 1

Communicating dynamic norms with visual cues

Can dynamic norm information reduce indicators of meat consumption?

Recommended by ORCID_LOGO based on reviews by Gabriela Jiga-Boy and 1 anonymous reviewer
Human meat consumption is associated with a variety of risks to health, animal welfare, sustainability, and the environment (including greenhouse gas emissions and loss of biodiversity), prompting a growing research effort to develop psychological interventions to reduce it and encourage alternative diets. At the same time, although meat consumption remains the majority choice in the UK, its prevalence is declining, with the proportion of vegetarians and vegans increasing substantially over the last two decades.
 
One potential tool to accelerate behaviour change is to expose people to “dynamic norm” messaging, which, rather than providing static descriptive information about the prevalence of a desired behaviour, emphasises how the desired behaviour is changing over time so that people can begin to conform to the emerging trend. Although promising in theory, previous research offers mixed evidence on the effectiveness of dynamic norms in encouraging a reduction in meat consumption, with some studies suggesting benefits and others showing no effect or even counterproductive effects. The methodological rigour of some studies is also in question.
 
In the present study, Aldoh et al. (2022) will investigate the effectiveness of dynamic norm information (compared to static norms) on several indicators of meat consumption, including interest, attitudes, and intentions toward reducing meat consumption, as well as self-reported meat consumption itself. Using an online sample up to 1500 participants, the authors will also test the role of visual cues (including data trend graphics) in causing any effects and will explore the potential longevity of the intervention over a period of 7 days.
 
The Stage 1 manuscript was evaluated over two rounds of in-depth review. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
 
URL to the preregistered Stage 1 protocol: https://osf.io/txzvm
 
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA. 
 
List of eligible PCI RR-friendly journals:
 
References
  
1. Aldoh, A., Sparks, P. & Harris, P. R. (2022). Communicating dynamic norm information, in principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/txzvm
Communicating dynamic norms with visual cuesAlaa Aldoh, Paul Sparks, Peter R Harris<p>While decreasing meat consumption is one of the most impactful behaviours an individual may do to reduce their carbon emissions, it is still a minority behaviour in many parts of the world. Research suggests that communicating information about...Social sciencesChris Chambers2021-08-11 18:52:41 View