Announcements
We are recruiting recommenders (editors) from all research fields!
Your feedback matters! If you have authored or reviewed a Registered Report at Peer Community in Registered Reports, then please take 5 minutes to leave anonymous feedback about your experience, and view community ratings.
220 records found
Latest recommendations
Id | Title * ▼ | Authors * | Abstract * | Picture | Thematic fields * | Recommender | Reviewers | Submission date | |
---|---|---|---|---|---|---|---|---|---|
17 Jan 2024
STAGE 1
Revisiting the Effects of Helper Intention on Gratitude and Indebtedness: Replication and extensions Registered Report of Tsang (2006)Chi Fung Chan, Hiu Ching Lim, Fung Yee Lau, Wing Ip, Chak Fong Shannon Lui, Katy Y. Y. Tam, Gilad Feldman https://osf.io/sdjq7Grateful or indebted? Revisiting the role of helper intention in gratitude and indebtednessRecommended by Zhang Chen based on reviews by Jo-Ann Tsang, Sarahanne Miranda Field and Cong PengWhen receiving a favour, we may feel grateful and/or indebted to those who have helped us. What factors determine how much gratitude and indebtedness people experience? In a seminal paper, Tsang (2006) found that people reported feeling more gratitude when the helper's intention was benevolent (e.g., helping others out of genuine concerns for other people) compared to when the helper's intention was perceived to be selfish (e.g., helping others for selfish reasons). In contrast, indebtedness was not influenced by perceived helper intention. This finding highlighted the different processes underlying gratitude and indebtedness, and also inspired later work on how these two emotions may have different downstream influences, for instance on interpersonal relationships.
So far, there has been no published direct replication of this seminal work by Tsang (2006). In the current study, Chan et al. (2024) propose to revisit the effects of helper intention on gratitude and indebtedness, by replicating and extending the original studies (Study 2 & 3) by Tsang (2006). Participants will be asked to either recall (Study 2) or read (Study 3) a scenario in which another person helped them with either benevolent or selfish intentions, and rate how much gratitude and indebtedness they would experience in such situations. The authors predict that in line with the original findings, gratitude will be more influenced by helper intention than indebtedness. To further extend the original findings, the authors will also assess people's perceived expectations for reciprocity, and their intention to reciprocate. These extensions will shed further light on how helper intention may influence beneficiaries’ experiences of gratitude and indebtedness, and their subsequent tendencies to reciprocate. This Stage 1 manuscript was evaluated over two rounds of in-depth review by three expert reviewers and the recommender. After the revisions, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA). URL to the preregistered Stage 1 protocol: https://osf.io/uyfvq
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA. List of eligible PCI RR-friendly journals:
References
1. Tsang, J.-A. (2006). The effects of helper intention on gratitude and indebtedness. Motivation and Emotion, 30, 199–205. https://doi.org/10.1007/s11031-006-9031-z 2. Chan, C. F., Lim, H. C., Lau, F. Y., Ip, W., Lui, C. F. S., Tam, K. Y. Y., & Feldman, G. (2024). Revisiting the Effects of Helper Intention on Gratitude and Indebtedness: Replication and extensions Registered Report of Tsang (2006). In principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/uyfvq | Revisiting the Effects of Helper Intention on Gratitude and Indebtedness: Replication and extensions Registered Report of Tsang (2006) | Chi Fung Chan, Hiu Ching Lim, Fung Yee Lau, Wing Ip, Chak Fong Shannon Lui, Katy Y. Y. Tam, Gilad Feldman | <p>[IMPORTANT: Abstract, method, and results were written using a randomized dataset produced by Qualtrics to simulate what these sections will look like after data collection. These will be updated following the data collection. For the purpose o... | Social sciences | Zhang Chen | 2023-01-12 09:34:50 | View | ||
19 Jun 2023
STAGE 1
Revisiting the “Belief in the law of small numbers”: Conceptual replication and extensions Registered Report of problems reviewed in Tversky and Kahneman (1971) [Stage 1]Cheuk Kiu (Jeffery) HONG, Gilad FELDMAN https://osf.io/6n8jpShould we believe in the “belief in the law of small numbers?”Recommended by Moin Syed based on reviews by Romain Espinosa and Kariyushi RaoProbability and randomness are foundational statistical concepts used not only throughout the sciences, but also in our daily lives to guide our behavior and make sense of the world. Their importance and widespread use may suggest that they are easy concepts to understand, yet that seems not to be the case. A classic article by Tversky and Kahneman (1971) on the “belief in the law of small numbers” revealed that professional psychologists tended to incorrectly perceive a small sample that is randomly drawn from a population as representative of that population. This finding has been hugely influential, inspiring myriad subsequent studies into error and bias when reasoning about probability.
In the current study, Hong and Feldman (2023) propose a conceptual replication and extension of Tversky and Kahneman (1971). The original article was shockingly sparse on details regarding the method, sample, and findings, and, to our knowledge, has never been replicated. These facts are especially concerning given the foundational status that the article holds in the field. Hong and Feldman (2023) have developed a conceptual replication project, using the same approach and targeting the same claims from Tversky and Kahneman (1971), but modifying the wording of the stimuli for clarity and appropriateness for lay respondents. Although Tversky and Kahneman (1971) relied on professional psychologists as participants, many of their claims were not restricted to that population, but rather were generalized to all people—which is also how the findings have been subsequently applied. Thus, the change from professional to lay responders is entirely appropriate and the study will be diagnostic of the original claims.
Finally, Hong and Feldman (2023) extend the target study by manipulating the sample size indicated in the stimuli. Tversky and Kahneman (1971) relied on a single sample size in each scenario, leaving open the question as to how sample size might impact respondents’ reasoning. Accordingly, Hong and Feldman (2023) vary the sample size across the scenarios to determine whether participants answer differently as the sample size increases.
The Stage 1 manuscript was evaluated over two rounds of in-depth review, the first round consisting of detailed comments from two reviewers and the second round consisting of a close read by the recommender. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and was therefore awarded in-principle acceptance (IPA).
URL to the preregistered Stage 1 protocol: https://osf.io/fzbq7
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA. List of eligible PCI RR-friendly journals: References
1. Hong, C. K., & Feldman, G. (2023). Revisiting the “Belief in the law of small numbers”: Conceptual replication and extensions Registered Report of problems reviewed in Tversky and Kahneman (1971). In principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/fzbq7
2. Tversky, A., & Kahneman, D. (1971). Belief in the law of small numbers. Psychological Bulletin, 76(2), 105–110. https://doi.org/10.1037/h0031322
| Revisiting the “Belief in the law of small numbers”: Conceptual replication and extensions Registered Report of problems reviewed in Tversky and Kahneman (1971) [Stage 1] | Cheuk Kiu (Jeffery) HONG, Gilad FELDMAN | <p>This is a scheduled PCI-RR snap shot for a planned project: "Revisiting the “Belief in the law of small numbers”: Replication and extensions of problems reviewed in Tversky and Kahneman (1971)"</p> | Social sciences | Moin Syed | 2023-02-23 08:23:23 | View | ||
20 Jun 2022
STAGE 1
Revisiting stigma attributions and reactions to stigma: Replication and extensions of Weiner et al. (1988)Kwan Yin (Gladys) Yeung, Gilad Feldman https://osf.io/rqdn2/Understanding the psychology of stigmasRecommended by Chris Chambers based on reviews by Charlotte Pennington and Joanne RathboneStigmas are prejudices or discrimination against people based on qualities that vary from the norm, such as a physical or mental illness, disability, sexuality, race, or one of many other personal characteristics. The harm caused by stigmatisation has made understanding the causes and potential solutions a vital area of study in psychology and public health. One of the major focuses of ongoing research is understanding the factors that determine whether a particular characteristic becomes stigmatised, and if so how the stigma might be eliminated. Previous research has found that for disease-based stigmas, the contagiousness, course, and disruptiveness of a disease can be influential. Another key determinant is the perceived cause of the stigmatised condition or characteristic. In a landmark study, Weiner et al. (1988) reported that attributes based on physical health were more likely to be perceived as being uncontrollable, stable and irreversible, prompting feelings of sympathy without anger or judgment. On the other hand, attributes related to mental health and behaviour were more likely to be regarded as controllable and reversible, prompting lack of sympathy coupled with feelings of anger and negative judgement. In a second experiment, they also found that manipulating the perception of controllability can modify emotional responses and judgments – for some stigmas (but not others), providing participants with information that a particular characteristic was controllable vs. uncontrollable was found to increase or decrease negative attributions, respectively.
In the current study, Yeung and Feldman (2022) propose to replicate Experiment 2 from Weiner et al. (1988) in a large online sample. In particular, they plan to ask how the source of a stigma is related to perceived controllability and stability, emotional reactions, and willingness to help. They also propose a range of extensions, including the inclusion of additional stigmas that have become relevant since the original study was published over 30 years ago.
The Stage 1 manuscript was evaluated over two rounds of in-depth review. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
URL to the preregistered Stage 1 protocol: https://osf.io/k957f Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.
List of eligible PCI RR-friendly journals:
References
1. Weiner, B., Perry, R. P., & Magnusson, J. (1988). An attributional analysis of reactions to stigmas. Journal of Personality and Social Psychology, 55, 738–748. https://doi.org/10.1037/0022-3514.55.5.738
2. Yeung, K. Y. & Feldman, G. (2022). Revisiting stigma attributions and reactions to stigma: Replication and extensions of Weiner et al. (1988), in principle acceptance of Version 2 by Peer Community in Registered Reports. https://osf.io/k957f
| Revisiting stigma attributions and reactions to stigma: Replication and extensions of Weiner et al. (1988) | Kwan Yin (Gladys) Yeung, Gilad Feldman | <p>This is a scheduled PCI-RR snap shot for a planned project: "Revisiting stigma attributions and reactions to stigma: Replication and extensions of Weiner et al. (1988) "</p> | Social sciences | Chris Chambers | Joanne Rathbone | 2022-02-15 10:55:13 | View | |
05 Jun 2024
STAGE 1
Revisiting Partition Priming in judgment under uncertainty: Replication and extension Registered Report of Fox and Rottenstreich (2003)Kerou Ding, Gilad Feldman https://osf.io/s2dvcUnderstanding probability assessments with partitioned framingRecommended by Romain Espinosa based on reviews by Olivier L'Haridon and Don MooreDecision-making based on limited information is a common occurrence. Whether it is the possibility of a cheaper product elsewhere or the unknown qualifications of election candidates, people are regularly forced to make a decision under ignorance or uncertainty. In such situations, information about certain events is unavailable or too costly to acquire and people rely on subjective probability allocation to guide decision-making processes. This allocation seems to result in what is known as ignorance priors, i.e., decision-makers assigning equal probabilities to each possible outcome within a given set. How events are grouped or partitioned is often subjective and may influence probability judgments and subsequent decisions. In such cases, the way the choices within a choice set are presented may shape the perceived likelihood of different outcomes. Understanding the impact of partitioning on probability estimation is crucial for both psychological and economic theories of judgment and decision.
The question of evaluating probabilities under uncertainty has received much attention in the psychology and economics literature over the past decades given the wide range of possible applications. In the current work, Ding and Feldman (2024) seek to replicate one of the foundational works on the topic: Fox and Rottenstreich (2003). In the original work, the authors provided exploratory evidence indicating that the framing of a situation affects the way individuals perceive probabilities of possible outcomes. They showed that people assigned uniform probabilities to sets of events described in a problem, such that the way the events are described partly determines people’s partitioning of those events and evaluations of the probabilities of the possible outcomes. Additionally, this partitioned framing affected judgments both under conditions of ignorance (where individuals have no information and rely solely on uniform probability assignments) and uncertainty (where individuals have some information but still rely on heuristics influenced by partitioning). This suggests that priors resulting from the inference of available evidence are sometimes partly contaminated by partitioning bias, affecting both uninformed and partially informed decision-making processes. As a consequence, the partitioning of events into different subsets might lead to varying evaluations of a single situation, resulting in inconsistencies and poorly calibrated probability assessments.
Ding and Feldman (2024) aim to replicate Studies 1a, 1b, 3, and 4 from Fox and Rottenstreich (2003). Their close replication will rely on original data (US participants, Prolific, N=600, not collected yet) with a large statistical power (>95%). Their replication aims to examine whether the partitioned framing affects prior formation under ignorance (Studies 1a, 1b, and 4) and uncertainty (Study 3). In addition, the authors propose an extension examining estimations of alternative event(s) contrasting estimations of the probabilities of events happening versus of events not happening.
The Stage 1 manuscript was evaluated by two external reviewers and the recommender. Based on detailed responses to the reviewers' and the recommender’s comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
URL to the preregistered Stage 1 protocol: https://osf.io/px6vb
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.
List of eligible PCI RR-friendly journals:
References
1. Ding, K. & Feldman, G. (2024). Revisiting Partition Priming in judgment under uncertainty:
Replication and extension Registered Report of Fox and Rottenstreich (2003). In principle acceptance of Version 2 by Peer Community in Registered Reports. https://osf.io/px6vb 2. Fox, C. R. & Rottenstreich, Y. (2003). Partition priming in judgment under uncertainty. Psychological Science, 14, 195-200. https://doi.org/10.1111/1467-9280.02431
| Revisiting Partition Priming in judgment under uncertainty: Replication and extension Registered Report of Fox and Rottenstreich (2003) | Kerou Ding, Gilad Feldman | <p>[IMPORTANT: Abstract, method, and results were written using a randomized dataset produced by Qualtrics to simulate what these sections will look like after data collection. These will be updated following the data collection. For the purpose o... | Social sciences | Romain Espinosa | 2024-01-18 12:46:26 | View | ||
17 May 2022
STAGE 1
Revisiting mental accounting classic paradigms: Replication of Thaler (1999) and an extension examining impulsivityMengfei Li; Gilad Feldman https://osf.io/4ps8m/Mental accounting under the microscopeRecommended by Chris Chambers based on reviews by Barnabas Szaszi and Féidhlim McGowanIn recent years, the study of mental accounting – the thought processes by which people informally record, categorise, and evaluate the costs and benefits of their financial transactions – has been an active research area, drawing attention to a range of biases and distortions that deviate from optimal economic decision-making (Zhang & Sussman, 2018). Although the term “mental accounting” is a relatively recent construction (Thaler, 1999), it stems from a longer history of behavioural economic research on value functions, decision frames, risk-taking, and related concepts.
In the current study, Li and Feldman propose to replicate 17 influential mental accounting problems (or tasks) reviewed by Thaler (1999) in a large online sample. The authors also propose several extensions examining the effects of sunk costs and expenses framing.
The Stage 1 manuscript was evaluated over two rounds of in-depth review. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
URL to the preregistered Stage 1 protocol: https://osf.io/d6cjk
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.
List of eligible PCI RR-friendly journals:
References
1. Zhang, C. Y., & Sussman, A. B. (2018). Perspectives on mental accounting: An exploration of budgeting and investing. Financial Planning Review, 1, e1011. https://doi.org/10.1002/cfp2.1011
2. Thaler, R. H. (1999). Mental accounting matters. Journal of Behavioral Decision Making, 12, 183-206. https://doi.org/10.1002/(SICI)1099-0771(199909)12:3%3C183::AID-BDM318%3E3.0.CO;2-F
3. Li, M. & Feldman, G. (2022). Revisiting mental accounting classic paradigms: Replication of the problems reviewed in Thaler (1999), in principle acceptance of Version 2 by Peer Community in Registered Reports. https://osf.io/d6cjk
| Revisiting mental accounting classic paradigms: Replication of Thaler (1999) and an extension examining impulsivity | Mengfei Li; Gilad Feldman | <p>This is a scheduled PCI-RR snap shot for a planned project: "Revisiting mental accounting classic paradigms: Replication of Thaler (1999) and an extension examining impulsivity"</p> | Social sciences | Chris Chambers | 2022-01-31 10:18:38 | View | ||
09 Jun 2022
STAGE 1
Revisiting diversification bias and partition dependence: Replication and extensions of Fox, Ratner, and Lieb (2005) Studies 1, 2, and 5Mei Yee (Alice) Li, Gilad Feldman https://osf.io/vkp3q/Testing the replicability of diversification bias and partition dependenceRecommended by Chris Chambers based on reviews by Craig Fox and Leo CohenWhen offered a range of options and asked to make multiple selections, how do people choose? Over the last 30 years, a key finding to emerge from behavioural economics is that people distribute their choices more evenly than would be considered optimal – a phenomenon termed “diversification bias” or the “diversification heuristic” (Read & Loewenstein, 1995). For example, when filling a plate from a buffet, you might be inclined to choose a relatively even amount of everything on offer, even when you prefer some foods over others. Similarly, when allocating savings among different investment options, people are prone to spreading their money more evenly than would maximise utility.
In an influential study, Fox et al. (2005) found that diversification bias can be shaped by so-called “partition dependence” – the tendency to allocate resources differently across options depending on how they are subjectively grouped. Such groupings could be arbitrary; so, for example, to return to the buffet example, people might diversify across high-level categories such as cooked and uncooked, savoury and sweet, or surf and turf, and then diversify across the options within those categories. The nature of level of these subjective (and potentially arbitrary) categorisations can strongly influence the final allocation of resources. Diversification bias and partition dependence have important implications for basic theory in judgment and decision-making as well as applications in behavioral economics and finance.
In the current study, Li and Feldman (2022) propose to replicate Studies 1, 2 and 5 from Fox et al. (2002) in a large online sample. In particular, they plan to ask how partitioning influences the allocation of choices between options, and the extent to which partition dependence is reduced in people with greater relevant expertise. The authors also propose extending the original study to explore individual differences in the desire for choice diversity as predictors of partition dependence.
The Stage 1 manuscript was evaluated over one round of in-depth review. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
URL to the preregistered Stage 1 protocol: https://osf.io/bx8vq Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.
List of eligible PCI RR-friendly journals: References 1. Read, D., & Loewenstein, G. (1995). Diversification bias: Explaining the discrepancy in variety seeking between combined and separated choices. Journal of Experimental Psychology: Applied, 1, 34-49. https://doi.org/10.1037/1076-898X.1.1.34
2. Fox, C. R., Ratner, R. K., & Lieb, D. S. (2005). How subjective grouping of options influences choice and allocation: Diversification bias and the phenomenon of partition dependence. Journal of Experimental Psychology: General, 134, 538-551. https://doi.org/10.1037/0096-3445.134.4.538
3. Li, M. Y. & Feldman, G. (2022). Revisiting diversification bias and partition dependence: Replication and extension of Fox, Ratner, and Lieb (2005) Studies 1, 2, and 5, in principle acceptance of Version 2 by Peer Community in Registered Reports. https://osf.io/bx8vq | Revisiting diversification bias and partition dependence: Replication and extensions of Fox, Ratner, and Lieb (2005) Studies 1, 2, and 5 | Mei Yee (Alice) Li, Gilad Feldman | <p>This is a scheduled PCI-RR snap shot for a planned project: "Revisiting diversification bias and partition dependence: Replication and extensions of Fox, Ratner, and Lieb (2005) Studies 1, 2, and 5 "</p> | Social sciences | Chris Chambers | Craig Fox, Leo Cohen | 2022-02-15 09:57:51 | View | |
30 Jun 2022
STAGE 1
Revisiting and updating the risk-benefits link: Replication of Fischhoff et al. (1978) with extensions examining pandemic related factorsJason M. Frank, Gilad Feldman https://osf.io/zayn3Understanding the relationship between the perception of risks and benefitsRecommended by Chris Chambers based on reviews by Katherine Fox-Glassman, Bjørn Sætrevik, Richard Brown and Toby WiseEveryday decisions involve weighing up many kinds of risks and benefits, prompting the question of how our perception of those risks relates to our perception of the associated benefits. Intuitively, we might assume that behaviours or practices that are judged by society as riskier would also be seen as carrying greater potential benefits, in keeping with the expression “high risk, high reward”. The psychology of risk perception, however, appears to be more complex. In a seminal study, Fischhoff et al. (1978) in fact found the opposite pattern: that perceived risk and perceived benefit were negatively correlated – behaviours or practices that were perceived to be higher risk tended to be perceived as carrying lower benefits. This counterintuitive finding has had a significant impact on the field of judgment and decision making, despite being subjected only rarely to close replication.
Using a large-scale online design, Frank and Feldman (2022) propose a replication that incorporates key elements of Fischhoff et al. (1978) as well as a recent replication by Fox-Glassman et al. (2016). In particular, the authors will reassess the strength and directionality of the relationship between perceived risks and perceived benefits, and how these relate to both risk characteristics and acceptable levels of risk. As part of a series of exploratory extensions, they will also examine the risk/benefit relationship for policies and practices related to the Covid-19 pandemic, including vaccinations, lockdowns, and social distancing.
The Stage 1 manuscript was evaluated over two rounds of in-depth review. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
URL to the preregistered Stage 1 protocol: https://osf.io/bx93v Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.
List of eligible PCI RR-friendly journals:
References
1. Fischhoff, B., Slovic, P., Lichtenstein, S., Read, S., & Combs, B. (1978). How safe is safe enough? A psychometric study of attitudes towards technological risks and benefits. Policy Sciences, 9, 127-152. https://doi.org/10.1007/BF00143739
2. Fox-Glassman, K. T. & Weber, E. U. (2016). What makes risk acceptable? Revisiting the 1978 psychological dimensions of perceptions of technological risks. Journal of Mathematical Psychology, 75, 157-169. https://doi.org/10.1016/j.jmp.2016.05.003
3. Frank, J. M. & Feldman, G. (2022). Revisiting and updating the risk-benefits link: Replication of Fischhoff et al. (1978) with extensions examining pandemic related factors, in principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/bx93v
| Revisiting and updating the risk-benefits link: Replication of Fischhoff et al. (1978) with extensions examining pandemic related factors | Jason M. Frank, Gilad Feldman | <p>This is a scheduled PCI-RR snap shot for a planned project: "Revisiting and updating the risk-benefits link: Replication of Fischhoff et al. (1978) with extensions examining pandemic related factors "</p> | Social sciences | Chris Chambers | 2022-02-15 09:21:15 | View | ||
14 Feb 2024
STAGE 1
Restriction of researcher degrees of freedom through the Psychological Research Preregistration-Quantitative (PRP-QUANT) TemplateLisa Spitzer & Stefanie Mueller https://doi.org/10.23668/psycharchives.14119Examining the restrictiveness of the PRP-QUANT TemplateRecommended by Daniel Lakens based on reviews by Marjan Bakker and 1 anonymous reviewerThe Psychological Research Preregistration-Quantitative Template has been created in 2022 to provide more structure and detail to preregistrations. The goal of the current study is to test if the PRP-QUANT template indeed provides greater restriction of the flexibility in a study for preregistered hypotheses than other existing templates. This question is important because one concern that has been raised about the practice of preregistration is that the quality of preregistrations is often low. Metascientific research has shown that preregistrations are often of low quality (Bakker et al., 2020), and hypothesis tests from preregistrations are still selectively reported (van den Akker, van Assen, Enting, et al., 2023). It is important to improve the quality of preregistrations, and if a better template can help, it is a cost-effective approach to improve quality if the wider adoption of the better template can be promoted.
In the current study, Spitzer and Mueller (2024) will follow the procedure of a previous meta-scientific study by Heirene et al. (2021). 74 existing preregistrations with the PRP-QUANT template are available, and will be compared with an existing dataset coded by Bakker and colleagues (2020). The sample size is limited, but allows detecting some differences that would be considered large enough to matter, even though there might be smaller differences that would not be detectable based on the currently available sample size. Nevertheless, given that there is a need for improvement, even preliminary data might already be useful to provide tentative recommendations. Restrictiveness will be coded in 23 items, and adherence to or deviations from the preregistration are coded as well. As such deviations are common, the question whether this template reduced the likelihood of deviations is important. Two coders will code all studies.
The study should provide a useful initial evaluation of the PRP-QUANT template, and has the potential to have practical implications if the PRP-QUANT template shows clear benefits. Both authors have declared COI's related to the PRP-QUANT template, making the Registered Report format a fitting approach to prevent confirmation bias from influencing the reported results.
This Stage 1 manuscript was evaluated over two rounds of in-depth review by two expert reviewers and the recommender. After the revisions, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
URL to the preregistered Stage 1 protocol: https://osf.io/vhezj
Level of bias control achieved: Level 3. At least some data/evidence that will be used to the answer the research question has been previously accessed by the authors (e.g. downloaded or otherwise received), but the authors certify that they have not yet observed ANY part of the data/evidence. List of eligible PCI RR-friendly journals:
References
1. van den Akker, O. R., van Assen, M. A. L. M., Bakker, M., Elsherif, M., Wong, T. K., & Wicherts, J. M. (2023). Preregistration in practice: A comparison of preregistered and non-preregistered studies in psychology. Behavior Research Methods. https://doi.org/10.3758/s13428-023-02277-0
2. Bakker, M., Veldkamp, C. L. S., Assen, M. A. L. M. van, Crompvoets, E. A. V., Ong, H. H., Nosek, B. A., Soderberg, C. K., Mellor, D., & Wicherts, J. M. (2020). Ensuring the quality and specificity of preregistrations. PLOS Biology, 18(12), e3000937. https://doi.org/10.1371/journal.pbio.3000937
3. Spitzer, L. & Mueller, S. (2024). Stage 1 Registered Report: Restriction of researcher degrees of freedom through the Psychological Research Preregistration-Quantitative (PRP-QUANT) Template. In principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/vhezj
4. Heirene, R., LaPlante, D., Louderback, E. R., Keen, B., Bakker, M., Serafimovska, A., & Gainsbury, S. M. (2021). Preregistration specificity & adherence: A review of preregistered gambling studies & cross-disciplinary comparison. PsyArXiv. https://doi.org/10.31234/osf.io/nj4es
| Restriction of researcher degrees of freedom through the Psychological Research Preregistration-Quantitative (PRP-QUANT) Template | Lisa Spitzer & Stefanie Mueller | <p>Preregistration can help to restrict researcher degrees of freedom and thereby ensure the integrity of research findings. However, its ability to restrict such flexibility depends on whether researchers specify their study plan in sufficient de... | Social sciences | Daniel Lakens | 2023-06-01 10:39:20 | View | ||
23 Jan 2023
STAGE 1
Responding to Online Toxicity: Which Strategies Make Others Feel Freer to Contribute, Believe That Toxicity Will Decrease, and Believe that Justice Has Been Restored?Alison I. Young Reusser, Houghton University; Kristian Veit, Olivet Nazarene University; Lisa Gassin, Olivet Nazarene University; Jonathan Case, Houghton University https://osf.io/hfjnbTesting antidotes to online toxicityRecommended by Chris Chambers based on reviews by Corina Logan and Marcel MartončikSocial media is a popular tool for online discussion and debate, bringing with it various forms of hostile interactions – from offensive remarks and insults, to harassment and threats of physical violence. The nature of such online toxicity has been well studied, but much remains to be understood regarding strategies to reduce it. Existing theory and evidence suggests that a range of responses – including those that emphasise prosociality and empathy – might be effective at mitigating online toxicity. But do such strategies work in practice?
In the current study, Young Reusser et al (2023) propose an experiment to test the effectiveness of three types of responses to online toxicity – Benevolent Correction (including disagreement), Benevolent Going Along (including joking/agreement), or Retaliation (additional toxicity) – on how able participants feel to contribute to conversations, their belief that the toxicity would be reduced by the intervention, and their belief that justice had been restored. The findings promise to shed light on approaches for improving the health of online discourse.
The Stage 1 manuscript was evaluated over two rounds of in-depth review. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
URL to the preregistered Stage 1 protocol: https://osf.io/hfjnb (under temporary private embargo) Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.
List of eligible PCI RR-friendly journals: References
1. Young Reusser, A. I., Veit, K. M., Gassin, E. A., & Case, J. P. (2023). Responding to Online Toxicity: Which Strategies Make Others Feel Freer to Contribute, Believe That Toxicity Will Decrease, and Believe that Justice Has Been Restored? In principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/hfjnb
| Responding to Online Toxicity: Which Strategies Make Others Feel Freer to Contribute, Believe That Toxicity Will Decrease, and Believe that Justice Has Been Restored? | Alison I. Young Reusser, Houghton University; Kristian Veit, Olivet Nazarene University; Lisa Gassin, Olivet Nazarene University; Jonathan Case, Houghton University | <p>When we encounter toxic comments online, how might individual efforts to reply to those comments improve others’ experiences conversing in that forum? Is it more helpful for others to publicly, but benevolently (with a polite tone, demonstrated... | Social sciences | Chris Chambers | 2022-06-08 18:35:48 | View | ||
Responding to Online Toxicity: Which Strategies Make Others Feel Freer to Contribute, Believe That Toxicity Will Decrease, and Believe that Justice Has Been Restored?Alison I. Young Reusser, Kristian M. Veit, Elizabeth A. Gassin, and Jonathan P. Case https://osf.io/k46e8Benevolent correction may provide a promising antidote to online toxicityRecommended by Chris Chambers based on reviews by Corina Logan and Marcel MartončikSocial media is a popular tool for online discussion and debate, bringing with it various forms of hostile interactions – from offensive remarks and insults, to harassment and threats of physical violence. The nature of such online toxicity has been well studied, but much remains to be understood regarding strategies to reduce it. Existing theory and evidence suggests that a range of responses – including those that emphasise prosociality and empathy – might be effective at mitigating online toxicity. But do such strategies work in practice?
In the current study, Young Reusser et al (2023) tested the effectiveness of three types of responses to online toxicity – benevolent correction (including disagreement), benevolent going along (including joking/agreement) and retaliation (additional toxicity) – on how able participants feel to contribute to conversations, their belief that the toxicity would be reduced by the intervention, and their belief that justice had been restored.
The results showed the benevolent correction – while an uncommon strategy in online communities – was most effective in helping participants feel freer to contribute to online discussions. Benevolent correction was also the preferred approach for discouraging toxicity and restoring justice. Overall, the findings suggest that responding to toxic commenters with empathy and understanding while (crucially) also correcting their toxicity may be an effective intervention for bystanders seeking to improve the health of online interaction. The authors note that future research should focus on whether benevolent correction actually discourages toxicity, which wasn't tested in the current experiment, and if so how the use of benevolent corrections might be encouraged.
Following one round of review and revisions, the recommender judged that the manuscript met the Stage 2 criteria and awarded a positive recommendation.
URL to the preregistered Stage 1 protocol: https://osf.io/hfjnb Level of bias control achieved: Level 6. No part of the data or evidence that was used to answer the research question was generated until after IPA.
List of eligible PCI RR-friendly journals:
References
1. Young Reusser, A. I., Veit, K. M., Gassin, E. A., & Case, J. P. (2023). Responding to Online Toxicity:
Which Strategies Make Others Feel Freer to Contribute, Believe That Toxicity Will Decrease, and Believe that Justice Has Been Restored? [Stage 2 Registered Report] Acceptance of Version 2 by Peer Community in Registered Reports. https://osf.io/k46e8 | Responding to Online Toxicity: Which Strategies Make Others Feel Freer to Contribute, Believe That Toxicity Will Decrease, and Believe that Justice Has Been Restored? | Alison I. Young Reusser, Kristian M. Veit, Elizabeth A. Gassin, and Jonathan P. Case | <p>When we encounter toxic comments online, how might individual efforts to reply to those comments improve others’ experiences conversing in that forum? Is it more helpful for others to publicly, but benevolently (with a polite tone, demonstrated... | Social sciences | Chris Chambers | 2023-08-02 05:30:37 | View |
MANAGING BOARD
Chris Chambers
Zoltan Dienes
Corina Logan
Benoit Pujol
Maanasa Raghavan
Emily S Sena
Yuki Yamada