We are recruiting recommenders (editors) from all research fields!
Your feedback matters! If you have authored or reviewed a Registered Report at Peer Community in Registered Reports, then please take 5 minutes to leave anonymous feedback about your experience, and view community ratings.
Latest recommendations
| Id | Title * | Authors * | Abstract * | Picture | Thematic fields * | Recommender | Reviewers▼ | Submission date | |
|---|---|---|---|---|---|---|---|---|---|
21 Feb 2022
STAGE 1
Recommended by Benoit Pujol based on reviews by Jean-François Gerard, Rachel Harrison and 1 anonymous reviewer
This submission has been withdrawn (see notice below)Sex-biased dispersal is widely acknowledged to influence range expansion and the geographic limits of species (Trochet et al. 2016). Evidence is accruing that suggests an impact of the learning ability of species on their capacity to colonise new habitats because the ability to learn provides an advantage when confronted to novel challenges (Lee and Thornton 2021). Whether these two mechanisms interact to shape range expansion remains however unknown. One could expect this interaction because both dispersal and the ability to learn are linked to related behaviours (e.g., exploration, Lee and Thornton 2021). In their study entitled “Investigating sex differences in learning in a range-expanding bird”, Alexis J. Breen and Dominik Deffner (Breen and Deffner 2022) propose to test this hypothesis in range-expanding great-tailed grackles (Quiscalus mexicanus) by exploring the individual variation of several behavioural traits (e.g., exploration, neophobia, problem solving, Logan 2016) linked to their learning ability. They will use a colour-reward reinforcement experimental approach to compare the learning performance between male and female great-tailed grackles in three study sites and evaluate whether sex-biased learning ability interacts with sex-biased dispersal. Data will be analysed by a Bayesian reinforcement learning model (Deffner et al. 2020), which was validated. This Stage 1 registered report was evaluated over one round of in-depth review by Jean-François Gerard, Rachel Harrison and one anonymous reviewer, and another round of review by Jean-François Gerard and Rachel Harrison. Based on detailed responses to the comments and the modifications brought to the manuscript by the authors, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA). Withdrawal notice: The Stage 2 manuscript associated with this accepted Stage 1 protocol was submitted to PCI RR on 22 July 2022. On 25 July 2022, the Managing Board offered the opportunity for the authors to revise the manuscript prior to in-depth review. On 7 Sep 2022, the authors withdrew the Stage 2 manuscript from consideration due to time constraints.URL to the preregistered Stage 1 protocol: https://osf.io/v3wxb
Level of bias control achieved: Level 2. At least some data/evidence that will be used to answer the research question has been accessed and partially observed by the authors, but the authors certify that they have not yet observed the key variables within the data that will be used to answer the research question AND they have taken additional steps to maximise bias control and rigour.
List of eligible PCI RR-friendly journals:
References Trochet, A., Courtois, E. A., Stevens, V. M., Baguette, M., Chaine, A., Schmeller, D. S., Clobert, J., & Wiens, J. J. (2016). Evolution of sex-biased dispersal. The Quarterly Review of Biology, 91(3), 297–320. https://doi.org/10.1086/688097 Lee, V. E., & Thornton, A. (2021). Animal cognition in an urbanised world. Frontiers in Ecology and Evolution, 9, 120. https://doi.org/10.3389/fevo.2021.633947 Logan, C. J. (2016b). Behavioral flexibility in an invasive bird is independent of other behaviors. PeerJ, 4, e2215. https://doi.org/10.7717/peerj.2215 Deffner, D., Kleinow, V., & McElreath, R. (2020). Dynamic social learning in temporally and spatially variable environments. Royal Society Open Science, 7(12), 200734. https://doi.org/10.1098/rsos.200734 Breen, A. J. & Deffner D. (2022). Investigating sex differences in learning in a range-expanding bird., https://github.com/alexisbreen/Sex-differences-in-grackles-learning, in principle acceptance of version 2 by Peer Community in Registered Reports. https://osf.io/v3wxb | [WITHDRAWN]: Investigating sex differences in learning in a range-expanding bird | Alexis J. Breen & Dominik Deffner | <p style="text-align: justify;">How might differences in dispersal and learning interact in range expansion dynamics? To begin to answer this question, in this preregistration we detail the background, hypothesis plus associated predictions, and m... | | Life Sciences | Benoit Pujol | Jean-François Gerard, Rachel Harrison, Kate Cross | 2021-11-10 13:12:04 | |
19 Jan 2024
STAGE 1
A systematic review of social connection inventoriesImproving the measurement of social connectionRecommended by Dorothy Bishop based on reviews by Jacek Buczny, Richard James and Alexander Wilson
This is an ambitious systematic review that uses a combination of quantitative and qualitative methods to make the measurement of the construct of social connection more rigorous. Social connection is a heterogeneous construct that includes aspects of structure, function and quality. Here, Paris et al. (2024) will use predefined methods to create a database of social connection measures, and will assess heterogeneity of items using human coders and ChatGPT. This database will form the basis of a second systematic review which will look at evidence for validity and measurement properties. This study will also look at the population groups and country of origin for which different measures were designed, making it possible to see how far culturally specific issues affect the content of measures in this domain.
The questions asked by this study are exploratory and descriptive and so the importance of pre-registration is in achieving clear criteria for how each question is addressed, rather than evidential criteria for hypothesis-testing.
The authors responded comprehensively to three reviewer reports. This study will provide a wealth of useful information for those studying social connection, and should serve to make the literature in this field more psychometrically robust and less fragmented.
URL to the preregistered Stage 1 protocol: https://osf.io/796uv
Level of bias control achieved: Level 3. At least some data/evidence that will be used to the answer the research question has been previously accessed by the authors (e.g. downloaded or otherwise received), but the authors certify that they have not yet observed ANY part of the data/evidence. List of eligible PCI RR-friendly journals:
References
1. Paris, B., Brickau, D., Stoianova, T., Luhmann, M., Mikton, C., Holt-Lunstad, J., Maes, A., & IJzerman, H. (2024). A systematic review of social connection inventories. In principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/796uv | A systematic review of social connection inventories | Bastien Paris, Debora Brickau, Tetiana Stoianova, Maike Luhmann, Christopher Mikton, Julianne Holt-Lunstad, Marlies Maes, Hans IJzerman | <p>Social connection is vital to health and longevity. To date, a plethora of instruments exists to measure social connection, assessing a variety of aspects of social connection like loneliness, social isolation, or social support. For comparabil... | Social sciences | Dorothy Bishop | Jacek Buczny, Alexander Wilson, Richard James | 2023-07-09 21:33:01 | ||
10 Jan 2025
STAGE 1
Development and evaluation of a revised 20-item short version of the UPPS-P Impulsive Behavior ScaleAssessing Impulsivity Measurement (UPPS-P-20-R)Recommended by Veli-Matti Karhulahti based on reviews by Ivan Ropovik and Orestis Zavlis
Impulsivity, as a construct, operates by an established history with various models and theories (Leshem & Glicksohn 2007) having accumulated evidence of relevance especially for mental disorders. One of the dominant models, the Impulsive Behavior Model, is conventionally measured in survey studies with UPPS-P scales, a short version of which was recently assessed in a large cross-cultural project (Fournier et al. 2024). In the present study, Fournier and colleagues (2025) aim to further test the revised 20-item scale in English via a three-phase protocol involving evaluations of construct validity, internal consistency reliability, test-retest reliability, convergent validity, and criterion validity. As such, the study contributes to ongoing important development of useful and up-to-date survey scales, which can help researchers avoid measurement issues (Flake & Fried 2020) in various fields where, in this case, impulsivity plays a role.
The study was reviewed over three rounds by two reviewers, with respective topic and methods expertise. Based on detailed responses to reviewers’ feedback and the recommender’s comments on the construct, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance.
URL to the preregistered Stage 1 protocol: https://osf.io/wevc4 (under temporary private embargo)
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA. List of eligible PCI-RR-friendly journals:
References 1. Flake, J. K. & Fried, E. I. (2020). Measurement schmeasurement: Questionable measurement practices and how to avoid them. Advances in Methods and Practices in Psychological Science, 3, 456-465. https://doi.org/10.1177/2515245920952393
2. Fournier, L., Bőthe, … & Billieux, J. (2024). Evaluating the factor structure and measurement invariance of the 20-item short version of the UPPS-P Impulsive Behavior Scale across multiple countries, languages, and gender identities. Assessment, 10731911241259560. https://doi.org/10.1177/10731911241259560
3. Fournier, L., Heeren, A., Baggio, S., Clark, L., Verdejo-García, A., Perales J.C., Billieux J. (2025) Development and evaluation of a revised 20-item short version of the UPPS-P Impulsive Behavior Scale. In principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/wevc4
4. Leshem, R. & Glicksohn, J. (2007). The construct of impulsivity revisited. Personality and individual Differences, 43, 681-691. https://doi.org/10.1016/j.paid.2007.01.015
| Development and evaluation of a revised 20-item short version of the UPPS-P Impulsive Behavior Scale | Loïs Fournier, Alexandre Heeren, Stéphanie Baggio, Luke Clark, Antonio Verdejo-García, José C. Perales, Joël Billieux | <p style="text-align: justify;">The UPPS-P Impulsive Behavior Scale is a well-established psychometric instrument for assessing impulsivity, a key psychological construct transdiagnostically involved in the etiology of numerous psychiatric and neu... | | Social sciences | Veli-Matti Karhulahti | Ivan Ropovik | 2024-06-27 17:47:17 | |
06 Sep 2024
STAGE 1
The Role of Offender Identifiability in Second- and Third-Party PunishmentPunishing OffendersRecommended by Clare Conry-Murray based on reviews by Gilad Feldman and Rajarshi Majumder
When people are less-well-known to us, it can impact how we treat them. People outside our communities may feel more anonymous or de-personalized to us, and this could impact the empathy we feel for them. Indeed, past research shows that people seem to care more for those who are who are identified to us, especially when they are victims of a crime (Small & Loewenstein, 2003). In addition, past research also shows that anonymizing victims can influence criminal behavior (Walters, 2022). Thus, social cognitive factors related to anonymity appear to affect both positive feelings (engaging in empathy) and negative activities (criminal activity) related to victims. It seems likely that anonymity can also affect how people judge criminals themselves.
This paper by Blanke and Twardawski (2024) examines how even minor identifying features can make individuals react differently to a perpetrator of a crime. A picture or name (information that may appear in the press) may impact how people perceive criminals in terms of punishment, empathy, outrage, and blame.
How people respond to anonymous or identified criminals may depend on whether the impact of the crime on the victim is made salient. Similar to the Black Sheep Effect (Marques & Paez,1994), the current paper expects that people who identify with victims are expected to punish a perpetrator more when the perpetrator’s name and image are known. This is similar to the case with an ingroup member in The Black Sheep Effect, where ingroup members are punished more for transgressions than outgroup members. For people who view the situation as a third party (and are thus less connected to the victim), an identified perpetrator is expected to lead to less punishment (and also less outrage and blame, and more empathy).
The current study focuses on pickpocketing since it is a crime that can be committed without identifying oneself to the victim. Future research should examine how the type of event impacts judgments, especially given the stigma of being a victim of some crimes. Littering and other minor violations may be seen as understandable when you see someone as a person, rather than a anonymous, impersonal criminal. On the other hand, there can be stigma to being a victim in some cases, such as the case of sexual harassment, where, research shows, perpetrators are judged more positively if they are identified, and victims, especially women, are judged more negatively if they are identified (Barak-Corren & Lewinsohn-Zamir, 2019).
People around the world engage in moral and legal transgressions, and if our judgments of them are influenced by minor features such as a photo or name, we should take action to treat people more fairly. This research will help to determine if people are influenced by these factors.
The Stage 1 manuscript underwent one round of thorough review. After considering the detailed responses to the reviewers' comments, the recommender determined that the manuscript met the Stage 1 criteria and granted in-principle acceptance (IPA).
URL to the preregistered Stage 1 protocol: https://osf.io/7qzva
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA. List of eligible PCI RR-friendly Journals:
References
1. Barak‐Corren, N., & Lewinsohn‐Zamir, D. (2019). What's in a Name? The Disparate Effects of Identifiability on Offenders and Victims of Sexual Harassment. Journal of Empirical Legal Studies, 16, 955-1000. https://doi.org/10.1111/jels.12233
2. Blanke, T. & Twardawski, M. (2024). The Role of Offender Identifiability in Second- and Third-Party Punishment. In principle acceptance of Version 2 by Peer Community in Registered Reports. https://osf.io/7qzva
3. Marques, J. M., & Paez, D. (1994). The ‘black sheep effect’: Social categorization, rejection of ingroup deviates, and perception of group variability. European Review of Social Psychology, 5, 37-68. https://doi.org/10.1080/14792779543000011
4. Small, D. A., & Loewenstein, G. (2003). Helping a victim or helping the victim: Altruism and identifiability. Journal of Risk and Uncertainty, 26, 5-16. https://doi.org/10.1023/A:1022299422219
5. Walters, G. D. (2022). Crime and social cognition: A meta-analytic review of the developmental roots of adult criminal thinking. Journal of Experimental Criminology, 18, 183-207. https://doi.org/10.1007/s11292-020-09435-w
| The Role of Offender Identifiability in Second- and Third-Party Punishment | Theresa Blanke, Mathias Twardawski | <p>The identifiability effect describes humans' tendency to exhibit different emotional and behavioral responses toward identified as compared to anonymous individuals. This phenomenon has been extensively studied within the identifiable victim ef... | Social sciences | Clare Conry-Murray | Gilad Feldman, Rajarshi Majumder | 2024-03-23 11:02:30 | ||
25 Oct 2024
STAGE 1
They look virtually the same: extraretinal representation of symmetry in virtual realityHow does virtual reality impact the processing of extraretinal symmetry?Recommended by Grace Edwards based on reviews by Daniel Baker, Felix Klotzsche and 1 anonymous reviewer
Karakashevska and colleagues (2024) aim to examine the extraretinal representation of visual symmetry presented in a virtual reality environment. Previous research had demonstrated that individuals can detect symmetry when the symmetry is represented on a perspective plane, slanted away from the viewer. In electroencephalography (EEG), perceived symmetry is marked by an Event Related Potential (ERP) called a Sustained Posterior Negativity (SPN). When symmetry is presented on a perspective plane in comparison to front-on (frontoparallel), the SPN is reduced, termed the perspective cost. Here, Karakashevska et al., (2024) will determine if presenting symmetry on a perspective plane in a virtual reality (VR) environment will reduce the perspective cost with the addition of 3D depth cues. Specifically, participants will be requested to detect symmetry or luminance of a stimulus presented in a VR environment whilst wearing an EEG. The authors hypothesize that no perspective cost will be identified between symmetry presented on a frontoparallel plane versus symmetry on a perspective plane. Furthermore, the authors will examine the impact of task within the virtual environment on symmetry processing. They hypothesize that a task focused on the regularity of the stimuli will result in a larger amplitude of the SPN than a luminance task. This design enables the authors to pinpoint immersive environments as providing cues critical in overcoming perspective cost.
The Stage 1 manuscript was evaluated by two expert reviewers across three rounds. Following in-depth review and responses from the authors, the recommender has determined that Stage 1 criteria was met and has awarded in-principle acceptance (IPA).
URL to the preregistered Stage 1 protocol: https://osf.io/7pnxu
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA. List of eligible PCI RR-friendly journals:
References
Karakashevska, E., Batterley, M. & Makin, A. D. J. (2024). They look virtually the same: extraretinal representation of symmetry in virtual reality. In principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/7pnxu
| They look virtually the same: extraretinal representation of symmetry in virtual reality | Elena Karakashevska, Michael Batterley and Alexis D.J. Makin | <p>The brain must identify objects from different viewpoints that change the retinal image. This study will determine the conditions under which the brain spends computational resources to construct view-invariant, extraretinal representations in ... | Life Sciences | Grace Edwards | Felix Klotzsche | 2024-05-23 20:13:42 | ||
16 Jun 2023
STAGE 1
Licensing via credentials: Replication of Monin and Miller (2001) with extensions investigating the domain-specificity of moral credentials and the association between the credential effect and trait reputational concernRevisiting moral licensingRecommended by Chris Chambers based on reviews by Corey Cusimano, Marek Vranka, Štěpán Bahník and Ethan Meyers
Does being good free people up to be bad? A large literature in social psychology suggests that it might, with evidence that “moral licensing” gives people a perception that actions deemed morally questionable, or socially undesirable, will be tolerated more readily if they have demonstrated a past history of praiseworthy, moral behaviour. In a formative study, Monin and Miller (2001) reported that having a track record of moral credentials as being nonprejudiced (e.g. non-sexist or non-racist) increased the willingness of participants to later express a prejudiced attitude. For example, in their Study 2 they found that participants who built up their moral credit by selecting a Black woman in a hypothetical recruitment task were then more willing to then prefer a White man for a second job, compared to participants who did not have the opportunity to initially recommend a Black woman. These results have prompted a burgeoning literature on moral licensing, albeit one that is mixed and has been found to exhibit substantial publication bias.
In the current study, Xiao et al. (2023) propose a large online replication of Study 2 in Monin and Miller (2001), asking whether previous moral behaviours that furnish participants with moral credentials make them more likely to then engage in morally questionable behaviours. The authors will also extend earlier work by testing whether moral credentials license immoral behaviours more effectively in the same domain (e.g. within sex) than in a different domain (e.g. across sex and race), asking whether there is a negative relationship between expression of prejudice and trait reputational concern (fear of negative evaluation), and whether moral credentials attenuate any such observed relationship.
The Stage 1 manuscript was evaluated over three rounds of in-depth review. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
URL to the preregistered Stage 1 protocol: https://osf.io/uxgrk
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA. List of eligible PCI RR-friendly journals:
References
1. Monin, B., & Miller, D. T. (2001). Moral credentials and the expression of prejudice. Journal of Personality and Social Psychology, 81, 33-43. https://psycnet.apa.org/doi/10.1037/0022-3514.81.1.33
2. Xiao, Q., Ching Li, L., Au, Y. L., Chung, W. T., Tan, S. N. & Feldman, G. (2023). Licensing via credentials: Replication of Monin and Miller (2001) with extensions investigating the domain-specificity of moral credentials and the association between the credential effect and trait reputational concern, in principle acceptance of Version 5 by Peer Community in Registered Reports. https://osf.io/uxgrk | Licensing via credentials: Replication of Monin and Miller (2001) with extensions investigating the domain-specificity of moral credentials and the association between the credential effect and trait reputational concern | Qinyu Xiao, Lok Ching Li, Ying Lam Au, Wing Tung Chung, See Ngueh Tan, Gilad Feldman | <p>This is a scheduled PCI-RR snap shot for a planned project: "Licensing via credentials: Replications of Monin and Miller (2001) with extensions investigating the domain-specificity of moral credentials and associations with trait reputational c... | Social sciences | Chris Chambers | Ethan Meyers, Štěpán Bahník, Marek Vranka | 2022-02-20 04:49:16 | ||
26 Jun 2024
STAGE 1
Do Scarcity-Related Cues Affect the Sustained Attentional Performance of the Poor and the Rich Differently?How does economic status moderate the effect of scarcity cues on attentional performance?Recommended by Matti Vuorre based on reviews by Ernst-Jan de Bruijn and Leon Hilbert
This Stage 1 registered report by Szecsi et al. (2024) seeks to clarify whether individuals' economic conditions moderate how scarcity cues affect their attentional performance. This idea has been previously explored: Here, the authors aim to clarify understanding of the how scarcity cues affect cognition by studying a large and diverse Hungarian sample with improved experimental methods.
Specifically, while it has been previously reported that financially less well-off individuals' are differentially affected by finance-related stimuli (e.g. Shah et al., 2018), Szecsi et al. (2024) argue that prior studies have used small samples with insufficient consideration of potentially important demographic variables. Therefore, the generalizability of prior studies might be lacking.
Second, Szecsi et al. (2024) aim to conduct a more realistic experiment by asking participants to free-associate in response to financial scarcity-related cues, whereas prior studies have often focused on simply querying for rating responses, which might not sufficiently engage the related cognitive mechanisms that could be most affected.
In the proposed study, then, the authors will rigorously test whether financially less well-off individuals have lower attentional performance while experiencing scarcity-related cues than individuals who are financially better off, and that attentional performance does not differ while experiencing non-scarcity related cues. Ultimately, Szecsi et al. propose to shed light on theories of scarcity-related cognition that posit overall decrements in attentional performance irrespective of individuals' financial status.
The Stage 1 manuscript was initially reviewed by two experts in the area, who both recommended several improvements to the study. The authors then thoroughly revised their write-up and protocol, and the two reviewers were satisfied with the substance of these revisions. Based on these evaluations, the recommender judged that the Stage 1 criteria were met and awarded in-principle acceptance. There were remaining editorial clarifications and suggestions which the authors can incorporate in their eventual Stage 2 report.
URL to the preregistered Stage 1 protocol: https://osf.io/3zdyb
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA. List of eligible PCI RR-friendly journals: References
1. Shah, A. K., Zhao, J., Mullainathan, S., & Shafir, E. (2018). Money in the mental lives of the poor. Social Cognition, 36, 4-19. https://doi.org/10.1521/soco.2018.36.1.4
2. Szecsi, P., Bognar, M., & Szaszi, B., (2024). Do Scarcity-Related Cues Affect the Sustained Attentional Performance of the Poor and the Rich Differently? In principle acceptance of Version 2 by Peer Community in Registered Reports. https://osf.io/3zdyb
| Do Scarcity-Related Cues Affect the Sustained Attentional Performance of the Poor and the Rich Differently? | Peter Szecsi, Miklos Bognar, Barnabas Szaszi | <p>Cues related to financial scarcity are commonly present in the daily environment shaping people’s mental lives. However, the results are mixed on whether such scarcity-related cues disproportionately deteriorate the cognitive performance of poo... | Social sciences | Matti Vuorre | Ernst-Jan de Bruijn, Leon Hilbert | 2024-01-18 14:29:03 | ||
29 Oct 2024
STAGE 1
The Harmful Dysfunction Analysis applied to the concept of behavioral addiction: A secondary analysis of data from the Health Behaviour in School - aged Children 2018Applying Harmful Dysfunction Analysis to social media usage in adolescentsRecommended by Andrew Jones based on reviews by Veli-Matti Karhulahti, Gemma Lucy Smart and Josip RazumAmendola and colleagues (2024) plan to examine the usefulness of Harmful Dysfunction Analysis (HDA) in identifying individuals with pathological social media disorder. Harmful Dysfunction Analysis, proposed by Wakefield et al (1992), is a framework for constructing diagnostic criteria, and suggests a disorder is a harmful dysfunction, and defines a dysfunction as a failure of an internal mechanism to perform its naturally designed function. One important distinction of HDA is that harmful consequences of behaviour in the absence of dysfunction does not mean a disorder is present. Both dysfunction and harm are required for diagnosis of a disorder
This analysis may provide a useful perspective on how to separate pathological social media use from high involvement. To examine their aims, the authors will conduct secondary analysis on data from the Health Behaviour in School-aged Children study (specifically the Swiss sample, N = 7,510), which is a world health organisation collaborative cross-sectional study of adolescent well-being from 2018 (https://www.who.int/europe/initiatives/health-behaviour-in-school-aged-children-(hbsc)-study). They will examine the 9-item Social Media Disorder Scale under DSM-5 and HDA categories (dysfunction and harm), and examine convergence between the scoring methods. Subsequent analyses will focus on groups defined by each scoring method (DSM vs HDA, with no overlapping cases) will be compared on measures of physical and mental health. Sensitivity analyses will be conducted in an independent sample from Hungary in 2023 (N = 3,789).
The Stage 1 manuscript was evaluated by three expert reviewers across two rounds of review. Following in-depth review and responses from the authors, the recommender judged that the Stage 1 criteria were met and awarded in-principle acceptance (IPA). URL to the preregistered Stage 1 protocol: https://osf.io/y3ub8
Level of bias control achieved: Level 3. At least some data/evidence that will be used to the answer the research question has been previously accessed by the authors (e.g. downloaded or otherwise received), but the authors certify that they have not yet observed ANY part of the data/evidence. List of eligible PCI RR-friendly journals:
References
1. Amendola, S., Hengartner, M. P., & Wakefield, J. C. (2024). The Harmful Dysfunction Analysis applied to the concept of behavioural addiction: A secondary analysis of data from the Health Behaviour in School-aged Children 2018. In principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/y3ub8 2. Wakefield, J. C. (1992). Disorder as Harmful Dysfunction: A Conceptual Critique of DSM-III-R’s Definition of Mental Disorder. Psychological Review, 99, 232–247. https://psycnet.apa.org/doi/10.1037/0033-295X.99.2.232 | The Harmful Dysfunction Analysis applied to the concept of behavioral addiction: A secondary analysis of data from the Health Behaviour in School - aged Children 2018 | Simone Amendola, Michael P. Hengartner, Jerome C. Wakefield | <p>Objective: The present study is an attempt to advance the debate on the validity of the diagnosis of gaming disorder and other specified disorders due to addictive behaviours by improving the differentiation between excessive/high involvement v... | Social sciences | Andrew Jones | Daniel Dunleavy | 2024-01-12 10:22:01 | ||
16 Oct 2024
STAGE 1
Open Scholarship and Feedback in Applied Research/Understanding the Role of Climate Change in Applied Research: A Qualitative Registered ReportUnderstanding how applied researchers address open scholarship, feedback and climate change in their workRecommended by Sarahanne Miranda Field based on reviews by Crystal Steltenpohl, Lisa Hof and Jay Patel
This recommendation concerns the plan of two studies that are intended to be conducted simultaneously, using the same data collection approach, and to result in two manuscripts that will be submitted for assessment at Stage 2. The Stage 1 manuscript containing these protocols was submitted via the programmatic track.
Protocol 1 concerns “Open Scholarship and Feedback in Applied Research: A Qualitative Registered Report”. With this study, the authors aim to explore how applied researchers integrate feedback processes into their work, in relation to transparency and rigor in particular. They will investigate whether their sample are aware of and use feedback mechanisms from the open science movement, such as registered reports, which makes this study nicely metascientific. Through interviews with 50 applied researchers from various fields, the study will examine current feedback practices. The authors intend to use the findings of this first study to inform recommendations on how open science practices can be incorporated into research workflows.
Protocol 2 concerns “Understanding the Role of Climate Change in Applied Research: A Qualitative Registered Report”. This study aims to explore how applied researchers address climate change in their work, including the ways their practices are influenced by and respond to climate challenges. It addresses how their approaches may evolve, and they plan to look into the barriers and opportunities climate change presents in practice. Interviews with 50 applied researchers will be analysed to help understand these dynamics. The authors aim to provide recommendations to help applied researchers and their employers adjust their priorities to align with the urgency of climate action. One reviewer did not comment on this second protocol, as the content was outside of their own research area. Although I would have found a reviewer who specializes in this area directly ideally, I found I could still rely on the other two reviewers and my own knowledge to assess this protocol.
General comments: As I mentioned in my initial assessment text, these studies were well planned from the get-go and the protocol nicely articulated those plans. The use of different colour highlighting clearly helped the reviewers target different elements of the protocol and give direct feedback on specific parts. It also helped prevent me from getting lost in all the details! Well done, once again, to the authors for making the distinction between the two studies so clear. I was also pleased at how well they balanced the information between the two protocols – this made it easier to see if there were deficiencies in either one somehow. Finally, I loved that reflexivity was considered by the authors. One suggestion by me is that the authors might consider providing a collective positionality statement to go with the trainees’ reflexivity statements (if this is already in the plan and I missed it, please forgive the oversight!) in the final studies, even if as part of an appendix. This is because the open science movement and climate change can both be controversial, and because of the nature of the qualitative approach I would like to understand a little of the stance the group takes towards these issues collectively if the authors think it’s appropriate. I understand that with a big group that might be difficult or impossible, but if it is possible I would like to see it. I would also like to see initials used in the manuscripts to indicate who was responsible for what analysis elements where possible. This allows for accountability and to attribute interpretation to specific individuals involved in the data analysis. Alternatively, individuals can be attributed in a statement at the end of each manuscript to serve the same purpose and be less awkward in the text. If this won't work for some reason, please motivate this decision. The three reviewers that took the time to go through the reports nevertheless had useful comments, most of which would have contributed to strengthening the plan and minimizing problematic bias later on. The authors took these comments seriously, and thoughtfully (cheerfully even) responded to each. In my estimation, each of the suggestions of the reviewers were satisfied by the authors’ response to reviews letter. Other than my earlier comment about the positionality statement, I have no further comments for the Stage 1 protocol, and I wish the authors all the best with running the studies and writing up Stage 2 for each.
URL to the preregistered Stage 1 protocol: https://osf.io/jdh32
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA. List of eligible PCI RR-friendly journals:
References
Evans, T. R. et al. (2024). Open Scholarship and Feedback in Applied Research/Understanding the Role of Climate Change in Applied Research: A Qualitative Registered Report. In principle acceptance of Version 2 by Peer Community in Registered Reports. https://osf.io/jdh32
| Open Scholarship and Feedback in Applied Research/Understanding the Role of Climate Change in Applied Research: A Qualitative Registered Report | Thomas R. Evans, James Bartlett, Olly Robertson, Charlotte R. Pennington, Calvin Burns, Laura Dean, Kate Bradley, Emma L. Henderson, Ruijie Wang, Amélie Gourdon-Kanhukamwe, Emma Wilson-Lemoine, Jérémy E. Wilson-Lemoine, Peter Branney, Joanna Butl... | <p>Applied researchers have an important societal role in influencing real-world practice, bridging academic research, theory and practical experiences. Despite this, relatively little is known about the processes or mechanisms of feedback adopted... | Social sciences | Sarahanne Miranda Field | Daniel Dunleavy | 2024-03-28 16:29:25 | ||
09 Jun 2022
STAGE 1
Revisiting diversification bias and partition dependence: Replication and extensions of Fox, Ratner, and Lieb (2005) Studies 1, 2, and 5Testing the replicability of diversification bias and partition dependenceRecommended by Chris Chambers based on reviews by Craig Fox and Leo Cohen
When offered a range of options and asked to make multiple selections, how do people choose? Over the last 30 years, a key finding to emerge from behavioural economics is that people distribute their choices more evenly than would be considered optimal – a phenomenon termed “diversification bias” or the “diversification heuristic” (Read & Loewenstein, 1995). For example, when filling a plate from a buffet, you might be inclined to choose a relatively even amount of everything on offer, even when you prefer some foods over others. Similarly, when allocating savings among different investment options, people are prone to spreading their money more evenly than would maximise utility.
In an influential study, Fox et al. (2005) found that diversification bias can be shaped by so-called “partition dependence” – the tendency to allocate resources differently across options depending on how they are subjectively grouped. Such groupings could be arbitrary; so, for example, to return to the buffet example, people might diversify across high-level categories such as cooked and uncooked, savoury and sweet, or surf and turf, and then diversify across the options within those categories. The nature of level of these subjective (and potentially arbitrary) categorisations can strongly influence the final allocation of resources. Diversification bias and partition dependence have important implications for basic theory in judgment and decision-making as well as applications in behavioral economics and finance.
In the current study, Li and Feldman (2022) propose to replicate Studies 1, 2 and 5 from Fox et al. (2002) in a large online sample. In particular, they plan to ask how partitioning influences the allocation of choices between options, and the extent to which partition dependence is reduced in people with greater relevant expertise. The authors also propose extending the original study to explore individual differences in the desire for choice diversity as predictors of partition dependence.
The Stage 1 manuscript was evaluated over one round of in-depth review. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
URL to the preregistered Stage 1 protocol: https://osf.io/bx8vq Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.
List of eligible PCI RR-friendly journals: References 1. Read, D., & Loewenstein, G. (1995). Diversification bias: Explaining the discrepancy in variety seeking between combined and separated choices. Journal of Experimental Psychology: Applied, 1, 34-49. https://doi.org/10.1037/1076-898X.1.1.34
2. Fox, C. R., Ratner, R. K., & Lieb, D. S. (2005). How subjective grouping of options influences choice and allocation: Diversification bias and the phenomenon of partition dependence. Journal of Experimental Psychology: General, 134, 538-551. https://doi.org/10.1037/0096-3445.134.4.538
3. Li, M. Y. & Feldman, G. (2022). Revisiting diversification bias and partition dependence: Replication and extension of Fox, Ratner, and Lieb (2005) Studies 1, 2, and 5, in principle acceptance of Version 2 by Peer Community in Registered Reports. https://osf.io/bx8vq | Revisiting diversification bias and partition dependence: Replication and extensions of Fox, Ratner, and Lieb (2005) Studies 1, 2, and 5 | Mei Yee (Alice) Li, Gilad Feldman | <p>This is a scheduled PCI-RR snap shot for a planned project: "Revisiting diversification bias and partition dependence: Replication and extensions of Fox, Ratner, and Lieb (2005) Studies 1, 2, and 5 "</p> | Social sciences | Chris Chambers | Craig Fox, Leo Cohen | 2022-02-15 09:57:51 |
