Announcements
We are recruiting recommenders (editors) from all research fields!
Your feedback matters! If you have authored or reviewed a Registered Report at Peer Community in Registered Reports, then please take 5 minutes to leave anonymous feedback about your experience, and view community ratings.
Latest recommendations
Id | Title * | Authors * | Abstract * ▲ | Picture | Thematic fields * | Recommender | Reviewers | Submission date | |
---|---|---|---|---|---|---|---|---|---|
17 Jan 2024
STAGE 1
Revisiting the Effects of Helper Intention on Gratitude and Indebtedness: Replication and extensions Registered Report of Tsang (2006)Chi Fung Chan, Hiu Ching Lim, Fung Yee Lau, Wing Ip, Chak Fong Shannon Lui, Katy Y. Y. Tam, Gilad Feldman https://osf.io/sdjq7Grateful or indebted? Revisiting the role of helper intention in gratitude and indebtednessRecommended by Zhang Chen based on reviews by Jo-Ann Tsang, Sarahanne Miranda Field and Cong PengWhen receiving a favour, we may feel grateful and/or indebted to those who have helped us. What factors determine how much gratitude and indebtedness people experience? In a seminal paper, Tsang (2006) found that people reported feeling more gratitude when the helper's intention was benevolent (e.g., helping others out of genuine concerns for other people) compared to when the helper's intention was perceived to be selfish (e.g., helping others for selfish reasons). In contrast, indebtedness was not influenced by perceived helper intention. This finding highlighted the different processes underlying gratitude and indebtedness, and also inspired later work on how these two emotions may have different downstream influences, for instance on interpersonal relationships.
So far, there has been no published direct replication of this seminal work by Tsang (2006). In the current study, Chan et al. (2024) propose to revisit the effects of helper intention on gratitude and indebtedness, by replicating and extending the original studies (Study 2 & 3) by Tsang (2006). Participants will be asked to either recall (Study 2) or read (Study 3) a scenario in which another person helped them with either benevolent or selfish intentions, and rate how much gratitude and indebtedness they would experience in such situations. The authors predict that in line with the original findings, gratitude will be more influenced by helper intention than indebtedness. To further extend the original findings, the authors will also assess people's perceived expectations for reciprocity, and their intention to reciprocate. These extensions will shed further light on how helper intention may influence beneficiaries’ experiences of gratitude and indebtedness, and their subsequent tendencies to reciprocate. This Stage 1 manuscript was evaluated over two rounds of in-depth review by three expert reviewers and the recommender. After the revisions, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA). URL to the preregistered Stage 1 protocol: https://osf.io/uyfvq
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA. List of eligible PCI RR-friendly journals:
References
1. Tsang, J.-A. (2006). The effects of helper intention on gratitude and indebtedness. Motivation and Emotion, 30, 199–205. https://doi.org/10.1007/s11031-006-9031-z 2. Chan, C. F., Lim, H. C., Lau, F. Y., Ip, W., Lui, C. F. S., Tam, K. Y. Y., & Feldman, G. (2024). Revisiting the Effects of Helper Intention on Gratitude and Indebtedness: Replication and extensions Registered Report of Tsang (2006). In principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/uyfvq | Revisiting the Effects of Helper Intention on Gratitude and Indebtedness: Replication and extensions Registered Report of Tsang (2006) | Chi Fung Chan, Hiu Ching Lim, Fung Yee Lau, Wing Ip, Chak Fong Shannon Lui, Katy Y. Y. Tam, Gilad Feldman | <p>[IMPORTANT: Abstract, method, and results were written using a randomized dataset produced by Qualtrics to simulate what these sections will look like after data collection. These will be updated following the data collection. For the purpose o... | Social sciences | Zhang Chen | 2023-01-12 09:34:50 | View | ||
05 Jun 2024
STAGE 1
Revisiting Partition Priming in judgment under uncertainty: Replication and extension Registered Report of Fox and Rottenstreich (2003)Kerou Ding, Gilad Feldman https://osf.io/s2dvcUnderstanding probability assessments with partitioned framingRecommended by Romain Espinosa based on reviews by Olivier L'Haridon and Don MooreDecision-making based on limited information is a common occurrence. Whether it is the possibility of a cheaper product elsewhere or the unknown qualifications of election candidates, people are regularly forced to make a decision under ignorance or uncertainty. In such situations, information about certain events is unavailable or too costly to acquire and people rely on subjective probability allocation to guide decision-making processes. This allocation seems to result in what is known as ignorance priors, i.e., decision-makers assigning equal probabilities to each possible outcome within a given set. How events are grouped or partitioned is often subjective and may influence probability judgments and subsequent decisions. In such cases, the way the choices within a choice set are presented may shape the perceived likelihood of different outcomes. Understanding the impact of partitioning on probability estimation is crucial for both psychological and economic theories of judgment and decision.
The question of evaluating probabilities under uncertainty has received much attention in the psychology and economics literature over the past decades given the wide range of possible applications. In the current work, Ding and Feldman (2024) seek to replicate one of the foundational works on the topic: Fox and Rottenstreich (2003). In the original work, the authors provided exploratory evidence indicating that the framing of a situation affects the way individuals perceive probabilities of possible outcomes. They showed that people assigned uniform probabilities to sets of events described in a problem, such that the way the events are described partly determines people’s partitioning of those events and evaluations of the probabilities of the possible outcomes. Additionally, this partitioned framing affected judgments both under conditions of ignorance (where individuals have no information and rely solely on uniform probability assignments) and uncertainty (where individuals have some information but still rely on heuristics influenced by partitioning). This suggests that priors resulting from the inference of available evidence are sometimes partly contaminated by partitioning bias, affecting both uninformed and partially informed decision-making processes. As a consequence, the partitioning of events into different subsets might lead to varying evaluations of a single situation, resulting in inconsistencies and poorly calibrated probability assessments.
Ding and Feldman (2024) aim to replicate Studies 1a, 1b, 3, and 4 from Fox and Rottenstreich (2003). Their close replication will rely on original data (US participants, Prolific, N=600, not collected yet) with a large statistical power (>95%). Their replication aims to examine whether the partitioned framing affects prior formation under ignorance (Studies 1a, 1b, and 4) and uncertainty (Study 3). In addition, the authors propose an extension examining estimations of alternative event(s) contrasting estimations of the probabilities of events happening versus of events not happening.
The Stage 1 manuscript was evaluated by two external reviewers and the recommender. Based on detailed responses to the reviewers' and the recommender’s comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
URL to the preregistered Stage 1 protocol: https://osf.io/px6vb
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.
List of eligible PCI RR-friendly journals:
References
1. Ding, K. & Feldman, G. (2024). Revisiting Partition Priming in judgment under uncertainty:
Replication and extension Registered Report of Fox and Rottenstreich (2003). In principle acceptance of Version 2 by Peer Community in Registered Reports. https://osf.io/px6vb 2. Fox, C. R. & Rottenstreich, Y. (2003). Partition priming in judgment under uncertainty. Psychological Science, 14, 195-200. https://doi.org/10.1111/1467-9280.02431
| Revisiting Partition Priming in judgment under uncertainty: Replication and extension Registered Report of Fox and Rottenstreich (2003) | Kerou Ding, Gilad Feldman | <p>[IMPORTANT: Abstract, method, and results were written using a randomized dataset produced by Qualtrics to simulate what these sections will look like after data collection. These will be updated following the data collection. For the purpose o... | Social sciences | Romain Espinosa | 2024-01-18 12:46:26 | View | ||
11 Apr 2023
STAGE 1
The link between Empathy and Forgiveness: Replication and extensions of McCullough et al. (1997)'s Study 1Chan Chi Fung, Gilad Feldman https://osf.io/hxdmsIs empathy important for forgiveness?Recommended by Chris Chambers based on reviews by Wenrui Cao, James Bartlett and Saleh ShuqairForgiveness is a core feature of human psychology in which a person makes a deliberate decision to cease negative emotions or attitudes toward an offender who has done them harm. The concept of interpersonal forgiveness is deeply embedded across societies, but much remains to be understood about how it actually works. What are its key ingredients and why does it occur in the first place? Research in social psychology has demonstrated a range of personal and social benefits of forgiveness, giving rise to two dominant mechanistic accounts – one that positions empathy as the driving factor and another that centres motivated reasoning (Donovan & Priester, 2017).
In the current study, Chan and Feldman (2023) seek to replicate a formative study by McCullough et al (1997) that led to the so-called Empathy Model of forgiveness. According to this theory, forgiving is a motivational change facilitated (crucially) by empathy, promoting constructive over destructive behaviour toward the offender. Chan and Feldman will replicate Study 1 from McCullough et al., measuring the correlational relationship between apology, forgiving, and empathy for offenders, and exploring whether forgiving is associated with increased conciliation and decreased avoidance motivation. As well as closely replicating the original study, the authors will extend it to test the more severe hypothesis that empathy causally influences forgiveness. To achieve this, they will experimentally manipulate empathy by adding two groups to the design: one in which participants are asked to recall hurtful past experiences in which they were not empathetic to the offender, and another in which they were highly empathetic.
The Stage 1 manuscript was evaluated over two rounds of in-depth review. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.
List of eligible PCI RR-friendly journals:
References
1. Donovan, L. A. N., & Priester, J. R. (2017). Exploring the psychological processes underlying interpersonal forgiveness: The superiority of motivated reasoning over empathy. Journal of Experimental Social Psychology, 71, 16-30. https://doi.org/10.1016/j.jesp.2017.02.005
2. Chan, C. F. & Feldman, G. (2023). The link between Empathy and Forgiveness: Replication and extensions of McCullough et al. (1997)'s Study 1, in principle acceptance of Version 2 by Peer Community in Registered Reports. https://osf.io/q78fs
| The link between Empathy and Forgiveness: Replication and extensions of McCullough et al. (1997)'s Study 1 | Chan Chi Fung, Gilad Feldman | <p>[IMPORTANT: Abstract, method, and results were written using a randomized dataset produced by Qualtrics to simulate what these sections will look like after data collection. These will be updated following the data collection. For the purpose o... | Social sciences | Chris Chambers | Wenrui Cao, James Bartlett | 2023-01-25 11:15:13 | View | |
Factors impacting effective altruism: Revisiting heuristics and biases in charity in a replication and extensions Registered Report of Baron and Szymanska (2011)Mannix Chan, Gilad Feldman https://osf.io/4etkpUnderstanding biases and heuristics in charity donationsRecommended by Romain Espinosa based on reviews by Amanda Geiser and Jonathan BermanDecisions to give to charities are affected by numerous external and internal factors. Understanding the elements influencing donation decisions is of first-order importance for science and society. On the scientific side, understanding the determinants of charity-giving contributes to the knowledge of altruistic behaviors in the presence of collective problems such as poverty, climate change, or animal welfare. On the social side, pointing out which factors affect donations can help increase prosocial behaviors and might facilitate collective actions in the case of public goods. Previous work has identified multiple mechanisms affecting altruistic donations to charities (Bekkers and Wiepking, 2011). Importantly, Baron and Szymanska (2011) collected empirical evidence suggesting that people prefer (i) their donations to be directly used for projects rather than organizational costs, (ii) when charities have low past costs, (iii) to diversity their donations into several NGOs, (iv) to favor charities that deal with close peers like nationals, and (v) to give voluntarily rather than through taxes. Here, Chan and Feldman (2024) conducted a close replication of Studies 1 to 4 of Baron and Szymanska (2011) using a large sample of online participants (four studies, overall N=1,403). In their replication, the authors found supporting evidence for the phenomena reported in the original study. In particular, people were more likely to donate to charities with lower organizational and lower past costs, to diversify their donations, and to show ingroup/nationalist preferences with larger donations to NGOs helping local over foreign children. Chan and Feldman (2024) ran additional analyses that indicated validity concerns regarding the analysis and questions that resulted in finding a preference for voluntary donations over taxation. In their added extensions that went beyond the original study, they also found that donors preferred to donate to charities whose overhead costs are paid for by other donors and unexpected evidence that making donations anonymous increased rather than decreased contributions. The Stage 2 manuscript was evaluated over one round of in-depth review by the recommender and two expert reviewers. Following revision, the recommender judged that the manuscript met the Stage 2 criteria and awarded a positive recommendation.
URL to the preregistered Stage 1 protocol: https://osf.io/gmswz
Level of bias control achieved: Level 6. No part of the data or evidence that was used to answer the research question was generated until after IPA. List of eligible PCI RR-friendly journals:
References
1. Baron, J. and Szymanska, E. (2011). Heuristics and Biases in Charity. In D. M. Oppenheimer and C. Y. Olivola (Eds.), The Science of Giving: Experimental Approaches to the Study of Charity (pp. 215–235). Psychology Press. https://doi.org/10.4324/9780203865972
2. Bekkers, R. and Wiepking, P. (2011). A Literature Review of Empirical Studies of Philanthropy. Nonprofit and Voluntary Sector Quarterly, 40, 924–973. https://doi.org/10.1177/0899764010380927
3. Chan, M. and Feldman, G. (2024). Factors impacting effective altruism: Revisiting heuristics and biases in charity in a replication and extensions Registered Report of Baron and Szymanska (2011) [Stage 2]. Acceptance of Version 5 by Peer Community in Registered Reports. https://osf.io/4etkp
| Factors impacting effective altruism: Revisiting heuristics and biases in charity in a replication and extensions Registered Report of Baron and Szymanska (2011) | Mannix Chan, Gilad Feldman | <p>Individuals who donate to charity may be affected by various biases and donate inefficiently. In a replication and extension Registered Report with a US Amazon Mechanical Turk sample using CloudResearch (N = 1403), we replicated Studies 1 to 4 ... | Social sciences | Romain Espinosa | 2024-04-27 02:28:49 | View | ||
21 Jun 2024
STAGE 1
Is it Worth the Hustle? A Multi-Country Replication of the Effort Moralization Effect and an Extension to Generational Differences in the Appreciation of EffortTassilo T. Tissot, Leopold H. O. Roth https://osf.io/5tkfrAre people who exert more effort in a task seen as more moral?Recommended by Adrien Fillon based on reviews by Jared Celniker, Ignazio Ziano and Michael InzlichtThis study seeks to understand cultural and age differences in the effort moralization effect, a phenomenon in which people who put more effort into a task are considered more moral, regardless of the quality or the morality associated with the task. This is shown in common phrases such as the “great resignation” or “quiet quitting”, which are mostly used against younger members of the population, in particular generation Z.
Tissot and Roth (2024) propose to conduct a replication of a study from Celniker et al. (2023) which found evidence for this effect, with new samples from Mexico and Germany to test potential cultural differences. They will also test the effect of age on the effort moralization effect. Therefore, the study will be a quantitative analysis.
The authors included an adequate power analysis, alternatives for non-supported hypotheses, and filtering to ensure a high quality of data collection. They already provided an R script and dummy data to ensure the quality of the analysis. The Stage 1 manuscript was evaluated over three rounds of in-depth review. Based on detailed responses to reviewers’ and the recommender’s comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance.
URL to the preregistered Stage 1 protocol: https://osf.io/tvgw2
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.
List of eligible PCI RR-friendly journals:
References 1. Celniker, J. B., Gregory, A., Koo, H. J., Piff, P. K., Ditto, P. H., & Shariff, A. F. (2023). The moralization of effort. Journal of Experimental Psychology: General, 152, 60–79. https://doi.org/10.1037/xge0001259
2. Tissot, T. T. & Roth, L. H. O. (2024). Is it Worth the Hustle? A Multi-Country Replication of the Effort Moralization Effect and an Extension to Generational Differences in the Appreciation of Effort. In principle acceptance of Version 4 by Peer Community in Registered Reports. https://osf.io/tvgw2
| Is it Worth the Hustle? A Multi-Country Replication of the Effort Moralization Effect and an Extension to Generational Differences in the Appreciation of Effort | Tassilo T. Tissot, Leopold H. O. Roth | <p>Inferring the character of individuals is an adaptive need for partner and mating decisions as well as to avoid harm. The effort moralization effect is the finding that people who exert more effort in a task are seen as more moral, even if high... | Social sciences | Adrien Fillon | 2024-01-18 14:58:04 | View | ||
22 Jul 2024
STAGE 1
Replication of “Carbon-Dot-Based Dual-Emission Nanohybrid Produces a Ratiometric Fluorescent Sensor for In Vivo Imaging of Cellular Copper Ions”Maha Said, Mustafa Gharib, Samia Zrig, Raphaël Lévy https://osf.io/kf9qe/Replicating, Revising and Reforming: Unpicking the Apparent Nanoparticle Endosomal Escape ParadoxRecommended by Emily Linnane and Yuki Yamada based on reviews by Cecilia Menard-Moyon and Zeljka KrpeticContext
Over the past decade there has been an exponential increase in the number of research papers utlising nanoparticles for biological applications such as intracellular sensing [1, 2], theranostics [3-5] and more recently drug delivery and precision medicine [6, 7]. Despite the success stories, there is a disconnect regarding current dogma on issues such as nanoparticle uptake and trafficking, nanoparticle delivery via the enhanced permeability and retention (EPR) effect, and endosomal escape. Critical re-evaluation of these concepts both conceptually and experimentally is needed for continued advancement in the field.
For this preregistration, Said et al. (2024) focus on nanoparticle intracellular trafficking, specifically endosomal escape [8]. The current consensus in the literature is that nanoparticles enter cells via endocytosis [9, 10] but reportedly just 1-2% of nanoparticles/ nanoparticle probes escape endosomes and enter the cytoplasm [11-13]. There is therefore an apparent paradox over how sensing nanoparticles can detect their intended targets in the cytoplasm if they are trapped within the cell endosomes. To address this fundamental issue of nanoparticle endosomal escape, Lévy and coworkers are carrying out replication studies to thoroughly and transparently replicate the most influential papers in the field of nanoparticle sensing. The aim of these replication studies is twofold: to establish a robust methodology to study endosomal escape of nanoparticles, and to encourage discussions, transparency and a step-change in the field.
Replication of “Carbon-Dot-Based Dual-Emission Nanohybrid Produces a Ratiometric Fluorescent Sensor for In Vivo Imaging of Cellular Copper Ions”
For this replication study, the authors classified papers on the topic of nanoparticle sensing and subsequently ranked them by number of citations. Based on this evaluation they selected a paper by Zhu and colleagues [14] entitled “Carbon-Dot-Based Dual-Emission Nanohybrid Produces a Ratiometric Fluorescent Sensor for In Vivo Imaging of Cellular Copper Ions” for their seminal replication study. To determine the reproducibility of the results from Zhu et al., the authors aim to establish the proportion of endosomal escape of the nanoparticles, and to examine the data in a biological context relevant to the application of the probe.
Beyond Replication
The authors plan to replicate the exact conditions reported in the materials and methods section of the selected paper such as nanoparticle probe synthesis of CdSe@C-TPEA nanoparticles, assessment of particle size, stability and reactivity and effect on cells (TEM, pH experiments, fluorescent responsivity to metal ions and cell viability). In addition, Said et al., plan to include further experimental characterisation to complement the existing study by Zhu and colleagues. They will incorporate additional controls and methodology to determine the intracellular location of nanoparticle probes in cells including: quantifying excess fluorescence in the culture medium, live cell imaging analysis, immunofluorescence with endosomal and lysosomal markers, and electron microscopy of cell sections. The authors will also include supplementary viability studies to assess the impact of the nanoparticles on HeLa cells as well as an additional biologically relevant cell line (for use in conjunction with the HeLa cells as per the original paper).
The Stage 1 manuscript underwent two rounds of thorough in-depth review. After considering the detailed responses to the reviewers' comments, the recommenders determined that the manuscript met the Stage 1 criteria and awarded in-principle acceptance (IPA).
The authors have thoughtfully considered their experimental approach to the replication study, whilst acknowledging any potential limitations. Given that conducting such a replication study is novel in the field of Nanotechnology and there is currently no ‘gold standard’ approach in doing so, the authors have showed thoughtful regard of statistical analysis and unbiased methodology where possible.
Based on current information, this study is the first use of preregistration via Peer Community in Registered Reports and the first formalised replication study in Nanotechnology for Biosciences. The outcomes of this of this study will be significant both scientifically and in the wider context in discussion of the scientific method.
URL to the preregistered Stage 1 protocol: https://osf.io/qbxpf
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA. List of eligible PCI RR-friendly Journals:
References
1. Howes, P. D., Chandrawati, R., & Stevens, M. M. (2014). Colloidal nanoparticles as advanced biological sensors. Science, 346(6205), 1247390. https://doi.org/10.1126/science.1247390
2. Liu, C. G., Han, Y. H., Kankala, R. K., Wang, S. B., & Chen, A. Z. (2020). Subcellular performance of nanoparticles in cancer therapy. International Journal of Nanomedicine, 675-704. https://doi.org/10.2147/IJN.S226186
3. Tang, W., Fan, W., Lau, J., Deng, L., Shen, Z., & Chen, X. (2019). Emerging blood–brain-barrier-crossing nanotechnology for brain cancer theranostics. Chemical Society Reviews, 48(11), 2967-3014. https://doi.org/10.1039/C8CS00805A
4. Yoon, Y. I., Pang, X., Jung, S., Zhang, G., Kong, M., Liu, G., & Chen, X. (2018). Smart gold nanoparticle-stabilized ultrasound microbubbles as cancer theranostics. Journal of Materials Chemistry B, 6(20), 3235-3239. https://doi.org/10.1039%2FC8TB00368H
5. Lin, H., Chen, Y., & Shi, J. (2018). Nanoparticle-triggered in situ catalytic chemical reactions for tumour-specific therapy. Chemical Society Reviews, 47(6), 1938-1958. https://doi.org/10.1039/C7CS00471K
6. Hou, X., Zaks, T., Langer, R., & Dong, Y. (2021). Lipid nanoparticles for mRNA delivery. Nature Reviews Materials, 6(12), 1078-1094. https://doi.org/10.1038/s41578-021-00358-0
7. Mitchell, M. J., Billingsley, M. M., Haley, R. M., Wechsler, M. E., Peppas, N. A., & Langer, R. (2021). Engineering precision nanoparticles for drug delivery. Nature Reviews Drug Discovery, 20(2), 101-124. https://doi.org/10.1038/s41573-020-0090-8
8. Said, M., Gharib, M., Zrig, S., & Lévy, R. (2024). Replication of “Carbon-Dot-Based Dual-Emission Nanohybrid Produces a Ratiometric Fluorescent Sensor for In Vivo Imaging of Cellular Copper Ions”. In principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/qbxpf
9. Behzadi, S., Serpooshan, V., Tao, W., Hamaly, M. A., Alkawareek, M. Y., Dreaden, E. C., ... & Mahmoudi, M. (2017). Cellular uptake of nanoparticles: Journey inside the cell. Chemical Society Reviews, 46(14), 4218-4244. https://doi.org/10.1039/C6CS00636A
10. de Almeida, M. S., Susnik, E., Drasler, B., Taladriz-Blanco, P., Petri-Fink, A., & Rothen-Rutishauser, B. (2021). Understanding nanoparticle endocytosis to improve targeting strategies in nanomedicine. Chemical society reviews, 50(9), 5397-5434. https://doi.org/10.1039/D0CS01127D
11. Smith, S. A., Selby, L. I., Johnston, A. P., & Such, G. K. (2018). The endosomal escape of nanoparticles: toward more efficient cellular delivery. Bioconjugate Chemistry, 30(2), 263-272. http://dx.doi.org/10.1021/acs.bioconjchem.8b00732
12. Cupic, K. I., Rennick, J. J., Johnston, A. P., & Such, G. K. (2019). Controlling endosomal escape using nanoparticle composition: current progress and future perspectives. Nanomedicine, 14(2), 215-223. https://doi.org/10.2217/nnm-2018-0326
13. Wang, Y., & Huang, L. (2013). A window onto siRNA delivery. Nature Biotechnology, 31(7), 611-612. https://doi.org/10.1038/nbt.2634
14. Zhu, A., Qu, Q., Shao, X., Kong, B., & Tian, Y. (2012). Carbon-dot-based dual-emission nanohybrid produces a ratiometric fluorescent sensor for in vivo imaging of cellular copper ions. Angewandte Chemie (International ed. in English), 51(29), 7185-7189. https://doi.org/10.1002/anie.201109089
| Replication of “Carbon-Dot-Based Dual-Emission Nanohybrid Produces a Ratiometric Fluorescent Sensor for In Vivo Imaging of Cellular Copper Ions” | Maha Said, Mustafa Gharib, Samia Zrig, Raphaël Lévy | <p>In hundreds of articles published over the past two decades, nanoparticles have been described as probes for sensing and imaging of a variety of intracellular cytosolic targets. However, nanoparticles generally enter cells by endocytosis with o... | Life Sciences, Medical Sciences, Physical Sciences | Emily Linnane | 2023-11-29 19:14:03 | View | ||
A Laboratory Experiment on Using Different Financial-Incentivization Schemes in Software-Engineering ExperimentationDmitri Bershadskyy, Jacob Krüger, Gül Çalıklı, Siegmar Otto, Sarah Zabel, Jannik Greif, Robert Heyer https://arxiv.org/pdf/2202.10985Bug detection in software engineering: which incentives work best?Recommended by Chris Chambers based on reviews by Edson OliveiraJrBug detection is central to software engineering, but what motivates programmers to perform as optimally as possible? Despite a long history of economic experiments on incentivisation, there is surprisingly little research on how different incentives shape software engineering performance.
In the current study, Bershadskyy et al. (2024) undertook an experiment to evaluate how the pay-off functions associated with different financial incentives influence the performance of participants in identifying bugs during code review. The authors hypothesised that performance-based incentivisation would result in higher average performance, as defined using the F1-score, and that different incentivisation schemes may also differ in their effectiveness.
The results did not support the preregistered predictions, with no statistically significant differences in F1-score observed between groups that received performance-based incentives compared to a control group that received no incentive. Exploratory analyses suggested some potential trends of interest, but the main implication of this work is methodological: that experiments in this field require substantially larger sample sizes to provide definitive tests. The current work is valuable in providing a novel unbiased insight on the magnitude of this challenge, which is now primed for further investigation.
The Stage 2 manuscript was evaluated over one round of in-depth review. Based on detailed responses to the recommender and reviewer's comments, the recommender judged that the manuscript met the Stage 2 criteria and awarded a positive recommendation.
URL to the preregistered Stage 1 protocol: https://osf.io/s36c2 Level of bias control achieved: Level 6. No part of the data or evidence that was used to answer the research question was generated until after IPA.
List of eligible PCI RR-friendly journals: References
Bershadskyy, D., Krüger, J., Çalıklı, G., Siegmar, O., Zabel, S., Greif, J. and Heyer, R. (2024). A Laboratory Experiment on Using Different Financial-Incentivization Schemes in Software-Engineering Experimentation. Acceptance of Version 8 by Peer Community in Registered Reports. https://arxiv.org/pdf/2202.10985
| A Laboratory Experiment on Using Different Financial-Incentivization Schemes in Software-Engineering Experimentation | Dmitri Bershadskyy, Jacob Krüger, Gül Çalıklı, Siegmar Otto, Sarah Zabel, Jannik Greif, Robert Heyer | <p>In software-engineering research, many empirical studies are conducted with open-source or industry developers. However, in contrast to other research communities like economics or psychology, only few experiments use financial incentives (i.e.... | Computer science | Chris Chambers | 2024-03-20 07:44:51 | View | ||
13 Jul 2023
STAGE 1
Modulatory effects of instructions on extinction efficacy in appetitive and aversive learning: A registered reportLea Busch, Katja Wiech, Matthias Gamer, Balint Kincses, Tamas Spisak, Katharina Schmidt, Ulrike Bingel https://osf.io/cj75pNeurocognitive insights on instructed extinction in the context of painRecommended by Chris Chambers based on reviews by Tom Beckers, Gaëtan Mertens and Karita OjalaRapid learning in response to pain is a crucial survival mechanism, relying on forming associations between cues in the environment and subsequent pain or injury. Existing evidence suggests that associations between conditioned stimuli (cues) and unconditioned aversive stimuli (such as pain) are learned faster than for appetitive stimuli that signal pain relief. In addition, when the link between a conditioned and unconditioned stimulus is broken (by unpairing them), the extinction of this learning effect is slower for aversive that appetitive stimuli, resulting in a flatter extinction slope. Understanding why extinction slopes are reduced for aversive stimuli is important for advancing theoretical models of learning, and for devising ways of increasing the slope (and thus facilitating extinction learning) could help develop more effective methods of pain relief, particularly in the treatment of chronic pain.
In the current programmatic submission, Busch et al. (2023) will undertake two Registered Reports to test whether a verbal instruction intervention that explicitly informs participants about contingency changes between conditioned and unconditioned stimuli facilitates extinction learning, especially for aversive (painful) stimuli, and how changes in extinction learning relate to neural biomarkers of functional connectivity. In the first Registered Report, they will initially seek to replicate previous findings including faster acquisition of aversive than appetitive conditioned stimuli as well as incomplete extinction of aversive conditioned stimuli without verbal instruction. They will then test how the instruction intervention alters extinction slopes and the completeness of extinction for appetitive and aversive stimuli, using a range of behavioral measures (expectancy and valence ratings) and physiological measures (pupillometry, skin conductance responses). To shed light on the neural correlates of these processes, in the second Registered Report the authors will use functional magnetic resonance imaging (fMRI) to ask firstly how acquisition and extinction of aversive and appetitive conditioned responses are related to resting state brain connectivity within a network that includes ventromedial prefrontal cortex, amygdala, and striatum, and secondly, whether the effectiveness of instruction on extinction learning is associated with differences in resting state connectivity across this network.
The Stage 1 manuscript was evaluated over two rounds of in-depth review. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
URL to the preregistered Stage 1 protocol: https://osf.io/cj75p (under temporary private embargo)
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA. List of eligible PCI RR-friendly journals:
References
1. Busch, L., Wiech, K., Gamer, M., Knicses, B., Spisak, T., Schmidt, K., & Bingel, U. (2023). Modulatory effects of instructions on extinction efficacy in appetitive and aversive learning: A registered report. In principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/cj75p
| Modulatory effects of instructions on extinction efficacy in appetitive and aversive learning: A registered report | Lea Busch, Katja Wiech, Matthias Gamer, Balint Kincses, Tamas Spisak, Katharina Schmidt, Ulrike Bingel | <p>In the context of pain, extinction learning has been shown to be slower or incomplete for aversive compared to appetitive cues (i.e., cues signaling pain exacerbation and pain relief, respectively), potentially due to their higher biological re... | Medical Sciences | Chris Chambers | 2022-10-15 19:45:48 | View | ||
Stage 2 Registered Report: Stress regulation via being in nature and social support in adults, a meta-analysisAlessandro Sparacio, Ivan Ropovik, Gabriela M. Jiga-Boy, Adar Cem Lağap, Hans IJzerman https://doi.org/10.31234/osf.io/a4zmjDoes emotional support and being in nature influence stress?Recommended by Chris Chambers based on reviews by Felix Schönbrodt and Siu Kit YeungStress is a familiar presence in modern life and may be rising in severity (Almeida et al., 2020). As a key driver of many health problems, controlling stress and its impacts is a central goal in clinical and health psychology, yet the effectiveness of existing interventions to regulate stress remains unclear.
In the current study, Sparacio et al tackled this question from a meta-analytic perspective, focusing on a corpus of existing research that has addressed the efficacy of two specific stress regulation interventions: being in nature and emotional social support. As well as evaluating the evidential content of the relevant literatures, the authors also examined signs of publication bias and the moderating role of personality traits.
After correcting for publication bias, the results reveal evidence that being in nature is effective at reducing stress while emotional social support is not. The moderating role of personality for both interventions was inconclusive due to lack of evidence. In addition, the quality of the surveyed literature was found to be low overall, suffering from a high risk of bias and high rate of statistical reporting errors. The authors offer several recommendations to improve the rigour and quality of studies in this field, including open data, open materials, code review, preregistration and the use of Registered Reports.
The Stage 2 manuscript was evaluated over one round of in-depth review. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 2 criteria and awarded a positive recommendation.
URL to the preregistered Stage 1 protocol: https://osf.io/c25qw
Level of bias control achieved: Level 3. At least some data/evidence that was used to the answer the research question had been previously accessed by the authors (e.g. downloaded or otherwise received), but the authors certify that they did not observe ANY part of the data/evidence prior to Stage 1 IPA.
List of eligible PCI RR-friendly journals:
References
1. Almeida, D. M., Charles, S. T., Mogle, J., Drewelies, J., Aldwin, C. M., Spiro, A. III, & Gerstorf, D. (2020). Charting adult development through (historically changing) daily stress processes. American Psychologist, 75(4), 511–524. https://doi.org/10.1037/amp0000597
2. Sparacio, A., Ropovik, I., Jiga-Boy, G. M., Lağap, A. C. & IJzerman, H. (2023). Stage 2 Registered Report: Stress regulation via being in nature and social support in adults, a meta-analysis. Acceptance of version 2 by Peer Community in Registered Reports. https://doi.org/10.31234/osf.io/a4zmj
| Stage 2 Registered Report: Stress regulation via being in nature and social support in adults, a meta-analysis | Alessandro Sparacio, Ivan Ropovik, Gabriela M. Jiga-Boy, Adar Cem Lağap, Hans IJzerman | <p>In this meta-analysis, the authors investigated whether being in nature and emotional social support are reliable strategies to downregulate stress. We retrieved all the relevant articles that investigated a connection between one of these two ... | Social sciences | Chris Chambers | 2023-01-09 09:32:27 | View | ||
Does alleviating poverty increase cognitive performance? Short- and long-term evidence from a randomized controlled trialBarnabas Szaszi, Bence Palfi, Gabor Neszveda, Aikaterini Taka, Péter Szécsi, Christopher Blattman, Julian C. Jamison, Margaret Sheridan https://doi.org/10.31234/osf.io/4gyzhNo strong effect of unconditional cash transfers on cognitionRecommended by Chris Chambers based on reviews by Charlotte Pennington and Matúš AdamkovičRecent studies have revealed potential benefits of unconditional cash transfers (UCTs) on a variety of health and social outcomes, including self-reported happiness and life satisfaction (Haushofer & Shapiro, 2016), economic and financial well-being (Blattman et al., 2013; Baird et al., 2018) and educational attainment (Baird et al., 2016). Although the effects of UCTs do not always out-perform rigorous control conditions (Whillans & West, 2022), these findings prompt the question of whether the alleviation of poverty via UCTs can also influence cognitive processing and performance.
In the current study, Szaszi et al. analysed the results of a previous randomised trial of UCTs by Blattman et al. (2017) to test whether a $200 lump sum – equivalent to three months of income – administered to a sample of young men in Liberia carries both short- and long-term benefits for a range of executive functions, including attention, response inhibition, and working memory capacity. Overall, the results suggest minimal if any consequences of the intervention – the observed effects of UCTs on cognition were several times smaller than suggested by previous research, and the evidence for a positive effect was inconclusive. Extensive multiverse analyses showed that these findings were robust to a range of alternative analytical specifications, and the authors estimate that a sample size of nearly 5000 would be required to provide strong evidence.
In their Discussion, the authors explore a range of reasons for the negative findings compared with previous research, including the more rigorous and severe causal test enabled by the randomised trial design, the demographic homogeneity of the sample demographic, the use of pen-and-paper tests (cf. computerised tests in previous studies), and the delivery of a lump-sum cash transfer compared with a regular monthly installment. In addition, although the results were negative or inconclusive, there were hints that a positive effect of UCTs may be more evident in some cognitive domains than in others – in this case, potentially benefiting working memory more than inhibitory control. Further research would be required to confirm this hypothesis.
The Stage 2 manuscript was evaluated over one round of in-depth review. Based on the responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 2 criteria and awarded a positive recommendation.
URL to the preregistered Stage 1 protocol: https://osf.io/k56yv
Level of bias control achieved: Level 2. At least some data/evidence that was used to answer the research question had been accessed and partially observed by the authors prior to Stage 1 acceptance, but the authors certified that they had not yet observed the key variables within the data that would be used to answer the research question AND they took additional steps to maximise bias control and rigour.
List of eligible PCI RR-friendly journals:
References
1. Haushofer, J. & Shapiro, J. (2016). The short-term impact of unconditional cash transfers to the poor: Experimental evidence from Kenya. Quarterly Journal of Economics, 13, 1973–2042. https://doi.org/10.1093/qje/qjw025
2. Blattman, C., Fiala, N. & Martinez, S. (2013) Generating skilled self-employment in developing countries: Experimental evidence from Uganda. Quarterly Journal of Economics, 129, 697–752. https://doi.org/10.1093/qje/qjt057
3. Baird, S., McKenzie, D., & Özler, B. (2018). The effects of cash transfers on adult labor market outcomes. IZA Journal of Development and Migration, 8, 1-20. https://doi.org/10.1186/s40176-018-0131-9
4. Baird, S., Chirwa, E., De Hoop, J., & Özler, B. (2016). Girl power: cash transfers and adolescent welfare: evidence from a cluster-randomized experiment in Malawi. In African Successes, Volume II: Human Capital (pp. 139-164). University of Chicago Press. https://www.nber.org/system/files/chapters/c13380/c13380.pdf
5. Whillans, A., & West, C. (2022). Alleviating time poverty among the working poor: A pre-registered longitudinal field experiment. Scientific Reports, 12(1), 1-17. https://doi.org/10.1038/s41598-021-04352-y
6. Blattman, C., Jamison, J. C. & Sheridan, M. (2017). Reducing crime and violence: Experimental evidence from cognitive behavioral therapy in Liberia. American Economic Review, 107, 1165–1206. http://doi.org/10.1257/aer.20150503
7. Szaszi, B., Palfi, B., Neszveda, G., Taka, A., Szecsi, P., Blattman, C., Jamison, J. C., & Sheridan, M. (2022). Does alleviating poverty increase cognitive performance? Short- and long-term evidence from a randomized controlled trial. Stage 2 Registered Report, acceptance of Version 2 by Peer Community in Registered Reports. https://psyarxiv.com/4gyzh
| Does alleviating poverty increase cognitive performance? Short- and long-term evidence from a randomized controlled trial | Barnabas Szaszi, Bence Palfi, Gabor Neszveda, Aikaterini Taka, Péter Szécsi, Christopher Blattman, Julian C. Jamison, Margaret Sheridan | <p>In this Registered Report, we investigated the impact of a poverty alleviation program on cognitive performance. We analyzed data from a randomized controlled trial conducted on low-income, high-risk individuals in Liberia where a random half o... | Social sciences | Chris Chambers | 2022-07-13 12:10:49 | View |
MANAGING BOARD
Chris Chambers
Zoltan Dienes
Corina Logan
Benoit Pujol
Maanasa Raghavan
Emily S Sena
Yuki Yamada