Announcements
We are recruiting recommenders (editors) from all research fields!
Your feedback matters! If you have authored or reviewed a Registered Report at Peer Community in Registered Reports, then please take 5 minutes to leave anonymous feedback about your experience, and view community ratings.
Latest recommendations
Id | Title * | Authors * | Abstract * ▼ | Picture | Thematic fields * | Recommender | Reviewers | Submission date | |
---|---|---|---|---|---|---|---|---|---|
Progression of white matter hyperintensities is related to blood pressure increases and global cognitive decline – a registered reportFrauke Beyer, Laurenz Lammer, Markus Loeffler, Steffi Riedel-Heller, Stéphanie Debette, Arno Villringer, A. Veronica Witte https://doi.org/10.17605/OSF.IO/REA4WWhite matter lessions are associated with increases in blood pressure and global cognitive declineRecommended by Chris ChambersCerebral small vessel disease (CSVD) is a common and multi-faceted set of pathologies that affect the small arteries, arterioles, venules and capillaries of the brain. The disease manifests through a range of symptoms and conditions, including psychiatric disorders, abnormal gait, and urinary incontinence, while accounting for 25% of strokes and nearly 50% of dementia.
The presence of CSVD is associated with white matter lesions detected as white matter hyperintensities (WMH) using neuroimaging, which have in turn been shown to predict future stroke, cognitive decline and dementia. While vascular risk factors of CSVD (such as hypertension and obesity) are also associated with CSVD, a complete picture of the predictive relationship between WMH, cognitive decline, and blood pressure remains to be determined, as does the role of sex/gender. These inter-relationships are important to determine for improving the diagnosis and treatment of CSVD.
In the current study, Beyer et al. analysed a large emerging dataset from the LIFE-Adult project – a longitudinal, two-wave, population-based study – to ask whether higher blood pressure predicts a greater increase in WMH, and whether progression of WMH is associated with measures of memory and executive function. In addition, the authors explored the relationship between abdominal obesity and WMH progression, and the extent to which WMH progression, and its interaction with vascular risk factors, depends on sex/gender.
Results revealed no reliable association between baseline blood pressure with WMH progression. WMH progression significantly predicted global cognitive decline but not decline in executive function specifically. Exploratory analyses revealed that increases in diastolic blood pressure as well as baseline and systolic blood pressure were associated with WMH progression, specifically in frontal periventricular regions, but there was no association of waist-to-hip ratio (a proxy of abdominal fat deposits) with WMH progression nor any gender-specific associations. The authors conclude that strict control of blood pressure might confer a protective effect, limiting WMH progression and negative effects on global cognitive function in the middle-aged to older population.
The Stage 2 manuscript was evaluated over one round of in-depth review. Based on responses to the reviewer's comments, the recommender judged that the manuscript met the Stage 2 criteria and awarded a positive recommendation.
URL to the preregistered Stage 1 protocol: https://osf.io/qkbgj Level of bias control achieved: Level 2. At least some data/evidence that was used to answer the research question had been accessed and partially observed by the authors prior to Stage 1 in-principle acceptance, but the authors certify that they had not yet observed the key variables within the data that were used to answer the research question.
List of eligible PCI RR-friendly journals: References
1. Beyer, F., Lammer, L., Loeffler, M., Riedel-Heller, S., Debette, S., Villringer, A. & Witte, A. V. (2023). Progression of white matter hyperintensities is related to blood pressure increases and global cognitive decline – a registered report [Stage 2]. Acceptance of Version 2 by Peer Community in Registered Reports. https://osf.io/k24pm
| Progression of white matter hyperintensities is related to blood pressure increases and global cognitive decline – a registered report | Frauke Beyer, Laurenz Lammer, Markus Loeffler, Steffi Riedel-Heller, Stéphanie Debette, Arno Villringer, A. Veronica Witte | <p>Introduction<br>White matter hyperintensities (WMH) reflect cerebral small vessel disease (cSVD), a major brain pathology contributing to cognitive decline and dementia. Vascular risk factors including higher diastolic blood pressure (DBP) have... | ![]() | Humanities, Medical Sciences | Chris Chambers | 2024-02-15 17:16:37 | View | |
24 Apr 2024
STAGE 1
![]() Synaesthesia as a Model for Assessing Individual Differences in Visual Perception and Memory PerformanceEmily Whelan, Chhavi Sachdeva, Rebecca Ovalle-Fresa, Nicolas Rothen and Jamie Ward https://osf.io/6h8dxWhat can synaesthesia tell us about links between perception and memory?Recommended by Reshanne ReederWhat is the relationship between perception and memory? Although these topics are typically investigated separately, there is evidence that these cognitive processes may be related: for example, individuals with synaesthesia may experience both enhancements in visual acuity and visual memory; and individuals with amnesia may also show deficits in visual perceptual processing. However, comprehensive evidence for the relationship between perception and different forms of memory (both short-term and long-term) is currently lacking.
In this Stage 1 manuscript, Whelan et al. (2024) seek to elucidate this relationship by investigating individual differences in perception and memory in a general population sample (i.e., in synaesthetes, non-synaesthetic relatives, and controls). There are two accounts that may explain enhanced perception and memory in synaesthesia: a ‘dual-coding’ account, which suggests that the extra perceptual information often experienced in synaesthesia (e.g., seeing colors for different letters of the alphabet) may contribute to encoding richer information in sensory memory; and an ‘enhanced processing’ account, which posits that enhanced perception and memory in synaesthesia may be due to genetic or environmental factors not directly related to synaesthetic experiences. In the former case, synaesthetes should perform more similarly to each other than to their non-synaesthetic relatives; in the latter case, non-synaesthetic relatives of synaesthetes should show similar perceptual and memory benefits. The current study should therefore find evidence in favor of one of these accounts over the other. In addition to this, the authors will generate multidimensional cognitive profiles of synaesthetes and their relatives, compared to non-synaethetes, including perception, memory, mental imagery and cognitive styles.
The Stage 1 submission was evaluated by the recommender and two expert reviewers. Following revisions, the recommender judged that the manuscript met the Stage 1 criteria and awarded in-principle acceptance (IPA).
URL to the preregistered Stage 1 protocol: https://osf.io/6h8dx (under temporary private embargo) Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA. List of eligible PCI RR-friendly journals:
References
1. Whelan, E., Sachdeva, C., Ovalle-Fresa, R., Rothen R., & Ward, J. (2024). Synaesthesia as a Model for Assessing Individual Differences in Visual Perception and Memory Performance. In principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/6h8dx
| Synaesthesia as a Model for Assessing Individual Differences in Visual Perception and Memory Performance | Emily Whelan, Chhavi Sachdeva, Rebecca Ovalle-Fresa, Nicolas Rothen and Jamie Ward | <p>In this study, the cognitive profile of synaesthesia (a perceptual condition in which primary experiences, such as perceiving digits or words, elicit extra secondary sensations) is used as a model system to assess visual perceptual abilities an... | Social sciences | Reshanne Reeder | 2023-11-07 13:02:39 | View | ||
Does alleviating poverty increase cognitive performance? Short- and long-term evidence from a randomized controlled trialBarnabas Szaszi, Bence Palfi, Gabor Neszveda, Aikaterini Taka, Péter Szécsi, Christopher Blattman, Julian C. Jamison, Margaret Sheridan https://doi.org/10.31234/osf.io/4gyzhNo strong effect of unconditional cash transfers on cognitionRecommended by Chris ChambersRecent studies have revealed potential benefits of unconditional cash transfers (UCTs) on a variety of health and social outcomes, including self-reported happiness and life satisfaction (Haushofer & Shapiro, 2016), economic and financial well-being (Blattman et al., 2013; Baird et al., 2018) and educational attainment (Baird et al., 2016). Although the effects of UCTs do not always out-perform rigorous control conditions (Whillans & West, 2022), these findings prompt the question of whether the alleviation of poverty via UCTs can also influence cognitive processing and performance.
In the current study, Szaszi et al. analysed the results of a previous randomised trial of UCTs by Blattman et al. (2017) to test whether a $200 lump sum – equivalent to three months of income – administered to a sample of young men in Liberia carries both short- and long-term benefits for a range of executive functions, including attention, response inhibition, and working memory capacity. Overall, the results suggest minimal if any consequences of the intervention – the observed effects of UCTs on cognition were several times smaller than suggested by previous research, and the evidence for a positive effect was inconclusive. Extensive multiverse analyses showed that these findings were robust to a range of alternative analytical specifications, and the authors estimate that a sample size of nearly 5000 would be required to provide strong evidence.
In their Discussion, the authors explore a range of reasons for the negative findings compared with previous research, including the more rigorous and severe causal test enabled by the randomised trial design, the demographic homogeneity of the sample demographic, the use of pen-and-paper tests (cf. computerised tests in previous studies), and the delivery of a lump-sum cash transfer compared with a regular monthly installment. In addition, although the results were negative or inconclusive, there were hints that a positive effect of UCTs may be more evident in some cognitive domains than in others – in this case, potentially benefiting working memory more than inhibitory control. Further research would be required to confirm this hypothesis.
The Stage 2 manuscript was evaluated over one round of in-depth review. Based on the responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 2 criteria and awarded a positive recommendation.
URL to the preregistered Stage 1 protocol: https://osf.io/k56yv
Level of bias control achieved: Level 2. At least some data/evidence that was used to answer the research question had been accessed and partially observed by the authors prior to Stage 1 acceptance, but the authors certified that they had not yet observed the key variables within the data that would be used to answer the research question AND they took additional steps to maximise bias control and rigour.
List of eligible PCI RR-friendly journals:
References
1. Haushofer, J. & Shapiro, J. (2016). The short-term impact of unconditional cash transfers to the poor: Experimental evidence from Kenya. Quarterly Journal of Economics, 13, 1973–2042. https://doi.org/10.1093/qje/qjw025
2. Blattman, C., Fiala, N. & Martinez, S. (2013) Generating skilled self-employment in developing countries: Experimental evidence from Uganda. Quarterly Journal of Economics, 129, 697–752. https://doi.org/10.1093/qje/qjt057
3. Baird, S., McKenzie, D., & Özler, B. (2018). The effects of cash transfers on adult labor market outcomes. IZA Journal of Development and Migration, 8, 1-20. https://doi.org/10.1186/s40176-018-0131-9
4. Baird, S., Chirwa, E., De Hoop, J., & Özler, B. (2016). Girl power: cash transfers and adolescent welfare: evidence from a cluster-randomized experiment in Malawi. In African Successes, Volume II: Human Capital (pp. 139-164). University of Chicago Press. https://www.nber.org/system/files/chapters/c13380/c13380.pdf
5. Whillans, A., & West, C. (2022). Alleviating time poverty among the working poor: A pre-registered longitudinal field experiment. Scientific Reports, 12(1), 1-17. https://doi.org/10.1038/s41598-021-04352-y
6. Blattman, C., Jamison, J. C. & Sheridan, M. (2017). Reducing crime and violence: Experimental evidence from cognitive behavioral therapy in Liberia. American Economic Review, 107, 1165–1206. http://doi.org/10.1257/aer.20150503
7. Szaszi, B., Palfi, B., Neszveda, G., Taka, A., Szecsi, P., Blattman, C., Jamison, J. C., & Sheridan, M. (2022). Does alleviating poverty increase cognitive performance? Short- and long-term evidence from a randomized controlled trial. Stage 2 Registered Report, acceptance of Version 2 by Peer Community in Registered Reports. https://psyarxiv.com/4gyzh
| Does alleviating poverty increase cognitive performance? Short- and long-term evidence from a randomized controlled trial | Barnabas Szaszi, Bence Palfi, Gabor Neszveda, Aikaterini Taka, Péter Szécsi, Christopher Blattman, Julian C. Jamison, Margaret Sheridan | <p>In this Registered Report, we investigated the impact of a poverty alleviation program on cognitive performance. We analyzed data from a randomized controlled trial conducted on low-income, high-risk individuals in Liberia where a random half o... | Social sciences | Chris Chambers | 2022-07-13 12:10:49 | View | ||
Stage 2 Registered Report: Stress regulation via being in nature and social support in adults, a meta-analysisAlessandro Sparacio, Ivan Ropovik, Gabriela M. Jiga-Boy, Adar Cem Lağap, Hans IJzerman https://doi.org/10.31234/osf.io/a4zmjDoes emotional support and being in nature influence stress?Recommended by Chris ChambersStress is a familiar presence in modern life and may be rising in severity (Almeida et al., 2020). As a key driver of many health problems, controlling stress and its impacts is a central goal in clinical and health psychology, yet the effectiveness of existing interventions to regulate stress remains unclear.
In the current study, Sparacio et al tackled this question from a meta-analytic perspective, focusing on a corpus of existing research that has addressed the efficacy of two specific stress regulation interventions: being in nature and emotional social support. As well as evaluating the evidential content of the relevant literatures, the authors also examined signs of publication bias and the moderating role of personality traits.
After correcting for publication bias, the results reveal evidence that being in nature is effective at reducing stress while emotional social support is not. The moderating role of personality for both interventions was inconclusive due to lack of evidence. In addition, the quality of the surveyed literature was found to be low overall, suffering from a high risk of bias and high rate of statistical reporting errors. The authors offer several recommendations to improve the rigour and quality of studies in this field, including open data, open materials, code review, preregistration and the use of Registered Reports.
The Stage 2 manuscript was evaluated over one round of in-depth review. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 2 criteria and awarded a positive recommendation.
URL to the preregistered Stage 1 protocol: https://osf.io/c25qw
Level of bias control achieved: Level 3. At least some data/evidence that was used to the answer the research question had been previously accessed by the authors (e.g. downloaded or otherwise received), but the authors certify that they did not observe ANY part of the data/evidence prior to Stage 1 IPA.
List of eligible PCI RR-friendly journals:
References
1. Almeida, D. M., Charles, S. T., Mogle, J., Drewelies, J., Aldwin, C. M., Spiro, A. III, & Gerstorf, D. (2020). Charting adult development through (historically changing) daily stress processes. American Psychologist, 75(4), 511–524. https://doi.org/10.1037/amp0000597
2. Sparacio, A., Ropovik, I., Jiga-Boy, G. M., Lağap, A. C. & IJzerman, H. (2023). Stage 2 Registered Report: Stress regulation via being in nature and social support in adults, a meta-analysis. Acceptance of version 2 by Peer Community in Registered Reports. https://doi.org/10.31234/osf.io/a4zmj
| Stage 2 Registered Report: Stress regulation via being in nature and social support in adults, a meta-analysis | Alessandro Sparacio, Ivan Ropovik, Gabriela M. Jiga-Boy, Adar Cem Lağap, Hans IJzerman | <p>In this meta-analysis, the authors investigated whether being in nature and emotional social support are reliable strategies to downregulate stress. We retrieved all the relevant articles that investigated a connection between one of these two ... | Social sciences | Chris Chambers | 2023-01-09 09:32:27 | View | ||
13 Jul 2023
STAGE 1
![]() Modulatory effects of instructions on extinction efficacy in appetitive and aversive learning: A registered reportLea Busch, Katja Wiech, Matthias Gamer, Balint Kincses, Tamas Spisak, Katharina Schmidt, Ulrike Bingel https://osf.io/cj75pNeurocognitive insights on instructed extinction in the context of painRecommended by Chris ChambersRapid learning in response to pain is a crucial survival mechanism, relying on forming associations between cues in the environment and subsequent pain or injury. Existing evidence suggests that associations between conditioned stimuli (cues) and unconditioned aversive stimuli (such as pain) are learned faster than for appetitive stimuli that signal pain relief. In addition, when the link between a conditioned and unconditioned stimulus is broken (by unpairing them), the extinction of this learning effect is slower for aversive that appetitive stimuli, resulting in a flatter extinction slope. Understanding why extinction slopes are reduced for aversive stimuli is important for advancing theoretical models of learning, and for devising ways of increasing the slope (and thus facilitating extinction learning) could help develop more effective methods of pain relief, particularly in the treatment of chronic pain.
In the current programmatic submission, Busch et al. (2023) will undertake two Registered Reports to test whether a verbal instruction intervention that explicitly informs participants about contingency changes between conditioned and unconditioned stimuli facilitates extinction learning, especially for aversive (painful) stimuli, and how changes in extinction learning relate to neural biomarkers of functional connectivity. In the first Registered Report, they will initially seek to replicate previous findings including faster acquisition of aversive than appetitive conditioned stimuli as well as incomplete extinction of aversive conditioned stimuli without verbal instruction. They will then test how the instruction intervention alters extinction slopes and the completeness of extinction for appetitive and aversive stimuli, using a range of behavioral measures (expectancy and valence ratings) and physiological measures (pupillometry, skin conductance responses). To shed light on the neural correlates of these processes, in the second Registered Report the authors will use functional magnetic resonance imaging (fMRI) to ask firstly how acquisition and extinction of aversive and appetitive conditioned responses are related to resting state brain connectivity within a network that includes ventromedial prefrontal cortex, amygdala, and striatum, and secondly, whether the effectiveness of instruction on extinction learning is associated with differences in resting state connectivity across this network.
The Stage 1 manuscript was evaluated over two rounds of in-depth review. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
URL to the preregistered Stage 1 protocol: https://osf.io/cj75p (under temporary private embargo)
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA. List of eligible PCI RR-friendly journals:
References
1. Busch, L., Wiech, K., Gamer, M., Knicses, B., Spisak, T., Schmidt, K., & Bingel, U. (2023). Modulatory effects of instructions on extinction efficacy in appetitive and aversive learning: A registered report. In principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/cj75p
| Modulatory effects of instructions on extinction efficacy in appetitive and aversive learning: A registered report | Lea Busch, Katja Wiech, Matthias Gamer, Balint Kincses, Tamas Spisak, Katharina Schmidt, Ulrike Bingel | <p>In the context of pain, extinction learning has been shown to be slower or incomplete for aversive compared to appetitive cues (i.e., cues signaling pain exacerbation and pain relief, respectively), potentially due to their higher biological re... | Medical Sciences | Chris Chambers | 2022-10-15 19:45:48 | View | ||
A Laboratory Experiment on Using Different Financial-Incentivization Schemes in Software-Engineering ExperimentationDmitri Bershadskyy, Jacob Krüger, Gül Çalıklı, Siegmar Otto, Sarah Zabel, Jannik Greif, Robert Heyer https://arxiv.org/pdf/2202.10985Bug detection in software engineering: which incentives work best?Recommended by Chris ChambersBug detection is central to software engineering, but what motivates programmers to perform as optimally as possible? Despite a long history of economic experiments on incentivisation, there is surprisingly little research on how different incentives shape software engineering performance.
In the current study, Bershadskyy et al. (2024) undertook an experiment to evaluate how the pay-off functions associated with different financial incentives influence the performance of participants in identifying bugs during code review. The authors hypothesised that performance-based incentivisation would result in higher average performance, as defined using the F1-score, and that different incentivisation schemes may also differ in their effectiveness.
The results did not support the preregistered predictions, with no statistically significant differences in F1-score observed between groups that received performance-based incentives compared to a control group that received no incentive. Exploratory analyses suggested some potential trends of interest, but the main implication of this work is methodological: that experiments in this field require substantially larger sample sizes to provide definitive tests. The current work is valuable in providing a novel unbiased insight on the magnitude of this challenge, which is now primed for further investigation.
The Stage 2 manuscript was evaluated over one round of in-depth review. Based on detailed responses to the recommender and reviewer's comments, the recommender judged that the manuscript met the Stage 2 criteria and awarded a positive recommendation.
URL to the preregistered Stage 1 protocol: https://osf.io/s36c2 Level of bias control achieved: Level 6. No part of the data or evidence that was used to answer the research question was generated until after IPA.
List of eligible PCI RR-friendly journals: References
Bershadskyy, D., Krüger, J., Çalıklı, G., Siegmar, O., Zabel, S., Greif, J. and Heyer, R. (2024). A Laboratory Experiment on Using Different Financial-Incentivization Schemes in Software-Engineering Experimentation. Acceptance of Version 8 by Peer Community in Registered Reports. https://arxiv.org/pdf/2202.10985
| A Laboratory Experiment on Using Different Financial-Incentivization Schemes in Software-Engineering Experimentation | Dmitri Bershadskyy, Jacob Krüger, Gül Çalıklı, Siegmar Otto, Sarah Zabel, Jannik Greif, Robert Heyer | <p>In software-engineering research, many empirical studies are conducted with open-source or industry developers. However, in contrast to other research communities like economics or psychology, only few experiments use financial incentives (i.e.... | Computer science | Chris Chambers | 2024-03-20 07:44:51 | View | ||
22 Jul 2024
STAGE 1
![]() Replication of “Carbon-Dot-Based Dual-Emission Nanohybrid Produces a Ratiometric Fluorescent Sensor for In Vivo Imaging of Cellular Copper Ions”Maha Said, Mustafa Gharib, Samia Zrig, Raphaël Lévy https://osf.io/kf9qe/Replicating, Revising and Reforming: Unpicking the Apparent Nanoparticle Endosomal Escape ParadoxRecommended by Emily Linnane and Yuki YamadaContext
Over the past decade there has been an exponential increase in the number of research papers utlising nanoparticles for biological applications such as intracellular sensing [1, 2], theranostics [3-5] and more recently drug delivery and precision medicine [6, 7]. Despite the success stories, there is a disconnect regarding current dogma on issues such as nanoparticle uptake and trafficking, nanoparticle delivery via the enhanced permeability and retention (EPR) effect, and endosomal escape. Critical re-evaluation of these concepts both conceptually and experimentally is needed for continued advancement in the field.
For this preregistration, Said et al. (2024) focus on nanoparticle intracellular trafficking, specifically endosomal escape [8]. The current consensus in the literature is that nanoparticles enter cells via endocytosis [9, 10] but reportedly just 1-2% of nanoparticles/ nanoparticle probes escape endosomes and enter the cytoplasm [11-13]. There is therefore an apparent paradox over how sensing nanoparticles can detect their intended targets in the cytoplasm if they are trapped within the cell endosomes. To address this fundamental issue of nanoparticle endosomal escape, Lévy and coworkers are carrying out replication studies to thoroughly and transparently replicate the most influential papers in the field of nanoparticle sensing. The aim of these replication studies is twofold: to establish a robust methodology to study endosomal escape of nanoparticles, and to encourage discussions, transparency and a step-change in the field.
Replication of “Carbon-Dot-Based Dual-Emission Nanohybrid Produces a Ratiometric Fluorescent Sensor for In Vivo Imaging of Cellular Copper Ions”
For this replication study, the authors classified papers on the topic of nanoparticle sensing and subsequently ranked them by number of citations. Based on this evaluation they selected a paper by Zhu and colleagues [14] entitled “Carbon-Dot-Based Dual-Emission Nanohybrid Produces a Ratiometric Fluorescent Sensor for In Vivo Imaging of Cellular Copper Ions” for their seminal replication study. To determine the reproducibility of the results from Zhu et al., the authors aim to establish the proportion of endosomal escape of the nanoparticles, and to examine the data in a biological context relevant to the application of the probe.
Beyond Replication
The authors plan to replicate the exact conditions reported in the materials and methods section of the selected paper such as nanoparticle probe synthesis of CdSe@C-TPEA nanoparticles, assessment of particle size, stability and reactivity and effect on cells (TEM, pH experiments, fluorescent responsivity to metal ions and cell viability). In addition, Said et al., plan to include further experimental characterisation to complement the existing study by Zhu and colleagues. They will incorporate additional controls and methodology to determine the intracellular location of nanoparticle probes in cells including: quantifying excess fluorescence in the culture medium, live cell imaging analysis, immunofluorescence with endosomal and lysosomal markers, and electron microscopy of cell sections. The authors will also include supplementary viability studies to assess the impact of the nanoparticles on HeLa cells as well as an additional biologically relevant cell line (for use in conjunction with the HeLa cells as per the original paper).
The Stage 1 manuscript underwent two rounds of thorough in-depth review. After considering the detailed responses to the reviewers' comments, the recommenders determined that the manuscript met the Stage 1 criteria and awarded in-principle acceptance (IPA).
The authors have thoughtfully considered their experimental approach to the replication study, whilst acknowledging any potential limitations. Given that conducting such a replication study is novel in the field of Nanotechnology and there is currently no ‘gold standard’ approach in doing so, the authors have showed thoughtful regard of statistical analysis and unbiased methodology where possible.
Based on current information, this study is the first use of preregistration via Peer Community in Registered Reports and the first formalised replication study in Nanotechnology for Biosciences. The outcomes of this of this study will be significant both scientifically and in the wider context in discussion of the scientific method.
URL to the preregistered Stage 1 protocol: https://osf.io/qbxpf
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA. List of eligible PCI RR-friendly Journals:
References
1. Howes, P. D., Chandrawati, R., & Stevens, M. M. (2014). Colloidal nanoparticles as advanced biological sensors. Science, 346(6205), 1247390. https://doi.org/10.1126/science.1247390
2. Liu, C. G., Han, Y. H., Kankala, R. K., Wang, S. B., & Chen, A. Z. (2020). Subcellular performance of nanoparticles in cancer therapy. International Journal of Nanomedicine, 675-704. https://doi.org/10.2147/IJN.S226186
3. Tang, W., Fan, W., Lau, J., Deng, L., Shen, Z., & Chen, X. (2019). Emerging blood–brain-barrier-crossing nanotechnology for brain cancer theranostics. Chemical Society Reviews, 48(11), 2967-3014. https://doi.org/10.1039/C8CS00805A
4. Yoon, Y. I., Pang, X., Jung, S., Zhang, G., Kong, M., Liu, G., & Chen, X. (2018). Smart gold nanoparticle-stabilized ultrasound microbubbles as cancer theranostics. Journal of Materials Chemistry B, 6(20), 3235-3239. https://doi.org/10.1039%2FC8TB00368H
5. Lin, H., Chen, Y., & Shi, J. (2018). Nanoparticle-triggered in situ catalytic chemical reactions for tumour-specific therapy. Chemical Society Reviews, 47(6), 1938-1958. https://doi.org/10.1039/C7CS00471K
6. Hou, X., Zaks, T., Langer, R., & Dong, Y. (2021). Lipid nanoparticles for mRNA delivery. Nature Reviews Materials, 6(12), 1078-1094. https://doi.org/10.1038/s41578-021-00358-0
7. Mitchell, M. J., Billingsley, M. M., Haley, R. M., Wechsler, M. E., Peppas, N. A., & Langer, R. (2021). Engineering precision nanoparticles for drug delivery. Nature Reviews Drug Discovery, 20(2), 101-124. https://doi.org/10.1038/s41573-020-0090-8
8. Said, M., Gharib, M., Zrig, S., & Lévy, R. (2024). Replication of “Carbon-Dot-Based Dual-Emission Nanohybrid Produces a Ratiometric Fluorescent Sensor for In Vivo Imaging of Cellular Copper Ions”. In principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/qbxpf
9. Behzadi, S., Serpooshan, V., Tao, W., Hamaly, M. A., Alkawareek, M. Y., Dreaden, E. C., ... & Mahmoudi, M. (2017). Cellular uptake of nanoparticles: Journey inside the cell. Chemical Society Reviews, 46(14), 4218-4244. https://doi.org/10.1039/C6CS00636A
10. de Almeida, M. S., Susnik, E., Drasler, B., Taladriz-Blanco, P., Petri-Fink, A., & Rothen-Rutishauser, B. (2021). Understanding nanoparticle endocytosis to improve targeting strategies in nanomedicine. Chemical society reviews, 50(9), 5397-5434. https://doi.org/10.1039/D0CS01127D
11. Smith, S. A., Selby, L. I., Johnston, A. P., & Such, G. K. (2018). The endosomal escape of nanoparticles: toward more efficient cellular delivery. Bioconjugate Chemistry, 30(2), 263-272. http://dx.doi.org/10.1021/acs.bioconjchem.8b00732
12. Cupic, K. I., Rennick, J. J., Johnston, A. P., & Such, G. K. (2019). Controlling endosomal escape using nanoparticle composition: current progress and future perspectives. Nanomedicine, 14(2), 215-223. https://doi.org/10.2217/nnm-2018-0326
13. Wang, Y., & Huang, L. (2013). A window onto siRNA delivery. Nature Biotechnology, 31(7), 611-612. https://doi.org/10.1038/nbt.2634
14. Zhu, A., Qu, Q., Shao, X., Kong, B., & Tian, Y. (2012). Carbon-dot-based dual-emission nanohybrid produces a ratiometric fluorescent sensor for in vivo imaging of cellular copper ions. Angewandte Chemie (International ed. in English), 51(29), 7185-7189. https://doi.org/10.1002/anie.201109089
| Replication of “Carbon-Dot-Based Dual-Emission Nanohybrid Produces a Ratiometric Fluorescent Sensor for In Vivo Imaging of Cellular Copper Ions” | Maha Said, Mustafa Gharib, Samia Zrig, Raphaël Lévy | <p>In hundreds of articles published over the past two decades, nanoparticles have been described as probes for sensing and imaging of a variety of intracellular cytosolic targets. However, nanoparticles generally enter cells by endocytosis with o... | ![]() | Life Sciences, Medical Sciences, Physical Sciences | Emily Linnane | 2023-11-29 19:14:03 | View | |
21 Jun 2024
STAGE 1
![]() Is it Worth the Hustle? A Multi-Country Replication of the Effort Moralization Effect and an Extension to Generational Differences in the Appreciation of EffortTassilo T. Tissot, Leopold H. O. Roth https://osf.io/5tkfrAre people who exert more effort in a task seen as more moral?Recommended by Adrien FillonThis study seeks to understand cultural and age differences in the effort moralization effect, a phenomenon in which people who put more effort into a task are considered more moral, regardless of the quality or the morality associated with the task. This is shown in common phrases such as the “great resignation” or “quiet quitting”, which are mostly used against younger members of the population, in particular generation Z.
Tissot and Roth (2024) propose to conduct a replication of a study from Celniker et al. (2023) which found evidence for this effect, with new samples from Mexico and Germany to test potential cultural differences. They will also test the effect of age on the effort moralization effect. Therefore, the study will be a quantitative analysis.
The authors included an adequate power analysis, alternatives for non-supported hypotheses, and filtering to ensure a high quality of data collection. They already provided an R script and dummy data to ensure the quality of the analysis. The Stage 1 manuscript was evaluated over three rounds of in-depth review. Based on detailed responses to reviewers’ and the recommender’s comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance.
URL to the preregistered Stage 1 protocol: https://osf.io/tvgw2
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.
List of eligible PCI RR-friendly journals:
References 1. Celniker, J. B., Gregory, A., Koo, H. J., Piff, P. K., Ditto, P. H., & Shariff, A. F. (2023). The moralization of effort. Journal of Experimental Psychology: General, 152, 60–79. https://doi.org/10.1037/xge0001259
2. Tissot, T. T. & Roth, L. H. O. (2024). Is it Worth the Hustle? A Multi-Country Replication of the Effort Moralization Effect and an Extension to Generational Differences in the Appreciation of Effort. In principle acceptance of Version 4 by Peer Community in Registered Reports. https://osf.io/tvgw2
| Is it Worth the Hustle? A Multi-Country Replication of the Effort Moralization Effect and an Extension to Generational Differences in the Appreciation of Effort | Tassilo T. Tissot, Leopold H. O. Roth | <p>Inferring the character of individuals is an adaptive need for partner and mating decisions as well as to avoid harm. The effort moralization effect is the finding that people who exert more effort in a task are seen as more moral, even if high... | Social sciences | Adrien Fillon | 2024-01-18 14:58:04 | View | ||
Is it Worth the Hustle? A Multi-Country Replication of the Effort Moralization Effect and an Extension to Generational Differences in the Appreciation of EffortTassilo T. Tissot, Leopold H. O. Roth https://doi.org/10.31219/osf.io/ck4st_v6Are people who exert more effort in a task seen as more moral?Recommended by Adrien FillonThis study seeks to understand cultural and age differences in the effort moralization effect, a phenomenon in which people who put more effort into a task are considered more moral, regardless of the quality or the morality associated with the task. This is shown in common phrases such as the “great resignation” or “quiet quitting”, which are mostly used against younger members of the population, in particular generation Z.
Tissot and Roth (2025) conducted a replication of a study from Celniker et al. (2023) which found evidence for this effect, with new samples from Mexico and Germany, to test potential cultural and age differences.
The results indicated a generalization of the effort moralization effect in Germany and Mexico, with important heterogeneity in the effect found, and effects sizes that were smaller than in the original study conducted in the USA. However, no effect was found regarding age, as younger individuals judged effort as being important in the same way as older individuals. It is possible, therefore, that the effort moralization effect is a consistent bias that persists regardless of age.
The Stage 2 manuscript was evaluated over three rounds of in-depth review. Based on detailed responses to the reviewers’ and recommender’s comments, the recommender judged that the manuscript met the Stage 2 criteria and awarded a positive recommendation.
URL to the preregistered Stage 1 protocol: https://osf.io/tvgw2
Level of bias control achieved: Level 6. No part of the data or evidence that was used to answer the research question was generated until after IPA.
List of eligible PCI RR-friendly journals:
References 1. Celniker, J. B., Gregory, A., Koo, H. J., Piff, P. K., Ditto, P. H., & Shariff, A. F. (2023). The moralization of effort. Journal of Experimental Psychology: General, 152, 60–79. https://doi.org/10.1037/xge0001259
2. Tissot, T. T. & Roth, L. H. O. (2025). Is it Worth the Hustle? A Multi-Country Replication of the Effort Moralization Effect and an Extension to Generational Differences in the Appreciation of Effort [Stage 2]. Acceptance of Version 6 by Peer Community in Registered Reports. https://doi.org/10.31219/osf.io/ck4st_v6
| Is it Worth the Hustle? A Multi-Country Replication of the Effort Moralization Effect and an Extension to Generational Differences in the Appreciation of Effort | Tassilo T. Tissot, Leopold H. O. Roth | <p>Inferring moral character of individuals is an adaptive need for social decision-making. The effort moralization effect describes the finding that people who exert more effort in a task are seen as more moral, even if higher effort does not enh... | Social sciences | Adrien Fillon | 2024-11-15 10:14:56 | View | ||
Factors impacting effective altruism: Revisiting heuristics and biases in charity in a replication and extensions Registered Report of Baron and Szymanska (2011)Mannix Chan, Gilad Feldman https://osf.io/4etkpUnderstanding biases and heuristics in charity donationsRecommended by Romain EspinosaDecisions to give to charities are affected by numerous external and internal factors. Understanding the elements influencing donation decisions is of first-order importance for science and society. On the scientific side, understanding the determinants of charity-giving contributes to the knowledge of altruistic behaviors in the presence of collective problems such as poverty, climate change, or animal welfare. On the social side, pointing out which factors affect donations can help increase prosocial behaviors and might facilitate collective actions in the case of public goods. Previous work has identified multiple mechanisms affecting altruistic donations to charities (Bekkers and Wiepking, 2011). Importantly, Baron and Szymanska (2011) collected empirical evidence suggesting that people prefer (i) their donations to be directly used for projects rather than organizational costs, (ii) when charities have low past costs, (iii) to diversity their donations into several NGOs, (iv) to favor charities that deal with close peers like nationals, and (v) to give voluntarily rather than through taxes. Here, Chan and Feldman (2024) conducted a close replication of Studies 1 to 4 of Baron and Szymanska (2011) using a large sample of online participants (four studies, overall N=1,403). In their replication, the authors found supporting evidence for the phenomena reported in the original study. In particular, people were more likely to donate to charities with lower organizational and lower past costs, to diversify their donations, and to show ingroup/nationalist preferences with larger donations to NGOs helping local over foreign children. Chan and Feldman (2024) ran additional analyses that indicated validity concerns regarding the analysis and questions that resulted in finding a preference for voluntary donations over taxation. In their added extensions that went beyond the original study, they also found that donors preferred to donate to charities whose overhead costs are paid for by other donors and unexpected evidence that making donations anonymous increased rather than decreased contributions. The Stage 2 manuscript was evaluated over one round of in-depth review by the recommender and two expert reviewers. Following revision, the recommender judged that the manuscript met the Stage 2 criteria and awarded a positive recommendation.
URL to the preregistered Stage 1 protocol: https://osf.io/gmswz
Level of bias control achieved: Level 6. No part of the data or evidence that was used to answer the research question was generated until after IPA. List of eligible PCI RR-friendly journals:
References
1. Baron, J. and Szymanska, E. (2011). Heuristics and Biases in Charity. In D. M. Oppenheimer and C. Y. Olivola (Eds.), The Science of Giving: Experimental Approaches to the Study of Charity (pp. 215–235). Psychology Press. https://doi.org/10.4324/9780203865972
2. Bekkers, R. and Wiepking, P. (2011). A Literature Review of Empirical Studies of Philanthropy. Nonprofit and Voluntary Sector Quarterly, 40, 924–973. https://doi.org/10.1177/0899764010380927
3. Chan, M. and Feldman, G. (2024). Factors impacting effective altruism: Revisiting heuristics and biases in charity in a replication and extensions Registered Report of Baron and Szymanska (2011) [Stage 2]. Acceptance of Version 5 by Peer Community in Registered Reports. https://osf.io/4etkp
| Factors impacting effective altruism: Revisiting heuristics and biases in charity in a replication and extensions Registered Report of Baron and Szymanska (2011) | Mannix Chan, Gilad Feldman | <p>Individuals who donate to charity may be affected by various biases and donate inefficiently. In a replication and extension Registered Report with a US Amazon Mechanical Turk sample using CloudResearch (N = 1403), we replicated Studies 1 to 4 ... | Social sciences | Romain Espinosa | 2024-04-27 02:28:49 | View |
FOLLOW US
MANAGING BOARD
Chris Chambers
Zoltan Dienes
Corina Logan
Benoit Pujol
Maanasa Raghavan
Emily S Sena
Yuki Yamada