Announcements
We are recruiting recommenders (editors) from all research fields!
Your feedback matters! If you have authored or reviewed a Registered Report at Peer Community in Registered Reports, then please take 5 minutes to leave anonymous feedback about your experience, and view community ratings.
Latest recommendations
Id | Title * | Authors * ▲ | Abstract * | Picture | Thematic fields * | Recommender | Reviewers | Submission date | |
---|---|---|---|---|---|---|---|---|---|
13 Jun 2022
STAGE 1
![]() Associations of fear, anger, happiness, and hope with risk judgments: Revisiting appraisal-tendency framework with a replication and extensions of Lerner and Keltner (2001)Sirui Lu; Gilad Feldman https://osf.io/zbqyr/Replicating the relationship between emotions and judgments of riskRecommended by Chris ChambersHow do emotions interact with cognition? The last 40 years has witnessed the rise of cognitive-appraisal theories, which propose that emotions can be differentiated along an axis of cognitive dimensions such as certainty, pleasantness, attentional activity, control, anticipated effort, and responsibility (Smith and Ellsworth, 1985). Early tests of such theories focused especially on the impact of the valence – pleasantness/unpleasantness – of emotions on judgment and decision-making, finding, for instance, that negative mood induction can heighten pessimistic estimates of risk (Johnson & Tversky, 1983).
The Appraisal-Tendency Framework proposed by Lerner and Keltner (2000) refined cognitive-appraisal theory by proposing that specific emotions trigger a predisposition to appraise future (or hypothetical) events in line with the central appraisal dimensions that triggered the emotion, even when the emotion and the judgment are unrelated. For example, an individual who is triggered to become fearful of a heightened risk, such as nuclear war, may then exhibit heightened pessimism about risks unrelated to war. The Appraisal-Tendency Framework also predicts relationships between traits, such as between fear, anger and risk-taking/risk-seeking tendencies. In an influential paper, Lerner and Keltner (2001) reported direct empirical support for the Appraisal-Tendency Framework, which aside from its influence in cognitive/affective psychology has had considerable impact in behavioural economics, moral psychology, and studies of consumer behaviour.
In the current study, Lu and Feldman (2022) propose to replicate three key studies from Lerner and Keltner (2001) in a large online sample. Through a combination of replication and extension, the authors will probe the relationship between various trait emotions (including fear, anger, happiness, and hope) and trait characteristics of risk seeking and optimistic risk assessment. The authors also propose examining how the ambiguity of triggering events moderates the relationship between specific emotions and risk judgments.
The Stage 1 manuscript was evaluated over two rounds of in-depth review. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
URL to the preregistered Stage 1 protocol: https://osf.io/8yu2x Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.
List of eligible PCI RR-friendly journals:
References
1. Smith, C. A., & Ellsworth, P. C. (1985). Patterns of cognitive appraisal in emotion. Journal of Personality and Social Psychology, 48, 813-838. https://doi.org/10.1037/0022-3514.48.4.813
2. Johnson, E. J., & Tversky, A. (1983). Affect, generalization, and the perception of risk. Journal of Personality and Social Psychology, 45(1), 20–31. https://doi.org/10.1037/0022-3514.45.1.20
3. Lerner, J. S., & Keltner, D. (2000). Beyond valence: Toward a model of emotion-specific influences on judgment and choice. Cognition & Emotion, 14, 473-493. https://doi.org/10.1080/026999300402763
4. Lerner, J. S., & Keltner, D. (2001). Fear, anger, and risk. Journal of Personality and Social Psychology, 81, 146–159. https://doi.org/10.1037/0022-3514.81.1.146
5. Lu, S. & Feldman, G. (2022). Associations of fear, anger, happiness, and hope with risk judgments: Revisiting appraisal-tendency framework with a replication and extensions of Lerner and Keltner (2001), in principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/8yu2x | Associations of fear, anger, happiness, and hope with risk judgments: Revisiting appraisal-tendency framework with a replication and extensions of Lerner and Keltner (2001) | Sirui Lu; Gilad Feldman | <p>This is a scheduled PCI-RR snap shot for a planned project: "Associations of fear, anger, happiness, and hope with risk judgments: Revisiting appraisal-tendency framework with a replication and extensions of Lerner and Keltner (2001)"</p> | Social sciences | Chris Chambers | 2022-01-31 09:36:29 | View | ||
16 Sep 2022
STAGE 1
![]() Action-Inaction Asymmetries in Emotions and Counterfactual Thoughts: Meta-Analysis of the Action EffectSiu Kit Yeung, Gilad Feldman https://osf.io/ycenpCharting meta-analytic evidence for the action-effectRecommended by Chris ChambersWinston Churchill once famously quipped, “I never worry about action, but only inaction.” Churchill, however, may have been an exception to the rule, with psychological research suggesting that people are more concerned about the consequences of actions than inactions. During the so-called “action-effect”, first reported by Kahneman and Tversky (1982), people regret an action leading to a bad outcome more than they do an inaction leading to the same bad outcome In the current study, Yeung and Feldman (2022) propose a wide-ranging meta-analysis to characterise evidence for the action-effect, focusing in particular on emotions and counterfactual thoughts – that is, mental representations of alternative decisions (or “what if” thoughts). Consistent with the expected consequences of the action-effect on emotion, they predict that action will be associated with stronger negative emotions than inaction (when outcomes are negative), and with stronger positive emotions than inaction (when outcomes are positive). The authors also expect action to be associated with a greater abundance of counterfactual thought compared to inaction. In addition to examining the overall reliability of the action-effect (plus a range of exploratory questions), the study will also examine the extent to which the action-effect is moderated by temporal distance (with more recent events or behaviours predicted to associated with a stronger action effect), the type of study design, prior outcomes and social norms, the specificity (vs. generality) of the prior event, and whether the study employed a hypothetical scenario or a real-life event. The Stage 1 manuscript was evaluated over two rounds of in-depth review. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and awarded in-principle acceptance (IPA). URL to the preregistered Stage 1 protocol: https://osf.io/4pvs6 Level of bias control achieved: Level 2. At least some data/evidence that will be used to answer the research question has been accessed and partially observed by the authors, but the authors certify that they have not yet observed the key variables within the data that will be used to answer the research question References | Action-Inaction Asymmetries in Emotions and Counterfactual Thoughts: Meta-Analysis of the Action Effect | Siu Kit Yeung, Gilad Feldman | <p>Action-effect refers to the phenomenon in which people experience, associate, or attribute stronger emotions for action compared to inaction. In this registered report, we conducted a meta-analysis of the action effect literature (k = [enter nu... | Social sciences | Chris Chambers | 2021-07-16 14:02:56 | View | ||
28 Mar 2024
STAGE 1
![]() Working memory performance in adverse environments: Enhanced, impaired, or intact?Stefan Vermeent, Anna-Lena Schubert, Meriah L. DeJoseph, Jaap J. A. Denissen, Jean-Louis van Gelder, Willem E. Frankenhuis https://github.com/StefanVermeent/liss_wm_profiles_2023/blob/master/manuscript/manuscript.pdfA closer look at working memory changing with adversityRecommended by Yuki YamadaAdverse environments involving threat, uncertainty, deprivation and stress can cause significant and long-lasting harm to cognition and development. In this Stage 1 protocol, Vermeent and colleagues (2024) aim to simultaneously test with a single paradigm and statistical model for findings from previous studies showing that human working memory capacity is impaired in adverse environments, as well as other evidence suggesting that adversity may actually enhance updating of working memory. Furthermore, they will also investigate whether working memory is related to each of the adversity types: threat, deprivation, and unpredictability.
The findings of this study should help clarify how working memory functions in combination with adversity, and will provide insight into the development of better interventions and training methods for optimal performance in a variety of environments.
The manuscript was reviewed by two experts and the recommender. Following two rounds of peer review, and based on detailed responses to the reviewers' comments, I, the recommender, judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
URL to the preregistered Stage 1 protocol: https://osf.io/dp7wc
Level of bias control achieved: Level 3. At least some data/evidence that will be used to the answer the research question has been previously accessed by the authors (e.g. downloaded or otherwise received), but the authors certify that they have not yet observed ANY part of the data/evidence. List of eligible PCI RR-friendly journals:
References
1. Vermeent, S., Schubert, A.-L., DeJoseph, M. L., Denissen, J. J. A, van Gelder, J.-L. & Frankenhuis, W. E. (2024). Working memory performance in adverse environments: Enhanced, impaired, or intact? In principle acceptance of Version 2 by Peer Community in Registered Reports. https://osf.io/dp7wc | Working memory performance in adverse environments: Enhanced, impaired, or intact? | Stefan Vermeent, Anna-Lena Schubert, Meriah L. DeJoseph, Jaap J. A. Denissen, Jean-Louis van Gelder, Willem E. Frankenhuis | <p>Decades of research have shown that adversity tends to lower working memory (WM) performance. This literature has mainly focused on impairments in the overall capacity to hold information available in WM for further processing. However, some re... | Social sciences | Yuki Yamada | Kathryn Bates, Anonymous | 2023-10-30 15:11:48 | View | |
Inconclusive evidence for associations between adverse experiences in adulthood and working memory performanceStefan Vermeent, Anna-Lena Schubert, Meriah L. DeJoseph, Jaap J. A. Denissen, Jean-Louis van Gelder, Willem E. Frankenhuis https://github.com/StefanVermeent/liss_wm_profiles_2023/blob/master/manuscript/vermeent_2024_stage2.pdfAdversity and working memory: Nuanced effects underpinned by rigorous methodologyRecommended by Yuki YamadaAdverse environments involving threat, uncertainty, deprivation, and stress have been shown to have significant impacts on cognition and development. In this Stage 2 manuscript, Vermeent et al. (2024) adhere to their Stage 1 protocol, investigating the effects of adversity on working memory (WM) using a comprehensive, psychometric modeling approach. The authors aimed to clarify seemingly contradictory findings from previous research: The evidence for working memory capacity impairments in adverse environments versus the possibility that adversity might enhance specific aspects of WM, such as updating ability. Moreover, they examined the effects of distinct types of adversity—neighborhood threat, material deprivation, and unpredictability—on WM performance.
The results of the study were, overall, inconclusive: the authors did not find consistent associations between adversity and either WM capacity or WM updating ability. Despite using a large sample and employing latent variable modeling, the study did not reveal significant effects that were either clearly positive or negative for any type of adversity examined. In addition, no evidence for equivalence to zero associations was found. The lack of clear associations suggests that the relationship between adversity and WM is likely more complex than previously thought.
As with the Stage 1 evaluation, this manuscript has undergone a rigorous peer review process at Stage 2. The reviewers included specialists in child and youth cognitive development. The constructive feedback from the reviewers ensured that the pre-registered protocol was followed accurately, deviations were reported appropriately, and all concerns raised were addressed satisfactorily. These processes helped to refine Vermeent et al.'s methods and confirm that the planned analysis was followed. Despite the inconclusive results, this study makes a significant contribution to our understanding of the subtle effects of adversity on working memory by providing transparent and rigorous findings that add valuable data to the field. Therefore, I am fully confident that this manuscript is suitable for Stage 2 recommendation.
URL to the preregistered Stage 1 protocol: https://osf.io/dp7wc
Level of bias control achieved: Level 3. At least some data/evidence that was used to the answer the research question had been previously accessed by the authors (e.g. downloaded or otherwise received), but the authors certify that they had not yet observed ANY part of the data/evidence until after Stage 1 in-principle acceptance. List of eligible PCI RR-friendly journals:
References
1. Vermeent, S., Schubert, A.-L., DeJoseph, M. L., Denissen, J. J. A, van Gelder, J.-L. & Frankenhuis, W. E. (2024). Inconclusive evidence for associations between adverse experiences in adulthood and working memory performance [Stage 2]. Acceptance of Version 3 by Peer Community in Registered Reports. https://github.com/StefanVermeent/liss_wm_profiles_2023/blob/master/manuscript/stage2_tracked.pdf
| Inconclusive evidence for associations between adverse experiences in adulthood and working memory performance | Stefan Vermeent, Anna-Lena Schubert, Meriah L. DeJoseph, Jaap J. A. Denissen, Jean-Louis van Gelder, Willem E. Frankenhuis | <p>Decades of research have shown that adversity tends to be associated with lower working memory (WM) performance. This literature has mainly focused on impairments in the capacity to hold information available in WM for further processing. Howev... | Social sciences | Yuki Yamada | 2024-06-25 15:25:13 | View | ||
06 Jun 2022
STAGE 1
![]() Revisiting the psychological sources of ambiguity avoidance: Replication and extensions of Curley, Yates, and Abrams (1986)Sze Ying (Dawn) Yiu, Gilad Feldman https://osf.io/xdes8/Reducing ambiguity in the psychological understanding of ambiguity avoidanceRecommended by Chris ChambersA considerable body of research in behavioural economics has established the existence of ambiguity avoidance: the tendency for people, when given a choice between two options, to choose the option for which there is greater certainty about the probabilities of certain outcomes occurring. In a seminal study, Curley, Yates, and Abrams (1986) explored potential psychological explanations of ambiguity avoidance, contrasting five hypotheses: hostile nature (the anticipation that more ambiguous options are biased against oneself), other-evaluation (the anticipation that one’s decision will be evaluated by others), self-evaluation (the anticipation that one's decision will be self-evaluated in the future), forced-choice (in which the less ambiguous option is selected only when all other considerations are equal), and a more general uncertainty avoidance associated with risk aversion. The results favoured other-evaluation as the most promising explanation, with implications in the following decades for research in social psychology, judgment and decision making, behavioural economics, consumer behaviour, and cognitive psychology.
In the current study, Yiu and Feldman (2022) plan to revisit the psychological basis of ambiguity avoidance in a large online sample through a replication of key studies from Curley et al. (1986), including extensions to increase methodological rigour and to explore the relationship between ambiguity avoidance and hostility bias, anticipated future regret, and post-choice social judgment from others, as well as trait measures of risk tolerance and ambiguity tolerance.
The Stage 1 manuscript was evaluated over one round of in-depth review. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
URL to the preregistered Stage 1 protocol: https://osf.io/wb3hc
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.
List of eligible PCI RR-friendly journals:
References
1. Curley, S. P., Yates, J. F. & Abrams, R. A. (1986). Psychological sources of ambiguity avoidance. Organizational Behavior and Human Decision Processes, 38, 230-256. https://doi.org/10.1016/0749-5978(86)90018-X
2. Yiu, S. Y. & Feldman, G. (2022). Revisiting the psychological sources of ambiguity avoidance:
Replication and extensions of Curley, Yates, and Abrams (1986), in principle acceptance of Version 2 by Peer Community in Registered Reports. https://osf.io/wb3hc | Revisiting the psychological sources of ambiguity avoidance: Replication and extensions of Curley, Yates, and Abrams (1986) | Sze Ying (Dawn) Yiu, Gilad Feldman | <p>This is a scheduled PCI-RR snap shot for a planned project: "Revisiting the psychological sources of ambiguity avoidance: Replication and extensions of Curley, Yates, and Abrams (1986) "</p> | Social sciences | Chris Chambers | 2022-02-15 09:03:37 | View | ||
21 Jun 2024
STAGE 1
![]() Is it Worth the Hustle? A Multi-Country Replication of the Effort Moralization Effect and an Extension to Generational Differences in the Appreciation of EffortTassilo T. Tissot, Leopold H. O. Roth https://osf.io/5tkfrAre people who exert more effort in a task seen as more moral?Recommended by Adrien FillonThis study seeks to understand cultural and age differences in the effort moralization effect, a phenomenon in which people who put more effort into a task are considered more moral, regardless of the quality or the morality associated with the task. This is shown in common phrases such as the “great resignation” or “quiet quitting”, which are mostly used against younger members of the population, in particular generation Z.
Tissot and Roth (2024) propose to conduct a replication of a study from Celniker et al. (2023) which found evidence for this effect, with new samples from Mexico and Germany to test potential cultural differences. They will also test the effect of age on the effort moralization effect. Therefore, the study will be a quantitative analysis.
The authors included an adequate power analysis, alternatives for non-supported hypotheses, and filtering to ensure a high quality of data collection. They already provided an R script and dummy data to ensure the quality of the analysis. The Stage 1 manuscript was evaluated over three rounds of in-depth review. Based on detailed responses to reviewers’ and the recommender’s comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance.
URL to the preregistered Stage 1 protocol: https://osf.io/tvgw2
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.
List of eligible PCI RR-friendly journals:
References 1. Celniker, J. B., Gregory, A., Koo, H. J., Piff, P. K., Ditto, P. H., & Shariff, A. F. (2023). The moralization of effort. Journal of Experimental Psychology: General, 152, 60–79. https://doi.org/10.1037/xge0001259
2. Tissot, T. T. & Roth, L. H. O. (2024). Is it Worth the Hustle? A Multi-Country Replication of the Effort Moralization Effect and an Extension to Generational Differences in the Appreciation of Effort. In principle acceptance of Version 4 by Peer Community in Registered Reports. https://osf.io/tvgw2
| Is it Worth the Hustle? A Multi-Country Replication of the Effort Moralization Effect and an Extension to Generational Differences in the Appreciation of Effort | Tassilo T. Tissot, Leopold H. O. Roth | <p>Inferring the character of individuals is an adaptive need for partner and mating decisions as well as to avoid harm. The effort moralization effect is the finding that people who exert more effort in a task are seen as more moral, even if high... | Social sciences | Adrien Fillon | 2024-01-18 14:58:04 | View | ||
06 Sep 2024
STAGE 1
![]() The Role of Offender Identifiability in Second- and Third-Party PunishmentTheresa Blanke, Mathias Twardawski https://osf.io/7qzvaPunishing OffendersRecommended by Clare Conry-MurrayWhen people are less-well-known to us, it can impact how we treat them. People outside our communities may feel more anonymous or de-personalized to us, and this could impact the empathy we feel for them. Indeed, past research shows that people seem to care more for those who are who are identified to us, especially when they are victims of a crime (Small & Loewenstein, 2003). In addition, past research also shows that anonymizing victims can influence criminal behavior (Walters, 2022). Thus, social cognitive factors related to anonymity appear to affect both positive feelings (engaging in empathy) and negative activities (criminal activity) related to victims. It seems likely that anonymity can also affect how people judge criminals themselves.
This paper by Blanke and Twardawski (2024) examines how even minor identifying features can make individuals react differently to a perpetrator of a crime. A picture or name (information that may appear in the press) may impact how people perceive criminals in terms of punishment, empathy, outrage, and blame.
How people respond to anonymous or identified criminals may depend on whether the impact of the crime on the victim is made salient. Similar to the Black Sheep Effect (Marques & Paez,1994), the current paper expects that people who identify with victims are expected to punish a perpetrator more when the perpetrator’s name and image are known. This is similar to the case with an ingroup member in The Black Sheep Effect, where ingroup members are punished more for transgressions than outgroup members. For people who view the situation as a third party (and are thus less connected to the victim), an identified perpetrator is expected to lead to less punishment (and also less outrage and blame, and more empathy).
The current study focuses on pickpocketing since it is a crime that can be committed without identifying oneself to the victim. Future research should examine how the type of event impacts judgments, especially given the stigma of being a victim of some crimes. Littering and other minor violations may be seen as understandable when you see someone as a person, rather than a anonymous, impersonal criminal. On the other hand, there can be stigma to being a victim in some cases, such as the case of sexual harassment, where, research shows, perpetrators are judged more positively if they are identified, and victims, especially women, are judged more negatively if they are identified (Barak-Corren & Lewinsohn-Zamir, 2019).
People around the world engage in moral and legal transgressions, and if our judgments of them are influenced by minor features such as a photo or name, we should take action to treat people more fairly. This research will help to determine if people are influenced by these factors.
The Stage 1 manuscript underwent one round of thorough review. After considering the detailed responses to the reviewers' comments, the recommender determined that the manuscript met the Stage 1 criteria and granted in-principle acceptance (IPA).
URL to the preregistered Stage 1 protocol: https://osf.io/7qzva
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA. List of eligible PCI RR-friendly Journals:
References
1. Barak‐Corren, N., & Lewinsohn‐Zamir, D. (2019). What's in a Name? The Disparate Effects of Identifiability on Offenders and Victims of Sexual Harassment. Journal of Empirical Legal Studies, 16, 955-1000. https://doi.org/10.1111/jels.12233
2. Blanke, T. & Twardawski, M. (2024). The Role of Offender Identifiability in Second- and Third-Party Punishment. In principle acceptance of Version 2 by Peer Community in Registered Reports. https://osf.io/7qzva
3. Marques, J. M., & Paez, D. (1994). The ‘black sheep effect’: Social categorization, rejection of ingroup deviates, and perception of group variability. European Review of Social Psychology, 5, 37-68. https://doi.org/10.1080/14792779543000011
4. Small, D. A., & Loewenstein, G. (2003). Helping a victim or helping the victim: Altruism and identifiability. Journal of Risk and Uncertainty, 26, 5-16. https://doi.org/10.1023/A:1022299422219
5. Walters, G. D. (2022). Crime and social cognition: A meta-analytic review of the developmental roots of adult criminal thinking. Journal of Experimental Criminology, 18, 183-207. https://doi.org/10.1007/s11292-020-09435-w
| The Role of Offender Identifiability in Second- and Third-Party Punishment | Theresa Blanke, Mathias Twardawski | <p>The identifiability effect describes humans' tendency to exhibit different emotional and behavioral responses toward identified as compared to anonymous individuals. This phenomenon has been extensively studied within the identifiable victim ef... | Social sciences | Clare Conry-Murray | Rajarshi Majumder, Gilad Feldman | 2024-03-23 11:02:30 | View | |
Functional MRI brain state occupancy in the presence of cerebral small vessel disease -- a pre-registered replication analysis of the Hamburg City Health StudyThies Ingwersen, Carola Mayer, Marvin Petersen, Benedikt M. Frey, Jens Fiehler, Uta Hanning, Simone Kühn, Jürgen Gallinat, Raphael Twerenbold, Christian Gerloff, Bastian Cheng, Götz Thomalla, Eckhard Schlemm, https://github.com/csi-hamburg/HCHS-brain-states-RR/blob/f9d00adbbcf9593d8d191bf5b93912141b80ab1b/manuscript/build/main.pdfReplicable dynamic functional connectivity and cognitive correlates of cerebral small vessel disease in the Hamburg City Health StudyRecommended by Robert McIntoshIn a previous analysis of data from 988 participants in the Hamburg City Health Study (HCHS), Schlemm and colleagues (2022) reported significant associations between the extent of cerebral small vessel disease (cSVD) and dynamic functional connectivity measures from resting state fMRI. Specifically, the volume of white matter hyperintensities of presumed vascular origin, a structural indicator of cSVD, was negatively related to the proportion of time (‘fractional occupancy’) spent in the two most occupied functional brain states. Reduced fractional occupancy was also associated with longer times to complete part B of the Trail Making Test.
In the present Registered Report, Ingwersen and colleagues (2023) successfully replicated these associations between structural, functional and cognitive measures in a sample of 1651 HCHS participants not included in the earlier study. An exploratory multiverse analysis found that the associations were generally robust to different brain parcellation and confound regression strategies. These replicable patterns reinforce the idea that cSVD may disrupt the brain’s ability to enter and maintain distinct functional modes, and that these changes in functional dynamics are predictive of cognitive impairment.
The Stage 2 manuscript was assessed over one round of in-depth review. The recommender judged that responses to reviewer comments were appropriate, and that the manuscript met the Stage 2 criteria for recommendation.
URL to the preregistered Stage 1 protocol: https://osf.io/9yhzc
Level of bias control achieved: Level 2. At least some data/evidence that was used to answer the research question had been accessed and partially observed by the authors prior to Stage 1 in-principle acceptance, but the authors certify that they had not yet observed the key variables within the data that were used to answer the research question AND they took additional steps to maximise bias control and rigour. List of eligible PCI RR-friendly journals:
References
1. Schlemm, E., Frey, B. M., Mayer, C., Petersen, M., Fiehler, J., Hanning, U., Kühn, S., Twerenbold, R., Gallinat, J., Gerloff, C., Thomalla, G. & Cheng, B. (2022). Equalization of brain state occupancy accompanies cognitive impairment in cerebral small vessel disease. Biological Psychiatry, 92, 592-602. https://doi.org/10.1016/j.biopsych.2022.03.019
2. Ingwersen, T., Mayer, C., Petersen, M., Frey, B. M., Fiehler, J., Hanning, U., Kühn, S., Gallinat, J., Twerenbold, R., Gerloff, C., Cheng, B., Thomalla, G. & Schlemm, E. (2023). Functional MRI brain state occupancy in the presence of cerebral small vessel disease -- a pre-registered replication analysis of the Hamburg City Health Study. Acceptance of Version 2.01 by Peer Community in Registered Reports. https://github.com/csi-hamburg/HCHS-brain-states-RR/blob/f9d00adbbcf9593d8d191bf5b93912141b80ab1b/manuscript/build/main.pdf
| Functional MRI brain state occupancy in the presence of cerebral small vessel disease -- a pre-registered replication analysis of the Hamburg City Health Study | Thies Ingwersen, Carola Mayer, Marvin Petersen, Benedikt M. Frey, Jens Fiehler, Uta Hanning, Simone Kühn, Jürgen Gallinat, Raphael Twerenbold, Christian Gerloff, Bastian Cheng, Götz Thomalla, Eckhard Schlemm, | <p><strong>Objective</strong>: To replicate recent findings on the association between the extent of cerebral small vessel disease (cSVD), functional brain network dedifferentiation, and cognitive impairment.</p> <p><strong>Methods:</strong> We a... | Life Sciences, Medical Sciences | Robert McIntosh | 2023-10-17 09:53:02 | View | ||
16 Oct 2024
STAGE 1
![]() Open Scholarship and Feedback in Applied Research/Understanding the Role of Climate Change in Applied Research: A Qualitative Registered ReportThomas R. Evans, James Bartlett, Olly Robertson, Charlotte R. Pennington, Calvin Burns, Laura Dean, Kate Bradley, Emma L. Henderson, Ruijie Wang, Amélie Gourdon-Kanhukamwe, Emma Wilson-Lemoine, Jérémy E. Wilson-Lemoine, Peter Branney, Joanna Butler, Tamara Kalandadze, Mirela Zaneva, Elias Keller, Vaitsa Giannouli, Helena Hartmann, Gerit Pfuhl, Jan Maskell, Christopher J. Graham, Emma O’Dwyer https://osf.io/preprints/psyarxiv/p8hb4Understanding how applied researchers address open scholarship, feedback and climate change in their workRecommended by Sarahanne Miranda FieldThis recommendation concerns the plan of two studies that are intended to be conducted simultaneously, using the same data collection approach, and to result in two manuscripts that will be submitted for assessment at Stage 2. The Stage 1 manuscript containing these protocols was submitted via the programmatic track.
Protocol 1 concerns “Open Scholarship and Feedback in Applied Research: A Qualitative Registered Report”. With this study, the authors aim to explore how applied researchers integrate feedback processes into their work, in relation to transparency and rigor in particular. They will investigate whether their sample are aware of and use feedback mechanisms from the open science movement, such as registered reports, which makes this study nicely metascientific. Through interviews with 50 applied researchers from various fields, the study will examine current feedback practices. The authors intend to use the findings of this first study to inform recommendations on how open science practices can be incorporated into research workflows.
Protocol 2 concerns “Understanding the Role of Climate Change in Applied Research: A Qualitative Registered Report”. This study aims to explore how applied researchers address climate change in their work, including the ways their practices are influenced by and respond to climate challenges. It addresses how their approaches may evolve, and they plan to look into the barriers and opportunities climate change presents in practice. Interviews with 50 applied researchers will be analysed to help understand these dynamics. The authors aim to provide recommendations to help applied researchers and their employers adjust their priorities to align with the urgency of climate action. One reviewer did not comment on this second protocol, as the content was outside of their own research area. Although I would have found a reviewer who specializes in this area directly ideally, I found I could still rely on the other two reviewers and my own knowledge to assess this protocol.
General comments: As I mentioned in my initial assessment text, these studies were well planned from the get-go and the protocol nicely articulated those plans. The use of different colour highlighting clearly helped the reviewers target different elements of the protocol and give direct feedback on specific parts. It also helped prevent me from getting lost in all the details! Well done, once again, to the authors for making the distinction between the two studies so clear. I was also pleased at how well they balanced the information between the two protocols – this made it easier to see if there were deficiencies in either one somehow. Finally, I loved that reflexivity was considered by the authors. One suggestion by me is that the authors might consider providing a collective positionality statement to go with the trainees’ reflexivity statements (if this is already in the plan and I missed it, please forgive the oversight!) in the final studies, even if as part of an appendix. This is because the open science movement and climate change can both be controversial, and because of the nature of the qualitative approach I would like to understand a little of the stance the group takes towards these issues collectively if the authors think it’s appropriate. I understand that with a big group that might be difficult or impossible, but if it is possible I would like to see it. I would also like to see initials used in the manuscripts to indicate who was responsible for what analysis elements where possible. This allows for accountability and to attribute interpretation to specific individuals involved in the data analysis. Alternatively, individuals can be attributed in a statement at the end of each manuscript to serve the same purpose and be less awkward in the text. If this won't work for some reason, please motivate this decision. The three reviewers that took the time to go through the reports nevertheless had useful comments, most of which would have contributed to strengthening the plan and minimizing problematic bias later on. The authors took these comments seriously, and thoughtfully (cheerfully even) responded to each. In my estimation, each of the suggestions of the reviewers were satisfied by the authors’ response to reviews letter. Other than my earlier comment about the positionality statement, I have no further comments for the Stage 1 protocol, and I wish the authors all the best with running the studies and writing up Stage 2 for each.
URL to the preregistered Stage 1 protocol: https://osf.io/jdh32
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA. List of eligible PCI RR-friendly journals:
References
Evans, T. R. et al. (2024). Open Scholarship and Feedback in Applied Research/Understanding the Role of Climate Change in Applied Research: A Qualitative Registered Report. In principle acceptance of Version 2 by Peer Community in Registered Reports. https://osf.io/jdh32
| Open Scholarship and Feedback in Applied Research/Understanding the Role of Climate Change in Applied Research: A Qualitative Registered Report | Thomas R. Evans, James Bartlett, Olly Robertson, Charlotte R. Pennington, Calvin Burns, Laura Dean, Kate Bradley, Emma L. Henderson, Ruijie Wang, Amélie Gourdon-Kanhukamwe, Emma Wilson-Lemoine, Jérémy E. Wilson-Lemoine, Peter Branney, Joanna Butl... | <p>Applied researchers have an important societal role in influencing real-world practice, bridging academic research, theory and practical experiences. Despite this, relatively little is known about the processes or mechanisms of feedback adopted... | Social sciences | Sarahanne Miranda Field | Daniel Dunleavy | 2024-03-28 16:29:25 | View | |
30 May 2024
STAGE 1
![]() Gaming Disorder: A Qualitative Meta-synthesis of Case StudiesTiina Auranen, Matúš Adamkovič, Veli-Matti Karhulahti, Marcel Martoncik, Yaewon Jin, Miia Siutila, Valtteri Kauraoja, Solip Park https://osf.io/sv2rmWhat can qualitative research tell us about Gaming Disorder?Recommended by Mateo Leganes-FonteneauHow can qualitative research and case studies inform theoretical models of gaming disorder? Gaming Disorder has generated a large amount of research, with up to 95% of it focusing on quantitative studies. As a result, most of the meta-analyses and review studies focus on quantitative research and disregard qualitative approaches. However, studying the direct experiences of gamers can provide more detailed and direct evidence that can feed into theoretical models.
In this Stage 1 manuscript, Auranen et al. (2024) will perform a qualitative meta-analysis of gaming disorder case studies, case reports, and case series of treatment-seekers using a 3-phase approach. First, they will focus on examining the reported problems of participants, the reported reasons for seeking help to reduce their gaming, and the causal link between gaming and reported problems, including the context of these problematic behaviors. Second, thematic synthesis will generate construct themes regarding the contexts of the individuals and the reported problems. Lastly, the authors will examine the relevance of findings in regards to the coping model, value fulfillment theory and the theory of cultural dissonance.
The Stage 1 submission was evaluated by the recommender and three expert reviewers, one of which was recused due to conflicts of interest that emerged after the first round of revisions. The recommender and co-recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
URL to the preregistered Stage 1 protocol: https://osf.io/hzc5a
Level of bias control achieved: Level 4. At least some of the data/evidence that will be used to answer the research question already exists AND is accessible in principle to the authors (e.g. residing in a public database or with a colleague), BUT the authors certify that they have not yet accessed any part of that data/evidence.
List of eligible PCI RR-friendly journals: References Auranen, T., Adamkovič, M., Martončik, M., Park, S., Kauraoja, V., Siutila, M., Jin, Y., & Karhulahti, V.-M. (2024). Gaming Disorder: A qualitative meta-synthesis of related case studies. In principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/hzc5a
| Gaming Disorder: A Qualitative Meta-synthesis of Case Studies | Tiina Auranen, Matúš Adamkovič, Veli-Matti Karhulahti, Marcel Martoncik, Yaewon Jin, Miia Siutila, Valtteri Kauraoja, Solip Park | <p>Several meta-analyses and reviews have been published on gaming-related health problems, which are today studied mainly in the context of the World Health Organization’s new mental disorder construct, “gaming disorder”. However, none of those r... | Medical Sciences, Social sciences | Mateo Leganes-Fonteneau | Ting Pan | 2023-11-24 14:00:19 | View |
FOLLOW US
MANAGING BOARD
Chris Chambers
Zoltan Dienes
Corina Logan
Benoit Pujol
Maanasa Raghavan
Emily S Sena
Yuki Yamada