We are recruiting recommenders (editors) from all research fields!
Your feedback matters! If you have authored or reviewed a Registered Report at Peer Community in Registered Reports, then please take 5 minutes to leave anonymous feedback about your experience, and view community ratings.
Latest recommendations
| Id | Title▲ | Authors | Abstract | Picture | Thematic fields | Recommender | Reviewers | Submission date | |
|---|---|---|---|---|---|---|---|---|---|
14 Feb 2024
STAGE 1
Detecting DIF in Forced-Choice Assessments: A Simulation Study Examining the Effect of Model MisspecificationDeveloping differential item functioning (DIF) testing methods for use in forced-choice assessmentsRecommended by Amanda Montoya based on reviews by Timo Gnambs and 2 anonymous reviewers
Traditional Likert-type items are commonly used but can elicit response bias. An alternative approach, the forced-choice question, required respondents to rank order all items. Forced-choice questions boast some advantages but required advanced item response theory analysis to generate scores which are comparable across individuals and to evaluate the properties of those scales. However, there has been limited discussion of how to test differential item functioning (DIF) in these scales. In a previous study, Lee et al. (2021) proposed a method for testing DIF.
Here, Plantz et al. (2024) explore the implications of incorrect specification of anchors in DIF detection for forced choice items. The study proposes to use a Monte Carlo simulation which manipulates sample size, equality of sample size across groups, effect size, percentage of differentially functioning items, analysis approach, anchor set size, and percent of DIF blocks in the anchor set. This study aims to answer research questions about the type I error and power of DIF detection strategies under a variety of circumstances, both evaluating whether the results from Lee et al. (2021) generalize to misspecified models and expanding to evaluate new research questions. Results of this study will provide practical implications for DIF testing with forced-choice questions. An important limitation of the study is that it does not explore non-uniform DIF, only uniform DIF. Additionally, as with all simulation studies not all results can only apply to conditions which are simulated and so rely on the realistic selection of simulation conditions. The authors have selected conditions to match reality in circumstances where data is available, but relied on previous simulations in cases when data is not available.
This Stage 1 manuscript was evaluated over two rounds of review by two reviewers with expertise in psychometrics. An additional round of review was completed by the recommender only. Based on the merits of the original submission and responsiveness of the authors to requests from the reviewers, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
URL to the preregistered Stage 1 protocol: https://osf.io/p8awx
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA. List of eligible PCI RR-friendly journals:
References 1. Lee, P., Joo, S.-H. & Stark, S. (2021). Detecting DIF in multidimensional forced choice measures using the Thurstonian Item Response Theory Model. Organizational Research Methods, 24, 739–771. https://doi.org/10.1177/1094428120959822
2. Plantz, J. W., Brown, A., Wright, K. & Flake, J. K. (2024). Detecting DIF in Forced-Choice Assessments: A Simulation Study Examining the Effect of Model Misspecification. In principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/p8awx
| Detecting DIF in Forced-Choice Assessments: A Simulation Study Examining the Effect of Model Misspecification | Jake Plantz, Anna Brown, Keith Wright, Jessica K. Flake | <p>On a forced-choice (FC) questionnaire, the respondent must rank two or more items instead of indicating how much they agree with each of them. Research demonstrates that this format can reduce response bias. However, the data are ipsative, resu... | Social sciences | Amanda Montoya | 2023-09-06 22:43:32 | |||
20 Mar 2023
STAGE 1
Do Ecological Valid Stop Signals Aid Detour Performance? A Comparison of Four Bird SpeciesWhat is the role of sensory perception in cognitive task performance? An improved replication of detour performance in four different bird speciesRecommended by Dieter Lukas based on reviews by 2 anonymous reviewers
The detour task, where an individual has to navigate around a see-through barrier in order to reach a goal, is one of the oldest paradigms used in animal cognition research (Kabadayi et al. 2018). While these previous tests have documented variation in the ability of animals to inhibit going straight for the visible but blocked reward, the cognitive underpinnings of this behaviour are as yet not fully understood. In the current study, Dewulf et al. (2023) propose to assess one of the specific cognitive processes that might be involved in this behaviour. Through experimental procedures, they will compare the role of signal detection in inhibitory response performance in a detour task. To assess whether variation in detection of the barrier might be linked to the ecological niche of a species, they will compare four bird species who live in different environments. Individuals from these four species were previously tested in a detour task (Regolin et al. 1994, Zucca et al. 2005), and the proposed research plan therefore also involves a partial replication of previous studies on the same issue, but improving some critical aspects.
The Stage 1 manuscript was evaluated over one round of in-depth review. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.
URL to the preregistered Stage 1 protocol: https://osf.io/qvxgh
List of eligible PCI RR-friendly journals:
References
Dewulf, A., Garcia-Co, C., Müller, W., Madden, J.R., Martel, A., Lens, L. & Verbruggen, F. (2023). Do Ecological Valid Stop Signals Aid Detour Performance? A Comparison of Four Bird Species. In principle acceptance of Version 2 by Peer Community in Registered Reports. https://osf.io/qvxgh
Kabadayi, C., Bobrowicz, K., & Osvath, M. (2018). The detour paradigm in animal cognition. Animal Cognition, 21, 21-35. https://doi.org/10.1007/s10071-017-1152-0
Regolin L, G Vallortigara, and M Zanforlin (1994). Perceptual and motivational aspects of detour behaviour in young chicks. Animal Behaviour 47, 123–131. https://doi.org/https://doi.org/10.1006/anbe.1994.1014
Zucca P, F Antonelli, and G Vallortigara (2005). Detour behaviour in three species of birds: quails (Coturnix sp.), herring gulls (Larus cachinnans) and canaries (Serinus canaria). Animal Cognition, 8, 122–128. https://doi.org/10.1007/s10071-004-0243-x
| Do Ecological Valid Stop Signals Aid Detour Performance? A Comparison of Four Bird Species | Anneleen Dewulf, Clara Garcia-Co, Wendt Müller, Joah R. Madden, An Martel, Luc Lens, & Frederick Verbruggen | <p>Response inhibition, or the stopping of actions, is considered a key component of flexible and adaptive behavior. Across fields,response inhibition is often treated as a unitary cognitive mechanism. However, we propose that response inhibition ... | Social sciences | Dieter Lukas | 2022-11-30 19:25:43 | |||
15 Sep 2023
STAGE 1
Do error predictions of perceived exertion inform the level of running pleasure?Does running pleasure result from finding it easier than you thought you would?Recommended by Zoltan Dienes based on reviews by Jasmin Hutchinson and 1 anonymous reviewer
The reward value of a stimulus is based on an error in prediction: Things going better than predicted. Could this learning principle, often tested on short acting stimuli, also apply to a long lasting episode, like going for a run? Could how rewarding a run is be based on the run going better than predicted?
Understanding the conditions under which exercise is pleasurable could of course be relevant to tempting people to do more of it! Brevers et al. (2023) will ask people before a daily run to predict the amount of perceived exertion they will experience; then just after the run, to rate the retrospective amount of perceived exertion actually experienced. The difference between the two ratings is the prediction error.
Participants will also rate their remembered pleasure in running and the authors will investigate whether running pleasure depends on prediction error.
The study plan was refined across four rounds of review, with input from two external reviewers and the recommender, after which it was judged to satisfy the Stage 1 criteria for in-principle acceptance (IPA). URL to the preregistered Stage 1 protocol: https://osf.io/xh724
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA. List of eligible PCI RR-friendly journals:
References
1. Brevers, D., Martinent, G., Oz, I. T., Desmedt, O. & de Geus, B. (2023). Do error predictions of perceived exertion inform the level of running pleasure? In principle acceptance of Version 5 by Peer Community in Registered Reports. https://osf.io/xh724 | Do error predictions of perceived exertion inform the level of running pleasure? | Damien Brevers, Guillaume Martinent, İrem Tuğçe Öz, Olivier Desmedt, Bas de Geus | <p>Humans have the ability to mentally project themselves into future events (prospective thinking) to promote the implementation of health-oriented behaviors, such as the planning of daily sessions of physical exercise. Nevertheless, it is curren... | Social sciences | Zoltan Dienes | 2023-04-21 17:40:50 | |||
15 Feb 2022
STAGE 1
Does alleviating poverty increase cognitive performance? Short- and long- term evidence from a randomized controlled trialUnderstanding the effect of unconditional cash transfers on cognitionRecommended by Chris Chambers based on reviews by Charlotte Pennington and Matúš Adamkovič
Over the last decade, a growing body of evidence has revealed potential benefits of unconditional cash transfers (UCTs) on a variety of outcomes, including self-reported happiness and life satisfaction (Haushofer & Shapiro, 2016), economic and financial well-being (Blattman et al., 2013; Baird et al., 2018) and educational attainment (Baird et al., 2016). Although the effects of UCTs do not always out-perform rigorous control conditions (Whillans & West, 2022), these findings prompt the question of whether the alleviation of poverty via UCTs can also influence cognitive processing and performance. In the current study, Szaszi et al. propose to analyse the results of a previous randomised trial of UCTs by Blattman et al. (2017) to test whether a $200 lump sum administered to a sample of young men in Liberia carries both short- and long-term benefits for a range of executive functions, including attention, response inhibition, and working memory capacity. The Stage 1 manuscript was evaluated over two rounds of in-depth review. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA). URL to the preregistered Stage 1 protocol: https://osf.io/k56yv Level of bias control achieved: Level 2. At least some data/evidence that will be used to answer the research question has been accessed and partially observed by the authors, but the authors certify that they have not yet observed the key variables within the data that will be used to answer the research question AND they have taken additional steps to maximise bias control and rigour. List of eligible PCI RR-friendly journals: References 1. Haushofer, J. & Shapiro, J. (2016). The short-term impact of unconditional cash transfers to the poor: Experimental evidence from Kenya. Quarterly Journal of Economics, 13, 1973–2042. https://doi.org/10.1093/qje/qjw025
2. Blattman, C., Fiala, N. & Martinez, S. (2013) Generating skilled self-employment in developing countries: Experimental evidence from Uganda. Quarterly Journal of Economics, 129, 697–752. https://doi.org/10.1093/qje/qjt057
3. Baird, S., McKenzie, D., & Özler, B. (2018). The effects of cash transfers on adult labor market outcomes. IZA Journal of Development and Migration, 8, 1-20. https://doi.org/10.1186/s40176-018-0131-9
4. Baird, S., Chirwa, E., De Hoop, J., & Özler, B. (2016). Girl power: cash transfers and adolescent welfare: evidence from a cluster-randomized experiment in Malawi. In African Successes, Volume II: Human Capital (pp. 139-164). University of Chicago Press. https://www.nber.org/system/files/chapters/c13380/c13380.pdf
5. Whillans, A., & West, C. (2022). Alleviating time poverty among the working poor: A pre-registered longitudinal field experiment. Scientific Reports, 12(1), 1-17. https://doi.org/10.1038/s41598-021-04352-y
6. Szaszi, B., Palfi, B., Neszveda, G., Taka, A., Szecsi, P., Blattman, C., Jamison, J. C., & Sheridan, M. (2022). Does alleviating poverty increase cognitive performance? Short- and long- term evidence from a randomized controlled trial, in principle acceptance of version 3 by Peer Community in Registered Reports. https://osf.io/k56yv
7. Blattman, C., Jamison, J. C. & Sheridan, M. (2017). Reducing crime and violence: Experimental evidence from cognitive behavioral therapy in Liberia. American Economic Review, 107, 1165–1206. http://doi.org/10.1257/aer.20150503
| Does alleviating poverty increase cognitive performance? Short- and long- term evidence from a randomized controlled trial | Barnabas Szaszi, Bence Palfi, Gabor Neszveda, Aikaterini Taka, Peter Szecsi, Christopher Blattman, Julian C. Jamison, Margaret Sheridan | <p>Recent findings suggest that poverty has a deteriorating effect on cognitive functioning which can reinforce existing social inequalities. In this Registered Report, we will investigate the impact of a poverty alleviation program on cognitive p... | Social sciences | Chris Chambers | 2021-07-22 20:34:50 | |||
Does alleviating poverty increase cognitive performance? Short- and long-term evidence from a randomized controlled trialNo strong effect of unconditional cash transfers on cognitionRecommended by Chris Chambers based on reviews by Charlotte Pennington and Matúš Adamkovič
Recent studies have revealed potential benefits of unconditional cash transfers (UCTs) on a variety of health and social outcomes, including self-reported happiness and life satisfaction (Haushofer & Shapiro, 2016), economic and financial well-being (Blattman et al., 2013; Baird et al., 2018) and educational attainment (Baird et al., 2016). Although the effects of UCTs do not always out-perform rigorous control conditions (Whillans & West, 2022), these findings prompt the question of whether the alleviation of poverty via UCTs can also influence cognitive processing and performance.
In the current study, Szaszi et al. analysed the results of a previous randomised trial of UCTs by Blattman et al. (2017) to test whether a $200 lump sum – equivalent to three months of income – administered to a sample of young men in Liberia carries both short- and long-term benefits for a range of executive functions, including attention, response inhibition, and working memory capacity. Overall, the results suggest minimal if any consequences of the intervention – the observed effects of UCTs on cognition were several times smaller than suggested by previous research, and the evidence for a positive effect was inconclusive. Extensive multiverse analyses showed that these findings were robust to a range of alternative analytical specifications, and the authors estimate that a sample size of nearly 5000 would be required to provide strong evidence.
In their Discussion, the authors explore a range of reasons for the negative findings compared with previous research, including the more rigorous and severe causal test enabled by the randomised trial design, the demographic homogeneity of the sample demographic, the use of pen-and-paper tests (cf. computerised tests in previous studies), and the delivery of a lump-sum cash transfer compared with a regular monthly installment. In addition, although the results were negative or inconclusive, there were hints that a positive effect of UCTs may be more evident in some cognitive domains than in others – in this case, potentially benefiting working memory more than inhibitory control. Further research would be required to confirm this hypothesis.
The Stage 2 manuscript was evaluated over one round of in-depth review. Based on the responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 2 criteria and awarded a positive recommendation.
URL to the preregistered Stage 1 protocol: https://osf.io/k56yv
Level of bias control achieved: Level 2. At least some data/evidence that was used to answer the research question had been accessed and partially observed by the authors prior to Stage 1 acceptance, but the authors certified that they had not yet observed the key variables within the data that would be used to answer the research question AND they took additional steps to maximise bias control and rigour.
List of eligible PCI RR-friendly journals:
References
1. Haushofer, J. & Shapiro, J. (2016). The short-term impact of unconditional cash transfers to the poor: Experimental evidence from Kenya. Quarterly Journal of Economics, 13, 1973–2042. https://doi.org/10.1093/qje/qjw025
2. Blattman, C., Fiala, N. & Martinez, S. (2013) Generating skilled self-employment in developing countries: Experimental evidence from Uganda. Quarterly Journal of Economics, 129, 697–752. https://doi.org/10.1093/qje/qjt057
3. Baird, S., McKenzie, D., & Özler, B. (2018). The effects of cash transfers on adult labor market outcomes. IZA Journal of Development and Migration, 8, 1-20. https://doi.org/10.1186/s40176-018-0131-9
4. Baird, S., Chirwa, E., De Hoop, J., & Özler, B. (2016). Girl power: cash transfers and adolescent welfare: evidence from a cluster-randomized experiment in Malawi. In African Successes, Volume II: Human Capital (pp. 139-164). University of Chicago Press. https://www.nber.org/system/files/chapters/c13380/c13380.pdf
5. Whillans, A., & West, C. (2022). Alleviating time poverty among the working poor: A pre-registered longitudinal field experiment. Scientific Reports, 12(1), 1-17. https://doi.org/10.1038/s41598-021-04352-y
6. Blattman, C., Jamison, J. C. & Sheridan, M. (2017). Reducing crime and violence: Experimental evidence from cognitive behavioral therapy in Liberia. American Economic Review, 107, 1165–1206. http://doi.org/10.1257/aer.20150503
7. Szaszi, B., Palfi, B., Neszveda, G., Taka, A., Szecsi, P., Blattman, C., Jamison, J. C., & Sheridan, M. (2022). Does alleviating poverty increase cognitive performance? Short- and long-term evidence from a randomized controlled trial. Stage 2 Registered Report, acceptance of Version 2 by Peer Community in Registered Reports. https://psyarxiv.com/4gyzh
| Does alleviating poverty increase cognitive performance? Short- and long-term evidence from a randomized controlled trial | Barnabas Szaszi, Bence Palfi, Gabor Neszveda, Aikaterini Taka, Péter Szécsi, Christopher Blattman, Julian C. Jamison, Margaret Sheridan | <p>In this Registered Report, we investigated the impact of a poverty alleviation program on cognitive performance. We analyzed data from a randomized controlled trial conducted on low-income, high-risk individuals in Liberia where a random half o... | Social sciences | Chris Chambers | 2022-07-13 12:10:49 | |||
23 May 2023
STAGE 1
Does Brooding Meaningfully Increase the Likelihood of Believing in a Conspiracy? A Registered ReportDoes brooding increase conspiracy beliefs?Recommended by Chris Chambers based on reviews by Matt Williams and 1 anonymous reviewer
The world is seemingly awash with conspiracy theories – from well-trodden examples such as fake Moon landings, the 9/11 truth movement, and Holocaust denial, to relative newcomers including COVID as a bioweapon, QAnon, and the belief that the science of climate change has been invented or falsified. While there is a public perception that conspiracy theories are becoming more prevalent, recent evidence suggests that the rate of conspiracism is relatively stable over time (Uscinski et al., 2022). At any point in history, it seems that a certain proportion of people find themselves vulnerable to conspiracy beliefs, but what distinguishes those who do from those who don’t, and what are the causal factors?
In the current study, Liekefett et al. (2023) investigate the critical role of rumination – a perseverative and repetitive focus on negative content leading to emotional distress. In particular, the authors ask whether one component of rumination referred to as brooding (dwelling on one’s worries and distressing emotions) has a specific causal role in the formation of conspiracy beliefs. In a series of preliminary experiments, the authors first established a procedure for successfully inducing rumination, identifying various boundary conditions and requirements for a successful design. In the proposed study (of up to N=1,638), they will then ask whether the induction of brooding causes a significant increase in conspiracy beliefs. Manipulation checks will be included to confirm intervention fidelity (independently of this hypothesis), and exploratory analyses will test the effect of various moderators, as well as the causal role of a complementary manipulation of reflection – a component of rumination in which attention is focused on the issue at hand rather than one’s emotions.
The Stage 1 manuscript was evaluated over two rounds of in-depth review. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
URL to the preregistered Stage 1 protocol: https://osf.io/y82bs
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA. List of eligible PCI RR-friendly journals: References
1. Uscinski, J., Enders, A., Klofstad, C., Seelig, M., Drochon, H., Premaratne, K. & Murthi, M. (2022) Have beliefs in conspiracy theories increased over time? PLOS ONE 17: e0270429. https://doi.org/10.1371/journal.pone.0270429
2. Liekefett, L. Sebben, S. & Becker, J. C. (2023). Does Brooding Meaningfully Increase the Likelihood of Believing in a Conspiracy? Stage 1 Registered Report, in principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/y82bs | Does Brooding Meaningfully Increase the Likelihood of Believing in a Conspiracy? A Registered Report | Luisa Liekefett, Simone Sebben, Julia C. Becker | <p>This project aims to investigate the relationship between rumination and conspiracy beliefs. It<br>involves four pilot studies, including one observational and three experimental studies, but the<br>results were inconclusive. We suggest that ru... | Humanities, Social sciences | Chris Chambers | 2023-02-01 14:47:09 | |||
24 Oct 2022
STAGE 1
Does childhood adversity alter opioid drug reward? A conceptual replication in outpatients before surgeryIs childhood adversity associated with a heightened response to opioids?Recommended by Chris Chambers based on reviews by Zoltan Dienes, Yuki Yamada and 1 anonymous reviewer
A convergence of evidence suggests that early life adversity may cause dysfunction in opioid-sensitive reward systems. Childhood adversity is associated with opioid use, potentially by altering reward and motivation networks, and experimental models in animals have found that early life adversity increases and consolidates opioid seeking behaviours. Further, in a recent controlled experiment, Carlyle et al. (2021) found that opioid administration produced stronger positive responses, and weaker negative responses, in adults with a history of childhood abuse and neglect.
In the current study, Carlyle et al. seek to test the generalisability of these previous findings in a pre-operative clinical setting. Using partially observed data from an existing cohort study (N=155), the authors will test whether patients with greater experience of childhood trauma in turn exhibit a larger mood boost and express greater subjective pleasure following opioid administration. Although not a randomised experimental design, this study provides the opportunity to examine the relationship between opioid response and history of childhood adversity in a naturalistic setting, and thus has the potential to either support or cast doubt on the theory that adversity elevates risk of opioid addiction by altering sensitivity to subjectively pleasurable effects.
Following three rounds of in-depth review, the recommender judged that the manuscript met the Stage 1 criteria and awarded in-principle acceptance (IPA).
URL to the preregistered Stage 1 protocol: https://osf.io/7ymts Level of bias control achieved: Level 2. At least some data/evidence that will be used to answer the research question has been accessed and partially observed by the authors, but the authors certify that they have not yet observed the key variables within the data that will be used to answer the research question AND they have taken additional steps to maximise bias control and rigour. List of eligible PCI RR-friendly journals:
References
1. Carlyle M., Broomby R., Simpson G., Hannon R., Fawaz L., Mollaahmetoglu O.M., Drain, J., Mostazir, M., & Morgan C. (2021). A randomised, double‐blind study investigating the relationship between early childhood trauma and the rewarding effects of morphine. Addiction Biology, 26(6):e13047.
2. Carlyle, M., Kvande, M., Leknes, S., Meier, I., Buen, K., Jensen, E. N., Ernst, G. & Eikemo, M. (2022). Does childhood adversity alter opioid drug reward? A conceptual replication in outpatients before surgery, in principle acceptance of Version 4 by Peer Community in Registered Reports. https://osf.io/7ymts
| Does childhood adversity alter opioid drug reward? A conceptual replication in outpatients before surgery | Molly Carlyle*, Malin Kvande*, Siri Leknes, Isabell Meier, Kaja Buen, Eira Nordeng Jensen, Gernot Ernst, Marie Eikemo. *denotes equal contribution. | <p>PCI-RR Snapshot only</p> | Life Sciences, Medical Sciences, Social sciences | Chris Chambers | 2022-03-15 10:07:29 | |||
Does childhood adversity alter opioid drug reward? A conceptual replication in outpatients before surgeryIs childhood adversity associated with a heightened response to opioids?Recommended by Chris Chambers based on reviews by Zoltan Dienes, Yuki Yamada and 1 anonymous reviewer
A convergence of evidence suggests that early life adversity may cause dysfunction in opioid-sensitive reward systems. Childhood adversity is associated with opioid use, potentially by altering reward and motivation networks, and experimental models in animals have found that early life adversity increases and consolidates opioid seeking behaviours. Further, in a recent controlled experiment, Carlyle et al. (2021) found that opioid administration produced stronger positive responses, and weaker negative responses, in adults with a history of childhood abuse and neglect.
In the current study, Carlyle et al. (2023) tested the generalisability of these previous findings in a pre-operative clinical setting. Using partially observed data from an existing cohort study (N=155), the authors asked whether patients with greater experience of childhood trauma in turn exhibit a larger mood boost and express greater subjective pleasure following opioid administration.
In contrast to previous findings, the results did not support the hypotheses that more experiences of childhood adversity would heighten ratings of drug liking and feeling good following opioid administration. Regression analyses instead revealed a statistically significant negative association between childhood adversity and post-opioid liking and no significant relationship with feeling good. The authors suggest that the discrepancy between the current and previous results may be due to stress related to the pre-surgical setting, the brief duration of drug exposure, and the relatively limited levels of high childhood adversity in the study sample. Nevertheless, these findings cast some doubt on the theory that adversity elevates risk of opioid addiction by altering sensitivity to subjectively pleasurable effects.
Following one round of in-depth review, the recommender judged that the manuscript met the Stage 2 criteria and awarded a positive recommendation.
URL to the preregistered Stage 1 protocol: https://osf.io/7ymts Level of bias control achieved: Level 2. At least some data/evidence that was used to answer the research question had been accessed and partially observed by the authors prior to IPA, but the authors certify that they had not yet observed the key variables within the data that were used to answer the research question AND they took additional steps to maximise bias control and rigour. List of eligible PCI RR-friendly journals:
References
1. Carlyle M., Broomby R., Simpson G., Hannon R., Fawaz L., Mollaahmetoglu O.M., Drain, J., Mostazir, M., & Morgan C. (2021). A randomised, double‐blind study investigating the relationship between early childhood trauma and the rewarding effects of morphine. Addiction Biology, 26(6):e13047. https://doi.org/10.1111/adb.13047
2. Carlyle, M., Kvande, M., Meier, I. M., Trøstheim, M., Buen, K., Jensen, E. N., Ernst, G. & Leknes, S. & Eikemo, M. (2023). Does childhood adversity alter opioid drug reward? A conceptual replication in outpatients before surgery, acceptance of Version 2 by Peer Community in Registered Reports. https://osf.io/9kt3a?view_only=4238d2ee3d654c4f908a94efea82a027
| Does childhood adversity alter opioid drug reward? A conceptual replication in outpatients before surgery | Molly Carlyle1*, Malin Kvande*, Isabell M. Meier, Martin Trøstheim, Kaja Buen, Eira Nordeng Jensen, Gernot Ernst, Siri Leknes, Marie Eikemo (*denotes equal contribution) | <p><strong>Introduction</strong>: Opioid analgesic treatment during surgery entails risk of persistent use. Experiences of childhood adversity have been shown to increase opioid reward in preclinical models, a finding recently extended to healthy ... | Medical Sciences, Social sciences | Chris Chambers | 2023-02-02 08:29:18 | |||
25 Oct 2023
STAGE 1
Does pupillometry provide a valid measure of spatial attentional bias (pseudoneglect)?Assessing visuospatial biases (pseudoneglect) using pupillometry: A replication and extension of Strauch et al. (2022)Recommended by Gemma Learmonth based on reviews by Christoph Strauch and Bianca Hatin
‘Pseudoneglect’ is a small, lateralised bias of visuospatial attention towards the left side of space, and is typically observed in healthy adults. Recently, Strauch et al. (2022) reported that bright stimuli presented in the left visual field induced a greater constriction of the pupil (the pupillary light reflex) compared to the same bright stimuli presented in the right visual field. Further, the pupillary restriction bias was positively correlated with a behavioural measure of pseudoneglect (the greyscales task). This is potentially an important development for attention research, because the passive nature of the task, in addition to the ability to track the time course of the bias measures, could provide a new, and highly sensitive, method of studying spatial attention.
In this report, Burns and McIntosh (2023) aim to replicate and extend the study of Strauch et al. (2022). The extension centres around investigating whether the pupillary biases are influenced by recording pupillary responses from the right or left eye. In their pilot replication data, Burns & McIntosh identified a larger constriction in response to stimuli on the right side when recording from the right eye. They hypothesise that pupillary biases may be stronger to stimuli presented in the ipsilateral, rather than contralateral, side of space.
The Stage 1 manuscript was reviewed over 2 rounds by 2 reviewers, including the authors of the study being replicated. Based on detailed responses to the reviewers’ comments and edits to the Stage 1 report, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance.
URL to the preregistered Stage 1 protocol: https://osf.io/ua9jn
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA. List of eligible PCI-RR-friendly journals:
References
1. Strauch, C., Romein, C., Naber, M., Van der Stigchel, S. & Ten Brink, A. F. (2022). The orienting response drives pseudoneglect—Evidence from an objective pupillometric method. Cortex, 151, 259-271.
2. Burns, N. E. & McIntosh, R. D. (2023). Does pupillometry provide a valid measure of spatial attentional bias (pseudoneglect)? In principle acceptance of Version 2 by Peer Community in Registered Reports. https://osf.io/ua9jn | Does pupillometry provide a valid measure of spatial attentional bias (pseudoneglect)? | Nicola E. Burns, and Robert D. McIntosh | <p>Strauch et al. (2022) introduced a novel approach to assess biases of visual attention, by measuring pupillary constriction in response to split-field stimuli, in which a bright patch is presented to one visual field and a dark patch to the oth... | Social sciences | Gemma Learmonth | Christoph Strauch | 2023-07-12 18:27:28 | ||
11 Apr 2024
STAGE 1
Does retrieval practice protect memory against stress? A meta-analysis [Stage 1 Registered Report]Can retrieval practice prevent the negative impact of acute stress on memory performance?Recommended by Thomas Evans based on reviews by Chris Hartgerink (they/them) and Adrien Fillon
There are a number of broad assumptions about memory which have penetrated societal understanding and mostly reflect supporting academic evidence e.g., that acute stress can compromise memory performance (Shields et al., 2017) and that practicing recalling critical information can help retain that knowledge (Moriera et al., 2019). The evidence base is less consistent when evaluating whether retrieval practice can protect against the negative effects of acute stress on memory, despite it being highly important for educators as to whether this specific strategy for supporting memorisation can be evidenced as especially effective under stressful conditions. A rigorous review of this mixed evidence base could provide the basis for developments in memory theory and research practice, with potential for direct educational applications.
Meta-analyses can play a critical role in furthering our understanding of complex cognitive mechanisms where the evidence base includes a wide range of methods, factors and effect size estimates. Furthermore, there is a lack of rigorous meta-analyses that prioritise open and reproducible processes (Topor et al., 2022) which help role-model good practice. In the current Registered Report, Mihaylova et al. (2024) have proposed a rigorous meta-analysis to systematically review and synthesise the evidence on the effects of retrieval practice for memory performance under acute stress. The work looks to be especially valuable for a) informing future research directions through a structured risk of bias evaluation, and b) generating theoretical developments through a range of confirmatory moderators (including stressor types, memory strategies, time of delay and task type). The findings of the planned analyses are expected to be of immediate interest to educational and occupational domains where memory recall is a priority.
The Stage 1 manuscript was evaluated over two rounds of in-depth review. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
URL to the preregistered Stage 1 protocol: https://osf.io/pkrzb
Level of bias control achieved: Level 3. At least some data/evidence that will be used to the answer the research question has been previously accessed by the authors (e.g. downloaded or otherwise received), but the authors certify that they have not yet observed ANY part of the data/evidence. List of eligible PCI RR-friendly journals:
References
1. Mihaylova, M., Kliegel, M, & Rothen, N. (2024). Does retrieval practice protect memory against stress? A meta-analysis. In principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/pkrzb
2. Moreira, B. F. T., Pinto, T. S. S., Starling, D. S. V., & Jaeger, A. (2019). Retrieval practice in classroom settings: A review of applied research. In Frontiers in Education (Vol. 4, p. 5). Frontiers Media SA. https://doi.org/10.3389/feduc.2019.00005
3. Shields, G. S., Sazma, M. A., McCullough, A. M., & Yonelinas, A. P. (2017). The effects of acute stress on episodic memory: A meta-analysis and integrative review. Psychological Bulletin, 143, 636–675. https://doi.org/10.1037/bul0000100
4. Topor, M. K., Pickering, J. S., Mendes, A. B., Bishop, D., Büttner, F., Elsherif, M. M., ... & Westwood, S. (2022). An integrative framework for planning and conducting Non-Intervention, Reproducible, and Open Systematic Reviews (NIRO-SR). Meta-Psychology. https://osf.io/preprints/metaarxiv/8gu5z
| Does retrieval practice protect memory against stress? A meta-analysis [Stage 1 Registered Report] | Mariela Mihaylova, Matthias Kliegel, Nicolas Rothen | <p>[Note: This is a Stage 1 Registered Report. All placeholders will be replaced with actual results by Stage 2.]</p> <p><br>Stressors such as test anxiety (TA) are known to decrease memory retrieval, whereas retrieval practice (RP) is the phenom... | Humanities, Social sciences | Thomas Evans | 2023-02-16 14:39:06 |
