Adverse environments involving threat, uncertainty, deprivation and stress can cause significant and long-lasting harm to cognition and development. In this Stage 1 protocol, Vermeent and colleagues (2024) aim to simultaneously test with a single paradigm and statistical model for findings from previous studies showing that human working memory capacity is impaired in adverse environments, as well as other evidence suggesting that adversity may actually enhance updating of working memory. Furthermore, they will also investigate whether working memory is related to each of the adversity types: threat, deprivation, and unpredictability.

 

The findings of this study should help clarify how working memory functions in combination with adversity, and will provide insight into the development of better interventions and training methods for optimal performance in a variety of environments.

 

The manuscript was reviewed by two experts and the recommender. Following two rounds of peer review, and based on detailed responses to the reviewers' comments, I, the recommender, judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).

 

URL to the preregistered Stage 1 protocol: https://osf.io/dp7wc
 
Level of bias control achieved: Level 3. At least some data/evidence that will be used to the answer the research question has been previously accessed by the authors (e.g. downloaded or otherwise received), but the authors certify that they have not yet observed ANY part of the data/evidence.
 
List of eligible PCI RR-friendly journals:

 

1. Vermeent, S., Schubert, A.-L., DeJoseph, M. L., Denissen, J. J. A, van Gelder, J.-L. & Frankenhuis, W. E. (2024). Working memory performance in adverse environments: Enhanced, impaired, or intact? In principle acceptance of Version 2 by Peer Community in Registered Reports. https://osf.io/dp7wc

The "lure of choice" refers to the idea that we prefer to preserve the option to choose even when the choice is not helpful. In a classic study cited hundred of times, Bown et al. (2003) reported evidence for the lure of choice from a series of studies involving choices between competing options of night clubs, bank savings accounts, casino spinners, and the Monty Hall door choice paradigm. In all cases, participants tended to prefer to choose an option when paired with a "lure", even when that lure was objectively inferior (e.g., same probability of winning but lower payoff).

 

The lure of choice phenomenon applies to a variety of real-life situations many of us often face in our daily lives, and Bown et al.’s findings have influenced the way organizations present choices to prospective users. Despite their theoretical and practical impact, Bown et al.'s findings have not previously been directly replicated, even as the importance of replication studies has become increasingly acknowledged (Nosek et al., 2022).

 

Here, Chan & Feldman (2024) outline a close replication of Bown et al. (2003) that will replicate and extend their original design. By unifying Bown et al.'s multiple studies into a single paradigm with which they will collect data from approximately 1,000 online participants via Prolific, they will have substantially greater statistical power than the original study to detect the predicted effects. They will follow LeBel et al.’s (2019) criteria for evaluating replicability, such that it will be considered a successful replication depending on how many of the 4 scenarios show a signal in the same direction as Bown et al.’s original results (at least 3 out of 4 scenarios = successful replication; no scenarios = failed replication; 1 or 2 scenarios = mixed results replication). They have also added additional controls including a neutral baseline choice without a lure, further ensuring the the validity and interpretability of their eventual findings.

 

One of the goals in creating Peer Community In Registered Reports (PCI RR) was to increase the availability of publishing venues for replication studies, and so PCI RR is well-suited to the proposed replication. Feldman’s lab has also pioneered the use of PCI RR for direct replications of previous studies (e.g., Zhu & Feldman, 2023), and the current submission uses an open-access template he developed (Feldman, 2023). This experience combined with PCI RR’s efficient scheduled review model meant that the current full Stage 1 protocol was able to go from initial submission, receive detailed peer review by two experts, and receive in-principle acceptance (IPA) for the revised submission, all in less than one month.

 

URL to the preregistered Stage 1 protocol: https://osf.io/8ug9m
 
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.
 
List of eligible PCI RR-friendly journals:
 

• Advances in Cognitive Psychology
• Collabra: Psychology
• F1000Research
• Journal of Cognition
• Meta-Psychology
• Peer Community Journal
• PeerJ
• Royal Society Open Science
• Studia Psychologica
• Swiss Psychology Open

 

 

Bown, N. J., Read, D. & Summers, B. (2003). The lure of choice. Journal of Behavioral Decision Making, 16(4), 297–308. https://doi.org/10.1002/bdm.447

 

Chan, A. N. Y. & Feldman, G. (2024). The lure of choice revisited: Replication and extensions Registered Report of Bown et al. (2003) [Stage 1]. In principle acceptance of Version 2 by Peer Community In Registered Reports. https://osf.io/8ug9m

 

Feldman, G. (2023). Registered Report Stage 1 manuscript template. https://doi.org/10.17605/OSF.IO/YQXTP

 

LeBel, E. P., Vanpaemel, W., Cheung, I. & Campbell, L. (2019). A brief guide to evaluate replications. Meta-Psychology, 3. https://doi.org/10.15626/MP.2018.843

 

Nosek, B. A., Hardwicke, T. E., Moshontz, H., Allard, A., Corker, K. S., Dreber, A., ... & Vazire, S. (2022). Replicability, robustness, and reproducibility in psychological science. Annual Review of Psychology, 73(1), 719-748. https://doi.org/10.1146/annurev-psych-020821-114157

 

Zhu, M. & Feldman, G. (2023). Revisiting the links between numeracy and decision making: Replication Registered Report of Peters et al. (2006) with an extension examining confidence. Collabra: Psychology, 9(1). https://doi.org/10.1525/collabra.77608

Single gene alterations have been estimated to account for nearly half of neurodevelopmental conditions (NDCs), providing a crucial opportunity for animal models to understand the underlying mechanisms, causes and potential treatments. The use of systematic reviews (SRs) can, in principle, provide a powerful means to synthesise this evidence-base; however, the reporting quality of previous SRs in preclinical animal research has been found lacking (Hunniford et al., 2021). In the current study, Wilson et al. (2023) will undertook a review of systematic reviews to assess the characteristics and reporting quality of SRs that, in turn, synthesise research in genetically-modified animals to model NDCs. In particular, the authors extracted key features of reviews (including, among others, the aim and primary research questions, relevant animal model, and number of studies in the SR), in addition to quality indicators such as risk of bias and completeness of reporting. In doing so, the authors aimed to enhance guidance on the conduct and reporting of systematic reviews in this area.

 

Of twelve publications that met the preregistered search criteria, the completeness and quality of reporting was variable. Among the better reported characteristics were search strategies (9 of 12 articles), reporting of funding sources (10 of 12 articles) and use of animal data (11 of 12 articles). In contrast, only two articles reported whether the study protocol was preregistered, only three articles reported methods for assessing risk of bias, and just one included methods to analyse publication bias. In addition, the authors identified 19 review registrations via PROSPERO, most of which remained unpublished after their anticipated end dates. Overall, the results highlight the importance of adherence to reporting guidelines for increasing the transparency and reproducibility of SRs in this field.

 

The Stage 2 manuscript was evaluated over one round of in-depth review. Based on detailed responses by the authors, the recommender judged that the manuscript met the Stage 2 criteria and awarded a positive recommendation.
 
URL to the preregistered Stage 1 protocol: https://osf.io/952qk

 

Level of bias control achieved: Level 4. At least some of the data/evidence that was used to answer the research question already existed prior to IPA and was accessible in principle to the authors, but the authors certify that they did not access any part of that data/evidence prior to IPA.

 
List of eligible PCI RR-friendly journals:

 

• Brain and Neuroscience Advances
• F1000Research
• Human Population Genetics and Genomics
• In&Vertebrates
• Journal for Reproducibility in Neuroscience
• Peer Community Journal
• PeerJ
• Royal Society Open Science
   

 

1. Hunniford V. T., Montroy J., Fergusson D. A., Avey M. T., Wever K. E., McCann S. K., Foster M., Fox G., Lafreniere M., Ghaly M., Mannell S., Godwinska K., Gentles A., Selim S., MacNeil J., Sikora L., Sena E. S., Page M. J., Macleod M., Moher D., & Lalu M. M. (2021). Epidemiology and reporting characteristics of preclinical systematic reviews. PLOS Biology, 19:e3001177. https://doi.org/10.1371/journal.pbio.3001177

 

2. Wilson, E., Currie, G., Macleod, M., Kind, P. & Sena, E. S. (2023). Genetically-modified animals as models of neurodevelopmental conditions: a review of systematic review reporting quality [Stage 2]. Acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/s5xd4

As virtual reality environments become more common, it is important to understand our sensorimotor interactions with them. In real world settings, sensory information is supplemented by prior expectations from past experiences, aiding efficient action control. In VR, the relative role of expectations could decrease due to a lack of prior experience with the environment, or increase because sensory information is impoverished or ambiguous. Harris, Arthur and Buckingham (2024) propose to test these possibilities by comparing a real-world object lifting task and a VR version in which the same objects are lifted but visual feedback is substituted by a virtual view. The experiment uses the Size-Weight Illusion (SWI) and the Material Weight Illusion (MWI). In these paradigms, the visual appearance of the object induces expectations about weight that can affect the perception of weight during lifting, and the fingertip forces generated. The degree to which the visual appearance of objects induces differences in perceived weight, and in measured fingertip forces, will index the influence of prior expectations for these two paradigms. The analyses will test whether the influence of prior expectations is lower or higher in the VR set-up than in real-world lifting. The outcomes across tasks (SWI and MWI) and measures (perceived weight, fingertip forces) will broaden our understanding of the role of predictive sensorimotor control in novel virtual environments.

 

After three rounds of evaluation, with input from two external reviewers, the recommender judged that the Stage 1 manuscript met the criteria for in-principle acceptance (IPA).

 

 
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.
 
List of eligible PCI RR-friendly journals:

 

• Advances in Cognitive Psychology
• Collabra: Psychology
• Communications in Kinesiology
• Experimental Psychology
• In&Vertebrates
• Journal of Cognition
• Peer Community Journal
• PeerJ
• Psychology of Consciousness: Theory, Research, and Practice
• Royal Society Open Science
• Studia Psychologica
• Swiss Psychology Open

 
References

 

1. Harris, D. J., Arthur, T., & Buckingham, G. (2024). Does ‘virtuality’ affect the role of prior expectations in perception and action? Comparing predictive grip and lifting forces in real and virtual environments. In principle acceptance of Version 4 by Peer Community in Registered Reports. https://osf.io/36jhb

 

How can qualitative research and case studies inform theoretical models of gaming disorder? Gaming Disorder has generated a large amount of research, with up to 95% of it focusing on quantitative studies. As a result, most of the meta-analyses and review studies focus on quantitative research and disregard qualitative approaches. However, studying the direct experiences of gamers can provide more detailed and direct evidence that can feed into theoretical models. 

 

In this Stage 1 manuscript, Auranen et al. (2024) will perform a qualitative meta-analysis of gaming disorder case studies, case reports, and case series of treatment-seekers using a 3-phase approach. First, they will focus on examining the reported problems of participants, the reported reasons for seeking help to reduce their gaming, and the causal link between gaming and reported problems, including the context of these problematic behaviors. Second, thematic synthesis will generate construct themes regarding the contexts of the individuals and the reported problems. Lastly, the authors will examine the relevance of findings in regards to the coping model, value fulfillment theory and the theory of cultural dissonance.

 

The Stage 1 submission was evaluated by the recommender and three expert reviewers, one of which was recused due to conflicts of interest that emerged after the first round of revisions. The recommender and co-recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).

 

 

Level of bias control achieved: Level 4. At least some of the data/evidence that will be used to answer the research question already exists AND is accessible in principle to the authors (e.g. residing in a public database or with a colleague), BUT the authors certify that they have not yet accessed any part of that data/evidence.
 
List of eligible PCI RR-friendly journals:

 

• Collabra: Psychology
• Peer Community Journal
• PeerJ
• Studia Psychologica
• Swiss Psychology Open

 
References

Auranen, T., Adamkovič, M., Martončik, M., Park, S., Kauraoja, V., Siutila, M., Jin, Y., & Karhulahti, V.-M. (2024). Gaming Disorder: A qualitative meta-synthesis of related case studies. In principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/hzc5a