Submit a report

Announcements

Please note that we will be CLOSED to ALL SUBMISSIONS from 1 December 2024 through 12 January 2025 to give our recommenders and reviewers a holiday break.

We are recruiting recommenders (editors) from all research fields!

Your feedback matters! If you have authored or reviewed a Registered Report at Peer Community in Registered Reports, then please take 5 minutes to leave anonymous feedback about your experience, and view community ratings.

Latest recommendationsrssmastodon

IdTitle * Authors * Abstract * PictureThematic fields * Recommender▼ReviewersSubmission date
13 Feb 2023
STAGE 2
(Go to stage 1)
article picture

Sight vs. sound judgments of music performance depend on relative performer quality: Cross-cultural evidence from classical piano and Tsugaru shamisen competitions [Stage 2 Registered Report]

Music is appreciated cross-modally, but is culture- and context-dependent

Recommended by ORCID_LOGO based on reviews by Kyoshiro Sasaki and 1 anonymous reviewer
Music is not merely limited to the aural experience we garner through our auditory faculties, as commonly perceived. Rather, various studies have explored the cross-modal impact of visual stimuli on the evaluation of music. These previous studies have been confined exclusively to Western music. Hence, Chiba et al. (2023) designed a study with a focus on the Tsugaru shamisen, a renowned folk instrument indigenous to Japan, and of which the first author is an outstanding player.

The study methodology was an improved version of previous endeavors, wherein actual musical material sourced from concours performances was displayed through audio-only, video-only or both modalities. A sample of Japanese participants were then asked to evaluate the concours performances on both the piano and the Tsugaru shamisen. The results, obtained through pre-registered protocols, revealed that for both concours performances, the participants displayed a cross-modal impact of visual information on their aural evaluation of music. This effect was also found to be contingent on cultural and contextual factors. These outcomes furnish valuable evidence towards the generalizability of the interplay between sight and sound in the assessment of music.
 
The study underwent rigorous peer-review processes in both Stage 1 and Stage 2, with three experts specializing in Japanese folk music, open science, and statistics, respectively, providing their critical assessments. Following multiple rounds of revision, the final manuscript was deemed fit for recommendation.
 
URL to the preregistered Stage 1 protocol: https://osf.io/ry2b6
 
Level of bias control achieved: Level 6. No part of the data or evidence that was used to answer the research question was generated until after IPA.
 
List of eligible PCI RR-friendly journals:
 
 
References
 
Chiba G., Ozaki Y., Fujii S., & Savage P.E. (2023). Sight vs. sound judgments of music performance depend on relative performer quality: Cross-cultural evidence from classical piano and Tsugaru shamisen competitions [Stage 2 Registered Report]. Acceptance of Version 2 by Peer Community in Registered Reports. https://doi.org/10.31234/osf.io/xky4j
Sight vs. sound judgments of music performance depend on relative performer quality: Cross-cultural evidence from classical piano and Tsugaru shamisen competitions [Stage 2 Registered Report]Gakuto Chiba, Yuto Ozaki, Shinya Fujii, Patrick E. Savage<p>Which information dominates in evaluating performance in music? Both experts and laypeople consistently report believing that sound should be the most important domain when judging music competitions, but experimental studies of Western partici...Social sciencesYuki Yamada2022-11-30 08:04:37 View
30 May 2024
STAGE 1

Does learning more about others impact liking them?: Replication and extension Registered Report of Norton et al. (2007)’s Lure of Ambiguity

Does familiarity really breed contempt?

Recommended by ORCID_LOGO based on reviews by Philipp Schoenegger and Zoltan Kekecs
In interpersonal evaluation, the amount of information available about the other person has a significant impact. Norton et al. (2007) conducted systematic experiments suggesting a 'less is more' effect – that a lack of information leads to a more positive evaluation. However, subsequent studies have not always reached the same conclusion.
 
In the current study, Horsham et al. (2024) aim to address this issue by conducting direct and conceptual replications of the Norton et al. (2007) experiments, as well as additional extensive experiments focusing on the effects of curiosity. The authors seek to confirm in a reliable way the relationship between ambiguity and liking, and even to clarify the factors that mediate this relationship. The results should significantly advance our understanding of the importance of information management in interpersonal relationships.
 
The Stage 1 manuscript was peer-reviewed by two experts; after four rounds of review and based on their revisions and detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and awarded it in-principle acceptance (IPA).
 
URL to the preregistered Stage 1 protocol: https://osf.io/7mc4y
 
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.
 
List of eligible PCI RR-friendly journals:
 
 
References
 
1. Norton, M. I., Frost, J. H., & Ariely, D. (2007). Less is more: The lure of ambiguity, or why familiarity breeds contempt. Journal of Personality and Social Psychology, 92, 97-105. https://doi.org/10.1037/0022-3514.92.1.97
 
2. Horsham, Z., Haydock-Symonds, A., Imada, H., Tai, H. C., Lau, W. L., Shum, T. L., Zeng, Y., Chow, H. T., & Feldman, G., (2024). Does learning more about others impact liking them? Replication and extension Registered Report of Norton et al. (2007)’s Lure of Ambiguity. In principle acceptance of Version 4 by Peer Community in Registered Reports. https://osf.io/7mc4y
Does learning more about others impact liking them?: Replication and extension Registered Report of Norton et al. (2007)’s Lure of AmbiguityZöe Horsham, Ashleigh Haydock-Symonds, Hirotaka Imada, Hiu Ching Tai, Wing Lam Lau, Tsz Lui Shum, Yuqing Zeng, Hiu Tang Chow, Gilad Feldman<p>[IMPORTANT: Abstract, method, and results were written using a randomized dataset produced by Qualtrics to simulate what these sections will look like after data collection. These will be updated following the data collection. For the purpose o...Social sciencesYuki Yamada Zoltan Kekecs2023-07-11 12:33:00 View
28 Mar 2024
STAGE 1

Working memory performance in adverse environments: Enhanced, impaired, or intact?

A closer look at working memory changing with adversity

Recommended by ORCID_LOGO based on reviews by Kathryn Bates and 1 anonymous reviewer
Adverse environments involving threat, uncertainty, deprivation and stress can cause significant and long-lasting harm to cognition and development. In this Stage 1 protocol, Vermeent and colleagues (2024) aim to simultaneously test with a single paradigm and statistical model for findings from previous studies showing that human working memory capacity is impaired in adverse environments, as well as other evidence suggesting that adversity may actually enhance updating of working memory. Furthermore, they will also investigate whether working memory is related to each of the adversity types: threat, deprivation, and unpredictability.
 
The findings of this study should help clarify how working memory functions in combination with adversity, and will provide insight into the development of better interventions and training methods for optimal performance in a variety of environments.
 
The manuscript was reviewed by two experts and the recommender. Following two rounds of peer review, and based on detailed responses to the reviewers' comments, I, the recommender, judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
 
URL to the preregistered Stage 1 protocol: https://osf.io/dp7wc
 
Level of bias control achieved: Level 3. At least some data/evidence that will be used to the answer the research question has been previously accessed by the authors (e.g. downloaded or otherwise received), but the authors certify that they have not yet observed ANY part of the data/evidence.
 
List of eligible PCI RR-friendly journals:
 
References

1. Vermeent, S., Schubert, A.-L., DeJoseph, M. L., Denissen, J. J. A, van Gelder, J.-L. & Frankenhuis, W. E. (2024). Working memory performance in adverse environments: Enhanced, impaired, or intact? In principle acceptance of Version 2 by Peer Community in Registered Reports. https://osf.io/dp7wc
Working memory performance in adverse environments: Enhanced, impaired, or intact?Stefan Vermeent, Anna-Lena Schubert, Meriah L. DeJoseph, Jaap J. A. Denissen, Jean-Louis van Gelder, Willem E. Frankenhuis<p>Decades of research have shown that adversity tends to lower working memory (WM) performance. This literature has mainly focused on impairments in the overall capacity to hold information available in WM for further processing. However, some re...Social sciencesYuki YamadaAnonymous, Kathryn Bates2023-10-30 15:11:48 View
15 Oct 2023
STAGE 1

Can one-shot learning be elicited from unconscious information?

Can unconscious experience drive perceptual learning?

Recommended by ORCID_LOGO based on reviews by Jeffrey Saunders and 1 anonymous reviewer
Unconscious priming effects have fascinated not just psychologists but also ad-makers and consumers alike. A related phenomenon in perception is illustrated by presenting participants with two-tone images, which are degraded versions of images of objects and scenes. These two-tone images look like and are indeed judged as meaningless dark and light patches. Upon presenting the actual template image, however, the two-tone image is accurately recognized. This perceptual learning is abrupt, robust, and long-lasting (Daoudi et al., 2017). Surprisingly, Chang et al. (2016) showed that such perceptual disambiguation of two-tone images can happen even in the absence of conscious awareness of having seen the template image. 
 
Halchin et al. (2023) in the current study propose to conduct a conceptual replication of Chang et al. (2016) with important modifications to the procedures to address limitations with the earlier work. Specifically, there was no explicit manipulation of levels of conscious awareness of the template images in the original study. Therefore, miscategorization of low-confidence awareness as unaware could have led to an erroneous conclusion about unconscious priors guiding perceptual learning. Such miscategorization errors and how to tackle them are of interest to the broader field of consciousness studies. Furthermore, a conceptual replication of Chang et al. (2016) is also timely given that prior related work suggests that masking impairs not only conscious awareness of visual features but also blocks processing of higher-level information about the images (e.g. object category). 
 
To address the issues identified above, Halchin et al. (2023) propose to experimentally manipulate conscious awareness by masking the template image very quickly (i.e., a short stimulus onset asynchrony; SOA) or by allowing some more time to induce weak and strong conscious awareness, respectively. The SOAs were validated through pilot studies. Furthermore, they include a four-point perceptual awareness scale instead of the original yes/no options to gauge participants’ subjective awareness of the template images. The authors also propose multiple experiments to include different ways of testing participants’ objective ability to identify the masked template images. Last but not least, the proposed design includes a stronger control condition than the original study by using masked images created from related images (e.g. belonging to the same semantic category). Depending on the results obtained in the main experiments, the inclusion of this control allows the authors to conduct a third experiment to investigate whether the results in the first two can be explained by semantic priming. The proposed study is sufficiently powered (as demonstrated through simulations), and Bayesian statistical procedures will be used to test the main hypotheses. In summary, the proposed work offers a significant improvement in terms of experimental procedures over the original study. If the Chang et al. (2016) results are replicated, the stronger design in the current study is likely to lead to a better understanding of the mechanisms underlying unconscious priors guiding perceptual learning. On the other hand, a failure to replicate not just Chang et al. (2016)’s results but also effects across the three experiments in the current study would raise legitimate questions about the reality of unconscious information guiding perceptual learning. 
 
The study plan was refined across two rounds of review, with input from two external reviewers who both agreed that the proposed study is well designed, timely, and scientifically valid. The recommender then reviewed the revised manuscript and judged that the study met the Stage 1 criteria for in-principle acceptance (IPA).
 
URL to the preregistered Stage 1 protocol: https://osf.io/juckg
 
Level of bias control achieved: Level 3. At least some of the data/evidence that will be used to answer the research question already exists AND is accessible in principle to the authors BUT the authors certify that they have not yet accessed any part of that data/evidence.
 
List of eligible PCI-RR-friendly journals:
 
 
References
 
1. Daoudi, L. D., Doerig, A., Parkosadze, K., Kunchulia, M. & Herzog, M. H. (2017). The role of one-shot learning in #TheDress. Journal of Vision, 17, 15-15. https://doi.org/10.1167/17.3.15 
 
2. Chang, R., Baria, A. T., Flounders, M. W., & He, B. J. (2016). Unconsciously elicited perceptual prior. Neuroscience of Consciousness, 2016. https://doi.org/10.1093/nc/niw008 
 
3. Halchin, A.-M., Teuful, C. & Bompas, A. (2023). Can one-shot learning be elicited from unconscious information? In principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/juckg
Can one-shot learning be elicited from unconscious information? Adelina-Mihaela Halchin, Christoph Teufel, Aline Bompas<p>The human brain has the remarkable ability to make sense of highly impoverished images once relevant prior information is available. Fitting examples of this effect are two-tone images, which initially look like meaningless black-and-white patc...Life SciencesVishnu Sreekumar2022-11-30 00:34:07 View
24 Sep 2023
STAGE 1

Sensorimotor Effects in Surprise Word Memory – a Registered Report

Evaluating adaptive and attentional accounts of sensorimotor effects in word recognition memory

Recommended by ORCID_LOGO based on reviews by Gordon Feld and Adam Osth
Words have served as stimuli in memory experiments for over a century. What makes some words stand out in memory compared to others? One plausible answer is that semantically rich words are more distinctive and therefore exhibit a mirror effect in recognition memory experiments where they are likely to be correctly endorsed and also less likely to be confused with other words (Glanzer & Adams, 1985). Semantic richness can arise due to extensive prior experience with the word in multiple contexts but can also arise due to sensorimotor grounding, i.e., direct perceptual and action-based experience with the concepts represented by the words (e.g. pillow, cuddle). However, previous experiments have revealed inconsistent recognition memory performance patterns for words based on different types of sensorimotor grounding (Dymarska et al., 2023). Most surprisingly, body-related words such as cuddle and fitness exhibited greater false alarm rates. 

In the current study, Dymarska and Connell (2023) propose to test two competing theories that can explain the increased confusability of body-related words: 1) the adaptive account - contextual elaboration-based strategies activate other concepts related to body and survival, increasing confusability; and 2) the attentional account - somatic attentional mechanisms automatically induce similar tactile and interoceptive experiences upon seeing body-related words leading to less distinctive memory traces. The adaptive account leads to different predictions under intentional and incidental memory conditions. Specifically, contextual elaboration strategies are unlikely to be employed when participants do not expect a memory test and therefore in an incidental memory task, body-related words should not lead to inflated false alarm rates (see Hintzman (2011) for a discussion on incidental memory tasks and the importance of how material is processed during memory tasks). However, the attentional account is not dependent on the task instructions or the knowledge about an upcoming memory test. 

Here, Dymarska and Connell (2023) have designed an incidental recognition memory experiment with over 5000 words, disguised as a lexical decision task using carefully matched pseudowords during the encoding phase. The sample size will be determined by using a sequential hypothesis testing plan with Bayes Factors. To test the predictions of the adaptive and attentional accounts, the authors derive a set of lexical and sensorimotor variables (including a body-component) after dimensionality reduction of a comprehensive set of lexical and semantic word features. The analysis will involve running both Bayesian and frequentist hierarchical linear regression to explain four different measures of recognition memory performance based on the key sensorimotor variables and other baseline/confounding variables. While this analysis plan enables a comparison with the earlier results from an expected memory test (Dymarska et al., 2023), the current study is self-contained in that it is possible to distinguish the adaptive and attentional accounts based on the effect of body component scores on hit rate and false alarm rate.

The study plan was refined across two rounds of review, with input from two external reviewers after which the recommender judged that the study satisfied the Stage 1 criteria for in-principle acceptance (IPA).
 
URL to the preregistered Stage 1 protocol: https://osf.io/ck5bg
 
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.
 
List of eligible PCI RR-friendly journals:
 
References
 
Dymarska, A. & Connell, L. (2023). Sensorimotor Effects in Surprise Word Memory – a Registered Report. In principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/ck5bg

Dymarska, A., Connell, L. & Banks, B. (2023). More is Not Necessarily Better: How Different Aspects of Sensorimotor Experience Affect Recognition Memory for Words. Journal of Experimental Psychology: Language, Memory, Cognition. Advance online publication. https://dx.doi.org/10.1037/xlm0001265 

Glanzer, M., & Adams, J. K. (1985). The mirror effect in recognition memory. Memory & cognition, 13, 8-20.

Hintzman, D. L. (2011). Research strategy in the study of memory: Fads, fallacies, and the search for the “coordinates of truth”. Perspectives on Psychological Science, 6(3), 253-271.
Sensorimotor Effects in Surprise Word Memory – a Registered ReportAgata Dymarska, Louise Connell<p>Sensorimotor grounding of semantic information elicits inconsistent effects on word memory, depending on which type of experience is involved, with some aspects of sensorimotor information facilitating memory performance while others inhibit it...Social sciencesVishnu Sreekumar2023-01-31 15:21:17 View
28 Feb 2024
STAGE 1

Changes in memory function in adults following SARS-CoV-2 infection: findings from the Covid and Cognition online study

Is memory affected in the long run following SARS-CoV-2 infection?

Recommended by ORCID_LOGO based on reviews by Phivos Phylactou, Dipanjan Ray and Mitul Mehta
COVID-19 has been suspected to have long-lasting effects on cognitive function. The SARS-CoV-2 virus may enter the central nervous system (Frontera et al., 2020; Miners, Kehoe, & Love, 2020), explaining the observed detrimental effects of COVID-19 on verbal planning and reasoning (Hampshire et al., 2021; Wild et al., 2021), executive function (Hadad et al., 2022), and long-term memory (Guo et al., 2022). In particular, Guo et al. (2022) used verbal item recognition and non-verbal associative memory tasks. Weinerova et al. (2024), in the current study, propose to conduct a replication of Guo et al. (2022), but specifically, to disentangle the effect of COVID-19 infection status on both memory type (item vs. associative) and stimulus modality (verbal vs. non-verbal). Furthermore, Weinerova et al. (2024) propose to analyze cognitive function based on vaccination status before infection to provide a critical test of the potential protective effects of vaccination on cognitive function.

Data collection has been completed with 325 participants after exclusion criteria were applied (COVID group N = 232, No COVID group N = 93). Simulations assuming an effect size observed in Guo et al. (2022), a Bayesian t-test comparing the groups, and a Bayes Factor of 6 indicated that N = 320 is sufficient to detect an effect on 79% of simulations. The main analyses will be conducted using a Bayesian ANCOVA that allows for the inclusion of control variables such as age, sex, country, and education level. Both accuracy and reaction times from the item and associative recognition tasks will be analyzed as the dependent variables. In one analysis, vaccination status will be included as a between-subjects factor, to understand whether vaccination status at the time of infection influences subsequent cognitive function. 

It is important to note that participants were recruited through long-COVID Facebook groups and clinics. Therefore, the results must be interpreted carefully to avoid generalizing to all COVID-19 infections. The data are part of a larger longitudinal study, and the current pre-registration applies only to the baseline timepoint for a cross-sectional analysis. The remaining longitudinal data collection is ongoing and is not part of the current pre-registration.  

The study plan was refined after one round of review, with input from three external reviewers who all agreed that the proposed study was well-designed and scientifically valid. The recommender then reviewed the revised manuscript and judged that the study met the Stage 1 criteria for in-principle acceptance (IPA).
 
URL to the preregistered Stage 1 protocol: https://osf.io/tjs5u (under temporary private embargo)
 
Level of bias control achieved: Level 3. At least some data/evidence that will be used to the answer the research question has been previously accessed by the authors (e.g. downloaded or otherwise received), but the authors certify that they have not yet observed ANY part of the data/evidence.
 
List of eligible PCI RR-friendly journals:
 
 
References
 
1. Frontera, J., Mainali, S., Fink, E.L. et al. Global Consortium Study of Neurological Dysfunction in COVID-19 (GCS-NeuroCOVID): Study Design and Rationale. Neurocrit Care 33, 25–34 (2020). https://doi.org/10.1007/s12028-020-00995-3

2. Guo, P., Benito Ballesteros, A., Yeung, S. P., Liu, R., Saha, A., Curtis, L., Kaser, M., Haggard, M. P. & Cheke, L. G. (2022). COVCOG 2: Cognitive and Memory Deficits in Long COVID: A Second Publication From the COVID and Cognition Study. Frontiers in Aging Neuroscience. https://doi.org/10.3389/fnagi.2022.804937  

3. Hadad, R., Khoury, J., Stanger, C., Fisher, T., Schneer, S., Ben-Hayun, R., Possin, K., Valcour, V., Aharon-Peretz, J. & Adir, Y. (2022). Cognitive dysfunction following COVID-19 infection. Journal of NeuroVirology, 28(3), 430–437. https://doi.org/10.1007/s13365-022-01079-y  

4. Hampshire, A., Trender, W., Chamberlain, S. R., Jolly, A. E., Grant, J. E., Patrick, F., Mazibuko, N., Williams, S. C., Barnby, J. M., Hellyer, P. & Mehta, M. A. (2021). Cognitive deficits in people who have recovered from COVID-19. EClinicalMedicine, 39, 101044. https://doi.org/10.1016/j.eclinm.2021.101044

5. Miners, S., Kehoe, P. G., & Love, S. (2020). Cognitive impact of COVID-19: looking beyond the short term. Alzheimer's research & therapy, 12, 1-16. https://doi.org/10.1186/s13195-020-00744-w 
 
6. Weinerova, J., Yeung, S., Guo, P., Yau, A., Horne, C., Ghinn, M., Curtis, L., Adlard, F., Bhagat, V., Zhang, S., Kaser, M., Bozic, M., Schluppeck, D., Reid, A., Tibon, R. & Cheke, L. G. (2024). Changes in memory function in adults following SARS-CoV-2 infection: findings from the Covid and Cognition online study. In principle acceptance of Version 2 by Peer Community in Registered Reports. https://osf.io/tjs5u

7. Wild, C. J., Norton, L., Menon, D. K., Ripsman, D. A., Swartz, R. H. & Owen, A. M. (2022). Disentangling the cognitive, physical, and mental health sequelae of COVID-19. Cell Reports Medicine, 3, 100750. https://doi.org/10.1016/j.xcrm.2022.100750 
Changes in memory function in adults following SARS-CoV-2 infection: findings from the Covid and Cognition online studyJosefina Weinerova, Sabine Yeung, Panyuan Guo, Alice Yau, Connor Horne, Molly Ghinn, Lyn Curtis, Francess Adlard, Vidita Bhagat, Seraphina Zhang, Muzaffer Kaser, Mirjana Bozic, Denis Schluppeck, Andrew Reid, Roni Tibon, Lucy Cheke<p>SARS-CoV-2, the virus responsible for the Covid-19 pandemic, has been shown to have an impact on cognitive function, but the specific aspects of cognition that are affected remain unclear. In this Registered Report, we present a study aimed at ...Life SciencesVishnu Sreekumar2023-08-14 11:09:45 View
05 Aug 2022
STAGE 1

Through the lens of Developmental Coordination Disorder (DCD): experiences of a late diagnosis

Developmental Coordination Disorder Diagnosis as Part of Evolving Self-Concepts

Recommended by ORCID_LOGO based on reviews by Moin Syed, Gill Waters and Catherine Purcell
Although developmental coordination disorder (DCD) is a common neurodevelopmental disorder with an estimated prevalence of up to 6% in children (APA, 2013), many DCD diagnoses are not made before late adulthood. Receiving a neurodevelopmental disorder diagnosis has been found adding to people’s self-concepts, for instance, with autism spectrum disorder (Tan, 2018), but it is not well known if and how such events unfold in late DCD diagnoses. In this Stage 1 Registered Report, Topor et al. (2022) present a careful plan to qualitatively investigate the lived experiences of individuals with a late DCD diagnosis in order to map out the variety of emotional responses to diagnoses and their effects on self-concepts.

Topor et al. (2022) will carry out 10–15 semi-structured interviews with participants who received a DCD diagnosis at the age of 30 or after. They commit to realist epistemology when utilizing thematic analysis; namely, instructions have been preregistered for two separate analysts who will code the transcript data independently. At the same time, the methodology involves reflexive components. The authors have prepared strong positionality statements through which their analyses will be carried out with post-analysis reflections to be written at Stage 2. The coding process will explicitly involve a data analysis log that pursues interpretive transparency. The data and materials will be shared, which adds to the work's value in the context of open qualitative psychology in general.   
 
The study will help us better understand the process of receiving (late) DCD diagnoses and, specifically, how the emotional aftermath is potentially related to one’s evolving self-concept. In addition to making a clear contribution to cumulative scientific knowledge, the findings can be useful for professionals working with DCD-diagnosed individuals as well as for the development of related support services. The Registered Report format allowed the research design to be reviewed in three rounds before data collection. Initially, three experts representing developmental psychology and DCD reviewed the Stage 1 manuscript, after which the recommender carried out two iterations with further requested revisions. This was followed by in-principle acceptance.
 
URL to the preregistered Stage 1 protocol: https://osf.io/67h3f
 
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA. 
 
List of eligible PCI RR-friendly journals:
 
 
References
 
1. APA (2013) Diagnostic and statistical manual of mental disorders, 5th ed, American Psychiatric Association, Washington, DC.

2. Tan, C. D. (2018). “I'm a normal autistic person, not an abnormal neurotypical”: Autism Spectrum Disorder diagnosis as biographical illumination.” Social Science & Medicine, 197, 161-167.
 
3. Topor, M., Armstrong, G., Gentle, J. (2022). Through the lens of Developmental Coordination Disorder (DCD): experiences of a late diagnosis, in principle acceptance of Version 4 by Peer Community in Registered Reports. https://osf.io/67h3f
Through the lens of Developmental Coordination Disorder (DCD): experiences of a late diagnosisMarta Topor, Gemma Armstrong, Judith Gentle<p>A late diagnosis of a lifelong neurodevelopmental condition has been shown to be an important life event with strong emotional consequences and deep personal reflections. &nbsp; Developmental Coordination Disorder (DCD/Dyspraxia) is a common, y...Medical Sciences, Social sciencesVeli-Matti Karhulahti2022-01-11 21:48:18 View
07 Apr 2022
STAGE 1

Breaking Ban: Assessing the effectiveness of Belgium’s gambling law regulation of video game loot boxes

Has the “ban” of loot boxes eliminated them from Belgian mobile games?

Recommended by ORCID_LOGO based on reviews by Andrew Moshirnia, Joseph Macey and Jason Chin
Paid loot boxes, i.e. randomised monetization methods that are similar to lottery-type gambling, have become prominent features of contemporary gaming (e.g., Macey & Bujić, 2022). Because the design structures of loot boxes vary and the value of their virtual rewards is not always clear-cut, many countries now struggle how to deal with them legally and in practice (see Drummond et al., 2020). Belgium is one of the few countries that have officially interpreted loot box monetization to widely belong under gambling regulation. Mobile games that monetize with paid loot boxes in Belgium should thus apply for a gambling license, and companies should generally not offer paid loot boxes to local underage players at all.
 
In this Stage 1 Registered Report, Xiao (2022) has constructed a careful plan for testing whether the “ban” in Belgium has made the local mobile game market distinct in terms of paid loot boxes. The work builds on a rapidly accumulating literature and evolving methods (e.g., Xiao et al., 2021). The author will carry out a systematic qualitative investigation of the country’s top 100 (iPhone) mobile games to investigate whether paid loot box design components have indeed been removed from the products -- and if not, whether related game companies operate with a required gambling license. Additionally, Xiao (2022) will assess Belgium’s overall paid loot box prevalence in comparison to other countries and carry out a field experiment to test whether players can easily circumvent the local regulation by transporting or downloading different versions of software.
 
The study will produce valuable evidence regarding the effectiveness of loot box regulation in general, and more specifically, the results should be of utmost interest to Belgian legal authorities. To ensure the transparency and validity of the chosen methods as well as upcoming interpretations, the registered report format allowed the research design to be reviewed in three rounds before data collection. Three experts, representing the fields of law and gaming, reviewed the Stage 1 manuscript twice and agreed upon the acceptance of all details. Finally, the recommender carried out a third iteration with further requested revisions, which was followed by in-principle acceptance. 
 

URL to the preregistered Stage 1 protocol: https://osf.io/5mxp6

Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.

List of eligible PCI RR-friendly journals:

References

  • Drummond, A., Sauer, J. D., Hall, L. C., Zendle, D., & Loudon, M. R. (2020). Why loot boxes could be regulated as gambling. Nature Human Behaviour, 4(10), 986-988.
  • Macey, J., & Bujić, M. (2022). "The Talk of the Town: Community Perspectiveson Loot Boxes." In Ruotsalainen et al. (eds), Modes of Esports Engagement in Overwatch (pp. 199-223). Palgrave Macmillan.
  • Xiao, L. (2022) “Breaking Ban: Assessing the effectiveness of Belgium’s gambling law regulation of loot boxes.” Stage 1 Registered Report, in principle acceptance of Version 5 by Peer Community in Registered Reports.
  • Xiao, L. Y., Henderson, L. L., Yang, Y., & Newall, P. W. (2021). Gaming the system: suboptimal compliance with loot box probability disclosure regulations in China. Behavioural Public Policy, 1-27.
Breaking Ban: Assessing the effectiveness of Belgium’s gambling law regulation of video game loot boxesLeon Y. Xiao<p>Loot boxes in video games are gambling-like mechanics that players buy to obtain randomised rewards of varying value. Loot boxes are conceptually and psychologically similar to gambling, and loot box expenditure is positively correlated with se...Humanities, Social sciencesVeli-Matti Karhulahti2022-02-07 22:54:50 View
14 Nov 2022
STAGE 2
(Go to stage 1)
article picture

Breaking Ban: Belgium’s ineffective gambling law regulation of video game loot boxes

Loot boxes remain prevalent in Belgium despite their “ban”

Recommended by ORCID_LOGO based on reviews by Andrew Moshirnia, Joseph Macey and Jason Chin
Several countries currently struggle to legally interpret and deal with loot boxes, i.e. gambling-like mechanisms that have become common especially in contemporary videogame design. One of the few countries to take a clear regulation stance is Belgium, which officially announced that they interpret paid loot boxes as games of chance that violate their Gaming and Betting Act and can thus be criminally prosecuted (Naessens 2018). This announcement four years ago laid the basis for a unique social experiment where companies offering loot boxes in Belgium had to decide whether to modify their games, exit the market, or continue to monetize with loot boxes. In the present study, Xiao (2022) investigated the outcomes of this experiment both via hypotheses testing and exploratory analysis.
 
Using the 100 highest-grossing iPhone games in Belgium as data and applying comprehensive qualitative mechanical analysis to each title, Xiao (2022) tested three preregistered hypotheses regarding loot box prevalence. None of the hypotheses were confirmed: the prevalence rate of loot boxes in the Belgian App Store was not null but extremely high (82.0%), also among mobile games designed for minors (54.2–80.2%), and significantly more compared to global standards when assessed by a binomial test (p<.001). Corroborating a fourth hypothesis, Xiao was also able to access various UK loot boxes in Belgium. In exploratory research, Xiao received a confirmation from the Belgian Gaming Commission that even “simulated gambling games” (that do not yield monetary wins) also legally constitute gambling in Belgium.
 
The results are the first to describe outcomes of ban-driven loot box regulation globally. Despite Belgium’s clear statement that “paid loot boxes must be removed from the video games in order to comply with the Belgian Gaming and Betting Act” (Naessens 2018, p. 16), almost all highest-grossing iPhone games in the Belgian App Store keep offering them. The finding is important especially for the legal authorities around the world who are currently assessing their own positions in potential regulation: simple statements are unlikely to have immediate effects on international companies in local markets. On the other hand, it remains unknown how these companies have interpreted the statement and what are their distinct reasons for continuing to offer loot boxes in the Belgian App Store. It would be important in future research to investigate the companies’ perspectives.
 
This study (Xiao 2022) is important also from a meta-scientific perspective. It paves the way for Registered Reports in new disciplines and methods, and involves an exceptional field experiment that was carefully documented with open data and materials. Three external experts reviewed the Stage 2 manuscript twice, based on which the recommender awarded a positive recommendation.
 

URL to the preregistered Stage 1 protocol: https://osf.io/5mxp6

Level of bias control achieved: Level 6. No part of the data or evidence that was used to answer the research question existed prior to Stage 1 in-principle acceptance.

List of eligible PCI RR-friendly journals:

 

References
 
1. Naessens, P. (2018) Research Report on Loot Boxes [English Translation]. Belgian Gaming Commission. URL: https://www.gamingcommission.be/sites/default/files/2021-08/onderzoeksrapport-loot-boxen-Engels-publicatie.pdf
 
2. Xiao, L.Y. (2022) Breaking Ban: Belgium’s ineffective gambling law regulation of video game loot boxes. Stage 2 Registered Report, acceptance of Version 2 by Peer Community in Registered Reports. https://doi.org/10.31219/osf.io/hnd7w 
Breaking Ban: Belgium’s ineffective gambling law regulation of video game loot boxesLeon Y. Xiao<p>Loot boxes in video games are gambling-like mechanics that players buy to obtain randomised rewards of varying value. Loot boxes are conceptually and psychologically similar to gambling, and loot box expenditure is positively correlated with se...Humanities, Social sciencesVeli-Matti Karhulahti2022-07-28 12:29:57 View
27 Mar 2023
STAGE 1
article picture

Optimizing Esports Performance Using a Synergistic Mindsets Intervention

Synergistic Mindset Intervention for Competitive Situations

Recommended by ORCID_LOGO based on reviews by Lee Moore, Ivan Ropovik , Ivana Piterová and Jacob Keech
Mindset theories suggest that the mere belief in the malleability of human abilities can already help one to develop related performance. On the other hand, one and the same performance situation can also be experienced in various affective ways, which differently contribute to performance outcomes. Arguably, appraising a performance situation as a “threat” instead of “challenge” is associated with maladaptive responses, such as impaired cardiovascular mobilization. If people could experience performance situations as positive challenges, this might also improve performance outcomes. Drawing from these connected theoretical premises, the synergistic mindset intervention was developed and tentatively found to help adolescents in stressful situations (Yeager et al., 2022).
 
In the present registered report, Behnke et al. (2023) build on the above and test whether the synergistic mindset intervention can help individuals in competitive gaming situations. The authors utilize one of the leading esport games, Counter-Strike: Global Offensive​, and recruit its active players into randomized control and intervention groups for two weeks. Ultimately, the participants compete in a cash-prize tournament involving measures of affective experience and cardiovascular responses. Behnke et al. (2023) hypothesize that the synergistic mindset group will show greater challenge affective responses and superior performance outcomes. As such, the study design has significant potential to generate valuable evidence for various theoretical models and the synergistic mindset model in particular.
 
The Stage 1 manuscript was evaluated over two rounds by four experts with experimental psychology specializations in mindsets, stress, and statistics. Based on the comprehensive responses to the reviewers' feedback, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
 
URL to the preregistered Stage 1 protocol: https://osf.io/z3adb
 
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.
 
List of eligible PCI RR-friendly journals: 
 
 
References
 
Behnke M., Lakens D., Petrova K., Chwiłkowska P., Kaczmarek L. D., Jamieson J. P., & Gross J. J. (2023) Optimizing Esports Performance Using a Synergistic Mindsets Intervention. In principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/z3adb

Yeager D.S., Bryan C.J., Gross J.J., Murray J., Krettek D., Santos P., ... & Jamieson J.P. (2022) A synergistic mindsets intervention protects adolescents from stress. Nature 607, 512–520. https://doi.org/10.1038/s41586-022-04907-7
Optimizing Esports Performance Using a Synergistic Mindsets InterventionMaciej Behnke, Daniël Lakens, Kate Petrova, Patrycja Chwiłkowska, Lukasz D. Kaczmarek, Jeremy P. Jamieson, James J. Gross<p>Affective responses during stressful high-stakes situations can play an important role in shaping performance outcomes. For example, feeling shaky and nervous at a job interview can undermine performance, whereas feeling pumped and excited duri...Social sciencesVeli-Matti Karhulahti2023-01-04 10:12:55 View