Announcements
We are recruiting recommenders (editors) from all research fields!
Your feedback matters! If you have authored or reviewed a Registered Report at Peer Community in Registered Reports, then please take 5 minutes to leave anonymous feedback about your experience, and view community ratings.
Latest recommendations
Id | Title * | Authors * | Abstract * | Picture▲ | Thematic fields * | Recommender | Reviewers | Submission date | |
---|---|---|---|---|---|---|---|---|---|
18 Jan 2023
STAGE 1
Beneath the label: Assessing video games’ compliance with ESRB and PEGI loot box warning label industry self-regulationLeon Y. Xiao https://osf.io/u7ghb?view_only=60cb55c3c3c74f76a8e170fb498e2789How effective is self-regulation in loot box labelling?Recommended by Chris Chambers based on reviews by Pete Etchells and Jim SauerPaid loot boxes – items bought for real-world money that offer randomised rewards – are a prevalent feature of contemporary video games (Zendle et al., 2020). Because they employ random chance to provide rewards after spending real money, loot boxes have been considered a form of gambling, raising concerns about risk of harm to children and other vulnerable users. In response, some countries have taken legal steps to regulate and even ban the use of loot boxes, with only limited success so far (Xiao, 2022). At the same time, the Entertainment Software Rating Board (ESRB) and PEGI (Pan-European Game Information) now expect games that contain loot boxes to be marked with warning labels that, in theory, will enable users (including parents) to make more informed decisions. These requirements by ESRB/PEGI are not legally binding and may be considered a form of industry self-regulation.
In the current study, Xiao (2023) will investigate the effectiveness of self-regulation in the use of loot box labels. Study 1 examines the consistency of warning labels by the ESRB and PEGI, with the expectation that if self-regulation works as it should then these labels should always (or nearly always) co-occur. Study 2 establishes the compliance rate for labelling among popular games that are known to contain loot boxes, with a rate of ≥95% considered to be successful. The findings should prove useful in identifying the success or failure of self-regulation as a means of ensuring industry compliance with loot box labelling.
The Stage 1 manuscript was evaluated over two rounds of in-depth review. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
URL to the preregistered Stage 1 protocol: https://osf.io/e6qbm Level of bias control achieved: Level 3. At least some data/evidence that will be used to the answer the research question has been previously accessed by the authors (e.g. downloaded or otherwise received), but the authors certify that they have not yet observed ANY part of the data/evidence.
List of eligible PCI RR-friendly journals:
References
1. Zendle, D., Meyer, R., Cairns, P., Waters, S., & Ballou, N. (2020). The prevalence of loot boxes in mobile and desktop games. Addiction, 115(9), 1768-1772. https://doi.org/10.1111/add.14973
2. Xiao, L. Y. (2022). Breaking Ban: Belgium’s ineffective gambling law regulation of video game loot boxes. Stage 2 Registered Report, acceptance of Version 2 by Peer Community in Registered Reports. https://doi.org/10.31219/osf.io/hnd7w 3. Xiao, L. Y. (2023). Beneath the label: Assessing video games’ compliance with ESRB and PEGI loot box warning label industry self-regulation, in principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/e6qbm
| Beneath the label: Assessing video games’ compliance with ESRB and PEGI loot box warning label industry self-regulation | Leon Y. Xiao | <p>Loot boxes in video games are a form of in-game transactions with randomised elements. Concerns have been raised about loot boxes’ similarities with gambling and their potential harms (e.g., overspending). Recognising players’ and parents’ conc... | Humanities, Social sciences | Chris Chambers | 2022-09-17 00:14:51 | View | ||
21 Apr 2024
STAGE 1
Cross-cultural relationships between music, emotion, and visual imagery: A comparative study of Iran, Canada, and Japan [Stage 1 Registered Report]Shafagh Hadavi, Junji Kuroda, Taiki Shimozono, Juan David Leongómez, Patrick E. Savage https://psyarxiv.com/26yg5/Testing cross-cultural difference in the emotionality and visual associations of musicRecommended by D. Samuel Schwarzkopf based on reviews by Elena Karakashevska, Juan David Leongómez and Nadine DijkstraFor many of us, music is far more than an auditory experience. It can trigger emotional reactions, evoke memories, and wide-ranging associations with other sensory modalities and cognitive states. Music also varies between different cultures in several ways. It remains unclear in how far the broader associations music has differs between cultural contexts, both in terms of the music itself and the listener. This study by Hadavi et al. (2024) seeks to better understand these relationships. Using an online survey targeted at 72 participants from anglophone Canada, Farsi-speaking Iran, and Japan (24 from each location), the researchers aim to address two straightforward hypotheses.
First, does faster tempo of music increase ratings of emotional arousal? Second, do participants match faster tempo music with denser visual line patterns? This latter measure aims to quantify the visual imagery evoked by the musical pieces. Imagery is a loaded term that is not used consistently across the cognitive neuroscience literature; one could argue that what the researchers are actually here is in fact mainly an association between tempo and a visual representation of tempo (or frequency). It certainly seems doubtful that persons listening to a piece of music will form a mental image of a bundle of horizontal lines. Yet, irrespective of how to interpret this experimental variable, it quantifies something about the impression listeners have when experiencing music, and whether these associations differ cross-culturally. The experiment has a balanced design, incorporating excerpts of musical pieces from each of the three cultural contexts, including both solo and group music. While the sample size is comparably low, given the online nature of data collection, it is based on a power analysis and relatively large expected effect sizes.
The proposed study was evaluated by three expert reviewers and the recommender over three rounds of in-depth review, plus a final round ironing out smaller issues. Reviewer Juan David Leongómez was recruited as a co-author after the first round of revisions. Following this process, the recommender decided that the manuscript met Stage 1 criteria and awarded in-principle acceptance (IPA).
URL to the preregistered Stage 1 protocol: https://osf.io/zdnkm
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA. List of eligible PCI RR-friendly journals:
References
1.Hadavi, S., Kuroda, J., Shimozono, T., Leongómez, J. D. & Savage, P. E. (2024). Cross-cultural relationships between music, emotion, and visual imagery: A comparative study of Iran, Canada, and Japan. In principle acceptance of Version 6 by Peer Community in Registered Reports. https://osf.io/zdnkm | Cross-cultural relationships between music, emotion, and visual imagery: A comparative study of Iran, Canada, and Japan [Stage 1 Registered Report] | Shafagh Hadavi, Junji Kuroda, Taiki Shimozono, Juan David Leongómez, Patrick E. Savage | <p>Many people experience emotions and visual imagery while listening to music. Previous research has identified cross-modal associations between musical and visual features as well as cross-cultural links between music and emotion and between mus... | Humanities, Social sciences | D. Samuel Schwarzkopf | 2023-03-01 02:48:54 | View | ||
28 Dec 2021
STAGE 1
Sight vs. sound in the judgment of music performance: Cross-cultural evidence from classical piano and Tsugaru shamisen competitionsGakuto Chiba, Yuto Ozaki, Shinya Fujii, Patrick E. Savage https://doi.org/10.31234/osf.io/xky4jUnderstanding the role of visual and auditory information in evaluating musical performanceRecommended by Yuki Yamada based on reviews by David Hughes and Kyoshiro SasakiIn this Stage 1 Registered Report, Chiba and colleagues (2021) aim to investigate how people use information from visual and auditory modalities when evaluating musical performances. Previous studies, mainly using Western music, have reported a visual dominance, but this has not yet been clearly and consistently reported. Thus, the authors propose to evaluate both the reproducibility and generalizability of the previous findings by conducting a replication study using the methodology of the previous studies and by introducing a new experimental condition in which the Tsugaru-shamisen, a unique Japanese musical instrument, is also performed. This study could represent an important turning point in the research context of performance evaluation and would be of considerable value. This manuscript was peer-reviewed by two experts in scientific methodology and Japanese traditional music, respectively, and during the two-round peer-review process they made a number of important points, but eventually awarded the manuscript a highly positive response. I am therefore pleased to recommend that this Stage 1 Registered Report meets our Stage 1 criteria and is worthy of in-principle acceptance. I look forward to seeing the results and discussion reported in Stage 2, with the expectation that the experiment conducted by the authors will be in strict accordance with this protocol. *The following is a very minor comment, which I hope the authors will find helpful in the future. Of course, this is not related to hypothesis construction and does not require revision: The "Blind Audition" study cited in the introduction is very impactful, but has recently been called into question, so I am at least a little cautious when citing this study. This article may be useful. https://www.wsj.com/articles/blind-spots-in-the-blind-audition-study-11571599303 URL to the preregistered Stage 1 protocol: https://osf.io/ry2b6 Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA. List of eligible PCI RR-friendly journals: References
| Sight vs. sound in the judgment of music performance: Cross-cultural evidence from classical piano and Tsugaru shamisen competitions | Gakuto Chiba, Yuto Ozaki, Shinya Fujii, Patrick E. Savage | <p style="text-align: justify;">Which information dominates in evaluating performance in music? Both experts and laypeople consistently report believing that sound should be the most important domain when judging music competitions, but experime... | Social sciences | Yuki Yamada | Kyoshiro Sasaki | 2021-09-24 08:59:26 | View | |
Sight vs. sound judgments of music performance depend on relative performer quality: Cross-cultural evidence from classical piano and Tsugaru shamisen competitions [Stage 2 Registered Report]Gakuto Chiba, Yuto Ozaki, Shinya Fujii, Patrick E. Savage https://doi.org/10.31234/osf.io/xky4jMusic is appreciated cross-modally, but is culture- and context-dependentRecommended by Yuki Yamada based on reviews by Kyoshiro Sasaki and 1 anonymous reviewerMusic is not merely limited to the aural experience we garner through our auditory faculties, as commonly perceived. Rather, various studies have explored the cross-modal impact of visual stimuli on the evaluation of music. These previous studies have been confined exclusively to Western music. Hence, Chiba et al. (2023) designed a study with a focus on the Tsugaru shamisen, a renowned folk instrument indigenous to Japan, and of which the first author is an outstanding player.
The study methodology was an improved version of previous endeavors, wherein actual musical material sourced from concours performances was displayed through audio-only, video-only or both modalities. A sample of Japanese participants were then asked to evaluate the concours performances on both the piano and the Tsugaru shamisen. The results, obtained through pre-registered protocols, revealed that for both concours performances, the participants displayed a cross-modal impact of visual information on their aural evaluation of music. This effect was also found to be contingent on cultural and contextual factors. These outcomes furnish valuable evidence towards the generalizability of the interplay between sight and sound in the assessment of music. The study underwent rigorous peer-review processes in both Stage 1 and Stage 2, with three experts specializing in Japanese folk music, open science, and statistics, respectively, providing their critical assessments. Following multiple rounds of revision, the final manuscript was deemed fit for recommendation.
URL to the preregistered Stage 1 protocol: https://osf.io/ry2b6
Level of bias control achieved: Level 6. No part of the data or evidence that was used to answer the research question was generated until after IPA.
List of eligible PCI RR-friendly journals:
References
Chiba G., Ozaki Y., Fujii S., & Savage P.E. (2023). Sight vs. sound judgments of music performance depend on relative performer quality: Cross-cultural evidence from classical piano and Tsugaru shamisen competitions [Stage 2 Registered Report]. Acceptance of Version 2 by Peer Community in Registered Reports. https://doi.org/10.31234/osf.io/xky4j
| Sight vs. sound judgments of music performance depend on relative performer quality: Cross-cultural evidence from classical piano and Tsugaru shamisen competitions [Stage 2 Registered Report] | Gakuto Chiba, Yuto Ozaki, Shinya Fujii, Patrick E. Savage | <p>Which information dominates in evaluating performance in music? Both experts and laypeople consistently report believing that sound should be the most important domain when judging music competitions, but experimental studies of Western partici... | Social sciences | Yuki Yamada | 2022-11-30 08:04:37 | View | ||
04 Jun 2024
STAGE 1
Voice preferences across contrasting singing and speaking stylesCamila Bruder, Klaus Frieler & Pauline Larrouy-Maestri https://osf.io/urkys?view_only=506d243a6e7a4d3680c81e696ca81025Exploring the enjoyment of voicesRecommended by Chris Chambers based on reviews by Patrick Savage, Christina Vanden Bosch der Nederlanden, Christina Krumpholz and 1 anonymous reviewerBeyond the semantics communicated by speech, human vocalisations can convey a wealth of non-verbal information, including the speaker’s identity, body size, shape, health, age, intentions, emotional state, and personality characteristics. While much has been studied about the neurocognitive basis of voice processing and perception, the richness of vocalisations leaves open fundamental questions about the aesthetics of (and across) song and speech, including which factors determine our preference (liking) for different vocal styles.
In the current study, Bruder et al. (2024) examine the characteristics that determine the enjoyment of voices in different contexts and the extent to which these preferences are shared across different types of vocalisation. Sixty participants will report their degree of liking across a validated stimulus set of naturalistic and controlled vocal performances by female singers performing different melody excerpts as a lullaby, as a pop song and as opera aria, as well as reading the corresponding lyrics aloud as if speaking to an adult audience or to an infant. The authors will then ask two main questions: first if there is a difference in the amount of shared taste (interrater agreement) across contrasting vocal styles, and second, as suggested by sexual selection accounts of voice attractiveness, whether the same performers are preferred across styles.
The Stage 1 manuscript was evaluated over three rounds of in-depth review. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA). URL to the preregistered Stage 1 protocol: https://osf.io/7dvme Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA. List of eligible PCI RR-friendly journals: References
1. Bruder, C., Frieler, K. & Larrouy-Maestri, P. (2024). Voice preferences across contrasting singing and speaking styles. In principle acceptance of Version 5 by Peer Community in Registered Reports. https://osf.io/7dvme | Voice preferences across contrasting singing and speaking styles | Camila Bruder, Klaus Frieler & Pauline Larrouy-Maestri | <p>Voice preferences are an integral part of interpersonal interactions and shape how people 1 connect with each other. While a large number of studies has investigated the mechanisms behind 2 (spoken) voice attractiveness, very little research wa... | Social sciences | Chris Chambers | 2022-11-30 23:02:34 | View | ||
08 Sep 2022
STAGE 1
How to succeed in human modified environmentsLogan CJ, Shaw R, Lukas D, McCune KB http://corinalogan.com/ManyIndividuals/mi1.htmlThe role of behavioural flexibility in promoting resilience to human environmental impactsRecommended by Chris Chambers based on reviews by Gloriana Chaverri, Vedrana Šlipogor and Alizée VernouilletUnderstanding and mitigating the environmental effects of human expansion is crucial for ensuring long-term biosustainability. Recent research indicates a steep increase in urbanisation – including the expansion of cities – with global urban extent expanding by nearly 10,000 km^2 per year between 1985 and 2015 (Liu et al, 2020). The consequences of these human modified environments on animal life are significant: in order to succeed, species must adapt quickly to environmental changes, and those populations that demonstrate greater behavioural flexibility are likely to cope more effectively. These observations have, in turn, prompted the question of whether enhancing behavioural flexibility in animal species might increase their resilience to human impacts.
In the current research, Logan et al. (2022) will use a serial reversal learning paradigm to firstly understand how behavioural flexibility relates to success in avian species that are already successful in human modified environments. The authors will then deploy these flexibility interventions in more vulnerable species to establish whether behavioural training can improve success, as measured by outcomes such as foraging breadth, dispersal dynamics, and survival rate.
The Stage 1 manuscript was submitted via the programmatic track and will eventually produce three Stage 2 outputs focusing on different species (toutouwai, grackles, and jays). Following two rounds of in-depth review, the recommender judged that the manuscript met the Stage 1 criteria and awarded in-principle acceptance (IPA).
URL to the preregistered Stage 1 protocol: https://osf.io/wbsn6
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA. List of eligible PCI RR-friendly journals: References
1. Liu, X., Huang, Y., Xu, X., Li, X., Li, X., Ciais, P., Lin, P., Gong, K., Ziegler, A. D., Chen, A., et al. (2020). High-spatiotemporal-resolution mapping of global urban change from 1985 to 2015. Nature Sustainability, 1–7. https://doi.org/10.1038/s41893-020-0521-x
2. Logan, C.J., Shaw, R., Lukas, D. & McCune, K.B. (2022). How to succeed in human modified environments, in principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/wbsn6
| How to succeed in human modified environments | Logan CJ, Shaw R, Lukas D, McCune KB | <p>Human modifications of environments are increasing, causing global changes that other species must adjust to or suffer from. Behavioral flexibility (hereafter ‘flexibility’) could be key to coping with rapid change. Behavioral research can cont... | Life Sciences | Chris Chambers | 2022-05-06 12:12:05 | View | ||
14 Feb 2024
STAGE 1
Restriction of researcher degrees of freedom through the Psychological Research Preregistration-Quantitative (PRP-QUANT) TemplateLisa Spitzer & Stefanie Mueller https://doi.org/10.23668/psycharchives.14119Examining the restrictiveness of the PRP-QUANT TemplateRecommended by Daniel Lakens based on reviews by Marjan Bakker and 1 anonymous reviewerThe Psychological Research Preregistration-Quantitative Template has been created in 2022 to provide more structure and detail to preregistrations. The goal of the current study is to test if the PRP-QUANT template indeed provides greater restriction of the flexibility in a study for preregistered hypotheses than other existing templates. This question is important because one concern that has been raised about the practice of preregistration is that the quality of preregistrations is often low. Metascientific research has shown that preregistrations are often of low quality (Bakker et al., 2020), and hypothesis tests from preregistrations are still selectively reported (van den Akker, van Assen, Enting, et al., 2023). It is important to improve the quality of preregistrations, and if a better template can help, it is a cost-effective approach to improve quality if the wider adoption of the better template can be promoted.
In the current study, Spitzer and Mueller (2024) will follow the procedure of a previous meta-scientific study by Heirene et al. (2021). 74 existing preregistrations with the PRP-QUANT template are available, and will be compared with an existing dataset coded by Bakker and colleagues (2020). The sample size is limited, but allows detecting some differences that would be considered large enough to matter, even though there might be smaller differences that would not be detectable based on the currently available sample size. Nevertheless, given that there is a need for improvement, even preliminary data might already be useful to provide tentative recommendations. Restrictiveness will be coded in 23 items, and adherence to or deviations from the preregistration are coded as well. As such deviations are common, the question whether this template reduced the likelihood of deviations is important. Two coders will code all studies.
The study should provide a useful initial evaluation of the PRP-QUANT template, and has the potential to have practical implications if the PRP-QUANT template shows clear benefits. Both authors have declared COI's related to the PRP-QUANT template, making the Registered Report format a fitting approach to prevent confirmation bias from influencing the reported results.
This Stage 1 manuscript was evaluated over two rounds of in-depth review by two expert reviewers and the recommender. After the revisions, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
URL to the preregistered Stage 1 protocol: https://osf.io/vhezj
Level of bias control achieved: Level 3. At least some data/evidence that will be used to the answer the research question has been previously accessed by the authors (e.g. downloaded or otherwise received), but the authors certify that they have not yet observed ANY part of the data/evidence. List of eligible PCI RR-friendly journals:
References
1. van den Akker, O. R., van Assen, M. A. L. M., Bakker, M., Elsherif, M., Wong, T. K., & Wicherts, J. M. (2023). Preregistration in practice: A comparison of preregistered and non-preregistered studies in psychology. Behavior Research Methods. https://doi.org/10.3758/s13428-023-02277-0
2. Bakker, M., Veldkamp, C. L. S., Assen, M. A. L. M. van, Crompvoets, E. A. V., Ong, H. H., Nosek, B. A., Soderberg, C. K., Mellor, D., & Wicherts, J. M. (2020). Ensuring the quality and specificity of preregistrations. PLOS Biology, 18(12), e3000937. https://doi.org/10.1371/journal.pbio.3000937
3. Spitzer, L. & Mueller, S. (2024). Stage 1 Registered Report: Restriction of researcher degrees of freedom through the Psychological Research Preregistration-Quantitative (PRP-QUANT) Template. In principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/vhezj
4. Heirene, R., LaPlante, D., Louderback, E. R., Keen, B., Bakker, M., Serafimovska, A., & Gainsbury, S. M. (2021). Preregistration specificity & adherence: A review of preregistered gambling studies & cross-disciplinary comparison. PsyArXiv. https://doi.org/10.31234/osf.io/nj4es
| Restriction of researcher degrees of freedom through the Psychological Research Preregistration-Quantitative (PRP-QUANT) Template | Lisa Spitzer & Stefanie Mueller | <p>Preregistration can help to restrict researcher degrees of freedom and thereby ensure the integrity of research findings. However, its ability to restrict such flexibility depends on whether researchers specify their study plan in sufficient de... | Social sciences | Daniel Lakens | 2023-06-01 10:39:20 | View | ||
15 Apr 2023
STAGE 1
Reconstructing Gaming Disorder: A Taxonomy by Registered ReportVeli-Matti Karhulahti, Marcel Martončik, Miia Siutila, Solip Park, Yaewon Jin, Matúš Adamkovič, Tiina Auranen, Bora Na, Tae-Jin Yoon https://osf.io/xtbgyHow can the experiences of those who engage in video games in healthy and unhealthy ways be systematically organised?Recommended by Zoltan Dienes based on reviews by Michelle Carras, Lukas J. Gunschera and Christopher FergusonPeople are often drawn into intensive video game use in ways they or others may find troubling, harmless or even praiseworthy. Understanding these different experiences may help with integrating intensive technology use into everyday life in a healthy way.
In this programmatic submission, Karhulahti et al. (2023) will explore the gaming experiences of three groups of people (those who have sought treatment for gaming, esport players, and adolescents who play around two hours every day), using phenomenological and clinical interviews, and gaming diary logs every four months over three years. Around 200-300 participants will be recruited initially from Finland, Slovakia, and South Korea. In order to further increase cross-cultural range, the study will apply a new duplication method to collect similar data also in countries that have been studied little in the past. The aim will be to answer the questions of a) Is it possible to distinguish passionate from pathological gaming by the meanings and values that players attach to videogame play? and b) What are the design structures of videogames, which are played intensively and/or with gaming-related health problems? Ultimately, the study aims to synthesise all its data into a new taxonomic system, which can help better understand the differences and idiosyncrasies of gaming in lives across cultures.
This Stage 1 manuscript was evaluated over two rounds of in-depth review. Based on the comprehensive responses to the reviewers' feedback, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
URL to the preregistered Stage 1 protocol: https://osf.io/ekm8x Level of bias control achieved: Level 4. At least some of the data/evidence that will be used to answer the research question already exists AND is accessible in principle to the authors (e.g. residing in a public database or with a colleague) BUT the authors certify that they have not yet accessed any part of that data/evidence List of eligible PCI RR-friendly journals: References
Karhulahti, V.-M., Martončik. M., Siutila, M., Park, S., Jin, J., Adamkovič, M., Auranen, T., Na, B., & Yoon, T.-J. (2023). Reconstructing Gaming Disorder: A Taxonomy by Registered Report, in principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/ekm8x
| Reconstructing Gaming Disorder: A Taxonomy by Registered Report | Veli-Matti Karhulahti, Marcel Martončik, Miia Siutila, Solip Park, Yaewon Jin, Matúš Adamkovič, Tiina Auranen, Bora Na, Tae-Jin Yoon | <p style="text-align: justify;">Videogames have become one of the most prevalent cultural forms around the world. While their role in art, pedagogy, and everyday life keeps growing, the health debates on videogame play—gaming—culminated in 2022 wi... | Humanities, Medical Sciences, Social sciences | Zoltan Dienes | Oluwaseyi Adeliyi, Abiola Akinnubi | 2022-10-10 15:09:55 | View | |
24 Sep 2021
STAGE 1
Phenomenological Strands for Gaming Disorder and Esports Play: A Qualitative Registered ReportVeli-Matti Karhulahti, Miia Siutila, Jukka Vahlo, Raine Koskimaa https://doi.org/10.31234/osf.io/q53jzHow does the phenomenology of "gaming disorder" differ from intensive but non-pathological videogame play?Recommended by Chris Chambers based on reviews by Malte Elson, Peter Branney and Michelle CarrasIn this Stage 1 Registered Report, Karhulahti and colleagues (2021) propose a qualitative, interview-based study of videogame play, with the central aim to understand key phenomological differences between gaming behaviour that is associated with vs. without health problems. This question is particularly important given the recent inclusion of "gaming disorder" in the WHO's International Statistical Classification of Diseases and Related Health Problems (ICD). In recent years, the validity of "gaming disorder" as an identifiable mental illness has been controversial (e.g. Van Rooij et al, 2018), as has the debate concerning purported harms or benefits of gaming for mental health. This Stage 1 manuscript describes a rigorous qualitative investigation that should provide new insights on this question, and will also include a longitudinal component to examine changes in phenomonology over time, as well as an examination of the extent to which the phenomonology of gaming is reflected in the experiences of medical experts such as doctors, nurses, and therapists who have worked with gaming-related health problems. More broadly, the manuscript breaks new ground for Registered Reports, being one of the first to focus on qualitative methods, while also making use of the Programmatic submission track in which the approved Stage 1 manuscript is intended to produce two Stage 2 manuscripts focusing on different elements of the project. Three expert reviewers with a variety of field-specialist and qualitative methodological expertise assessed the Stage 1 manuscript over two rounds of in-depth review. Following revision, the reviewers and recommender agreed that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA). URL to the preregistered Stage 1 protocol: https://osf.io/a2rwg Level of bias control achieved: Level 4. At least some of the data/evidence that will be used to answer the research question already exists AND is accessible in principle to the authors (e.g. residing in a public database or with a colleague), BUT the authors certify that they have not yet accessed any part of that data/evidence. List of eligible PCI RR-friendly journals: References
| Phenomenological Strands for Gaming Disorder and Esports Play: A Qualitative Registered Report | Veli-Matti Karhulahti, Miia Siutila, Jukka Vahlo, Raine Koskimaa | <p style="text-align: justify;">The recent inclusion of gaming disorder in the ICD-11 as a mental disorder has further increased the importance of researching the health spectrum related to gaming. A critical area in this regard is the lack of cla... | Medical Sciences, Social sciences | Chris Chambers | 2021-06-16 20:22:24 | View | ||
Breaking Ban: Belgium’s ineffective gambling law regulation of video game loot boxesLeon Y. Xiao https://doi.org/10.31219/osf.io/hnd7wLoot boxes remain prevalent in Belgium despite their “ban”Recommended by Veli-Matti Karhulahti based on reviews by Andrew Moshirnia, Joseph Macey and Jason ChinSeveral countries currently struggle to legally interpret and deal with loot boxes, i.e. gambling-like mechanisms that have become common especially in contemporary videogame design. One of the few countries to take a clear regulation stance is Belgium, which officially announced that they interpret paid loot boxes as games of chance that violate their Gaming and Betting Act and can thus be criminally prosecuted (Naessens 2018). This announcement four years ago laid the basis for a unique social experiment where companies offering loot boxes in Belgium had to decide whether to modify their games, exit the market, or continue to monetize with loot boxes. In the present study, Xiao (2022) investigated the outcomes of this experiment both via hypotheses testing and exploratory analysis.
Using the 100 highest-grossing iPhone games in Belgium as data and applying comprehensive qualitative mechanical analysis to each title, Xiao (2022) tested three preregistered hypotheses regarding loot box prevalence. None of the hypotheses were confirmed: the prevalence rate of loot boxes in the Belgian App Store was not null but extremely high (82.0%), also among mobile games designed for minors (54.2–80.2%), and significantly more compared to global standards when assessed by a binomial test (p<.001). Corroborating a fourth hypothesis, Xiao was also able to access various UK loot boxes in Belgium. In exploratory research, Xiao received a confirmation from the Belgian Gaming Commission that even “simulated gambling games” (that do not yield monetary wins) also legally constitute gambling in Belgium.
The results are the first to describe outcomes of ban-driven loot box regulation globally. Despite Belgium’s clear statement that “paid loot boxes must be removed from the video games in order to comply with the Belgian Gaming and Betting Act” (Naessens 2018, p. 16), almost all highest-grossing iPhone games in the Belgian App Store keep offering them. The finding is important especially for the legal authorities around the world who are currently assessing their own positions in potential regulation: simple statements are unlikely to have immediate effects on international companies in local markets. On the other hand, it remains unknown how these companies have interpreted the statement and what are their distinct reasons for continuing to offer loot boxes in the Belgian App Store. It would be important in future research to investigate the companies’ perspectives.
This study (Xiao 2022) is important also from a meta-scientific perspective. It paves the way for Registered Reports in new disciplines and methods, and involves an exceptional field experiment that was carefully documented with open data and materials. Three external experts reviewed the Stage 2 manuscript twice, based on which the recommender awarded a positive recommendation.
URL to the preregistered Stage 1 protocol: https://osf.io/5mxp6 Level of bias control achieved: Level 6. No part of the data or evidence that was used to answer the research question existed prior to Stage 1 in-principle acceptance. List of eligible PCI RR-friendly journals:
References
1. Naessens, P. (2018) Research Report on Loot Boxes [English Translation]. Belgian Gaming Commission. URL: https://www.gamingcommission.be/sites/default/files/2021-08/onderzoeksrapport-loot-boxen-Engels-publicatie.pdf
2. Xiao, L.Y. (2022) Breaking Ban: Belgium’s ineffective gambling law regulation of video game loot boxes. Stage 2 Registered Report, acceptance of Version 2 by Peer Community in Registered Reports. https://doi.org/10.31219/osf.io/hnd7w
| Breaking Ban: Belgium’s ineffective gambling law regulation of video game loot boxes | Leon Y. Xiao | <p>Loot boxes in video games are gambling-like mechanics that players buy to obtain randomised rewards of varying value. Loot boxes are conceptually and psychologically similar to gambling, and loot box expenditure is positively correlated with se... | Humanities, Social sciences | Veli-Matti Karhulahti | 2022-07-28 12:29:57 | View |
MANAGING BOARD
Chris Chambers
Zoltan Dienes
Corina Logan
Benoit Pujol
Maanasa Raghavan
Emily S Sena
Yuki Yamada