Submit a report

Announcements

Please note that we will be CLOSED to ALL SUBMISSIONS from 1 December 2024 through 12 January 2025 to give our recommenders and reviewers a holiday break.

We are recruiting recommenders (editors) from all research fields!

Your feedback matters! If you have authored or reviewed a Registered Report at Peer Community in Registered Reports, then please take 5 minutes to leave anonymous feedback about your experience, and view community ratings.

Latest recommendationsrssmastodon

IdTitle * Authors * Abstract * PictureThematic fields * RecommenderReviewersSubmission date
13 Jun 2022
STAGE 1

Associations of fear, anger, happiness, and hope with risk judgments: Revisiting appraisal-tendency framework with a replication and extensions of Lerner and Keltner (2001)

Replicating the relationship between emotions and judgments of risk

Recommended by ORCID_LOGO based on reviews by Kelly Wolfe, Max Primbs, Agata Sobków and Karolina Scigala
How do emotions interact with cognition? The last 40 years has witnessed the rise of cognitive-appraisal theories, which propose that emotions can be differentiated along an axis of cognitive dimensions such as certainty, pleasantness, attentional activity, control, anticipated effort, and responsibility (Smith and Ellsworth, 1985). Early tests of such theories focused especially on the impact of the valence – pleasantness/unpleasantness – of emotions on judgment and decision-making, finding, for instance, that negative mood induction can heighten pessimistic estimates of risk (Johnson & Tversky, 1983).
 
The Appraisal-Tendency Framework proposed by Lerner and Keltner (2000) refined cognitive-appraisal theory by proposing that specific emotions trigger a predisposition to appraise future (or hypothetical) events in line with the central appraisal dimensions that triggered the emotion, even when the emotion and the judgment are unrelated. For example, an individual who is triggered to become fearful of a heightened risk, such as nuclear war, may then exhibit heightened pessimism about risks unrelated to war. The Appraisal-Tendency Framework also predicts relationships between traits, such as between fear, anger and risk-taking/risk-seeking tendencies. In an influential paper, Lerner and Keltner (2001) reported direct empirical support for the Appraisal-Tendency Framework, which aside from its influence in cognitive/affective psychology has had considerable impact in behavioural economics, moral psychology, and studies of consumer behaviour.
 
In the current study, Lu and Feldman (2022) propose to replicate three key studies from Lerner and Keltner (2001) in a large online sample. Through a combination of replication and extension, the authors will probe the relationship between various trait emotions (including fear, anger, happiness, and hope) and trait characteristics of risk seeking and optimistic risk assessment. The authors also propose examining how the ambiguity of triggering events moderates the relationship between specific emotions and risk judgments. 
 
The Stage 1 manuscript was evaluated over two rounds of in-depth review. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
 
URL to the preregistered Stage 1 protocol: https://osf.io/8yu2x
 
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA. 
 
List of eligible PCI RR-friendly journals:
 
References
 
1. Smith, C. A., & Ellsworth, P. C. (1985). Patterns of cognitive appraisal in emotion. Journal of Personality and Social Psychology, 48, 813-838. https://doi.org/10.1037/0022-3514.48.4.813
 
2. Johnson, E. J., & Tversky, A. (1983). Affect, generalization, and the perception of risk. Journal of Personality and Social Psychology, 45(1), 20–31. https://doi.org/10.1037/0022-3514.45.1.20
 
3. Lerner, J. S., & Keltner, D. (2000). Beyond valence: Toward a model of emotion-specific influences on judgment and choice. Cognition & Emotion, 14, 473-493. https://doi.org/10.1080/026999300402763 
 
4. Lerner, J. S., & Keltner, D. (2001). Fear, anger, and risk. Journal of Personality and Social Psychology, 81, 146–159. https://doi.org/10.1037/0022-3514.81.1.146
  
5. Lu, S. & Feldman, G. (2022). Associations of fear, anger, happiness, and hope with risk judgments: Revisiting appraisal-tendency framework with a replication and extensions of Lerner and Keltner (2001), in principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/8yu2x
Associations of fear, anger, happiness, and hope with risk judgments: Revisiting appraisal-tendency framework with a replication and extensions of Lerner and Keltner (2001)Sirui Lu; Gilad Feldman<p>This is a scheduled PCI-RR snap shot for a planned project: "Associations of fear, anger, happiness, and hope with risk judgments: &nbsp;Revisiting appraisal-tendency framework with a replication and extensions of Lerner and Keltner (2001)​"</p>Social sciencesChris Chambers2022-01-31 09:36:29 View
06 Jun 2024
STAGE 2
(Go to stage 1)

Associations of fear, anger, happiness, and hope with risk judgments: Revisiting appraisal-tendency framework with a replication and extensions Registered Report of Lerner and Keltner (2001)

Mixed evidence for the Appraisal-Tendency Framework in explaining links between emotion and decision-making

Recommended by ORCID_LOGO based on reviews by Kelly Wolfe and Max Primbs
How do emotions interact with cognition? The last 40 years has witnessed the rise of cognitive-appraisal theories, which propose that emotions can be differentiated along an axis of cognitive dimensions such as certainty, pleasantness, attentional activity, control, anticipated effort, and responsibility (Smith and Ellsworth, 1985). Early tests of such theories focused especially on the impact of the valence – pleasantness/unpleasantness – of emotions on judgment and decision-making, finding, for instance, that negative mood induction can heighten pessimistic estimates of risk (Johnson & Tversky, 1983).
 
The Appraisal-Tendency Framework proposed by Lerner and Keltner (2000) refined cognitive-appraisal theory by proposing that specific emotions trigger a predisposition to appraise future (or hypothetical) events in line with the central appraisal dimensions that triggered the emotion, even when the emotion and the judgment are unrelated. For example, an individual who is triggered to become fearful of a heightened risk, such as nuclear war, may then exhibit heightened pessimism about risks unrelated to war. The Appraisal-Tendency Framework also predicts relationships between traits, such as fear, anger and risk-taking/risk-seeking tendencies. In an influential paper, Lerner and Keltner (2001) reported direct empirical support for the Appraisal-Tendency Framework, which aside from its influence in cognitive/affective psychology has had considerable impact in behavioural economics, moral psychology, and studies of consumer behaviour.
 
In the current study, Lu et al. (2024) replicated three key studies from Lerner and Keltner (2001) in a large online sample. Through a combination of replication and extension, the authors probed the relationship between various trait emotions (including fear, anger, happiness, and hope) and trait characteristics of risk seeking and optimistic risk assessment. The authors also examined how the ambiguity of triggering events moderates the relationship between specific emotions and risk judgments.
 
Overall, the results provide mixed support for the predictions of the Appraisal-Tendency Framework. Trait anger and trait happiness were positively associated with risk-seeking and optimistic risk estimates, while trait fear was negatively associated with optimistic risk assessment (although a reliable association between fear and risk-seeking was not observed). The original finding of Lerner and Keltner (2001) that the valence-based approach applied to risk optimism for unambiguous events was not supported. In addition, there was no reliable evidence for a positive relationship between hope and risk-seeking preference or optimistic risk estimates. The authors conclude that future research should consider a wider range of emotions to develop a more complete understanding of the link to risk-related judgment and decision-making.
 
The Stage 2 manuscript was evaluated over one round of in-depth review. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 2 criteria and therefore awarded a positive recommendation.
 
URL to the preregistered Stage 1 protocol: https://osf.io/8yu2x
 
Level of bias control achieved: Level 6. No part of the data or evidence that was used to answer the research question was generated until after IPA. 
 
List of eligible PCI RR-friendly journals:
 
References
 
1. Smith, C. A., & Ellsworth, P. C. (1985). Patterns of cognitive appraisal in emotion. Journal of Personality and Social Psychology, 48, 813-838. https://doi.org/10.1037/0022-3514.48.4.813
 
2. Johnson, E. J., & Tversky, A. (1983). Affect, generalization, and the perception of risk. Journal of Personality and Social Psychology, 45(1), 20–31. https://doi.org/10.1037/0022-3514.45.1.20
 
3. Lerner, J. S., & Keltner, D. (2000). Beyond valence: Toward a model of emotion-specific influences on judgment and choice. Cognition & Emotion, 14, 473-493. https://doi.org/10.1080/026999300402763 
 
4. Lerner, J. S., & Keltner, D. (2001). Fear, anger, and risk. Journal of Personality and Social Psychology, 81, 146–159. https://doi.org/10.1037/0022-3514.81.1.146
  
5. Lu, S., Efendić, E., & Feldman, G. (2024). Associations of fear, anger, happiness, and hope with risk judgments: Revisiting appraisal-tendency framework with a replication and extensions Registered Report of Lerner and Keltner (2001) [Stage 2]. Acceptance of Version 2 by Peer Community in Registered Reports. https://osf.io/xytsw
Associations of fear, anger, happiness, and hope with risk judgments: Revisiting appraisal-tendency framework with a replication and extensions Registered Report of Lerner and Keltner (2001)Sirui Lu; Emir Efendić; Gilad Feldman<p>The appraisal-tendency framework proposed that specific emotions predispose individuals to appraise future events corresponding to the core appraisal themes of the emotions. In a Registered Report with a US American online Amazon Mechanical Tur...Social sciencesChris Chambers2024-04-26 16:55:30 View
19 Jan 2024
STAGE 1

A systematic review of social connection inventories

Improving the measurement of social connection

Recommended by ORCID_LOGO based on reviews by Jacek Buczny, Richard James and Alexander Wilson
This is an ambitious systematic review that uses a combination of quantitative and qualitative methods to make the measurement of the construct of social connection more rigorous. Social connection is a heterogeneous construct that includes aspects of structure, function and quality. Here, Paris et al. (2024) will use predefined methods to create a database of social connection measures, and will assess heterogeneity of items using human coders and ChatGPT. This database will form the basis of a second systematic review which will look at evidence for validity and measurement properties. This study will also look at the population groups and country of origin for which different measures were designed, making it possible to see how far culturally specific issues affect the content of measures in this domain.
 
The questions asked by this study are exploratory and descriptive and so the importance of pre-registration is in achieving clear criteria for how each question is addressed, rather than evidential criteria for hypothesis-testing.
 
The authors responded comprehensively to three reviewer reports. This study will provide a wealth of useful information for those studying social connection, and should serve to make the literature in this field more psychometrically robust and less fragmented.
 
URL to the preregistered Stage 1 protocol: https://osf.io/796uv
 
Level of bias control achieved: Level 3. At least some data/evidence that will be used to the answer the research question has been previously accessed by the authors (e.g. downloaded or otherwise received), but the authors certify that they have not yet observed ANY part of the data/evidence. 
 
List of eligible PCI RR-friendly journals:
 
 
References
 

1. Paris, B., Brickau, D., Stoianova, T., Luhmann, M., Mikton, C., Holt-Lunstad, J., Maes, A., & IJzerman, H. (2024). A systematic review of social connection inventories. In principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/796uv

A systematic review of social connection inventoriesBastien Paris, Debora Brickau, Tetiana Stoianova, Maike Luhmann, Christopher Mikton, Julianne Holt-Lunstad, Marlies Maes, Hans IJzerman<p>Social connection is vital to health and longevity. To date, a plethora of instruments exists to measure social connection, assessing a variety of aspects of social connection like loneliness, social isolation, or social support. For comparabil...Social sciencesDorothy Bishop Alexander Wilson, Jacek Buczny, Richard James2023-07-09 21:33:01 View
15 Nov 2024
STAGE 1

Attraction depending on the level of abstraction of the character descriptions

Does reducing abstractness increase attraction? A test of Uncertainty Reduction Theory

Recommended by ORCID_LOGO based on reviews by Zoltan Dienes and Florian Pargent
What determines levels of interpersonal attraction? A long history of research in social psychology has highlighted a range of important factors, such as physical attractiveness, similarity of attitudes and beliefs, reciprocity of feelings, self-disclosure of personal information, and familiarity. One theme that runs through several of these characteristics is the concept of uncertainty, and in particular how reducing uncertainty in knowledge about a person influences levels of attraction. According to the Uncertainty Reduction Theory (URT), as an individual’s uncertainty in a person diminishes, levels of attraction are expected to rise. Previous research, however, has reported a mixed and somewhat complicated relationship between uncertainty and attraction, possibly moderated by the current stage of the interpersonal relationship. 
 
One limitation of this area of enquiry is that the methods used to reduce uncertainty have tended to focus on the amount of available information rather than its quality. This shortcoming has become increasingly salient with the rise of online social networking, where people have a wide range of strategies available to reduce uncertainty through passive (non-interactive) observation, for instance by studying profile details or other online information about a person. In the current study, Kuge et al. (2024) aim to partially fill this gap by examining the role of uncertainty reduction by altering the abstractness (or specificity) of available information, rather than its quantity, particularly in an observational, non-interactive setting. According to the tenets of URT, the authors predict firstly that participants will rate a person described in more concrete terms as more attractive than one described using abstract terms, and secondly that perceived uncertainty will mediate the effect of the abstractness on levels of attraction.
 
To test these hypotheses, the authors begin with an online survey (N=250) to select pairs of sentences with varying levels of abstractness while ensuring they are matched for favourability. Then in the main study (N=1000) they will test the effect of the selected abstract vs. concrete expressions on levels of attractiveness, in addition to control variables such as how confident the participant is in predicting the person’s behaviour, as well as a manipulation check to confirm the effectiveness of the abstractness manipulation. Confirmation of these hypotheses would add support for URT, while disconfirmation may indicate that the theory is inadequate at explaining the drivers of attraction in online unilateral communication.
 
URL to the preregistered Stage 1 protocol: https://osf.io/28f4q
 
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.
 
List of eligible PCI RR-friendly journals:
 
 
References
 
Kuge, H., Otsubo, K., Hattori, K., Urakawa, M., & Yamada. Y (2024). Attraction depending on the level of abstraction of the character descriptions. In principle acceptance of Version 4 by Peer Community in Registered Reports. https://osf.io/28f4q
Attraction depending on the level of abstraction of the character descriptionsHiyori Kuge, Kai Otsubo, Kaede Hattori, Mai Urakawa, Yuki Yamada<p>With the recent expansion of social networking platforms, we find ourselves presented with burgeoning opportunities to evaluate other people by reading their profiles without direct interactions. Therefore, it is important to examine the determ...Social sciencesChris Chambers2022-10-10 09:08:03 View
06 Sep 2024
STAGE 1

Barriers and facilitators to the adoption and promotion of Open Science practices in psychology. The case of Slovakia

What are the barriers and facilitators to open science practices for researchers, policy makers and media representatives in Slovakia?

Recommended by ORCID_LOGO based on reviews by Crystal Steltenpohl, Peter Branney, Andrea E. Abele-Brehm , Emma Norris and 1 anonymous reviewer
Open science practices (OSPs, e.g., preregistration, open materials, code and data) aim to enhance the transparency, integrity, and reproducibility of research. Recent work, however, has highlighted various facilitators and barriers perceived by researchers in implementing these, which can either enhance or hinder their success. Little is known about these barriers in the context of Slovakia, and such perceptions are rarely investigated for policy makers and media representatives who are also embedded in the research ecosystem.
 
In their Stage 1 Registered Report, Marcel Martončik and colleagues aim to map the perceptions and experiences of barriers and facilitators of OSPs that are unique to different stakeholder groups in Slovakia. They will conduct both semi-structured interviews and focus groups with a diverse sample of postgraduate students, researchers, policymakers, and media representatives from the field of psychology. Reflexive thematic analysis will identify overarching themes regarding such barriers and facilitators which will provide valuable insights into the support required to make OSPs normative across different stakeholder groups.
 
Four expert reviewers assessed the Stage 1 manuscript across two rounds of in-depth review. Based on the authors' detailed and informed responses to the reviewer’s comments, the recommender judged that the manuscript met the Stage 1 criteria and awarded in principle acceptance (IPA).
 
URL to the preregistered Stage 1 protocol: https://osf.io/n86um
 
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.
 
List of eligible PCI RR-friendly Journals:
 
 
References
 
Martončik, M., Adamkovič, M., Baník G., Fedáková, D., Issmailová, S., Kačmár, P., Kentoš, M., Majdáková, V., Papcunová, J., & Vargová, L. (2024). Barriers and facilitators to the adoption and promotion of Open Science practices in psychology. The case of Slovakia. In principle acceptance of Version 1.1 by Peer Community in Registered Reports. https://osf.io/n86um
Barriers and facilitators to the adoption and promotion of Open Science practices in psychology. The case of SlovakiaMarcel Martončik, Matúš Adamkovič, Gabriel Baník, Denisa Fedáková, Samar Issmailová, Pavol Kačmár, Michal Kentoš, Viktória Majdáková, Jana Papcunová, Lenka Vargová<p>Various responsible research practices emphasizing transparency, such as open<br>data, open code, open peer review, and preregistration, have been introduced to<br>enhance the reproducibility and replicability of findings. The ongoing initiativ...Social sciencesCharlotte Pennington2024-04-29 14:39:12 View
18 Jan 2023
STAGE 1
article picture

Beneath the label: Assessing video games’ compliance with ESRB and PEGI loot box warning label industry self-regulation

How effective is self-regulation in loot box labelling?

Recommended by ORCID_LOGO based on reviews by Pete Etchells and Jim Sauer
Paid loot boxes – items bought for real-world money that offer randomised rewards – are a prevalent feature of contemporary video games (Zendle et al., 2020). Because they employ random chance to provide rewards after spending real money, loot boxes have been considered a form of gambling, raising concerns about risk of harm to children and other vulnerable users. In response, some countries have taken legal steps to regulate and even ban the use of loot boxes, with only limited success so far (Xiao, 2022). At the same time, the Entertainment Software Rating Board (ESRB) and PEGI (Pan-European Game Information) now expect games that contain loot boxes to be marked with warning labels that, in theory, will enable users (including parents) to make more informed decisions. These requirements by ESRB/PEGI are not legally binding and may be considered a form of industry self-regulation.
 
In the current study, Xiao (2023) will investigate the effectiveness of self-regulation in the use of loot box labels. Study 1 examines the consistency of warning labels by the ESRB and PEGI, with the expectation that if self-regulation works as it should then these labels should always (or nearly always) co-occur. Study 2 establishes the compliance rate for labelling among popular games that are known to contain loot boxes, with a rate of ≥95% considered to be successful. The findings should prove useful in identifying the success or failure of self-regulation as a means of ensuring industry compliance with loot box labelling.
 
The Stage 1 manuscript was evaluated over two rounds of in-depth review. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
 
URL to the preregistered Stage 1 protocol: https://osf.io/e6qbm
 
Level of bias control achieved: Level 3. At least some data/evidence that will be used to the answer the research question has been previously accessed by the authors (e.g. downloaded or otherwise received), but the authors certify that they have not yet observed ANY part of the data/evidence.
 
List of eligible PCI RR-friendly journals:
 
 
References
 
1. Zendle, D., Meyer, R., Cairns, P., Waters, S., & Ballou, N. (2020). The prevalence of loot boxes in mobile and desktop games. Addiction, 115(9), 1768-1772. https://doi.org/10.1111/add.14973

2. Xiao, L. Y. (2022). Breaking Ban: Belgium’s ineffective gambling law regulation of video game loot boxes. Stage 2 Registered Report, acceptance of Version 2 by Peer Community in Registered Reports. https://doi.org/10.31219/osf.io/hnd7w 
 
3. Xiao, L. Y. (2023). Beneath the label: Assessing video games’ compliance with ESRB and PEGI loot box warning label industry self-regulation, in principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/e6qbm
Beneath the label: Assessing video games’ compliance with ESRB and PEGI loot box warning label industry self-regulationLeon Y. Xiao<p>Loot boxes in video games are a form of in-game transactions with randomised elements. Concerns have been raised about loot boxes’ similarities with gambling and their potential harms (e.g., overspending). Recognising players’ and parents’ conc...Humanities, Social sciencesChris Chambers2022-09-17 00:14:51 View
07 Mar 2023
STAGE 2
(Go to stage 1)

Beneath the label: Unsatisfactory compliance with ESRB, PEGI, and IARC industry self-regulation requiring loot box presence warning labels by video game companies

Failure of industry self-regulation in loot box labelling

Recommended by ORCID_LOGO
Paid loot boxes – items bought for real-world money that offer randomised rewards – are a prevalent feature of contemporary video games (Zendle et al., 2020). Because they employ random chance to provide rewards after spending real money, loot boxes have been considered a form of gambling, raising concerns about risk of harm to children and other vulnerable users. In response, some countries have taken legal steps to regulate and even ban the use of loot boxes, with only limited success so far (Xiao, 2022). At the same time, the Entertainment Software Rating Board (ESRB) and PEGI (Pan-European Game Information) now expect games that contain loot boxes to be marked with warning labels that, in theory, will enable users (including parents) to make more informed decisions. These requirements by ESRB/PEGI are not legally binding and may be considered a form of industry self-regulation.
 
In the current study, Xiao (2023) investigated the effectiveness of self-regulation in the use of loot box labels. Study 1 examined the consistency of warning labels by the ESRB and PEGI, with the expectation that if self-regulation works as it should then these labels should always (or nearly always) co-occur. Study 2 established the compliance rate for labelling among popular games that are known to contain loot boxes, with a rate of ≥95% considered to be successful.
 
The results of both studies reveal deficiences in industry self-regulation. The consistency rate of warning labels by the ESRB and PEGI was just 39.4% in preregistered analyses, rising to 83.9% in an unregistered exploratory analysis that took into account industry responses to the findings. Even at this upper bound, this rate is lower than expected by complete (or near-complete) consistency. The results of Study 2 indicate that only 29% of games on the Google Play Store known to contain loot boxes were accurately labelled, indicating that 71% were non-compliant with industry requirements.
 
Following careful evaluation, the recommender judged that the manuscript met the Stage 2 criteria and awarded a positive recommendation.
 
URL to the preregistered Stage 1 protocol: https://osf.io/e6qbm
 
Level of bias control achieved: Level 3. At least some data/evidence that was used to the answer the research question had been previously accessed by the authors (e.g. downloaded or otherwise received), but the authors certifed that they had not yet observed ANY part of the data/evidence prior to in-principle-acceptance.
 
List of eligible PCI RR-friendly journals:
 
 
References
 
1. Zendle, D., Meyer, R., Cairns, P., Waters, S., & Ballou, N. (2020). The prevalence of loot boxes in mobile and desktop games. Addiction, 115(9), 1768-1772. https://doi.org/10.1111/add.14973

2. Xiao, L. Y. (2022). Breaking Ban: Belgium’s ineffective gambling law regulation of video game loot boxes. Stage 2 Registered Report, acceptance of Version 2 by Peer Community in Registered Reports. https://doi.org/10.31219/osf.io/hnd7w 
 
3. Xiao, L. Y. (2023). Beneath the label: Unsatisfactory compliance with ESRB, PEGI, and IARC industry self-regulation requiring loot box presence warning labels by video game companies, acceptance of Version 2 by Peer Community in Registered Reports. https://doi.org/10.31219/osf.io/asbcg
Beneath the label: Unsatisfactory compliance with ESRB, PEGI, and IARC industry self-regulation requiring loot box presence warning labels by video game companiesLeon Y. Xiao<p>Loot boxes in video games are a form of in-game transactions with randomised elements. Concerns have been raised about loot boxes’ similarities with gambling and their potential harms (e.g., overspending). Recognising players’ and parents’ conc...Humanities, Social sciencesChris Chambers Jim Sauer, Pete Etchells 2023-02-12 16:17:34 View
07 Apr 2022
STAGE 1

Breaking Ban: Assessing the effectiveness of Belgium’s gambling law regulation of video game loot boxes

Has the “ban” of loot boxes eliminated them from Belgian mobile games?

Recommended by ORCID_LOGO based on reviews by Andrew Moshirnia, Joseph Macey and Jason Chin
Paid loot boxes, i.e. randomised monetization methods that are similar to lottery-type gambling, have become prominent features of contemporary gaming (e.g., Macey & Bujić, 2022). Because the design structures of loot boxes vary and the value of their virtual rewards is not always clear-cut, many countries now struggle how to deal with them legally and in practice (see Drummond et al., 2020). Belgium is one of the few countries that have officially interpreted loot box monetization to widely belong under gambling regulation. Mobile games that monetize with paid loot boxes in Belgium should thus apply for a gambling license, and companies should generally not offer paid loot boxes to local underage players at all.
 
In this Stage 1 Registered Report, Xiao (2022) has constructed a careful plan for testing whether the “ban” in Belgium has made the local mobile game market distinct in terms of paid loot boxes. The work builds on a rapidly accumulating literature and evolving methods (e.g., Xiao et al., 2021). The author will carry out a systematic qualitative investigation of the country’s top 100 (iPhone) mobile games to investigate whether paid loot box design components have indeed been removed from the products -- and if not, whether related game companies operate with a required gambling license. Additionally, Xiao (2022) will assess Belgium’s overall paid loot box prevalence in comparison to other countries and carry out a field experiment to test whether players can easily circumvent the local regulation by transporting or downloading different versions of software.
 
The study will produce valuable evidence regarding the effectiveness of loot box regulation in general, and more specifically, the results should be of utmost interest to Belgian legal authorities. To ensure the transparency and validity of the chosen methods as well as upcoming interpretations, the registered report format allowed the research design to be reviewed in three rounds before data collection. Three experts, representing the fields of law and gaming, reviewed the Stage 1 manuscript twice and agreed upon the acceptance of all details. Finally, the recommender carried out a third iteration with further requested revisions, which was followed by in-principle acceptance. 
 

URL to the preregistered Stage 1 protocol: https://osf.io/5mxp6

Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.

List of eligible PCI RR-friendly journals:

References

  • Drummond, A., Sauer, J. D., Hall, L. C., Zendle, D., & Loudon, M. R. (2020). Why loot boxes could be regulated as gambling. Nature Human Behaviour, 4(10), 986-988.
  • Macey, J., & Bujić, M. (2022). "The Talk of the Town: Community Perspectiveson Loot Boxes." In Ruotsalainen et al. (eds), Modes of Esports Engagement in Overwatch (pp. 199-223). Palgrave Macmillan.
  • Xiao, L. (2022) “Breaking Ban: Assessing the effectiveness of Belgium’s gambling law regulation of loot boxes.” Stage 1 Registered Report, in principle acceptance of Version 5 by Peer Community in Registered Reports.
  • Xiao, L. Y., Henderson, L. L., Yang, Y., & Newall, P. W. (2021). Gaming the system: suboptimal compliance with loot box probability disclosure regulations in China. Behavioural Public Policy, 1-27.
Breaking Ban: Assessing the effectiveness of Belgium’s gambling law regulation of video game loot boxesLeon Y. Xiao<p>Loot boxes in video games are gambling-like mechanics that players buy to obtain randomised rewards of varying value. Loot boxes are conceptually and psychologically similar to gambling, and loot box expenditure is positively correlated with se...Humanities, Social sciencesVeli-Matti Karhulahti2022-02-07 22:54:50 View
14 Nov 2022
STAGE 2
(Go to stage 1)
article picture

Breaking Ban: Belgium’s ineffective gambling law regulation of video game loot boxes

Loot boxes remain prevalent in Belgium despite their “ban”

Recommended by ORCID_LOGO based on reviews by Andrew Moshirnia, Joseph Macey and Jason Chin
Several countries currently struggle to legally interpret and deal with loot boxes, i.e. gambling-like mechanisms that have become common especially in contemporary videogame design. One of the few countries to take a clear regulation stance is Belgium, which officially announced that they interpret paid loot boxes as games of chance that violate their Gaming and Betting Act and can thus be criminally prosecuted (Naessens 2018). This announcement four years ago laid the basis for a unique social experiment where companies offering loot boxes in Belgium had to decide whether to modify their games, exit the market, or continue to monetize with loot boxes. In the present study, Xiao (2022) investigated the outcomes of this experiment both via hypotheses testing and exploratory analysis.
 
Using the 100 highest-grossing iPhone games in Belgium as data and applying comprehensive qualitative mechanical analysis to each title, Xiao (2022) tested three preregistered hypotheses regarding loot box prevalence. None of the hypotheses were confirmed: the prevalence rate of loot boxes in the Belgian App Store was not null but extremely high (82.0%), also among mobile games designed for minors (54.2–80.2%), and significantly more compared to global standards when assessed by a binomial test (p<.001). Corroborating a fourth hypothesis, Xiao was also able to access various UK loot boxes in Belgium. In exploratory research, Xiao received a confirmation from the Belgian Gaming Commission that even “simulated gambling games” (that do not yield monetary wins) also legally constitute gambling in Belgium.
 
The results are the first to describe outcomes of ban-driven loot box regulation globally. Despite Belgium’s clear statement that “paid loot boxes must be removed from the video games in order to comply with the Belgian Gaming and Betting Act” (Naessens 2018, p. 16), almost all highest-grossing iPhone games in the Belgian App Store keep offering them. The finding is important especially for the legal authorities around the world who are currently assessing their own positions in potential regulation: simple statements are unlikely to have immediate effects on international companies in local markets. On the other hand, it remains unknown how these companies have interpreted the statement and what are their distinct reasons for continuing to offer loot boxes in the Belgian App Store. It would be important in future research to investigate the companies’ perspectives.
 
This study (Xiao 2022) is important also from a meta-scientific perspective. It paves the way for Registered Reports in new disciplines and methods, and involves an exceptional field experiment that was carefully documented with open data and materials. Three external experts reviewed the Stage 2 manuscript twice, based on which the recommender awarded a positive recommendation.
 

URL to the preregistered Stage 1 protocol: https://osf.io/5mxp6

Level of bias control achieved: Level 6. No part of the data or evidence that was used to answer the research question existed prior to Stage 1 in-principle acceptance.

List of eligible PCI RR-friendly journals:

 

References
 
1. Naessens, P. (2018) Research Report on Loot Boxes [English Translation]. Belgian Gaming Commission. URL: https://www.gamingcommission.be/sites/default/files/2021-08/onderzoeksrapport-loot-boxen-Engels-publicatie.pdf
 
2. Xiao, L.Y. (2022) Breaking Ban: Belgium’s ineffective gambling law regulation of video game loot boxes. Stage 2 Registered Report, acceptance of Version 2 by Peer Community in Registered Reports. https://doi.org/10.31219/osf.io/hnd7w 
Breaking Ban: Belgium’s ineffective gambling law regulation of video game loot boxesLeon Y. Xiao<p>Loot boxes in video games are gambling-like mechanics that players buy to obtain randomised rewards of varying value. Loot boxes are conceptually and psychologically similar to gambling, and loot box expenditure is positively correlated with se...Humanities, Social sciencesVeli-Matti Karhulahti2022-07-28 12:29:57 View
01 Jun 2024
STAGE 1

Can Imagining Actions as Occurring Involuntarily Cause Intentional Behaviour to Feel Involuntary?

Can the sense of agency and reality be altered by our meta-cognitive models?

Recommended by ORCID_LOGO based on reviews by Zoltan Kekecs and Sophie Siestrup
Alterations in subjective experience, including alterations in the sense of agency (SoA) and reality (SoR), are commonly implicated in direct-verbal suggestions, such as hypnotic suggestions. Although extensively studied, how direct-verbal suggestions can alter the SoA and SoR is not understood (e.g., see Martin & Pacherie, 2019; Zahedi et al., 2024). One class of theories postulates that the alterations in SoA and SoR are related to meta-cognition. For instance, the intention to move or form a mental image can be kept out of conscious awareness, creating a sense of involuntariness (Dienes & Perner, 2007).

Relying on this theory, in the current study Sheldrake and Dienes (2024) postulate that the metacognitive processes related to these alterations can occur by appropriate use of imagination. In other words, by imagining the movement or object to be hallucinated and further imagining the underlying process was outside of awareness, one can elicit alterations in SoA and SoR. To this end, an intervention is devised whereby the participant is repeatedly asked to consider what might help or hinder them from imagining they are unaware of the relevant intention and thereby adjust their imagination. A control group will be asked to increase the feeling of involuntariness or altered reality simply by repeated practice. Afterward, participants will be asked in a test phase the extent to which the suggested experience felt involuntary.
 
The Stage 1 manuscript was evaluated over three rounds of in-depth review. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA). 
 
URL to the preregistered Stage 1 protocol: https://osf.io/f8hsd
 
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.  
 
List of eligible PCI RR-friendly journals:
 

References
 
1. Dienes, Z. & Perner, J. (2007). Executive control without conscious awareness: The cold control theory of hypnosis. In G. A. Jamieson (Ed.), Hypnosis and conscious states: The cognitive neuroscience perspective (pp. 293-314). Oxford University Press.
 
2. Martin, J. R. & Pacherie, E. (2019). Alterations of agency in hypnosis: A new predictive coding model. Psychol Rev, 126(1), 133-152. https://doi.org/10.1037/rev0000134
 
3. Sheldrake, K. & Dienes, Z. (2043). Can Imagining Actions as Occurring Involuntarily Cause Intentional Behaviour to Feel Involuntary? In principle acceptance of Version 6 by Peer Community in Registered Reports. https://osf.io/f8hsd
 
4. Zahedi, A., Lynn, S. J., & Sommer, W. (2024). Cognitive Simulation along with Neural Adaptation Explain Effects of Suggestions: A Novel Theoretical Framework. Frontiers in Psychology. https://doi.org/10.3389/fpsyg.2024.1388347
Can Imagining Actions as Occurring Involuntarily Cause Intentional Behaviour to Feel Involuntary?Kevin Sheldrake, Zoltan Dienes<p>The cold control theory of response to imaginative suggestions calling for distortions in veridical experience (including hypnotic suggestions) states that behavioural and cognitive responses are generated intentionally, but are perceived as in...Social sciencesAnoushiravan Zahedi Zoltan Kekecs2023-11-25 16:24:53 View