Please note that we will be CLOSED to ALL SUBMISSIONS from 1 December 2024 through 12 January 2025 to give our recommenders and reviewers a holiday break.
We are recruiting recommenders (editors) from all research fields!
Your feedback matters! If you have authored or reviewed a Registered Report at Peer Community in Registered Reports, then please take 5 minutes to leave anonymous feedback about your experience, and view community ratings.
Latest recommendations
| Id | Title * | Authors * | Abstract * | Picture | Thematic fields * | Recommender▲ | Reviewers | Submission date | |
|---|---|---|---|---|---|---|---|---|---|
21 Apr 2024
STAGE 1
Mechanisms of secularization: Testing between three causal pathwaysUnderstanding links between secularization, rationalisation and insecurityRecommended by Adrien Fillon based on reviews by Chris Chambers and 1 anonymous reviewer
What relationship can be expected between secularization, rationalisation and insecurity? While some authors argue that rationalisation reduces the willingness to belong to religious groups, others have suggested that insecurity increases this need to belong to religious groups.
In the current study, Lang and Chvaja (2024) will adjudicate between these two possibilities using an economics game in participants from two countries: US and Poland. The central question posed by the authors is whether cooperative insecurity increases the probability of joining a religious normative group. They will test the relationship between an environment (secure and insecure) and institution (which related to the norm context: religious and secular) on the probability of choosing the normative group in an experimental setting. Therefore, the study will be a quantitative analysis.
The authors included an adequate power analysis, alternatives for non-supported hypotheses, and filtering to ensure a high quality of data collection. They also undertook a pilot study to ensure the quality of the procedure and sensitivity of the analyses.
The Stage 1 manuscript was evaluated over one round of in-depth review. Based on detailed responses to reviewers’ and the recommender’s comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance.
URL to the preregistered Stage 1 protocol: https://osf.io/yzgek
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.
List of eligible PCI RR-friendly journals:
References 1.Lang, M. & Chvaja, R. (2024). Mechanisms of secularization: Testing between the rationalization and existential insecurity theories. In principle acceptance of Version 2 by Peer Community in Registered Reports. https://osf.io/yzgek
| Mechanisms of secularization: Testing between three causal pathways | Martin Lang, Radim Chvaja | <p>The study tests two competing explanations of the secularization process related to rationalizing worldviews and decreasing existential insecurity. While the former explanation argues that people are unwilling to join religious groups because o... | Social sciences | Adrien Fillon | 2023-11-22 11:17:30 | |||
21 Jun 2024
STAGE 1
Is it Worth the Hustle? A Multi-Country Replication of the Effort Moralization Effect and an Extension to Generational Differences in the Appreciation of EffortAre people who exert more effort in a task seen as more moral?Recommended by Adrien Fillon based on reviews by Jared Celniker, Ignazio Ziano and Michael Inzlicht
This study seeks to understand cultural and age differences in the effort moralization effect, a phenomenon in which people who put more effort into a task are considered more moral, regardless of the quality or the morality associated with the task. This is shown in common phrases such as the “great resignation” or “quiet quitting”, which are mostly used against younger members of the population, in particular generation Z.
Tissot and Roth (2024) propose to conduct a replication of a study from Celniker et al. (2023) which found evidence for this effect, with new samples from Mexico and Germany to test potential cultural differences. They will also test the effect of age on the effort moralization effect. Therefore, the study will be a quantitative analysis.
The authors included an adequate power analysis, alternatives for non-supported hypotheses, and filtering to ensure a high quality of data collection. They already provided an R script and dummy data to ensure the quality of the analysis. The Stage 1 manuscript was evaluated over three rounds of in-depth review. Based on detailed responses to reviewers’ and the recommender’s comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance.
URL to the preregistered Stage 1 protocol: https://osf.io/tvgw2
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.
List of eligible PCI RR-friendly journals:
References 1. Celniker, J. B., Gregory, A., Koo, H. J., Piff, P. K., Ditto, P. H., & Shariff, A. F. (2023). The moralization of effort. Journal of Experimental Psychology: General, 152, 60–79. https://doi.org/10.1037/xge0001259
2. Tissot, T. T. & Roth, L. H. O. (2024). Is it Worth the Hustle? A Multi-Country Replication of the Effort Moralization Effect and an Extension to Generational Differences in the Appreciation of Effort. In principle acceptance of Version 4 by Peer Community in Registered Reports. https://osf.io/tvgw2
| Is it Worth the Hustle? A Multi-Country Replication of the Effort Moralization Effect and an Extension to Generational Differences in the Appreciation of Effort | Tassilo T. Tissot, Leopold H. O. Roth | <p>Inferring the character of individuals is an adaptive need for partner and mating decisions as well as to avoid harm. The effort moralization effect is the finding that people who exert more effort in a task are seen as more moral, even if high... | Social sciences | Adrien Fillon | 2024-01-18 14:58:04 | |||
14 Feb 2024
STAGE 1
Detecting DIF in Forced-Choice Assessments: A Simulation Study Examining the Effect of Model MisspecificationDeveloping differential item functioning (DIF) testing methods for use in forced-choice assessmentsRecommended by Amanda Montoya based on reviews by Timo Gnambs and 2 anonymous reviewers
Traditional Likert-type items are commonly used but can elicit response bias. An alternative approach, the forced-choice question, required respondents to rank order all items. Forced-choice questions boast some advantages but required advanced item response theory analysis to generate scores which are comparable across individuals and to evaluate the properties of those scales. However, there has been limited discussion of how to test differential item functioning (DIF) in these scales. In a previous study, Lee et al. (2021) proposed a method for testing DIF.
Here, Plantz et al. (2024) explore the implications of incorrect specification of anchors in DIF detection for forced choice items. The study proposes to use a Monte Carlo simulation which manipulates sample size, equality of sample size across groups, effect size, percentage of differentially functioning items, analysis approach, anchor set size, and percent of DIF blocks in the anchor set. This study aims to answer research questions about the type I error and power of DIF detection strategies under a variety of circumstances, both evaluating whether the results from Lee et al. (2021) generalize to misspecified models and expanding to evaluate new research questions. Results of this study will provide practical implications for DIF testing with forced-choice questions. An important limitation of the study is that it does not explore non-uniform DIF, only uniform DIF. Additionally, as with all simulation studies not all results can only apply to conditions which are simulated and so rely on the realistic selection of simulation conditions. The authors have selected conditions to match reality in circumstances where data is available, but relied on previous simulations in cases when data is not available.
This Stage 1 manuscript was evaluated over two rounds of review by two reviewers with expertise in psychometrics. An additional round of review was completed by the recommender only. Based on the merits of the original submission and responsiveness of the authors to requests from the reviewers, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
URL to the preregistered Stage 1 protocol: https://osf.io/p8awx
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA. List of eligible PCI RR-friendly journals:
References 1. Lee, P., Joo, S.-H. & Stark, S. (2021). Detecting DIF in multidimensional forced choice measures using the Thurstonian Item Response Theory Model. Organizational Research Methods, 24, 739–771. https://doi.org/10.1177/1094428120959822
2. Plantz, J. W., Brown, A., Wright, K. & Flake, J. K. (2024). Detecting DIF in Forced-Choice Assessments: A Simulation Study Examining the Effect of Model Misspecification. In principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/p8awx
| Detecting DIF in Forced-Choice Assessments: A Simulation Study Examining the Effect of Model Misspecification | Jake Plantz, Anna Brown, Keith Wright, Jessica K. Flake | <p>On a forced-choice (FC) questionnaire, the respondent must rank two or more items instead of indicating how much they agree with each of them. Research demonstrates that this format can reduce response bias. However, the data are ipsative, resu... | Social sciences | Amanda Montoya | 2023-09-06 22:43:32 | |||
13 Sep 2024
STAGE 1
Personality traits predict perception of pandemic risk and compliance with infection control measuresAssociations between personality traits, compliance and risk perception in Norwegian adults during COVID-19Recommended by Andrew Jones based on reviews by Xiaowen Xu and 1 anonymous reviewerThis study aims to examine the associations between personality traits, using the big-5 personality model (Costa & McCrae, 1992), and compliance with pandemic measures (e.g. handwashing), and perceived risk of the pandemic to the individual, in a representative sample of the adult Norwegian population.
Several previous studies have examined associations between personality and adherence to medical advice using measures administered at the same point in time the during COVID-19 pandemic (e.g. Götz et al., 2021), however the dataset the current investigators plan to use assessed personality one year prior to the pandemic (May/June 2019) and the risk and compliance measures four months into the pandemic (August/September 2020).
Here, Sætrevik et al. (2024) make a number of hypotheses, including that conscientiousness, agreeableness, openness and neuroticism will be positively associated with compliance; extraversion will be negatively associated with compliance; extraversion and openness will be negatively associated with perceived risk; and finally, neuroticism will be positively associated with perceived risk. They plan to test their hypotheses using linear regression analyses. Importantly, given the topic, the data for this study already exists and some response distributions of the compliance and risk measures have been examined. However, the authors have yet to link the data on personality to the data on compliance and risk, which is the focus of their hypotheses. The findings from this study will help us to understand the personality characteristics associated with infection control measures and individual risk perceptions of viral illnesses during a pandemic. The Stage 1 manuscript was evaluated by two expert reviewers in two rounds of in-depth review. Following responses from the authors, the recommender determined that Stage 1 criteria were met and awarded in-principle acceptance (IPA). URL to the preregistered Stage 1 protocol: https://osf.io/p5sjb
Level of bias control achieved: Level 1. At least some of the data/evidence that will be used to the answer the research question has been accessed and observed by the authors, including key variables, but the authors certify that they have not yet performed any of their preregistered analyses, and in addition they have taken stringent steps to reduce the risk of bias.
List of eligible PCI RR-friendly journals: References
1. Costa, P. T., and McCrae, R. R. (1992). The five-factor model of personality and its relevance to personality disorders. Journal of Personality Disorders, 6, 343–359. https://doi.org/10.1521/pedi.1992.6.4.343 2. Götz, F. M., Gvirtz, A., Galinsky, A. D., and Jachimowicz, J. M. (2021). How personality and policy predict pandemic behavior: Understanding sheltering-in-place in 55 countries at the onset of COVID-19. The American psychologist, 76, 39–49. https://doi.org/10.1037/amp0000740 3. Sætrevik, B., Erevik, E. K., and Bjørkheim, S. B. (2024). Personality traits predict perception of pandemic risk and compliance with infection control measures. In principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/p5sjb
| Personality traits predict perception of pandemic risk and compliance with infection control measures | Bjørn Sætrevik, Eilin K. Erevik, Sebastian B. Bjørkheim | <p>Personality traits influence our outlook and choices in life, and may also influence how we evaluate and respond to an extreme event such as the COVID-19 pandemic in 2020. Here we combined big-5 personality measures from a large nationally repr... | Social sciences | Andrew Jones | 2023-11-30 23:17:12 | |||
30 Sep 2024
STAGE 1
Examining the role of action interpretation in changes in choice induced by go/no-go and approach/avoidance responsesDoes interpretation of actions as either avoid or inhibit influence choice behaviour for candy?Recommended by Andrew Jones based on reviews by Alexander MacLellan and Katrijn HoubenExperimental research demonstrates that executing or inhibiting motor responses (or approaching / avoiding) towards a stimulus can alter the valuation of the stimulus (Yang et al., 2022). There are competing theories as to the proposed mechanisms of value change, such as increased response conflict or prediction errors (Houben & Aulbach, 2023). However, research has mostly examined response execution/inhibition and approach/avoidance in isolation and the few studies that have examined these together have focused on stimulus evaluation as an outcome.
In the present study, Chen et al. (2024) will use a novel version of a combined go/no-go / approach avoidance paradigm to test the effects on choice of consumable candy. In this task, participants are randomly assigned to make a response framed as a go / no-go action or an approach / avoidance action to control a shopping cart (Chen & Van Dessel, 2024). Following this they will complete a food choice task in which participants make a series of binary choices for different candies. Their performance on this task will lead to the receipt of real-world candy. The authors aim to test whether the same responses will lead to different effects on food choice, depending on how the response was interpreted (e.g. participants in the approach/avoidance instruction group will select Approach items more often than those in the go/no-go instruction group). The study is well powered to detect the proposed effect size of interest, and data will be analysed using Bayesian mixed-effect models. This study will shed light onto theoretical predictions of action interpretation on stimulus value and choice, which may improve the efficacy of behaviour change tools such as approach bias training in future. The Stage 1 manuscript was evaluated over two rounds of in-depth review. Based on detailed responses to the recommender and reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
URL to the preregistered Stage 1 protocol: https://osf.io/bn5xa (under temporary private embargo)
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.
List of eligible PCI RR-friendly journals:
References
1. Chen, Z. and Van Dessel, P. (2024). Action interpretation determines the effects of go/no-go and approach/avoidance actions on stimulus evaluation. Open Mind, 8, 898-923. https://doi.org/10.1162/opmi_a_00151 2. Chen, Z., Van Dessel, P., and Figner, B. (2024). Examining the role of action interpretation in changes in choice induced by go/no-go and approach/avoidance responses. In principle acceptance of Version 2 by Peer Community in Registered Reports. https://osf.io/bn5xa
3. Houben, K. and Aulbach, M. (2023). Is there a difference between stopping and avoiding? A review of the mechanisms underlying Go/No-Go and Approach-Avoidance training for food choice. Current Opinion in Behavioral Sciences, 49, 101245. https://doi.org/10.1016/j.cobeha.2022.101245 4. Yang, Y., Qi, L., Morys, F., Wu, Q. and Chen, H. (2022). Food-Specific Inhibition Training for Food Devaluation: A Meta-Analysis. Nutrients, 14, 1363. https://doi.org/10.3390/nu14071363 | Examining the role of action interpretation in changes in choice induced by go/no-go and approach/avoidance responses | Zhang Chen, Pieter Van Dessel, Bernd Figner | <p>Executing go/no-go (GNG) and approach/avoidance (AAT) responses toward objects can increase people’s choices for go over no-go items, and for approach over avoidance items. Some theoretical accounts explain these effects as the results of merel... | Social sciences | Andrew Jones | Alexander MacLellan, Katrijn Houben | 2024-06-17 17:57:07 | ||
01 Jun 2024
STAGE 1
Can Imagining Actions as Occurring Involuntarily Cause Intentional Behaviour to Feel Involuntary?Can the sense of agency and reality be altered by our meta-cognitive models?Recommended by Anoushiravan Zahedi based on reviews by Zoltan Kekecs and Sophie Siestrup
Alterations in subjective experience, including alterations in the sense of agency (SoA) and reality (SoR), are commonly implicated in direct-verbal suggestions, such as hypnotic suggestions. Although extensively studied, how direct-verbal suggestions can alter the SoA and SoR is not understood (e.g., see Martin & Pacherie, 2019; Zahedi et al., 2024). One class of theories postulates that the alterations in SoA and SoR are related to meta-cognition. For instance, the intention to move or form a mental image can be kept out of conscious awareness, creating a sense of involuntariness (Dienes & Perner, 2007).
Relying on this theory, in the current study Sheldrake and Dienes (2024) postulate that the metacognitive processes related to these alterations can occur by appropriate use of imagination. In other words, by imagining the movement or object to be hallucinated and further imagining the underlying process was outside of awareness, one can elicit alterations in SoA and SoR. To this end, an intervention is devised whereby the participant is repeatedly asked to consider what might help or hinder them from imagining they are unaware of the relevant intention and thereby adjust their imagination. A control group will be asked to increase the feeling of involuntariness or altered reality simply by repeated practice. Afterward, participants will be asked in a test phase the extent to which the suggested experience felt involuntary. The Stage 1 manuscript was evaluated over three rounds of in-depth review. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
URL to the preregistered Stage 1 protocol: https://osf.io/f8hsd Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA. List of eligible PCI RR-friendly journals: References 1. Dienes, Z. & Perner, J. (2007). Executive control without conscious awareness: The cold control theory of hypnosis. In G. A. Jamieson (Ed.), Hypnosis and conscious states: The cognitive neuroscience perspective (pp. 293-314). Oxford University Press.
2. Martin, J. R. & Pacherie, E. (2019). Alterations of agency in hypnosis: A new predictive coding model. Psychol Rev, 126(1), 133-152. https://doi.org/10.1037/rev0000134
3. Sheldrake, K. & Dienes, Z. (2043). Can Imagining Actions as Occurring Involuntarily Cause Intentional Behaviour to Feel Involuntary? In principle acceptance of Version 6 by Peer Community in Registered Reports. https://osf.io/f8hsd
4. Zahedi, A., Lynn, S. J., & Sommer, W. (2024). Cognitive Simulation along with Neural Adaptation Explain Effects of Suggestions: A Novel Theoretical Framework. Frontiers in Psychology. https://doi.org/10.3389/fpsyg.2024.1388347
| Can Imagining Actions as Occurring Involuntarily Cause Intentional Behaviour to Feel Involuntary? | Kevin Sheldrake, Zoltan Dienes | <p>The cold control theory of response to imaginative suggestions calling for distortions in veridical experience (including hypnotic suggestions) states that behavioural and cognitive responses are generated intentionally, but are perceived as in... | Social sciences | Anoushiravan Zahedi | Zoltan Kekecs | 2023-11-25 16:24:53 | ||
21 Feb 2022
STAGE 1
Recommended by Benoit Pujol based on reviews by Jean-François Gerard, Rachel Harrison and 1 anonymous reviewer
This submission has been withdrawn (see notice below)Sex-biased dispersal is widely acknowledged to influence range expansion and the geographic limits of species (Trochet et al. 2016). Evidence is accruing that suggests an impact of the learning ability of species on their capacity to colonise new habitats because the ability to learn provides an advantage when confronted to novel challenges (Lee and Thornton 2021). Whether these two mechanisms interact to shape range expansion remains however unknown. One could expect this interaction because both dispersal and the ability to learn are linked to related behaviours (e.g., exploration, Lee and Thornton 2021). In their study entitled “Investigating sex differences in learning in a range-expanding bird”, Alexis J. Breen and Dominik Deffner (Breen and Deffner 2022) propose to test this hypothesis in range-expanding great-tailed grackles (Quiscalus mexicanus) by exploring the individual variation of several behavioural traits (e.g., exploration, neophobia, problem solving, Logan 2016) linked to their learning ability. They will use a colour-reward reinforcement experimental approach to compare the learning performance between male and female great-tailed grackles in three study sites and evaluate whether sex-biased learning ability interacts with sex-biased dispersal. Data will be analysed by a Bayesian reinforcement learning model (Deffner et al. 2020), which was validated. This Stage 1 registered report was evaluated over one round of in-depth review by Jean-François Gerard, Rachel Harrison and one anonymous reviewer, and another round of review by Jean-François Gerard and Rachel Harrison. Based on detailed responses to the comments and the modifications brought to the manuscript by the authors, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA). Withdrawal notice: The Stage 2 manuscript associated with this accepted Stage 1 protocol was submitted to PCI RR on 22 July 2022. On 25 July 2022, the Managing Board offered the opportunity for the authors to revise the manuscript prior to in-depth review. On 7 Sep 2022, the authors withdrew the Stage 2 manuscript from consideration due to time constraints.URL to the preregistered Stage 1 protocol: https://osf.io/v3wxb
Level of bias control achieved: Level 2. At least some data/evidence that will be used to answer the research question has been accessed and partially observed by the authors, but the authors certify that they have not yet observed the key variables within the data that will be used to answer the research question AND they have taken additional steps to maximise bias control and rigour.
List of eligible PCI RR-friendly journals:
References Trochet, A., Courtois, E. A., Stevens, V. M., Baguette, M., Chaine, A., Schmeller, D. S., Clobert, J., & Wiens, J. J. (2016). Evolution of sex-biased dispersal. The Quarterly Review of Biology, 91(3), 297–320. https://doi.org/10.1086/688097 Lee, V. E., & Thornton, A. (2021). Animal cognition in an urbanised world. Frontiers in Ecology and Evolution, 9, 120. https://doi.org/10.3389/fevo.2021.633947 Logan, C. J. (2016b). Behavioral flexibility in an invasive bird is independent of other behaviors. PeerJ, 4, e2215. https://doi.org/10.7717/peerj.2215 Deffner, D., Kleinow, V., & McElreath, R. (2020). Dynamic social learning in temporally and spatially variable environments. Royal Society Open Science, 7(12), 200734. https://doi.org/10.1098/rsos.200734 Breen, A. J. & Deffner D. (2022). Investigating sex differences in learning in a range-expanding bird., https://github.com/alexisbreen/Sex-differences-in-grackles-learning, in principle acceptance of version 2 by Peer Community in Registered Reports. https://osf.io/v3wxb | [WITHDRAWN]: Investigating sex differences in learning in a range-expanding bird | Alexis J. Breen & Dominik Deffner | <p style="text-align: justify;">How might differences in dispersal and learning interact in range expansion dynamics? To begin to answer this question, in this preregistration we detail the background, hypothesis plus associated predictions, and m... | | Life Sciences | Benoit Pujol | Rachel Harrison, Kate Cross, Jean-François Gerard | 2021-11-10 13:12:04 | |
17 Jan 2022
STAGE 1
Identifying Gaming Disorders by Ontology: A Nationally Representative Registered ReportDo different screening instruments for ‘gaming disorder’ measure the same or different construct(s)?Recommended by Charlotte Pennington based on reviews by Daniel Dunleavy, Linda Kaye, David Ellis and 1 anonymous reviewer
There is considerable debate regarding the relationship between excessive gaming and mental health problems. Whilst the diagnostic classification of “gaming disorder” has now been included in the WHO’s International Classification of Diseases (ICD-11), the APA decided not to include this diagnosis in their Diagnostic and Statistical Manual of Mental Disorders (DSM-5) because the literature “suffers from a lack of a standard definition from which to derive prevalence data” (APA 2013, p. 796). Furthermore, screening instruments that aim to provide diagnostic classifications derive from different ontologies and it is not known whether they identify equivalent prevalence rates of ‘gaming disorder’ or even the same individuals. In this Stage 1 Registered Report, Karhulahti et al. (2022) aim to assess how screening instruments that derive from different ontologies differ in identifying associated problem groups. A nationally representative sample of 8000 Finnish individuals will complete four screening measures to assess the degree of overlap between identified prevalence (how many?), who they identify (what characteristics?) and the health of their identified groups (how healthy?). If these four ontologically diverse instruments operate similarly, this will support the notion of a single “gaming disorder” construct. If, however, the instruments operate differently, this will suggest that efforts should be directed toward assessing the clinical (ir)relevance of multiple constructs. This rigorous study will therefore have important implications for the conceptualisation and measurement of “gaming disorder”, contributing to the debate around the mixed findings of gaming-related health problems. Four expert reviewers with field expertise assessed the Stage 1 manuscript over three rounds of in-depth review. Based on detailed and informed responses to the reviewers' comments, the recommender decided that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA). URL to the preregistered Stage 1 protocol: https://osf.io/usj5b Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA. List of eligible PCI RR-friendly journals:
References
| Identifying Gaming Disorders by Ontology: A Nationally Representative Registered Report | Veli-Matti Karhulahti, Jukka Vahlo, Marcel Martončik, Matti Munukka, Raine Koskimaa, Mikaela von Bonsdorff | <p style="text-align: justify;">Gaming-related health problems have been researched since the 1980s with numerous different “ontologies” as reference systems, from self-assessed “game addiction” to “pathological gambling” (in the DSM-IV), “interne... | | Medical Sciences, Social sciences | Charlotte Pennington | 2021-08-25 23:08:26 | ||
Ontological Diversity in Gaming Disorder Measurement: A Nationally Representative Registered ReportDifferent ontologies, different constructs? Instruments for gaming-related health problems identify different groups of people and measure different problemsRecommended by Charlotte Pennington based on reviews by Daniel Dunleavy and David Ellis
Screening instruments that aim to provide diagnostic classifications of gaming-related health problems derive from different ontologies and it is not known whether they identify equivalent prevalence rates of ‘gaming disorder’ or even the same individuals. Underpinned by this, Karhulahti et al. (2022) assessed how screening instruments that derive from different ontologies differ in identifying associated problem groups. A nationally representative sample of 8217 Finnish participants completed four screening measures to assess the degree of overlap between identified prevalence (how many?), who they identify (what characteristics?) and the health of their identified groups (how healthy?).
The results indicate that measures based on the ICD-11, DSM-5, DSM-IV, and self-assessment appear to be associated with lower mental health. However, these measures of gaming-related health problems differed significantly in terms of prevalence and/or overlap, suggesting that they identify different groups of people and that different problems or constructs are being measured by different instruments. These findings are important because they contribute to the rapidly growing literature on the ‘fuzziness’ of constructs and measures relating to technology use. The authors recommend that researchers working with these measures should: (a) define their construct of interest; and (b) evaluate the construct validity of their instruments. Being able to answer these questions will enhance research quality and contribute to strengthened meta-analyses. Importantly, this will prevent hype around gaming-related disorders, allowing researchers to communicate clearly and appropriately without risk of confusing related yet different constructs.
The Stage 2 manuscript was evaluated by two of the reviewers who assessed it at Stage 1. Following revision, the recommender judged that the manuscript met the Stage 2 criteria and awarded a positive recommendation. To ensure that the manuscript met the requirements of the PCI RR TOP guidelines, prior to this acceptance an email communication was sent to the authors by the recommender to ensure that study data were openly available on a temporary OSF link before the final data archive is full validated by the Finnish Social Sciences Data Archive (FSD). This is noted in the recommended preprint.
URL to the preregistered Stage 1 protocol: https://osf.io/usj5b
Level of bias control achieved: Level 6. No part of the data or evidence that was used to answer the research question existed prior to Stage 1 in-principle acceptance.
List of eligible PCI RR-friendly journals:
References
1. Karhulahti V.-M., Vahlo J., Martončik M., Munukka M., Koskimaa R. and Bonsdorff M. (2022). Ontological Diversity in Gaming Disorder Measurement: A Nationally Representative Registered Report. Peer-reviewed and recommended at Stage 2 by Peer Community in Registered Reports https://psyarxiv.com/qytrs
| Ontological Diversity in Gaming Disorder Measurement: A Nationally Representative Registered Report | Veli-Matti Karhulahti, Jukka Vahlo, Marcel Martončik, Matti Munukka, Raine Koskimaa, Mikaela von Bonsdorff | <p>Gaming-related health problems have been researched since the 1980s with numerous different “ontologies” as reference systems, from self-assessed “game addiction” to “pathological gambling” (in the DSM-IV), “internet gaming disorder” (in the 3r... | Medical Sciences, Social sciences | Charlotte Pennington | 2022-05-23 16:14:04 | |||
19 Mar 2023
STAGE 1
How does the phrasing of house edge information affect gamblers’ perceptions and level of understanding? A Registered ReportDoes relaying ‘house edge’ information influence gambler’s perceived chances of winning and their factual understanding of the statistical outcomes?Recommended by Charlotte Pennington based on reviews by Zhang Chen, Graeme Knibb and Luke Clarke
Many products that can impact upon health and wellbeing (e.g. alcohol, food) relay information to consumers about the potential risks. However, such information is commonly provided in suboptimal format for gambling-related products. To encourage safer gambling, research has therefore recommended that information about the average loss from a gambling product (“house edge”) or percentage payout (“return-to-player”) should be communicated, with the former translating to better perceived understanding by gamblers. In this study, Newall et al. (2022) aim to experimentally compare two phrasings of the house edge against a control return-to-player to arrive at the most effective phrasing to aid gambler’s perceived chances of winning and their factual understanding of the statistical outcomes of their bet. Using a hypothetical gambling scenario, a sample of 3,000 UK-based online gamblers will be randomly assigned to receive two alternative phrasings of the house edge or the equivalent return-to-player information. Two outcome measures will be used to judge the effectiveness of the house edge information: gamblers’ perceived changes of winning and rates of accurate responding on a multiple-choice question measuring factual understanding of this information. This study will therefore assess the most effective communication of gambling risk, which can inform public health policies to reduce gambling-related harm.
Following a positive initial appraisal, and after two rounds of in-depth review, the recommender judged that the manuscript met the Stage 1 criteria and awarded in-principle acceptance (IPA).
URL to the preregistered Stage 1 protocol: https://osf.io/5npy9
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA. List of eligible PCI RR-friendly journals:
References
1. Newall, P. W. S., James, R. J. E. & Maynard, O. M. (2022). How does the phrasing of house edge information affect gamblers’ perceptions and level of understanding? A Registered Report, in principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/5npy9 | How does the phrasing of house edge information affect gamblers’ perceptions and level of understanding? A Registered Report | Philip Newall, Richard James, Olivia Maynard | <p>The provision of information to consumers is a common input to tackling various public health issues. By comparison to the information given on food and alcohol products, information on gambling products is either not given at all, or shown in ... | Social sciences | Charlotte Pennington | 2022-07-18 16:25:06 |
