We are recruiting recommenders (editors) from all research fields!
Your feedback matters! If you have authored or reviewed a Registered Report at Peer Community in Registered Reports, then please take 5 minutes to leave anonymous feedback about your experience, and view community ratings.
Latest recommendations
| Id | Title | Authors | Abstract | Picture | Thematic fields | Recommender▼ | Reviewers | Submission date | |
|---|---|---|---|---|---|---|---|---|---|
Registered Report: Are anticipatory auditory predictions enhanced in tinnitus and independent of hearing loss?Evidence for the role of predictive coding in subjective tinnitusRecommended by Chris Chambers based on reviews by Will Sedley, Pia Brinkmann and Emilie Cardon
Subjective tinnitus is a common disorder in which people experience a persistent sound in the absence of any external source. The underlying causes of tinnitus are debated – although the condition is strongly associated with hearing loss resulting from auditory damage, much remains to be understood about the neural processes that give rise to the phantom perception. Various classes of neurophysiological theories have been proposed, including the “altered gain” model – in which neurons in the auditory pathway increase their responsiveness to compensate for reduced auditory input following hearing loss – and the “noise cancellation” model – in which disrupted feedback connections from limbic regions are unable to tune out phantom signals. Although these theories account for much observed data, they have not been conclusively supported, and their ability to explain tinnitus is limited by the fact that hearing loss and tinnitus can arise independently and at different times.
In the current study, Reisinger et al. (2024) tested an emerging alternative theory based on a Bayesian predictive-coding framework (Sedley et al., 2016) in which the alteration of perceptual priors leads the auditory system to expect a sound that, if functioning normally, it should not expect. Using magnetoencephalography (MEG) in a sample of tinnitus patients (and carefully-matched controls for age, gender, and level of hearing loss), they asked whether tinnitus is associated with anticipatory brain activation, tuned to the carrier-frequency of an expected auditory stimulus. Specifically, the authors predicted that if the predictive-coding framework is correct then individuals with tinnitus should show different regularity-dependent pre-activations of carrier- frequency-specific information compared to the control group, while tone carrier-frequencies should be processed normally in tinnitus patients. They also predicted that any such pre-activations should not be related to levels of reported subjective tinnitus distress, as measured with the short version of the Tinnitus Questionnaire (mini-TQ).
The results broadly confirmed the hypotheses, with some caveats. Statistically significant differences in regularity-dependent pre-activations were observed between the tinnitus and control groups, however – curiously – the effects appear to be driven by below-chance decoding in the control group, complicating the interpretration. At the same time, consistent with expectations, frequency processing did not differ significantly between individuals with and without tinnitus, and the observed pre-activations were not significantly related to tinnitus distress. Overall, the findings cautiously support the conclusion that chronic tinnitus is associated with maladaptively upregulated predictive neural processing, and that this phenomenon is unlikely to be explained by either tinnitus distress or hearing loss.
The Stage 2 manuscript was evaluated over one round of in-depth review. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 2 criteria and awarded a positive recommendation.
URL to the preregistered Stage 1 protocol: https://osf.io/6gvpy
Level of bias control achieved: Level 3. At least some data/evidence that was used to the answer the research question had been previously accessed by the authors (e.g. downloaded or otherwise received), but the authors certify that they had yet observed any part of the data/evidence prior to Stage 1 IPA.
List of eligible PCI RR-friendly journals:
References
1. Reisinger, L., Demarchi, G., Rösch, , S., Trinka, E., Obleser, L., & Weisz, N. (2024). Registered Report: Are anticipatory auditory predictions enhanced in tinnitus and independent of hearing loss? [Stage 2] Acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/9wqjh
2. Sedley, W., Friston, K. J., Gander, P. E., Kumar, S., & Griffiths, T. D. (2016). An integrative tinnitus model based on sensory precision. Trends in Neurosciences, 39, 799-812. https://doi.org/10.1016/j.tins.2016.10.004
| Registered Report: Are anticipatory auditory predictions enhanced in tinnitus and independent of hearing loss? | L. Reisinger, G. Demarchi, S. Rösch, E. Trinka, J. Obleser, N. Weisz | <p>Phantom perceptions occur without any identifiable environmental or bodily source. The mechanisms and key drivers behind phantom perceptions like tinnitus are not well understood. The dominant “altered-gain”-framework suggests that tinnitus res... | Life Sciences | Chris Chambers | 2024-02-21 16:17:33 | |||
17 Jan 2022
STAGE 1
Identifying Gaming Disorders by Ontology: A Nationally Representative Registered ReportDo different screening instruments for ‘gaming disorder’ measure the same or different construct(s)?Recommended by Charlotte Pennington based on reviews by Daniel Dunleavy, Linda Kaye, David Ellis and 1 anonymous reviewer
There is considerable debate regarding the relationship between excessive gaming and mental health problems. Whilst the diagnostic classification of “gaming disorder” has now been included in the WHO’s International Classification of Diseases (ICD-11), the APA decided not to include this diagnosis in their Diagnostic and Statistical Manual of Mental Disorders (DSM-5) because the literature “suffers from a lack of a standard definition from which to derive prevalence data” (APA 2013, p. 796). Furthermore, screening instruments that aim to provide diagnostic classifications derive from different ontologies and it is not known whether they identify equivalent prevalence rates of ‘gaming disorder’ or even the same individuals. In this Stage 1 Registered Report, Karhulahti et al. (2022) aim to assess how screening instruments that derive from different ontologies differ in identifying associated problem groups. A nationally representative sample of 8000 Finnish individuals will complete four screening measures to assess the degree of overlap between identified prevalence (how many?), who they identify (what characteristics?) and the health of their identified groups (how healthy?). If these four ontologically diverse instruments operate similarly, this will support the notion of a single “gaming disorder” construct. If, however, the instruments operate differently, this will suggest that efforts should be directed toward assessing the clinical (ir)relevance of multiple constructs. This rigorous study will therefore have important implications for the conceptualisation and measurement of “gaming disorder”, contributing to the debate around the mixed findings of gaming-related health problems. Four expert reviewers with field expertise assessed the Stage 1 manuscript over three rounds of in-depth review. Based on detailed and informed responses to the reviewers' comments, the recommender decided that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA). URL to the preregistered Stage 1 protocol: https://osf.io/usj5b Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA. List of eligible PCI RR-friendly journals:
References
| Identifying Gaming Disorders by Ontology: A Nationally Representative Registered Report | Veli-Matti Karhulahti, Jukka Vahlo, Marcel Martončik, Matti Munukka, Raine Koskimaa, Mikaela von Bonsdorff | <p style="text-align: justify;">Gaming-related health problems have been researched since the 1980s with numerous different “ontologies” as reference systems, from self-assessed “game addiction” to “pathological gambling” (in the DSM-IV), “interne... | | Medical Sciences, Social sciences | Charlotte Pennington | 2021-08-25 23:08:26 | ||
Ontological Diversity in Gaming Disorder Measurement: A Nationally Representative Registered ReportDifferent ontologies, different constructs? Instruments for gaming-related health problems identify different groups of people and measure different problemsRecommended by Charlotte Pennington based on reviews by Daniel Dunleavy and David Ellis
Screening instruments that aim to provide diagnostic classifications of gaming-related health problems derive from different ontologies and it is not known whether they identify equivalent prevalence rates of ‘gaming disorder’ or even the same individuals. Underpinned by this, Karhulahti et al. (2022) assessed how screening instruments that derive from different ontologies differ in identifying associated problem groups. A nationally representative sample of 8217 Finnish participants completed four screening measures to assess the degree of overlap between identified prevalence (how many?), who they identify (what characteristics?) and the health of their identified groups (how healthy?).
The results indicate that measures based on the ICD-11, DSM-5, DSM-IV, and self-assessment appear to be associated with lower mental health. However, these measures of gaming-related health problems differed significantly in terms of prevalence and/or overlap, suggesting that they identify different groups of people and that different problems or constructs are being measured by different instruments. These findings are important because they contribute to the rapidly growing literature on the ‘fuzziness’ of constructs and measures relating to technology use. The authors recommend that researchers working with these measures should: (a) define their construct of interest; and (b) evaluate the construct validity of their instruments. Being able to answer these questions will enhance research quality and contribute to strengthened meta-analyses. Importantly, this will prevent hype around gaming-related disorders, allowing researchers to communicate clearly and appropriately without risk of confusing related yet different constructs.
The Stage 2 manuscript was evaluated by two of the reviewers who assessed it at Stage 1. Following revision, the recommender judged that the manuscript met the Stage 2 criteria and awarded a positive recommendation. To ensure that the manuscript met the requirements of the PCI RR TOP guidelines, prior to this acceptance an email communication was sent to the authors by the recommender to ensure that study data were openly available on a temporary OSF link before the final data archive is full validated by the Finnish Social Sciences Data Archive (FSD). This is noted in the recommended preprint.
URL to the preregistered Stage 1 protocol: https://osf.io/usj5b
Level of bias control achieved: Level 6. No part of the data or evidence that was used to answer the research question existed prior to Stage 1 in-principle acceptance.
List of eligible PCI RR-friendly journals:
References
1. Karhulahti V.-M., Vahlo J., Martončik M., Munukka M., Koskimaa R. and Bonsdorff M. (2022). Ontological Diversity in Gaming Disorder Measurement: A Nationally Representative Registered Report. Peer-reviewed and recommended at Stage 2 by Peer Community in Registered Reports https://psyarxiv.com/qytrs
| Ontological Diversity in Gaming Disorder Measurement: A Nationally Representative Registered Report | Veli-Matti Karhulahti, Jukka Vahlo, Marcel Martončik, Matti Munukka, Raine Koskimaa, Mikaela von Bonsdorff | <p>Gaming-related health problems have been researched since the 1980s with numerous different “ontologies” as reference systems, from self-assessed “game addiction” to “pathological gambling” (in the DSM-IV), “internet gaming disorder” (in the 3r... | Medical Sciences, Social sciences | Charlotte Pennington | 2022-05-23 16:14:04 | |||
19 Mar 2023
STAGE 1
How does the phrasing of house edge information affect gamblers’ perceptions and level of understanding? A Registered ReportDoes relaying ‘house edge’ information influence gambler’s perceived chances of winning and their factual understanding of the statistical outcomes?Recommended by Charlotte Pennington based on reviews by Zhang Chen, Graeme Knibb and Luke Clarke
Many products that can impact upon health and wellbeing (e.g. alcohol, food) relay information to consumers about the potential risks. However, such information is commonly provided in suboptimal format for gambling-related products. To encourage safer gambling, research has therefore recommended that information about the average loss from a gambling product (“house edge”) or percentage payout (“return-to-player”) should be communicated, with the former translating to better perceived understanding by gamblers. In this study, Newall et al. (2022) aim to experimentally compare two phrasings of the house edge against a control return-to-player to arrive at the most effective phrasing to aid gambler’s perceived chances of winning and their factual understanding of the statistical outcomes of their bet. Using a hypothetical gambling scenario, a sample of 3,000 UK-based online gamblers will be randomly assigned to receive two alternative phrasings of the house edge or the equivalent return-to-player information. Two outcome measures will be used to judge the effectiveness of the house edge information: gamblers’ perceived changes of winning and rates of accurate responding on a multiple-choice question measuring factual understanding of this information. This study will therefore assess the most effective communication of gambling risk, which can inform public health policies to reduce gambling-related harm.
Following a positive initial appraisal, and after two rounds of in-depth review, the recommender judged that the manuscript met the Stage 1 criteria and awarded in-principle acceptance (IPA).
URL to the preregistered Stage 1 protocol: https://osf.io/5npy9
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA. List of eligible PCI RR-friendly journals:
References
1. Newall, P. W. S., James, R. J. E. & Maynard, O. M. (2022). How does the phrasing of house edge information affect gamblers’ perceptions and level of understanding? A Registered Report, in principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/5npy9 | How does the phrasing of house edge information affect gamblers’ perceptions and level of understanding? A Registered Report | Philip Newall, Richard James, Olivia Maynard | <p>The provision of information to consumers is a common input to tackling various public health issues. By comparison to the information given on food and alcohol products, information on gambling products is either not given at all, or shown in ... | Social sciences | Charlotte Pennington | 2022-07-18 16:25:06 | |||
How does the phrasing of house edge information affect gamblers’ perceptions and level of understanding? A Registered ReportDoes relaying ‘house edge’ information influence gambler’s perceived chances of winning and their factual understanding of the statistical outcomes?Recommended by Charlotte Pennington based on reviews by Zhang Chen and Graeme Knibb
Many products that can impact upon health and wellbeing (e.g., alcohol, food) relay information to consumers about the potential risks. However, such information is commonly provided in suboptimal format for gambling-related products. To encourage safer gambling, research has therefore recommended that information about the average loss from a gambling product (“house edge”) or percentage payout (“return-to-player”) should be communicated, with the former translating to better perceived understanding by gamblers. This Registered Report aimed to experimentally compare two phrasings of the house edge against a control return-to-player to arrive at the most effective phrasing to aid gambler’s perceived chances of winning and their factual understanding of the statistical outcomes of their bet. Using a hypothetical gambling scenario, a sample of 3,333 UK-based online gamblers received one of three phrasings: an original house-edge (“his game keeps 10% of all money bet on average”), an alternative house-edge (“on average this game is programmed to cost you 10% of your stake on each bet”) or return-to-player (“this game has an average percentage payout of 90%”). Two outcome measures were employed to judge the effectiveness of this information: gamblers’ perceived changes of winning and factual understanding. The findings indicate that the two-house edge formats were more effective in communicating gambling-related harms than the return-to-player format, but the original house edge phrasing appeared to be the most optimal as it decreased gambler’s perceived chances of winning and increased their factual understanding compared to return-to-player. These results can therefore inform public health policies to reduce gambling-related harm by presenting the most effective communication of gambling risk.
After two in-depth reviews, the recommender judged that the manuscript met the Stage 2 criteria and awarded a positive recommendation.
URL to the preregistered Stage 1 protocol: https://osf.io/5npy9
Level of bias control achieved: Level 6. No part of the data or evidence that was used to answer the research question was generated until after IPA. List of eligible PCI RR-friendly journals:
References
1. Newall, P. W. S., James, R. J. E. & Maynard, O. M. (2023). How does the phrasing of house edge information affect gamblers’ perceptions and level of understanding? A Registered Report. Acceptance of Version 2 by Peer Community in Registered Reports. https://doi.org/10.31234/osf.io/pfnzd | How does the phrasing of house edge information affect gamblers’ perceptions and level of understanding? A Registered Report | Philip Newall, Richard James, Olivia Maynard | <p>The provision of information to consumers is a common input to tackling various public health issues. By comparison to the information given on food and alcohol products, information on gambling products is either not given at all, or shown in ... | Social sciences | Charlotte Pennington | Zhang Chen | 2023-01-09 14:56:36 | ||
21 Feb 2022
STAGE 1
Recommended by Benoit Pujol based on reviews by Jean-François Gerard, Rachel Harrison and 1 anonymous reviewer
This submission has been withdrawn (see notice below)Sex-biased dispersal is widely acknowledged to influence range expansion and the geographic limits of species (Trochet et al. 2016). Evidence is accruing that suggests an impact of the learning ability of species on their capacity to colonise new habitats because the ability to learn provides an advantage when confronted to novel challenges (Lee and Thornton 2021). Whether these two mechanisms interact to shape range expansion remains however unknown. One could expect this interaction because both dispersal and the ability to learn are linked to related behaviours (e.g., exploration, Lee and Thornton 2021). In their study entitled “Investigating sex differences in learning in a range-expanding bird”, Alexis J. Breen and Dominik Deffner (Breen and Deffner 2022) propose to test this hypothesis in range-expanding great-tailed grackles (Quiscalus mexicanus) by exploring the individual variation of several behavioural traits (e.g., exploration, neophobia, problem solving, Logan 2016) linked to their learning ability. They will use a colour-reward reinforcement experimental approach to compare the learning performance between male and female great-tailed grackles in three study sites and evaluate whether sex-biased learning ability interacts with sex-biased dispersal. Data will be analysed by a Bayesian reinforcement learning model (Deffner et al. 2020), which was validated. This Stage 1 registered report was evaluated over one round of in-depth review by Jean-François Gerard, Rachel Harrison and one anonymous reviewer, and another round of review by Jean-François Gerard and Rachel Harrison. Based on detailed responses to the comments and the modifications brought to the manuscript by the authors, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA). Withdrawal notice: The Stage 2 manuscript associated with this accepted Stage 1 protocol was submitted to PCI RR on 22 July 2022. On 25 July 2022, the Managing Board offered the opportunity for the authors to revise the manuscript prior to in-depth review. On 7 Sep 2022, the authors withdrew the Stage 2 manuscript from consideration due to time constraints.URL to the preregistered Stage 1 protocol: https://osf.io/v3wxb
Level of bias control achieved: Level 2. At least some data/evidence that will be used to answer the research question has been accessed and partially observed by the authors, but the authors certify that they have not yet observed the key variables within the data that will be used to answer the research question AND they have taken additional steps to maximise bias control and rigour.
List of eligible PCI RR-friendly journals:
References Trochet, A., Courtois, E. A., Stevens, V. M., Baguette, M., Chaine, A., Schmeller, D. S., Clobert, J., & Wiens, J. J. (2016). Evolution of sex-biased dispersal. The Quarterly Review of Biology, 91(3), 297–320. https://doi.org/10.1086/688097 Lee, V. E., & Thornton, A. (2021). Animal cognition in an urbanised world. Frontiers in Ecology and Evolution, 9, 120. https://doi.org/10.3389/fevo.2021.633947 Logan, C. J. (2016b). Behavioral flexibility in an invasive bird is independent of other behaviors. PeerJ, 4, e2215. https://doi.org/10.7717/peerj.2215 Deffner, D., Kleinow, V., & McElreath, R. (2020). Dynamic social learning in temporally and spatially variable environments. Royal Society Open Science, 7(12), 200734. https://doi.org/10.1098/rsos.200734 Breen, A. J. & Deffner D. (2022). Investigating sex differences in learning in a range-expanding bird., https://github.com/alexisbreen/Sex-differences-in-grackles-learning, in principle acceptance of version 2 by Peer Community in Registered Reports. https://osf.io/v3wxb | [WITHDRAWN]: Investigating sex differences in learning in a range-expanding bird | Alexis J. Breen & Dominik Deffner | <p style="text-align: justify;">How might differences in dispersal and learning interact in range expansion dynamics? To begin to answer this question, in this preregistration we detail the background, hypothesis plus associated predictions, and m... | | Life Sciences | Benoit Pujol | Rachel Harrison, Kate Cross, Jean-François Gerard | 2021-11-10 13:12:04 | |
14 Feb 2024
STAGE 1
Detecting DIF in Forced-Choice Assessments: A Simulation Study Examining the Effect of Model MisspecificationDeveloping differential item functioning (DIF) testing methods for use in forced-choice assessmentsRecommended by Amanda Montoya based on reviews by Timo Gnambs and 2 anonymous reviewers
Traditional Likert-type items are commonly used but can elicit response bias. An alternative approach, the forced-choice question, required respondents to rank order all items. Forced-choice questions boast some advantages but required advanced item response theory analysis to generate scores which are comparable across individuals and to evaluate the properties of those scales. However, there has been limited discussion of how to test differential item functioning (DIF) in these scales. In a previous study, Lee et al. (2021) proposed a method for testing DIF.
Here, Plantz et al. (2024) explore the implications of incorrect specification of anchors in DIF detection for forced choice items. The study proposes to use a Monte Carlo simulation which manipulates sample size, equality of sample size across groups, effect size, percentage of differentially functioning items, analysis approach, anchor set size, and percent of DIF blocks in the anchor set. This study aims to answer research questions about the type I error and power of DIF detection strategies under a variety of circumstances, both evaluating whether the results from Lee et al. (2021) generalize to misspecified models and expanding to evaluate new research questions. Results of this study will provide practical implications for DIF testing with forced-choice questions. An important limitation of the study is that it does not explore non-uniform DIF, only uniform DIF. Additionally, as with all simulation studies not all results can only apply to conditions which are simulated and so rely on the realistic selection of simulation conditions. The authors have selected conditions to match reality in circumstances where data is available, but relied on previous simulations in cases when data is not available.
This Stage 1 manuscript was evaluated over two rounds of review by two reviewers with expertise in psychometrics. An additional round of review was completed by the recommender only. Based on the merits of the original submission and responsiveness of the authors to requests from the reviewers, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
URL to the preregistered Stage 1 protocol: https://osf.io/p8awx
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA. List of eligible PCI RR-friendly journals:
References 1. Lee, P., Joo, S.-H. & Stark, S. (2021). Detecting DIF in multidimensional forced choice measures using the Thurstonian Item Response Theory Model. Organizational Research Methods, 24, 739–771. https://doi.org/10.1177/1094428120959822
2. Plantz, J. W., Brown, A., Wright, K. & Flake, J. K. (2024). Detecting DIF in Forced-Choice Assessments: A Simulation Study Examining the Effect of Model Misspecification. In principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/p8awx
| Detecting DIF in Forced-Choice Assessments: A Simulation Study Examining the Effect of Model Misspecification | Jake Plantz, Anna Brown, Keith Wright, Jessica K. Flake | <p>On a forced-choice (FC) questionnaire, the respondent must rank two or more items instead of indicating how much they agree with each of them. Research demonstrates that this format can reduce response bias. However, the data are ipsative, resu... | Social sciences | Amanda Montoya | 2023-09-06 22:43:32 | |||
21 Apr 2024
STAGE 1
Mechanisms of secularization: Testing between three causal pathwaysUnderstanding links between secularization, rationalisation and insecurityRecommended by Adrien Fillon based on reviews by Chris Chambers and 1 anonymous reviewer
What relationship can be expected between secularization, rationalisation and insecurity? While some authors argue that rationalisation reduces the willingness to belong to religious groups, others have suggested that insecurity increases this need to belong to religious groups.
In the current study, Lang and Chvaja (2024) will adjudicate between these two possibilities using an economics game in participants from two countries: US and Poland. The central question posed by the authors is whether cooperative insecurity increases the probability of joining a religious normative group. They will test the relationship between an environment (secure and insecure) and institution (which related to the norm context: religious and secular) on the probability of choosing the normative group in an experimental setting. Therefore, the study will be a quantitative analysis.
The authors included an adequate power analysis, alternatives for non-supported hypotheses, and filtering to ensure a high quality of data collection. They also undertook a pilot study to ensure the quality of the procedure and sensitivity of the analyses.
The Stage 1 manuscript was evaluated over one round of in-depth review. Based on detailed responses to reviewers’ and the recommender’s comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance.
URL to the preregistered Stage 1 protocol: https://osf.io/yzgek
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.
List of eligible PCI RR-friendly journals:
References 1.Lang, M. & Chvaja, R. (2024). Mechanisms of secularization: Testing between the rationalization and existential insecurity theories. In principle acceptance of Version 2 by Peer Community in Registered Reports. https://osf.io/yzgek
| Mechanisms of secularization: Testing between three causal pathways | Martin Lang, Radim Chvaja | <p>The study tests two competing explanations of the secularization process related to rationalizing worldviews and decreasing existential insecurity. While the former explanation argues that people are unwilling to join religious groups because o... | Social sciences | Adrien Fillon | 2023-11-22 11:17:30 |
