DIENES Zoltan
- School of Psychology, University of Sussex, Brighton, United Kingdom
- Social sciences
- administrator, recommender, manager, developer
Recommendations: 22
Reviews: 6
Areas of expertise
Professor of Psychology
website: http://www.lifesci.sussex.ac.uk/home/Zoltan_Dienes/
I joined the first Registered Reports editorial team at Cortex in 2013 (and the team for Exploratory Reports at Cortex when it was set up in 2018); and in 2019 I became an associate editor for Registered Reports for Neuroscience of Consciousness and for Royal Society Open Science.
I resigned my positions at Cortex in 2021 because of deciding to have no more dealings, as author, reviewer or editor for journals run by for-profit companies (except society journals because there is some minimal trickle down), despite the fact I felt Cortex had been involved in ground breaking work in scientific publishing.
My philosophical and practical approach to Registered Reports is described here:
Dienes, Z. (draft). The inner workings of Registered Reports. In Austin Lee Nichols & John E. Edlund (Eds), Cambridge Handbook of Research Methods and Statistics for the Social and Behavioral Sciences, https://doi.org/10.31234/osf.io/yhp2a
This is my first Registered Report seen through to publication:
Palfi, B., Parris, B. A., McLatchie, N., Kekecs, Z., & Dienes, Z. (2021). Can unconscious intentions be more effective than conscious intentions? Test of the role of metacognition in hypnotic response. Registered Report. Cortex, 135, 219-239.
https://psyarxiv.com/x982m/
I am also interested in how Bayes factors can improve scientific inferences. For an online calculator see:
http://www.lifesci.sussex.ac.uk/home/Zoltan_Dienes/inference/Bayes.htm
and a practical introduction to the issues:
Dienes, Z. (2021). How to use and report Bayesian hypothesis tests. Psychology of Consciousness: Theory, Research, and Practice, 8, 9–26
https://psyarxiv.com/bua5n/
Recommendations: 22
Managing Disclosure Outcomes in Intelligence Interviews
Managing costs and rewards when choosing to disclose information
Recommended by Zoltan Dienes based on reviews by Yikang Zhang and Tyler JacobsAn interviewee in an intelligence interview can face competing interests in disclosing information: The value in cooperating because, for example, information given leads to the arrest of a narcotics gang, making the neighbourhood safer; and the risk that disclosing the information leads to reprisals from the gang. Different pieces of information will compete with each other for disclosure, depending on this balance of risks to self-interest. According to the disclosure-outcomes management model of Neequaye et al., information will be disclosed more with a high than low probability of reward, as might be straightforwardly expected, but this difference will be larger when there is a low probability of cost rather than a high probability. The high probability of cost will induce more a variable response to the possible benefits.
Neequaye et al. (2024) invited participants to assume the role of an informant, with the goal of maximizing their points according to stated probabilities of costs and benefits of disclosing pieces of information relating to given scenarios. The degree to which each type of information was disclosed in a subsequent interview wase assessed. Perceived benefits positively influenced the likelihood of disclosing information. The crucial interaction, obtained in a Pilot study, was not significant in the pre-registered replication. The study had decent power to pick up an interaction the same size as found in the pilot, but not half the size, which would still have been interesting.
The Stage 2 manuscript was evaluated over one round of in-depth review. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 2 criteria.
URL to the preregistered Stage 1 protocol: https://osf.io/ru8j5
Level of bias control achieved: Level 6. No part of the data or evidence that was used to answer the research question was generated until after IPA.
List of eligible PCI RR-friendly journals:
- Collabra: Psychology
- F1000Research
- International Review of Social Psychology
- Peer Community Journal
- PeerJ
- Royal Society Open Science
- Social Psychological Bulletin
- Studia Psychologica
- Swiss Psychology Open
References
Neequaye, D. A., Luke, T. J., & Kollback, K. (2024). Managing Disclosure Outcomes in Intelligence Interviews [Stage 2]. Acceptance of Version 11 by Peer Community in Registered Reports. https://doi.org/10.31234/osf.io/tfp2c
11 Apr 2024
STAGE 1
Managing Disclosure Outcomes in Intelligence Interviews
Managing costs and rewards when choosing to disclose information
Recommended by Zoltan Dienes based on reviews by Jason Chin, Yikang Zhang and Tyler JacobsAn interviewee in an intelligence interview can face competing interests in disclosing information: The value in cooperating because, for example, information given leads to the arrest of a narcotics gang, making the neighbourhood safer; and the risk that disclosing the information leads to reprisals from the gang. Different pieces of information will compete with each other for disclosure, depending on this balance of risks to self-interest. According to the disclosure-outcomes management model of Neequaye et al., information will be disclosed more with a high than low probability of reward, as might be straightforwardly expected, but this difference will be larger when there is a low probability of cost rather than a high probability. The high probability of cost will induce more a variable response to the possible benefits.
Neequaye et al. (2023) will invite participants to assume the role of an informant, with the goal of maximizing their points according to stated probabilities of costs and benefits of disclosing pieces of information relating to given scenarios. Then the degree to which each type of information is disclosed in a subsequent interview will be assessed: this way the crucial interaction can be tested.
The Stage 1 manuscript was evaluated over one round of in-depth review. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
URL to the preregistered Stage 1 protocol: https://osf.io/ru8j5
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.
List of eligible PCI RR-friendly journals:
References
Neequaye, D. A., Luke, T. J., & Kollback, K. (2023). Managing Disclosure Outcomes in Intelligence Interviews, in principle acceptance of Version 2 by Peer Community in Registered Reports. https://osf.io/ru8j5
25 Mar 2024
STAGE 1
Assessing compliance with UK loot box industry self-regulation on the Apple App Store: a 6-month longitudinal study on the implementation process
Does self regulation by gaming companies for the use of loot boxes work?
Recommended by Zoltan Dienes based on reviews by Chris Chambers, Lukas J. Gunschera and Andy PrzybylskiVideo games may provide the option of spending real money in exchange for probabilistically receiving game-relevant rewards; in effect, encouraging potentially young teenagers to gamble. The industry has subscribed to a set of regulatory principles to cover the use of such "loot boxes", including 1) that they will prevent loot box purchasing by under 18s unless parental consent is given; 2) that they will make it initially clear that the game contains loot boxes; and 3) that they will clearly disclose the probabilities of receiving different rewards.
Can the industry effectively self regulate? Xiao (2024) will evaluate this important question by investigating the 100 top selling games on the Apple App Store and estimating the percentage compliance to these three regulatory principles at two time points 6 months apart.
The Stage 1 manuscript was evaluated over one round of in-depth review. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
URL to the preregistered Stage 1 protocol: https://osf.io/3knyb
Level of bias control achieved: Level 2. At least some data/evidence that will be used to answer the research question has been accessed and partially observed by the authors, but the authors certify that they have not yet observed the key variables within the data that will be used to answer the research question.
List of eligible PCI RR-friendly journals:
References
1. Xiao, L. (2024). Assessing compliance with UK loot box industry self-regulation on the Apple App Store: a 6-month longitudinal study on the implementation process. In principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/3knyb
04 Dec 2023
STAGE 1
Self-Control beyond inhibition. German Translation and Quality Assessment of the Self-Control Strategy Scale (SCSS)
Strategies for self control: German translation and evaluation of the Self Control Strategy Scale
Recommended by Zoltan Dienes based on reviews by Eleanor Miles, Kaitlyn Werner and Sebastian BürglerSelf-control has shown to be a trait related to beneficial outcomes, including health, academic achievement and relationship quality. It is mostly understood as the ability to surpress immediate urges in order to achieve long-term goals, such as not watching another episode and therefore reaching a healthy amount of sleep. An emerging perspective on self-control shows that there is broader variety in applied strategies, such as removing oneself from a tempting situation, or reminding oneself of one's long-term goal, or reinterpreting the temptation.
Katzir et al. (2021) developed a novel instrument, the Self-Control Strategy Scale, that measured the tendency to engage in eight such strategies. In the current study, Roth et al. (2023) propose to translate the scale into German and assess its psychometric properties. Further, they will determine which strategies are related to particular outcomes that may be beneficial; for example, amount of physical activity engaged in, how healthy the diet is, exam performance and life satisfaction.
The Stage 1 manuscript was evaluated over two rounds of in-depth review by the recommender and at least two expert reviewers, before issuing in-principle acceptance.
URL to the preregistered Stage 1 protocol: https://osf.io/s7qwk
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.
List of eligible PCI RR-friendly journals:
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.
List of eligible PCI RR-friendly journals:
- Addiction Research & Theory
- Advances in Cognitive Psychology
- Collabra: Psychology
- F1000Research
- Journal of Cognition
- Peer Community Journal
- PeerJ
- Royal Society Open Science
- Studia Psychologica
- Swiss Psychology Open
References
1. Katzir, M., Baldwin, M., Werner, K. M., & Hofmann, W. (2021). Moving beyond inhibition: Capturing a broader scope of the self-control construct with the Self-Control Strategy Scale (SCSS). Journal of Personality Assessment, 103, 762-776. https://doi.org/10.1080/00223891.2021.1883627
2. Roth, L. H. O., Jankowski, J., Clay, G., Meindl, D., Vogt, L.-M., Wagner, V., Nordmann, A., Stenzel, L., Freiman, O., Mlynski, C., & Job, V. (2023). Self-Control beyond inhibition. German Translation and Quality Assessment of the Self-Control Strategy Scale (SCSS). In principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/s7qwk
16 Nov 2023
STAGE 1
The effect of stimulus saliency on the modulation of pain-related ongoing neural oscillations: a Registered Report
Are there oscillatory markers of pain intensity?
Recommended by Zoltan Dienes based on reviews by Markus Ploner and Björn HoringRhythmic changes in pain can lead to corresponding modulations of EEG amplitudes in theta, alpha, and beta bands. But the question remains open as to whether these modulations are actually tracking pain, or maybe rather saliency or stimulus intensity. The question is of some importance because a marker of pain per se could be useful for tracking felt pain without a verbal response, and could be useful in investigating interventions for treating pain (such as suggestion). Here, Leu et al. (2023) will address the question of whether modulations reflect saliency or else the intensity of pain, by using an oddball paradigm in which most trials are a pain stimulus of a certain intensity, and oddball trials will sometimes occur, at either a higher intensity or a lower intensity than the baseline ones. If the modulations reflect salience, the modulation at the frequency of the oddball will be similar for high and low intensity oddballs. However, if the modulations reflect pain intensity, the modulations for the low rather than high oddball condition will be lower.
The Stage 1 manuscript was evaluated over three rounds of in-depth peer review, the first two consisting of substantial comments from two scholars with relevant expertise, and the third consisting of a close review by the recommender. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
URL to the preregistered Stage 1 protocol: https://osf.io/qbrf2
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.
List of eligible PCI RR-friendly journals:
- Advances in Cognitive Psychology
- Brain and Neuroscience Advances
- Cortex
- F1000Research
- Imaging Neuroscience
- In&Vertebrates
- NeuroImage: Reports
- Peer Community Journal
- PeerJ
- Psychology of Consciousness: Theory, Research and Practice
- Royal Society Open Science
- Studia Psychologica
References
1. Leu, C., Forest, S., Legrain, V., & Liberati, G. (2023). The effect of stimulus saliency on the modulation of pain-related ongoing neural oscillations: a Registered Report. In principle acceptance of Version 4 by Peer Community in Registered Reports. https://osf.io/qbrf2
1. Leu, C., Forest, S., Legrain, V., & Liberati, G. (2023). The effect of stimulus saliency on the modulation of pain-related ongoing neural oscillations: a Registered Report. In principle acceptance of Version 4 by Peer Community in Registered Reports. https://osf.io/qbrf2
18 Oct 2023
STAGE 1
Putting things into perspective: Which visual cues facilitate automatic extraretinal symmetry representation?
Understanding how visual cues influence extraretinal representation of planar symmetry
Recommended by Grace Edwards and Zoltan Dienes based on reviews by Tadamasa Sawada, Guillaume Rousselet, Benoit Cottereau and Deborah ApthorpVisual symmetry is critical to our interaction with our environment so that when detected, symmetry automatically produces a neural marker in the form of an Event Related Potential (ERP) called Sustained Posterior Negativity (SPN). However, when symmetry is presented to the visual system slanted away from the viewer, there is a reduction in SPN, termed a perspective cost.
Considering objects are rarely presented front-on (or frontoparallel) in our natural environment, Karakashevska et al., (2023) plan to examine the extent of the perspective cost with the addition of visual cues to facilitate extraretinal representation of the visual symmetry. The authors will record electroencephalography (EEG) from 120 participants while they perform a luminance task on symmetrical and asymmetrical stimuli. The authors hypothesize perspective cost will be reduced by three perspective cues: 1) monocular viewing, when cue conflict caused by binocular viewing is eliminated, 2) a static frame surrounding the symmetrical stimulus, adding a depth cue, and 3) a moving frame, assisting 3D perception prior to the symmetry onset. If the SPN is equivalent during frontoparallel and slanted presentation in a cue condition, the authors will conclude extraretinal representation can be automatic when sufficient visual cues are available. The proposed experiment is powered to detect a relatively small difference between perspective cue conditions. This will solidify fundamental research on visual symmetry processing and will further our understanding of object perception and recognition.
The Stage 1 manuscript was evaluated over three rounds by four expert reviewers. Following in-depth review and responses from the authors, the recommenders have determined that Stage 1 criteria was met and have awarded in-principle acceptance (IPA).
URL to the preregistered Stage 1 protocol: https://osf.io/yzsq5
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.
List of eligible PCI-RR-friendly journals:
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.
List of eligible PCI-RR-friendly journals:
References
1. Karakashevska, E., Bertamini, M. & Makin, A. D. J. (2023). Putting things into perspective: Which visual cues facilitate automatic extraretinal symmetry representation? [Stage 1 Registered Report]. In principle acceptance of Version 4 by Peer Community in Registered Reports. https://osf.io/yzsq5
15 Sep 2023
STAGE 1
Do error predictions of perceived exertion inform the level of running pleasure?
Does running pleasure result from finding it easier than you thought you would?
Recommended by Zoltan Dienes based on reviews by Jasmin Hutchinson and 1 anonymous reviewerThe reward value of a stimulus is based on an error in prediction: Things going better than predicted. Could this learning principle, often tested on short acting stimuli, also apply to a long lasting episode, like going for a run? Could how rewarding a run is be based on the run going better than predicted?
Understanding the conditions under which exercise is pleasurable could of course be relevant to tempting people to do more of it! Brevers et al. (2023) will ask people before a daily run to predict the amount of perceived exertion they will experience; then just after the run, to rate the retrospective amount of perceived exertion actually experienced. The difference between the two ratings is the prediction error.
Participants will also rate their remembered pleasure in running and the authors will investigate whether running pleasure depends on prediction error.
The study plan was refined across four rounds of review, with input from two external reviewers and the recommender, after which it was judged to satisfy the Stage 1 criteria for in-principle acceptance (IPA).
The study plan was refined across four rounds of review, with input from two external reviewers and the recommender, after which it was judged to satisfy the Stage 1 criteria for in-principle acceptance (IPA).
URL to the preregistered Stage 1 protocol: https://osf.io/xh724
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.
List of eligible PCI RR-friendly journals:
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.
List of eligible PCI RR-friendly journals:
- Communications in Kinesiology
- In&Vertebrates
- Peer Community Journal
- PeerJ
- Royal Society Open Science
- Studia Psychologica
- Swiss Psychology Open
References
1. Brevers, D., Martinent, G., Oz, I. T., Desmedt, O. & de Geus, B. (2023). Do error predictions of perceived exertion inform the level of running pleasure? In principle acceptance of Version 5 by Peer Community in Registered Reports. https://osf.io/xh724
1. Brevers, D., Martinent, G., Oz, I. T., Desmedt, O. & de Geus, B. (2023). Do error predictions of perceived exertion inform the level of running pleasure? In principle acceptance of Version 5 by Peer Community in Registered Reports. https://osf.io/xh724
How Intelligence Interviewees Mentally Identify Relevant Information
How an interviewee knows what information is key to disclose or withhold
Recommended by Zoltan Dienes based on reviews by 1 anonymous reviewerResearch on interviewing has often focused on topics (such as aiding memory of witnesses) which presume the interviewee has already correctly identified the precise information that the interviewer is really after. But how does an informant know what sort of information is asked for, a precondition for an informant to then choose to provide the information or withhold it (depending on their own interests)?
In this study, Neequaye and Lorson (2023) asked subjects to take the role of an informant about a criminal gang, with the further instructions to be cooperative or resistant in helping the interviewer obtain the information they want. In one study, the participants were asked merely to identify what information the interviewer wants. In the second study, the participants answered the interviewer's questions, disclosing whatever information they felt best suited their interest. Crucially, the level of detail of the questions was manipulated, such that the question specified a clear objective or not. Contrary to the theory, mental designation preferences indicated that interviewees generally assume interviewers wanted to know complete details, irrespective of question specificity.
The Stage 2 manuscript was evaluated over one round of in-depth review. Based on responses to the comments, the recommender judged that the manuscript met the Stage 2 criteria and therefore awarded a positive recommendation.
URL to the preregistered Stage 1 protocol: https://osf.io/82qtn
Level of bias control achieved: Level 6. No part of the data or evidence that was used to answer the research question was generated until after IPA.
List of eligible PCI RR-friendly journals:
References
1. Neequaye, D. A., & Lorson, A. (2023). How Intelligence Interviewees Mentally Identify Relevant Information [Stage 2]. Acceptance of of Version 10 by Peer Community in Registered Reports. https://doi.org/10.31234/osf.io/bpdn2
09 Jul 2023
STAGE 1
How Intelligence Interviewees Mentally Identify Relevant Information
How an interviewee knows what information is key to disclose or withhold
Recommended by Zoltan Dienes based on reviews by 2 anonymous reviewersResearch on interviewing has often focused on topics (such as aiding memory of witnesses) which presume the interviewee has already correctly identified the precise information that the interviewer is really after. But how does an informant know what sort of information is asked for, a precondition for an informant to then choose to provide the information or withhold it (depending on their own interests)?
In this study, Neequaye and Lorson will ask subjects to take the role of an informant about a criminal gang, with the further instructions to be cooperative or resistant in helping the interviewer obtain the information they want. In one study, the participants will be asked merely to identify what information the interviewer wants. In the second study, the participants will answer the interviewer's questions, disclosing whatever information they feel best suits their interest. Crucially, the level of detail of the questions will be manipulated, such that the question specifies a clear objective or not.
The Stage 1 manuscript was evaluated over three rounds of in-depth review. Based on detailed responses to the reviewers’ comments and edits to the stage 1 report, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
URL to the preregistered Stage 1 protocol: https://osf.io/82qtn
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.
List of eligible PCI RR-friendly journals:
References
1. Neequaye, D. A., & Lorson, A. (2022). How Intelligence Interviewees Mentally Identify Relevant Information, in principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/82qtn
15 Apr 2023
STAGE 1
Reconstructing Gaming Disorder: A Taxonomy by Registered Report
How can the experiences of those who engage in video games in healthy and unhealthy ways be systematically organised?
Recommended by Zoltan Dienes based on reviews by Michelle Carras, Lukas J. Gunschera and Christopher FergusonPeople are often drawn into intensive video game use in ways they or others may find troubling, harmless or even praiseworthy. Understanding these different experiences may help with integrating intensive technology use into everyday life in a healthy way.
In this programmatic submission, Karhulahti et al. (2023) will explore the gaming experiences of three groups of people (those who have sought treatment for gaming, esport players, and adolescents who play around two hours every day), using phenomenological and clinical interviews, and gaming diary logs every four months over three years. Around 200-300 participants will be recruited initially from Finland, Slovakia, and South Korea. In order to further increase cross-cultural range, the study will apply a new duplication method to collect similar data also in countries that have been studied little in the past. The aim will be to answer the questions of a) Is it possible to distinguish passionate from pathological gaming by the meanings and values that players attach to videogame play? and b) What are the design structures of videogames, which are played intensively and/or with gaming-related health problems? Ultimately, the study aims to synthesise all its data into a new taxonomic system, which can help better understand the differences and idiosyncrasies of gaming in lives across cultures.
This Stage 1 manuscript was evaluated over two rounds of in-depth review. Based on the comprehensive responses to the reviewers' feedback, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
URL to the preregistered Stage 1 protocol: https://osf.io/ekm8x
Level of bias control achieved: Level 4. At least some of the data/evidence that will be used to answer the research question already exists AND is accessible in principle to the authors (e.g. residing in a public database or with a colleague) BUT the authors certify that they have not yet accessed any part of that data/evidence
List of eligible PCI RR-friendly journals:
URL to the preregistered Stage 1 protocol: https://osf.io/ekm8x
Level of bias control achieved: Level 4. At least some of the data/evidence that will be used to answer the research question already exists AND is accessible in principle to the authors (e.g. residing in a public database or with a colleague) BUT the authors certify that they have not yet accessed any part of that data/evidence
List of eligible PCI RR-friendly journals:
References
Karhulahti, V.-M., Martončik. M., Siutila, M., Park, S., Jin, J., Adamkovič, M., Auranen, T., Na, B., & Yoon, T.-J. (2023). Reconstructing Gaming Disorder: A Taxonomy by Registered Report, in principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/ekm8x
Exploring How Members of Illicit Networks Navigate Investigative Interviews
What to say to help one's partners in crime
Recommended by Zoltan Dienes based on reviews by Lorraine HopeWhen interviewing members of a criminal network, what determines the information a given interviewee chooses to disclose, as guided by the network's collective planning? What principles could help inform a detective preparing for such interviews? In the current study, Neequaye et al. recruited groups of people known to each other to assume the role of networks that run an illegal sports betting business, fronting as a chain of tanning salons. Although each network launders money, they have to come up with a strategy to convince investigators they are legit. The groups are motivated to disclose some information when individuals are interviewed, but only enough to appear cooperative. Members disclosed information they perceived would yield benefical outcomes, but the extent to which members disclosed varied substantially according to the groups they were in.
The Stage 2 manuscript was evaluated over one round of in-depth review. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 2 criteria and awarded a positive recommendation.
URL to the preregistered Stage 1 protocol: https://osf.io/n7ugr
Level of bias control achieved: Level 6. Data collection began during the final round of Stage 1 peer review. Since no further revisions were made after this review round, the risk of bias due to prior data observation remained zero, and the manuscript therefore qualified for Level 6.
Level of bias control achieved: Level 6. Data collection began during the final round of Stage 1 peer review. Since no further revisions were made after this review round, the risk of bias due to prior data observation remained zero, and the manuscript therefore qualified for Level 6.
List of eligible PCI RR-friendly journals:
References
1. Neequaye, D. A., Granhag, P. A. & Luke, T. J. (2023). Exploring How Members of Illicit Networks Navigate Investigative Interviews. Acceptance of Version 3 by Peer Community in Registered Reports. https://doi.org/10.31234/osf.io/f3ct4
1. Neequaye, D. A., Granhag, P. A. & Luke, T. J. (2023). Exploring How Members of Illicit Networks Navigate Investigative Interviews. Acceptance of Version 3 by Peer Community in Registered Reports. https://doi.org/10.31234/osf.io/f3ct4
Causal evidence for the role of the sensory visual cortex in visual short-term memory maintenance
The visual cortex can maintain information for up to a second
Recommended by Zoltan Dienes based on reviews by Evie Vergauwe and Vincent van de VenAccording to the sensory recruitment framework, the visual cortex is at least in part responsible for maintaining information about elementary visual features in visual short term memory. Could an early visual area, constantly taking in new information, really be responsible for holding information for up to a second? But conversely, could higher order regions, such as frontal regions, really hold subtle sensory distinctions? It must be done somewhere. Yet the existing evidence is conflicting. Phylactou et al. addressed this question by applying transcranial magnetic stimulation (TMS) to disrupt early visual areas at intervals up to a second after stimulus presentation to determine the effect on visual short term memory performance. In this way, they causally influenced the sensory cortex at relevant times while tightening up on possible confounds in earlier research.
They found that TMS applied to the occipital hemisphere at each of 200ms and 1000ms after presentation of a brief visual stimulus disrupted stimuls detection on a visual short term memory test. These findings support sensory recruitment, which claims that both perceptual and memory processes rely on the same neural substrates in the visual cortex.
The Stage 2 manuscript was evaluated by two expert reviewers. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 2 criteria for recommendation.
URL to the preregistered Stage 1 protocol: https://osf.io/empdt
Level of bias control achieved: Level 6. No part of the data or evidence that was used to answer the research question was generated until after Stage 1 IPA.
List of eligible PCI RR-friendly journals:
- Advances in Cognitive Psychology
- F1000Research
- In&Vertebrates
- Peer Community Journal
- PeerJ
- Psychology of Consciousness: Theory, Research and Practice
- Royal Society Open Science
References
1. Phylactou, P., Shimi, A. & Konstantinou, N. (2023). Causal evidence for the role of the sensory visual cortex in visual short-term memory maintenance, acceptance of Version 13 by Peer Community in Registered Reports. https://doi.org/10.31234/osf.io/64hdx
The labels and models used to describe problematic substance use impact discrete elements of stigma: A Registered Report
Different ways of describing problematic substance use and its treatment influence public stigma
Recommended by Zoltan Dienes based on reviews by Nicholas Sinclair-HousePeople experiencing problematic substance use are often stigmatised by the general public. This public stigma may impair such people obtaining help and the quality of help that they receive. For this reason, previous research has investigated the factors that may exacerbate or lessen stigma by focusing on the terminology used to describe problematic substance use. However, the evidence is not clear cut, with some studies suggesting that labelling the condition as a "chronically relapsing brain disease" vs a "problem" reduces certain elements of stigma and other studies finding absence of evidence. A closer look at these studies points to methodological differences that may explain their results, such as whether problematic substance use is compared with another health condition, whether the individual is described as seeking treatment or not, and whether general or discrete elements of stigma are measured.
In this Stage 2 Registered Report, Pennington et al. (2023) isolated these methodological differences to investigate if any of them influenced two different measures of stigma used in previous work. They found that greater social distance, danger and public stigma but lower blame were ascribed to drug use relative to a health concern, supporting previous research to suggest that problematic substance use is a highly stigmatised health condition. Furthermore, greater (genetic) blame was reported when drug use was labelled as a ‘chronically relapsing brain disease’ relative to a ‘problem’. The results for attributional judgement were either inconclusive or statistically equivalent. In summary, these findings suggest that the labels and models used to describe problematic substance use may impact upon public stigma in distinct ways. The authors suggest that future research should justify which measures are being used in line with theory. They also put forward the notion that addiction is a functional attribution, which may explain the mixed literature on the brain disease model of addiction to date.
The Stage 2 manuscript was evaluated over one round of specialist review and several rounds of discussion with the recommender. Based on comprehensive responses, the recommender judged that the manuscript met the Stage 2 criteria and awarded a positive recommendation.
URL to the preregistered Stage 1 protocol: https://osf.io/4vscg
Level of bias control achieved: Level 6. No part of the data or evidence that was used to answer the research question was generated until after IPA.
List of eligible PCI RR-friendly journals:
References
Pennington, C. R., Monk, R. L., Heim, D., Rose, A. K., Gough, T., Clarke, R., Knibb, G., Patel, R., Rai, P., Ravat, H., Ali, R., Anastasiou, G., Asgari, F., Bate, E., Bourke, T., Boyles, J., Campbell, A., Fowler, N., Hester, S., Neil, C., McIntrye, B., Ogilvy, E., Renouf, A., Stafford, J., Toothill, K., Wong, H. K., & Jones, A. (2023). The labels and models used to describe problematic substance use impact discrete elements of stigma: A Registered Report. Stage 2 acceptance of Version 4 by Peer Community in Registered Reports. https://osf.io/z9bnf
No reliable effect of task-irrelevant cross-modal statistical regularities on distractor suppression
Failure to learn cross-modally to suppress distractors
Recommended by Zoltan Dienes based on reviews by Miguel Vadillo and 1 anonymous reviewerThere are two fundamental processes that the brain engages in: statistical learning and selection. Indeed, past work has shown these processes often come together: People can use a task-irrelevant stimulus to predict a target stimulus even in different modalities (crossmodal statistical learning), thereby enhancing the processing of the target stimulus (selection). Further, people can learn where a distractor will be in order to efficiently suppress it (selecting out), using task irrelevant stimuli in the same modality (within-modality statistical learning).
In two experiments Jagini and Sunny found that people did not learn to use a task-irrelevant stimulus from a different modality (cross modal statistical learning) to suppress a distractor (selecting out). They also found that people had little awareness of the relation between the predictor task-irrelevant stimulus and the location of the distractor. The results may reflect limits on what can be achieved unconsciously.
In two experiments Jagini and Sunny found that people did not learn to use a task-irrelevant stimulus from a different modality (cross modal statistical learning) to suppress a distractor (selecting out). They also found that people had little awareness of the relation between the predictor task-irrelevant stimulus and the location of the distractor. The results may reflect limits on what can be achieved unconsciously.
Following peer review, the recommender judged that the manuscript met the Stage 2 criteria and awarded a positive recommendation.
URL to the preregistered Stage 1 protocol: https://osf.io/qjbmg
Level of bias control achieved: Level 6. No part of the data or evidence that was used to answer the research question existed prior to Stage 1 in-principle acceptance.
List of eligible PCI RR-friendly journals:
Level of bias control achieved: Level 6. No part of the data or evidence that was used to answer the research question existed prior to Stage 1 in-principle acceptance.
List of eligible PCI RR-friendly journals:
- Advances in Cognitive Psychology
- Cortex
- Experimental Psychology
- In&Vertebrates
- Journal of Cognition
- Peer Community Journal
- PeerJ
- Psychology of Consciousness: Theory, Research and Practice
- Royal Society Open Science
- Swiss Psychology Open
References
1. Jagini, K. K. & Sunny, M. M. (2023). No reliable effect of task-irrelevant cross-modal statistical regularities on distractor suppression. Stage 2 Registered Report, acceptance of Version 4 by Peer Community in Registered Reports. https://doi.org/10.31234/osf.io/d8wes
17 Jan 2023
STAGE 1
How long does it take to form a habit?: A Multi-Centre Replication
How much practice is needed before daily actions are performed in a way that feels habitual?
Recommended by Zoltan Dienes based on reviews by Benjamin Gardner, Wendy Wood and Adam TakacsEven small changes in daily life can have a significant impact on one’s health, for example going to the gym at regular times and eating a healthy breakfast. But how long must we do something before it becomes a habit? Lally et al. (2010) tracked the subjective automaticity of a novel, daily (eating or exercise-related) routine. Based on 39 participants, they found a median time of 66 days. This estimate has never been replicated with their exact procedure, so the question remains of how well this holds up. Yet the estimate is useful for knowing how long we have to effortfully make ourselves perform an action until we will do it automatically.
In the current study, de Wit et al. (2023) propose a four-centre near-exact replication of Lally et al. (2010), for which they aim to test 800 subjects to provide a precise estimate of the time it takes to form a habit.
The Stage 1 manuscript was evaluated over four rounds of review. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
URL to the preregistered Stage 1 protocol: https://osf.io/bj9r2
URL to the preregistered Stage 1 protocol: https://osf.io/bj9r2
Level of bias control achieved: Level 4. At least some of the data/evidence that will be used to answer the research question already exists AND is accessible in principle to the authors (e.g. residing in a public database or with a colleague), BUT the authors certify that they have not yet accessed any part of that data/evidence.
List of eligible PCI RR-friendly journals:
- Advances in Methods and Practices in Psychological Science
- F1000Research
- Meta-Psychology
- Peer Community Journal
- PeerJ
- Psychology of Consciousness: Theory, Research, and Practice
- Royal Society Open Science
- Swiss Psychology Open
References
1. Lally, P., van Jaarsveld, C. H. M., Potts, H. W. W., & Wardle, J. (2010). How are habits formed: Modelling habit formation in the real world. European Journal of Social Psychology, 40, 998–1009. https://doi.org/10.1002/ejsp.674
2. de Wit, S., Bieleke, M., Fletcher, P. C., Horstmann, A., Schüler, J., Brinkhof, L. P., Gunschera, L. J., AND Murre, J. M. J. (2023). How long does it take to form a habit?: A Multi-Centre Replication, in principle acceptance of Version 4 by Peer Community in Registered Reports. https://osf.io/bj9r2
Removing barriers to plant-based diets: assisting doctors with vegan patients
Informing doctors of the evidence on plant-based diets
Recommended by Zoltan Dienes based on reviews by Alaa Aldoh, Joshua Tasoff and Bence PalfiWhat the best diet is has always been an area of contention. But one thing is clear: Meat is not necessary for health or fitness, and a diet high in plant proteins may well be especially healthy (e.g. Herpich et al., 2022). Further, plant- rather than animal-based diets leave a lower carbon footprint. So what might hold people back from adopting a plant-based diet? One reason is that people may understandably approach their doctor for advice; and the doctor may advise against it, given that many doctors are not well trained in nutrition (Crowley et al., 2019).
Espinosa et al. (2022) conducted a randomised control trial on French general practitioners with 200 doctors given a leaflet and access to an online platform, and 200 controls. The information in the materials concerned the health benefits of plant-based diets, and what nutrients (e.g. B12) may be deficient and what may not be. Attitudes towards and knowledge about plant-based diets was assessed. On a scale of 0-100% expressing whether they would advise for or against (0 = not at all, 100 = absolutely), the intervention shifted attitudes making them more positive about plant based diets by 17 percentage points. However, knowledge of specifically what is worth testing for (e.g. is zinc deficiency more probable or not?) did not change much. The research shows just what can be achieved by a small leaflet (shifting attitudes) and what may require more extensive training (knowledge of relevant medical practice).
The Stage 2 manuscript was evaluated over one round of in-depth review. Based on the responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 2 criteria and awarded a positive recommendation.
URL to the preregistered Stage 1 protocol: https://osf.io/fc9gp
Level of bias control achieved: Level 6. No part of the data or evidence that was used to answer the research question existed prior to Stage 1 in-principle acceptance.
List of eligible PCI RR-friendly journals:
References
1. Crowley, J., Ball, L. & Hiddink, G. J. (2019.) Nutrition in medical education: a systematic review. Lancet Planetary Health. 3, e379–e389. https://doi.org/10.1016/S2542-5196(19)30171-8
2. Herpich, C., Müller-Werdan, U., & Norman, K. (2022). Role of plant-based diets in promoting health and longevity. Maturitas, 165, 47-51. https://doi.org/10.1016/j.maturitas.2022.07.003
3. Espinosa, R., Arpinon, T., Maginot, P., Demange, S. & Peureux, F. (2022). Removing barriers to plant-based diets: assisting doctors with vegan patients, acceptance of Version 2 by Peer Community in Registered Reports. https://osf.io/kq6eh?view_only=66eab29c7acb4aebbcec4631cbcb9217
17 Nov 2022
STAGE 1
Removing barriers to plant-based diets: assisting doctors with vegan patients
Stage 1 acceptance (IPA)
Recommended by Zoltan Dienes based on reviews by Joshua Tasoff, Bence Palfi and Alaa AldohThank you for your careful response to the points of myself and the reviewers. I am now happy to award in principle acceptance (IPA). As requested, your submission is being awarded a private Stage 1 acceptance, which will not appear yet on the PCI RR website. Your Stage 1 manuscript has also been registered under the requested 4-year private embargo on the OSF (link below).
URL to the preregistered Stage 1 protocol: https://osf.io/fc9gp
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.
List of eligible PCI RR-friendly journals:
06 Jun 2022
STAGE 1
Causal evidence for the role of the sensory visual cortex in visual short-term memory maintenance
Can the visual cortex maintain information in the short term?
Recommended by Zoltan Dienes based on reviews by Robert McIntosh, Evie Vergauwe and Vincent van de VenAccording to the sensory recruitment framework, the visual cortex is at least in part responsible for maintaining information about elementary visual features in visual short term memory. Could an early visual area, constantly taking in new information, really be responsible for holding information for up to a second? But conversely, could higher order regions, such as frontal regions, really hold subtle sensory distinctions? It must be done somewhere. Yet the existing evidence is conflicting. Phylactou et al. seek to address this question by applying transcranial magnetic stimulation (TMS) to disrupt early visual areas at intervals up to a second after stimulus presentation to determine the effect on visual short term memory performance. In this way they will causally influence the sensory cortex at relevant times while tightening up on possible confounds in earlier research.
The Stage 1 manuscript was evaluated over two rounds of in-depth review by three expert reviewers. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
URL to the preregistered Stage 1 protocol: https://osf.io/empdt
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.
List of eligible PCI RR-friendly journals:
- Advances in Cognitive Psychology
- F1000Research
- In&Vertebrates
- Peer Community Journal
- PeerJ
- Psychology of Consciousness: Theory, Research and Practice
- Royal Society Open Science
References
1. Phylactou, P., Shimi, A. & Konstantinou, N. (2022). Causal evidence for the role of the sensory visual cortex in visual short-term memory maintenance, in principle acceptance of Version 5 by Peer Community in Registered Reports. https://osf.io/empdt
02 Jun 2022
STAGE 1
Exploring How Members of Illicit Networks Navigate Investigative Interviews
What to say to help one's partners in crime
Recommended by Zoltan Dienes based on reviews by Tom Ormerod and Lorraine HopeWhen interviewing members of a criminal network, what determines what information a given interviewee chooses to disclose, as guided by the network's collective planning? What principles could help inform a detective preparing for such interviews? In the current study, Neequaye et al. will recruit groups of people known to each other to assume the role of networks that run an illegal sports betting business, fronting as a chain of tanning salons. Although each network launders money, they have to come up with a strategy to convince investigators they are legit. The groups are motivated to disclose some information when individuals are interviewed, but only enough to appear cooperative. The relation of the amount of different sorts of information disclosed depending on estimated risks and benefits for the group will be tested.
The Stage 1 manuscript was evaluated over two rounds of in-depth review by two expert reviewers. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
URL to the preregistered Stage 1 protocol: https://osf.io/n7ugr
Level of bias control achieved: Level 6. Data collection began during the final round of Stage 1 peer review. Since no further revisions were made after this review round, the risk of bias due to prior data observation remains zero, and the manuscript therefore qualifies for Level 6.
Level of bias control achieved: Level 6. Data collection began during the final round of Stage 1 peer review. Since no further revisions were made after this review round, the risk of bias due to prior data observation remains zero, and the manuscript therefore qualifies for Level 6.
List of eligible PCI RR-friendly journals:
References
1. Neequaye, D. A., Granhag, P. A. & Luke, T. J. (2022). Exploring How Members of Illicit Networks Navigate Investigative Interviews, in principle acceptance of Version 4 by Peer Community in Registered Reports. https://osf.io/n7ugr
1. Neequaye, D. A., Granhag, P. A. & Luke, T. J. (2022). Exploring How Members of Illicit Networks Navigate Investigative Interviews, in principle acceptance of Version 4 by Peer Community in Registered Reports. https://osf.io/n7ugr
26 Apr 2022
STAGE 1
Do task-irrelevant cross-modal statistical regularities induce distractor suppression in visual search?
Learning cross-modally to suppress distractors
Recommended by Zoltan Dienes based on reviews by Miguel Vadillo and 1 anonymous reviewerThere are two fundamental processes that the brain engages in: statistical learning and selection. Indeed, past work has shown these processes often come together: People can use a task-irrelevant stimulus to predict a target stimulus even in different modalities (crossmodal statistical learning), thereby enhancing the processing of the target stimulus (selection). Further, people can learn where a distractor will be in order to efficiently suppress it (selecting out), using task irrelevant stimuli in the same modality (within-modality statistical learning).
In the current study, Jagini and Sunny will test whether people can learn where a distractor stimulus is, in order to suppress it (selecting out), using a task-irrelevant stimulus from a different modality (cross modal statistical learning). They will also test whether people can express awareness of the relation between the predictor task-irrelevant stimulus and the location of the distractor on a forced choice test. On some (but not other) theories of consciousness, such a test measures conscious knowledge of the association.
The Stage 1 manuscript was evaluated over two rounds of in-depth review. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
URL to the preregistered Stage 1 protocol: https://osf.io/qjbmg
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.
List of eligible PCI RR-friendly journals:
- Advances in Cognitive Psychology
- Cortex
- Experimental Psychology
- In&Vertebrates
- Journal of Cognition
- Peer Community Journal
- PeerJ
- Psychology of Consciousness: Theory, Research and Practice
- Royal Society Open Science
- Swiss Psychology Open
References
1. Jagini, K. K. & Sunny, M. M. (2022). Do task-irrelevant cross-modal statistical regularities induce distractor suppression in visual search? Stage 1 Registered Report, in principle acceptance of Version 4 by Peer Community in Registered Reports. https://osf.io/qjbmg
08 Feb 2022
STAGE 1
Arithmetic deficits in Parkinson's Disease? A registered report
Getting the numbers right in Parkinson's disease?
Recommended by Zoltan Dienes based on reviews by Pia Rotshtein, Ann Dowker, Stephanie Rossit and 1 anonymous reviewerEveryday life, including for patients taking different types of medicine, involves dealing with numbers. Even though Parkinson's disease may ordinarily be thought of as primarily being a motor disorder, there is evidence that numerical abilities decline as Parkinson's disease progresses. Further, the brain areas involved in arithmetic operations overlap with the areas that degenerate in Parkinson's disease.
In this Stage 1 Registered Report, Loenneker et al. (2022) will test healthy controls, Parkinson disease patients with normal cognition, and Parkinson disease patients with mild cognitive impairment on general working memory tasks as well as arithmetic performance on the four basic operations (addition, subtraction, multiplication, division). The study aims to test whether or not there is a deficit in each operation, and the relation of any deficits to general working memory capacity.
The Stage 1 manuscript was evaluated over four rounds of review (including two rounds of in-depth specialist review). Based on comprehensive responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
URL to the preregistered Stage 1 protocol: https://osf.io/nb5fj
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.
List of eligible PCI RR-friendly journals:
- Advances in Cognitive Psychology
- Brain and Neuroscience Advances
- Cortex
- Peer Community Journal
- PeerJ
- Royal Society Open Science
- Swiss Psychology Open
References
Loenneker, H. D., Liepelt-Scarfone, I., Willmes, K., Nuerk, H.-C., & Artemenko, C. (2022). Arithmetic deficits in Parkinson’s Disease? A Registered Report. Stage 1 preregistration, in principle acceptance of version 4 by Peer Community in Registered Reports. https://osf.io/nb5fj
25 Jan 2022
STAGE 1
To help or hinder: Do the labels and models used to describe problematic substance use influence public stigma?
Understanding the role of health condition, aetiological labels, and attributional judgements in public stigma toward problematic substance use
Recommended by Zoltan Dienes based on reviews by Nicholas Sinclair-House and Roger Giner-SorollaPeople suffering from substance misuse problems are often stigmatised. Such public stigma may impair such people obtaining help and the quality of help that they receive. For this reason, previous research has investigated the factors that may reduce stigma. Evidence has been found, but not consistently, for the claim that labelling the condition as "chronically relapsing brain disease" vs a "problem" reduces stigma; as does "a health concern" vs " drug use". Another potentially relevant difference that may explain different previous results is describing how effective treatment can be.
In this Stage 1 Registered Report, Pennington et al. (2022) describe how they will investigate if any of these factors affect two different measures of stigma used in previous work, with a study well powered for testing whether the 99% CI lies outside or inside an equivalence region. While the CI being outside the region will straightforwardly justify concluding an effect of interest, a CI within the region will need to be interpreted with due regard to the fact that some effects within the region may be interesting.
The Stage 1 manuscript was evaluated over two rounds of review (including one round of in-depth specialist review). Based on comprehensive responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
URL to the preregistered Stage 1 protocol: https://osf.io/4vscg
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.
List of eligible PCI RR-friendly journals:
- Addiction Research & Theory
- Advances in Cognitive Psychology
- F1000Research
- Journal of Cognition
- Peer Community Journal
- PeerJ
- Royal Society Open Science
- Swiss Psychology Open
References
Pennington, C. R., Monk, R. L., Heim, D., Rose, A. K., Gough, T., Clarke, R., Knibb, G., & Jones, A. (2022). To help or hinder: Do the labels and models used to describe problematic substance use influence public stigma? Stage 1 preregistration, in principle acceptance of version 2 by Peer Community in Registered Reports. https://osf.io/4vscg
Reviews: 6
Cue-based modulation of pain stimulus expectation: do ongoing oscillations reflect changes in pain perception? A Registered Report
Understanding oscillatory correlates of pain expectation
Recommended by Gemma Learmonth based on reviews by Zoltan Dienes, Chris Chambers and Markus PlonerRecent studies using an EEG frequency tagging approach have reported modulations of alpha, beta and theta bands at the stimulation frequency during nociceptive/painful thermal stimulation compared to non-nociceptive/non-painful vibrotactile stimulation. Prior expectations of the intensity of upcoming painful stimuli are known to strongly modulate the subjective experience of those stimuli. Thus, modulating the expectation of pain should result in a change in the modulation of oscillations if these factors are indeed linked.
In this study, Leu, Glineur and Liberati modulated expectations of pain (low or high intensity) in 40 participants prior to delivering thermal cutaneous stimulation (low, medium or high intensity). They recorded how intense participants expected the pain to be, and how intense they felt it to be, as well as EEG to assess oscillatory differences across the expectation and intensity conditions.
The results confirmed that there was a strong effect of expectation on the perceived stimulus intensity. However, contrary to the hypotheses, this was not reflected in the cortical oscillations. Overall this indicates a possible dissociation between perceived pain and modulation of ongoing oscillations in the theta, alpha and beta bands.
The Stage 2 manuscript was evaluated over one round of in-depth review. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 2 criteria and awarded a positive recommendation.
URL to the preregistered Stage 1 protocol: https://osf.io/y6fb8
Level of bias control achieved: Level 6. No part of the data or evidence that was used to answer the research question was generated until after IPA.
List of eligible PCI RR-friendly journals:
Level of bias control achieved: Level 6. No part of the data or evidence that was used to answer the research question was generated until after IPA.
List of eligible PCI RR-friendly journals:
References
1. Leu, C., Glineur, E. & Liberati, G. (2023). Cue-based modulation of pain stimulus expectation: do ongoing oscillations reflect changes in pain perception? [Stage 2] Acceptance of Version 2 by Peer Community in Registered Reports. https://osf.io/awrge
1. Leu, C., Glineur, E. & Liberati, G. (2023). Cue-based modulation of pain stimulus expectation: do ongoing oscillations reflect changes in pain perception? [Stage 2] Acceptance of Version 2 by Peer Community in Registered Reports. https://osf.io/awrge
14 Aug 2023
STAGE 1
Cue-based modulation of pain stimulus expectation: do ongoing oscillations reflect changes in pain perception?
Understanding oscillatory correlates of pain expectation
Recommended by Gemma Learmonth based on reviews by Zoltan Dienes, Chris Chambers and Markus PlonerRecent studies using an EEG frequency tagging approach have reported modulations of alpha, beta and theta bands at the stimulation frequency during nociceptive/painful thermal stimulation compared to non-nociceptive/non-painful vibrotactile stimulation. Prior expectations of the intensity of upcoming painful stimuli are known to strongly modulate the subjective experience of those stimuli. Thus, modulating the expectation of pain should result in a change in the modulation of oscillations if these factors are indeed linked.
In this study, Leu, Glineur and Liberati will modulate expectations of pain (low or high intensity) prior to delivering thermal cutaneous stimulation (low, medium or high intensity). They will record how intense participants expect the pain to be, and how intense they felt it to be, as well as record EEG to assess oscillatory differences across the expectation and intensity conditions.
The Stage 1 manuscript was reviewed over 5 rounds by 3 reviewers. Based on detailed responses to the reviewers’ comments and edits to the Stage 1 report, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance.
URL to the preregistered Stage 1 protocol: https://osf.io/y6fb8
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.
List of eligible PCI RR-friendly journals:
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.
List of eligible PCI RR-friendly journals:
References
1. Leu, C., Glineur, E. & Liberati, G. (2023). Cue-based modulation of pain stimulus expectation: do ongoing oscillations reflect changes in pain perception? In principle acceptance of Version 5 by Peer Community in Registered Reports. https://osf.io/y6fb8
1. Leu, C., Glineur, E. & Liberati, G. (2023). Cue-based modulation of pain stimulus expectation: do ongoing oscillations reflect changes in pain perception? In principle acceptance of Version 5 by Peer Community in Registered Reports. https://osf.io/y6fb8
25 Jun 2023
STAGE 1
Cortical plasticity of the tactile mirror system in borderline personality disorder
Is borderline personality disorder linked to impairment of the tactile mirror system?
Recommended by Chris Chambers based on reviews by Zoltan Dienes and 2 anonymous reviewersBorderline personality disorder (BPD) is a mental illness affecting ~1 in 100 people (Ellison et al., 2018), characterised by emotional dysregulation, impulsivity, a distorted sense of self, and a long-term pattern of unstable interpersonal relationships. Among this heterogenous range of symptoms is difficulty in the cognitive dimension of empathy, in particular understanding the perspectives of others, which in turn has been suggested to rely on the mirror neuron system, both in the motor and somatosensory domains. The integrity of the mirror system has therefore been a focus for understanding the possible causes or consequences of the disorder, with preliminary studies pointing to hypoactivity of neuronal areas associated with the mirror system in BPD (Mier et al., 2013).
In the current study, Zazio et al. (2023) will use crossmodal paired associative stimulation (cm-PAS) in which an image of a hand being touched is repeatedly paired with transcranial magnetic stimulation (TMS) of the primary somatosensory cortex (S1) to test the hypothesis that BPD is associated with a specific deficit in the tactile mirror system. In healthy controls, the close temporal coupling (20ms) between the visual depiction of tactile stimulation and TMS of S1 is expected boost tactile acuity and elevate the performance cost of incongruence in a task that manipulates visuo-tactile spatial congruity (VTSC) – effects that are thought to reflect the fidelity of the tactile mirror system.
In BPD patients, however, the authors make the crucial prediction that impairment of the tactile mirror system (if present) will lead to a reduced (or even non-existent) effect of cm-PAS on tactile acuity and VTSC task performance compared to healthy controls. To help ensure a severe test of this hypothesis, the design includes a variety of controls, including an attention check, control cm-PAS in which the inter-stimulus interval is increased to 100ms to break the close temporal coupling between visual stimulation and TMS, and a positive control to confirm that active cm-PAS (compared to control cm-PAS) produces the expected boost in tactile acuity in healthy controls.
The Stage 1 manuscript was evaluated over three rounds of in-depth review. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
URL to the preregistered Stage 1 protocol: https://osf.io/ge2rm
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.
List of eligible PCI RR-friendly journals:
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.
List of eligible PCI RR-friendly journals:
- Advances in Cognitive Psychology
- Brain and Neuroscience Advances
- Cortex
- Imaging Neuroscience
- In&Vertebrates
- NeuroImage: Reports
- Peer Community Journal
- PeerJ
- Royal Society Open Science
References
1. Ellison, W. D., Rosenstein, L. K., Morgan, T. A., & Zimmerman, M. (2018). Community and clinical epidemiology of borderline personality disorder. Psychiatric Clinics, 41, 561-573. https://doi.org/10.1016/j.psc.2018.07.008
2. Mier, D., Lis, S., Esslinger, C., Sauer, C., Hagenhoff, M., Ulferts, J., Gallhofer, B. & Kirsch, P. (2013). Neuronal correlates of social cognition in borderline personality disorder. Social Cognitive and Affective Neuroscience, 8, 531-537. https://doi.org/10.1093/scan/nss028
2. Zazio, A., Guidali, G., Rossi, R., Bolognini, N. & Bortoletto, A. (2023). Cortical plasticity of the tactile mirror system in borderline personality disorder, in principle acceptance of Version 4 by Peer Community in Registered Reports. https://osf.io/ge2rm
Does childhood adversity alter opioid drug reward? A conceptual replication in outpatients before surgery
Is childhood adversity associated with a heightened response to opioids?
Recommended by Chris Chambers based on reviews by Zoltan Dienes, Yuki Yamada and 1 anonymous reviewerA convergence of evidence suggests that early life adversity may cause dysfunction in opioid-sensitive reward systems. Childhood adversity is associated with opioid use, potentially by altering reward and motivation networks, and experimental models in animals have found that early life adversity increases and consolidates opioid seeking behaviours. Further, in a recent controlled experiment, Carlyle et al. (2021) found that opioid administration produced stronger positive responses, and weaker negative responses, in adults with a history of childhood abuse and neglect.
In the current study, Carlyle et al. (2023) tested the generalisability of these previous findings in a pre-operative clinical setting. Using partially observed data from an existing cohort study (N=155), the authors asked whether patients with greater experience of childhood trauma in turn exhibit a larger mood boost and express greater subjective pleasure following opioid administration.
In contrast to previous findings, the results did not support the hypotheses that more experiences of childhood adversity would heighten ratings of drug liking and feeling good following opioid administration. Regression analyses instead revealed a statistically significant negative association between childhood adversity and post-opioid liking and no significant relationship with feeling good. The authors suggest that the discrepancy between the current and previous results may be due to stress related to the pre-surgical setting, the brief duration of drug exposure, and the relatively limited levels of high childhood adversity in the study sample. Nevertheless, these findings cast some doubt on the theory that adversity elevates risk of opioid addiction by altering sensitivity to subjectively pleasurable effects.
Following one round of in-depth review, the recommender judged that the manuscript met the Stage 2 criteria and awarded a positive recommendation.
URL to the preregistered Stage 1 protocol: https://osf.io/7ymts
Level of bias control achieved: Level 2. At least some data/evidence that was used to answer the research question had been accessed and partially observed by the authors prior to IPA, but the authors certify that they had not yet observed the key variables within the data that were used to answer the research question AND they took additional steps to maximise bias control and rigour.
URL to the preregistered Stage 1 protocol: https://osf.io/7ymts
Level of bias control achieved: Level 2. At least some data/evidence that was used to answer the research question had been accessed and partially observed by the authors prior to IPA, but the authors certify that they had not yet observed the key variables within the data that were used to answer the research question AND they took additional steps to maximise bias control and rigour.
List of eligible PCI RR-friendly journals:
- Addiction Research & Theory
- Cortex
- In&Vertebrates
- Infant and Child Development
- Peer Community Journal
- PeerJ
- Royal Society Open Science
- Swiss Psychology Open
References
1. Carlyle M., Broomby R., Simpson G., Hannon R., Fawaz L., Mollaahmetoglu O.M., Drain, J., Mostazir, M., & Morgan C. (2021). A randomised, double‐blind study investigating the relationship between early childhood trauma and the rewarding effects of morphine. Addiction Biology, 26(6):e13047. https://doi.org/10.1111/adb.13047
2. Carlyle, M., Kvande, M., Meier, I. M., Trøstheim, M., Buen, K., Jensen, E. N., Ernst, G. & Leknes, S. & Eikemo, M. (2023). Does childhood adversity alter opioid drug reward? A conceptual replication in outpatients before surgery, acceptance of Version 2 by Peer Community in Registered Reports. https://osf.io/9kt3a?view_only=4238d2ee3d654c4f908a94efea82a027
07 Apr 2023
STAGE 1
The WEIRD problem in a “non-WEIRD” context: A meta-research on the representativeness of human subjects in Chinese psychological research
How well do "non-WEIRD" participants in multi-lab studies represent their local population?
Recommended by Yuki Yamada based on reviews by Zoltan Dienes, Patrick Forscher and Kai HiraishiIn this protocol, Yue et al. (2023) aim to clarify whether the sample of non-WEIRD countries included in multi-lab studies is actually representative of those countries and cultures. Focusing on China, this study will compare Chinese samples in several multi-lab studies with participants in studies published in leading national Chinese journals on various aspects, including demographic data and geographic information. This work will provide useful information on the extent to which multi-lab studies are able to deal with generalizability, especially as they intend to address the generalizability problem.
The Stage 1 manuscript was reviewed by three experts, including two with an interest in the WEIRD problem and a wealth of experience in open science and multi-lab research, plus an expert in Bayesian statistics, which this manuscript uses. Following multilpe rounds of peer review, and based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
URL to the preregistered Stage 1 protocol: https://osf.io/ehw54
URL to the preregistered Stage 1 protocol: https://osf.io/ehw54
Level of bias control achieved: Level 4. At least some of the data/evidence that will be used to answer the research question already exists AND is accessible in principle to the authors (e.g. residing in a public database or with a colleague) BUT the authors certify that they have not yet accessed any part of that data/evidence.
List of eligible PCI RR-friendly journals:
- Advances in Methods and Practices in Psychological Science
- F1000Research
- Peer Community Journal
- PeerJ
- Royal Society Open Science
- Swiss Psychology Open
References
Yue, L., Zuo, X.-N., & Hu, C.-P. (2023) The WEIRD problem in a “non-WEIRD” context: A meta-research on the representativeness of human subjects in Chinese psychological research, in principle acceptance of Version 7 by Peer Community in Registered Reports. https://osf.io/ehw54
Yue, L., Zuo, X.-N., & Hu, C.-P. (2023) The WEIRD problem in a “non-WEIRD” context: A meta-research on the representativeness of human subjects in Chinese psychological research, in principle acceptance of Version 7 by Peer Community in Registered Reports. https://osf.io/ehw54
24 Oct 2022
STAGE 1
Does childhood adversity alter opioid drug reward? A conceptual replication in outpatients before surgery
Is childhood adversity associated with a heightened response to opioids?
Recommended by Chris Chambers based on reviews by Zoltan Dienes, Yuki Yamada and 1 anonymous reviewerA convergence of evidence suggests that early life adversity may cause dysfunction in opioid-sensitive reward systems. Childhood adversity is associated with opioid use, potentially by altering reward and motivation networks, and experimental models in animals have found that early life adversity increases and consolidates opioid seeking behaviours. Further, in a recent controlled experiment, Carlyle et al. (2021) found that opioid administration produced stronger positive responses, and weaker negative responses, in adults with a history of childhood abuse and neglect.
In the current study, Carlyle et al. seek to test the generalisability of these previous findings in a pre-operative clinical setting. Using partially observed data from an existing cohort study (N=155), the authors will test whether patients with greater experience of childhood trauma in turn exhibit a larger mood boost and express greater subjective pleasure following opioid administration. Although not a randomised experimental design, this study provides the opportunity to examine the relationship between opioid response and history of childhood adversity in a naturalistic setting, and thus has the potential to either support or cast doubt on the theory that adversity elevates risk of opioid addiction by altering sensitivity to subjectively pleasurable effects.
Following three rounds of in-depth review, the recommender judged that the manuscript met the Stage 1 criteria and awarded in-principle acceptance (IPA).
URL to the preregistered Stage 1 protocol: https://osf.io/7ymts
Level of bias control achieved: Level 2. At least some data/evidence that will be used to answer the research question has been accessed and partially observed by the authors, but the authors certify that they have not yet observed the key variables within the data that will be used to answer the research question AND they have taken additional steps to maximise bias control and rigour.
URL to the preregistered Stage 1 protocol: https://osf.io/7ymts
Level of bias control achieved: Level 2. At least some data/evidence that will be used to answer the research question has been accessed and partially observed by the authors, but the authors certify that they have not yet observed the key variables within the data that will be used to answer the research question AND they have taken additional steps to maximise bias control and rigour.
List of eligible PCI RR-friendly journals:
- Cortex
- In&Vertebrates
- Infant and Child Development
- Peer Community Journal
- PeerJ
- Royal Society Open Science
- Swiss Psychology Open
References
1. Carlyle M., Broomby R., Simpson G., Hannon R., Fawaz L., Mollaahmetoglu O.M., Drain, J., Mostazir, M., & Morgan C. (2021). A randomised, double‐blind study investigating the relationship between early childhood trauma and the rewarding effects of morphine. Addiction Biology, 26(6):e13047.
2. Carlyle, M., Kvande, M., Leknes, S., Meier, I., Buen, K., Jensen, E. N., Ernst, G. & Eikemo, M. (2022). Does childhood adversity alter opioid drug reward? A conceptual replication in outpatients before surgery, in principle acceptance of Version 4 by Peer Community in Registered Reports. https://osf.io/7ymts