In 2023, the journal eLife ended the practice of making binary accept/reject decisions following peer review, instead sharing peer review reports (for manuscripts that are peer-reviewed) and brief “eLife assessments” representing the consensus opinions of editors and peer reviewers. As part of these assessments, the journal draws language from a "common vocabulary" to linguistically rank the significance of findings and strength of empirical support for the article's conclusions. In particular, the significance of findings is described using an ordinal scale of terms from "landmark" → "fundamental" → "important" → "valuable" → "useful", while the strength of support is ranked across six descending levels from "exceptional" down to "inadequate".

 

In the current study, Hardwicke et al. (2023) question the validity of this taxonomy, noting a range of linguistic ambiguities and counterintuitive characteristics that may undermine the communication of research evaluations to readers. Given the centrality of this common vocabulary to the journal's policy, the authors propose a study to explore whether the language used in the eLife assessments will be interpreted as intended by readers. Using a repeated-measures experimental design, they will tackle three aims: first, to understand the extent to which people share similar interpretations of phrases used to describe scientific research; second, to reveal the extent to which people’s implicit ranking of phrases used to describe scientific research aligns with each other and with the intended ranking; and third, to test whether phrases used to describe scientific research have overlapping interpretations. The proposed study has the potential to make a useful contribution to metascience, as well as being a valuable source of information for other journals potentially interested in following the novel path made by eLife.

 

The Stage 1 manuscript was evaluated over one round of in-depth review. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).

 

URL to the preregistered Stage 1 protocol: https://osf.io/mkbtp
 
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.
 
List of eligible PCI RR-friendly journals:
 

References
 
1. Hardwicke, T. E., Schiavone, S., Clarke, B. & Vazire, S. (2023). Finding the right words to evaluate research: An empirical appraisal of eLife’s assessment vocabulary. In principle acceptance of Version 2 by Peer Community in Registered Reports. https://osf.io/mkbtp

The excessive consumption of energy-dense but nutrient-poor foods and drinks can lead to many health problems. There is thus an increasing need for tools that may help people reduce the consumption of such foods and drinks. Training people to consistently respond or not respond to food items has been shown to reliably change their subjective evaluations of and choices for these items, mostly within laboratory settings. However, evidence on whether such trainings can also modify real consumption behavior remains mixed.

Najberg et al. developed a mobile-based response training game that combines two training tasks, one in which people consistently do not respond to sugary drinks (i.e., the go/no-go training), and one in which they consistently respond to water items rapidly (i.e., the cue-approach training). Recent work showed that after the training, participants in the experimental group reported more reduction in liking for sugary drinks and more increase in liking for water items compared to the control group. However, both groups showed equivalent reduction in self-reported consumption of sugary drinks (Najberg et al. 2023a). 

In the current study, Najberg and colleagues will further examine the efficacy of the gamified response training, by testing whether the training can help people resist the consumption of sugary drinks (Najberg et al. 2023b). Participants will be divided into experimental and control groups, and will receive the respective training for a minimum of seven days (and up to 20 days). After completing the training, they will be asked to avoid the trained sugary drinks, and the number of days in which they successfully adhere to this restrictive diet will be used as the dependent variable. Reporting the time at which one consumed a certain drink is presumably easier than reporting the exact volume consumed (cf. Najberg et al. 2023a). Furthermore, certain diets may require people to avoid specific foods and drinks entirely, rather than merely reduce the amount of consumption. Examining whether the training will be effective in this setting will therefore be informative. The authors will additionally examine whether the amount of training one completes, and the changes in subjective valuation of drinks after training, will be correlated with the successful avoidance of sugary drinks. These results will offer insights into the underlying mechanisms of the training and provide guidance on how they may best be implemented in applied settings.

This Stage 1 manuscript was evaluated over three rounds of in-depth reviews by three expert reviewers and the recommender. The recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).

 

Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.

 

List of eligible PCI-RR-friendly journals:
 

• Advances in Cognitive Psychology
• Collabra: Psychology
• F1000Research
• Journal of Cognition
• Peer Community Journal
• PeerJ
• Royal Society Open Science
• Studia Psychologica
• Swiss Psychology Open

References

1. Najberg, H., Mouthon, M., Coppin, G., & Spierer, L. (2023a). Reduction in sugar drink valuation and consumption with gamified executive control training. Scientific Reports, 13, 10659. https://doi.org/10.1038/s41598-023-36859-x

2. Najberg, H., Tapparel, M., & Spierer, L. (2023b). Sugary drinks devaluation with response training helps to resist their consumption. In principle acceptance of Version 4 by Peer Community in Registered Reports. https://osf.io/97aez

Self-control has shown to be a trait related to beneficial outcomes, including health, academic achievement and relationship quality. It is mostly understood as the ability to surpress immediate urges in order to achieve long-term goals, such as not watching another episode and therefore reaching a healthy amount of sleep. An emerging perspective on self-control shows that there is broader variety in applied strategies, such as removing oneself from a tempting situation, or reminding oneself of one's long-term goal, or reinterpreting the temptation.

 

Katzir et al. (2021) developed a novel instrument, the Self-Control Strategy Scale, that measured the tendency to engage in eight such strategies. In the current study, Roth et al. (2023) propose to translate the scale into German and assess its psychometric properties. Further, they will determine which strategies are related to particular outcomes that may be beneficial; for example, amount of physical activity engaged in, how healthy the diet is, exam performance and life satisfaction.

 

The Stage 1 manuscript was evaluated over two rounds of in-depth review by the recommender and at least two expert reviewers, before issuing in-principle acceptance.

 

URL to the preregistered Stage 1 protocol: https://osf.io/s7qwk
 
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.
 
List of eligible PCI RR-friendly journals:
 

 

1. Katzir, M., Baldwin, M., Werner, K. M., & Hofmann, W. (2021). Moving beyond inhibition: Capturing a broader scope of the self-control construct with the Self-Control Strategy Scale (SCSS). Journal of Personality Assessment, 103, 762-776. https://doi.org/10.1080/00223891.2021.1883627

 

2. Roth, L. H. O., Jankowski, J., Clay, G., Meindl, D., Vogt, L.-M., Wagner, V., Nordmann, A., Stenzel, L., Freiman, O., Mlynski, C., & Job, V. (2023). Self-Control beyond inhibition. German Translation and Quality Assessment of the Self-Control Strategy Scale (SCSS). In principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/s7qwk

What are the neurophysiological correlates of paired associative stimulation (PAS) in inducing plastic changes in human motor cortex (M1)? Here, Arrigoni and colleagues (2024) will apply transcranial magnetic stimulation (TMS) to left M1 paired with electrical stimulation of the right median nerve at an ISI of 25 ms or 10 ms to induce long-term potentiation (LTP) or long-term depression (LTD), respectively. Arrigoni and colleagues (2024) will determine if these stimulation pairings effect cortical excitability using motor-evoked potentials (MEPs) and TMS-evoked potentials (TEPs). Specifically, they hypothesize PASLTP will increase the peak-to-peak amplitude of MEPs, whereas PASLTD will decrease the amplitude, replicating previous work. They will then extend these previous findings by examining TEPs. The authors anticipate modulation of the P30 and P60, which are TEPs thought to reflect local cortical excitability. They plan to account for the MEP reafference which may also mediate the P60 amplitude by stimulating at sub- and supra- motor threshold. Further, they hypothesize an increase of the N100, a marker of inhibitory processing mediated by GABA, by PASLTD. Finally, the authors will also examine the impact of cortical excitability over time to determine the duration of the PAS effects.   

 

This detailed examination of TEPs following PAS stimulation will determine which TEPs could be used as biomarkers with the induction of LTP and LTD through stimulation. The authors have built in an MEP replication for the PAS stimulation, supporting previous literature and acting as a positive control.  

 

The Stage 1 manuscript was evaluated by three expert reviewers across two rounds. Following in-depth review and responses from the authors, the recommender determined that Stage 1 criteria was met and awarded in-principle acceptance (IPA).

 

URL to the preregistered Stage 1 protocol: https://osf.io/detjc (under temporary private embargo)
 
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA. 
 
List of eligible PCI RR-friendly journals:

 

References
 
1. Arrigoni, E., Bolognini, N., Pisoni, A. & Guidali, G. (2024). Neurophysiological correlates of plasticity induced by paired associative stimulation (PAS) targeting the motor cortex: a TMS-EEG registered report. In principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/detjc

Social media is a popular tool for online discussion and debate, bringing with it various forms of hostile interactions –  from offensive remarks and insults, to harassment and threats of physical violence. The nature of such online toxicity has been well studied, but much remains to be understood regarding strategies to reduce it. Existing theory and evidence suggests that a range of responses – including those that emphasise prosociality and empathy – might be effective at mitigating online toxicity. But do such strategies work in practice?

 

In the current study, Young Reusser et al (2023) tested the effectiveness of three types of responses to online toxicity – benevolent correction (including disagreement), benevolent going along (including joking/agreement) and retaliation (additional toxicity) – on how able participants feel to contribute to conversations, their belief that the toxicity would be reduced by the intervention, and their belief that justice had been restored.

 

The results showed the benevolent correction – while an uncommon strategy in online communities – was most effective in helping participants feel freer to contribute to online discussions. Benevolent correction was also the preferred approach for discouraging toxicity and restoring justice. Overall, the findings suggest that responding to toxic commenters with empathy and understanding while (crucially) also correcting their toxicity may be an effective intervention for bystanders seeking to improve the health of online interaction. The authors note that future research should focus on whether benevolent correction actually discourages toxicity, which wasn't tested in the current experiment, and if so how the use of benevolent corrections might be encouraged.

 

Following one round of review and revisions, the recommender judged that the manuscript met the Stage 2 criteria and awarded a positive recommendation.
 
URL to the preregistered Stage 1 protocol: https://osf.io/hfjnb

 

Level of bias control achieved: Level 6. No part of the data or evidence that was used to answer the research question was generated until after IPA. 

 
List of eligible PCI RR-friendly journals:

 

 

1. Young Reusser, A. I., Veit, K. M., Gassin, E. A., & Case, J. P. (2023). Responding to Online Toxicity: 
Which Strategies Make Others Feel Freer to Contribute, Believe That Toxicity Will Decrease, and Believe that Justice Has Been Restored? [Stage 2 Registered Report] Acceptance of Version 2 by Peer Community in Registered Reports. https://osf.io/k46e8