Submit a report

Announcements

We are recruiting recommenders (editors) from all research fields!

Your feedback matters! If you have authored or reviewed a Registered Report at Peer Community in Registered Reports, then please take 5 minutes to leave anonymous feedback about your experience, and view community ratings.

Latest recommendationsrssmastodon

IdTitle * Authors * Abstract * PictureThematic fields * Recommender▼ReviewersSubmission date
11 Jun 2024
STAGE 1

The effects of memory distrust toward commission and omission on recollection-belief correspondence and memory errors

Manipulating what is believed about what is remembered

Recommended by ORCID_LOGO based on reviews by Dan Wright, Romuald Polczyk, Iwona Dudek and Greg Neil
We may not believe what our memory tells us: Memory may deliver a compelling recollection we believe did not happen (we know we were not there at the time); and we may know an event happened that we fail to remember (even for when we were not drunk!). That is, there can be distrust in remembering and distrust in forgetting. Previous work by the authors has looked at this through a signal detection lens, reporting in separate studies that people who have distrust in remembering have either a high or low criterion for saying "old" (Zhang et al, 2023, 2024a). A plausible explanation for these contrasting results is that the criterion can either be the means by which false memories are generated enabling the distrust (low criterion); or rather, in conditions where accuracy is at stake, the means for compensating for the distrust (high criterion).
 
In the current study by Zhang et al (2024b), participants will be incentivised to be as accurate as possible, and in a memory test given feedback about commission errors or, in another group, ommission errors. As a manipulation check, the authors will test that the feedback increases distrust in remembering or distrust in forgetting, respectively, compared to a no feedback control group. Crucially, the authors hypothesize that people will adjust the criterion to say "old" in a compensatory way in each group. The study uses inference by intervals to provide a fairly severe test of this hypothesis.
 
The Stage 1 manuscript was evaluated over multiple rounds of in-depth review. Based on detailed responses to the reviewers' and recommender's comments, the recommender judged that the manuscript met the Stage 1 criteria and awarded in-principle acceptance (IPA).
 
URL to the preregistered Stage 1 protocol: https://osf.io/x69qt
 
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA. 
 
List of eligible PCI RR-friendly journals:
 
 
References
 
1. Zhang, Y., Qi, F., Otgaar, H., Nash, R. A., & Jelicic, M. (2023). A Tale of Two Distrusts: Memory Distrust towards Commission and Omission Errors in the Chinese Context. Journal of Applied Research in Memory and Cognition. https://doi.org/10.1037/mac0000134
 
2. Zhang, Y., Otgaar, H., Nash, R. A., & Rosar, L. (2024). Time and memory distrust shape the dynamics of recollection and belief-in-occurrence. Memory, 32, 484–501. https://doi.org/10.1080/09658211.2024.2336166
 
3. Zhang, Y., Otgaar, H., Nash, R. A., & Li, C. (2024b). The effects of memory distrust toward commission and omission on recollection-belief correspondence and memory errors. In principle acceptance of Version 5 by Peer Community in Registered Reports. https://osf.io/x69qt
 
The effects of memory distrust toward commission and omission on recollection-belief correspondence and memory errors Yikang Zhang, Henry Otgaar, Robert A. Nash, Chunlin Li<p>Our appraisals and beliefs about our memory functioning shape how we reconstruct and report specific memory episodes. Research has shown that people differ in the extent to which they are skeptical about their memories, which is termed memory d...Social sciencesZoltan Dienes2023-09-21 09:08:32 View
11 Apr 2024
STAGE 2
(Go to stage 1)

Managing Disclosure Outcomes in Intelligence Interviews

Managing costs and rewards when choosing to disclose information

Recommended by ORCID_LOGO based on reviews by Yikang Zhang and Tyler Jacobs
An interviewee in an intelligence interview can face competing interests in disclosing information: The value in cooperating because, for example, information given leads to the arrest of a narcotics gang, making the neighbourhood safer; and the risk that disclosing the information leads to reprisals from the gang. Different pieces of information will compete with each other for disclosure, depending on this balance of risks to self-interest. According to the disclosure-outcomes management model of Neequaye et al., information will be disclosed more with a high than low probability of reward, as might be straightforwardly expected, but this difference will be larger when there is a low probability of cost rather than a high probability. The high probability of cost will induce more a variable response to the possible benefits.

Neequaye et al. (2024) invited participants to assume the role of an informant, with the goal of maximizing their points according to stated probabilities of costs and benefits of disclosing pieces of information relating to given scenarios. The degree to which each type of information was disclosed in a subsequent interview wase assessed. Perceived benefits positively influenced the likelihood of disclosing information. The crucial interaction, obtained in a Pilot study, was not significant in the pre-registered replication. The study had decent power to pick up an interaction the same size as found in the pilot, but not half the size, which would still have been interesting.
 
The Stage 2 manuscript was evaluated over one round of in-depth review. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 2 criteria.
 
URL to the preregistered Stage 1 protocol: https://osf.io/ru8j5

Level of bias control achieved: Level 6. No part of the data or evidence that was used to answer the research question was generated until after IPA.
 
List of eligible PCI RR-friendly journals:
 
 
References
 
Neequaye, D. A., Luke, T. J., & Kollback, K. (2024). Managing Disclosure Outcomes in Intelligence Interviews [Stage 2]. Acceptance of Version 11 by Peer Community in Registered Reports. https://doi.org/10.31234/osf.io/tfp2c
Managing Disclosure Outcomes in Intelligence InterviewsDavid A. Neequaye, Timothy J. Luke, Kristina Kollback<p>We introduce the disclosure-outcomes management model. The model views disclosure in intelligence interviews as a behavior interviewees use to profitably navigate self-interest dilemmas. We theorized that interviewees compare the potential outc...Social sciencesZoltan Dienes2024-02-29 17:26:19 View
14 Jun 2024
STAGE 2
(Go to stage 1)

Do prediction errors of perceived exertion inform the level of running pleasure?

Running pleasure results from finding it easier than you thought you would

Recommended by ORCID_LOGO based on reviews by Jasmin Hutchinson and 1 anonymous reviewer
The reward value of a stimulus is based on an error in prediction: Things going better than predicted. Could this learning principle, often tested on short acting stimuli, also apply to a long lasting episode, like going for a run? Could how rewarding a run is be based on the run going better than predicted?
 
Understanding the conditions under which exercise is pleasurable could of course be relevant to tempting people to do more of it! In the current study, Brevers et al. (2024) asked people before a daily run to predict the amount of perceived exertion they would experience; then just after the run, to rate the retrospective amount of perceived exertion actually experienced. The difference between the two ratings was the prediction error. Participants also rated their remembered pleasure in running. As hypothesized, the authors found that running pleasure increased linearly with how much retrospective exertion was than predicted.
 
The Stage 2 manuscript received one round of review from two external reviewers, then some minor comments from the recommender, after which it was judged to satisfy the Stage 2 criteria and was awarded a positive recommendation.
 
URL to the preregistered Stage 1 protocol: https://osf.io/xh724
 
Level of bias control achieved: Level 6. No part of the data or evidence that was used to answer the research question was generated until after IPA.
 
List of eligible PCI RR-friendly journals:
 
 
References
 
1. Brevers, D., Martinent, G., Oz, I. T., Desmedt, O. & de Geus, B. (2024). Do prediction errors of perceived exertion inform the level of running pleasure? [Stage 2]. In principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/xfgqp
Do prediction errors of perceived exertion inform the level of running pleasure? Damien Brevers, Guillaume Martinent, İrem Tuğçe Öz, Olivier Desmedt, Bas de Geus<p>Humans have the ability to mentally project themselves into future events (prospective thinking) to promote the implementation of health-oriented behaviors, such as the planning of daily physical exercise sessions. Nevertheless, it is currently...Social sciencesZoltan Dienes2024-04-26 11:58:57 View
14 Sep 2024
STAGE 2
(Go to stage 1)

Self-Control Beyond Inhibition. German Translation and Quality Assessment of the Self-Control Strategy Scale (SCSS)

Strategies for self control: German translation and evaluation of the Self Control Strategy Scale

Recommended by ORCID_LOGO based on reviews by Eleanor Miles, Kaitlyn Werner and Sebastian Bürgler
Self-control has shown to be a trait related to beneficial outcomes, including health, academic achievement and relationship quality. It is mostly understood as the ability to suppress immediate urges in order to achieve long-term goals, such as not watching another episode and therefore reaching a healthy amount of sleep. An emerging perspective on self-control shows that there is broader variety in applied strategies, such as removing oneself from a tempting situation, or reminding oneself of one's long-term goal, or reinterpreting the temptation.
 
Katzir et al. (2021) developed a novel instrument, the Self-Control Strategy Scale, that measured the tendency to engage in eight such strategies. In the current study, Roth et al. (2024) translated the scale into German and assessed its psychometric properties: internal consistency and retest reliability were sufficient for six or seven of the eight subscales. Further, different strategies (subscales) were related to particular outcomes; at least one strategy was related to each outcome for 20 out of 23 outcomes in health behavior, school/work achievement, life satisfaction, interpersonal functioning and pro-environmental behavior (though the particular pattern of similarities and differences would need confirming). Thus, the SCSS is a valid and reliable measure that can now be used in German.
 
The Stage 2 manuscript was evaluated over two rounds of in-depth review by the recommender and at least two expert reviewers. Following revision, the recommender judged that the manuscript met the Stage 2 criteria and awarded a positive recommendation.
 
URL to the preregistered Stage 1 protocol: https://osf.io/s7qwk
 
Level of bias control achieved: Level 6. No part of the data or evidence that was used to answer the research question was generated until after IPA.
 
List of eligible PCI RR-friendly journals:
 

References
 
1. Katzir, M., Baldwin, M., Werner, K. M., and Hofmann, W. (2021). Moving beyond inhibition: Capturing a broader scope of the self-control construct with the Self-Control Strategy Scale (SCSS). Journal of Personality Assessment, 103, 762-776. https://doi.org/10.1080/00223891.2021.1883627
 
2. Roth, L. H. O., Jankowski, J., Meindl, D., Clay, G., Mlynski, C., Freiman, O., Nordmann, A., Stenzel, L., and Wagner, V. (2024). Self-Control beyond inhibition. German Translation and Quality Assessment of the Self-Control Strategy Scale (SCSS) [Stage 2]. Acceptance of Version 3 by Peer Community in Registered Reports. https://doi.org/10.31234/osf.io/gpmnv

Self-Control Beyond Inhibition. German Translation and Quality Assessment of the Self-Control Strategy Scale (SCSS)Leopold H. O. Roth, Julia M. Jankowski, Dominik Meindl, Georgia Clay, Christopher Mlynski, Olga Freiman, Artemis L. Nordmann, Loana-Corine Stenzel, Victoria Wagner<p>Self-control is crucial for goal attainment and related to several beneficial outcomes, such as health and education. For a long time, it was predominantly understood in terms of inhibition, namely the ability to suppress immediate urges for th...Social sciencesZoltan Dienes Sebastian Bürgler, Kaitlyn Werner, Eleanor Miles2024-06-28 11:50:25 View
07 Apr 2023
STAGE 1

Psychological predictors of long-term esports success: A Registered Report

What psychological factors predict long-term success in esports?

Recommended by and ORCID_LOGO based on reviews by Justin Bonny and Maciej Behnke
Electronic sports (esports), the competitive play of video games, has seen a large surge in popularity over the past few decades. Millions of people nowadays participate in esports as a hobby, and many consider becoming professional esports athletes as a potential career path. However, psychological factors that may predict one's long-term success in esports have remained unclear.

In the current study, Martončik and colleagues (2023) propose to examine potential predictors of long-term esports success, in three currently most impactful PC esports games, namely League of Legends, Counter Strike: Global Offensive, and Fortnite. Based on an extensive review of the literature and four pilot studies, the authors will examine to what extent naive practice and deliberate practice, as well as other psychological factors such as attention, speed of decision-making, reaction time, teamwork, intelligence and persistence, can predictor player's highest rank in the past 12 months, as an indicator of long-term success. Deliberate practice has been proposed to play an essential role in the development of expertise in other domains, and the current study offers a test of the role of both naive and deliberate practice in long-term esports success. The novel measurement on naive and deliberate practice, developed as part of the current investigation, will also be a valuable contribution to future research on esports. Lastly, from an applied perspective, the results of the current study will be of great interest to individuals who are considering pursuing a professional career in esports, as well as professional and semi-professional esports teams and coaches.

This Stage 1 manuscript was evaluated over two rounds of in-depth review. Based on the comprehensive responses to the reviewers' feedback, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
 
URL to the preregistered Stage 1 protocol: https://osf.io/84zbv
 
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.
 
List of eligible PCI RR-friendly journals: 
 
References
 
Martončik, M., Karhulahti, V.-M., Jin, Y. & Adamkovič, M. (2023). Psychological predictors of long-term esports success: A Registered Report, in principle acceptance of Version 1.4 by Peer Community in Registered Reports. https://osf.io/84zbv
Psychological predictors of long-term esports success: A Registered ReportMarcel Martončik, Veli-Matti Karhulahti, Yaewon Jin, Matúš Adamkovič<p>The competitive play of digital games, esports, has attracted worldwide attention of hundreds of millions of young people. Although esports players are known to practice in similar ways to other athletes, it remains largely unknown what factors...Social sciencesZhang Chen2022-08-17 12:12:51 View
17 Jan 2024
STAGE 1

Revisiting the Effects of Helper Intention on Gratitude and Indebtedness: Replication and extensions Registered Report of Tsang (2006)

Grateful or indebted? Revisiting the role of helper intention in gratitude and indebtedness

Recommended by based on reviews by Jo-Ann Tsang, Sarahanne Miranda Field and Cong Peng
When receiving a favour, we may feel grateful and/or indebted to those who have helped us. What factors determine how much gratitude and indebtedness people experience? In a seminal paper, Tsang (2006) found that people reported feeling more gratitude when the helper's intention was benevolent (e.g., helping others out of genuine concerns for other people) compared to when the helper's intention was perceived to be selfish (e.g., helping others for selfish reasons). In contrast, indebtedness was not influenced by perceived helper intention. This finding highlighted the different processes underlying gratitude and indebtedness, and also inspired later work on how these two emotions may have different downstream influences, for instance on interpersonal relationships.

So far, there has been no published direct replication of this seminal work by Tsang (2006). In the current study, Chan et al. (2024) propose to revisit the effects of helper intention on gratitude and indebtedness, by replicating and extending the original studies (Study 2 & 3) by Tsang (2006). Participants will be asked to either recall (Study 2) or read (Study 3) a scenario in which another person helped them with either benevolent or selfish intentions, and rate how much gratitude and indebtedness they would experience in such situations. The authors predict that in line with the original findings, gratitude will be more influenced by helper intention than indebtedness. To further extend the original findings, the authors will also assess people's perceived expectations for reciprocity, and their intention to reciprocate. These extensions will shed further light on how helper intention may influence beneficiaries’ experiences of gratitude and indebtedness, and their subsequent tendencies to reciprocate.

This Stage 1 manuscript was evaluated over two rounds of in-depth review by three expert reviewers and the recommender. After the revisions, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
 
URL to the preregistered Stage 1 protocol: https://osf.io/uyfvq
 
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA. 
 
List of eligible PCI RR-friendly journals:
 
 
References

1. Tsang, J.-A. (2006). The effects of helper intention on gratitude and indebtedness. Motivation and Emotion, 30, 199–205. https://doi.org/10.1007/s11031-006-9031-z

2. Chan, C. F., Lim, H. C., Lau, F. Y., Ip, W., Lui, C. F. S., Tam, K. Y. Y., & Feldman, G. (2024). Revisiting the Effects of Helper Intention on Gratitude and Indebtedness: Replication and extensions Registered Report of Tsang (2006). In principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/uyfvq
Revisiting the Effects of Helper Intention on Gratitude and Indebtedness: Replication and extensions Registered Report of Tsang (2006)Chi Fung Chan, Hiu Ching Lim, Fung Yee Lau, Wing Ip, Chak Fong Shannon Lui, Katy Y. Y. Tam, Gilad Feldman<p>[IMPORTANT: Abstract, method, and results were written using a randomized dataset produced by Qualtrics to simulate what these sections will look like after data collection. These will be updated following the data collection. For the purpose o...Social sciencesZhang Chen2023-01-12 09:34:50 View
26 Feb 2024
STAGE 2
(Go to stage 1)

Psychological predictors of long-term esports success: A Registered Report

Psychological predictors of long-term success in esports

Recommended by and ORCID_LOGO based on reviews by Justin Bonny and Maciej Behnke
The competitive play of digital games known as ‘esports’ has surged in popularity over the past few decades. Millions of people nowadays participate in esports as a hobby, and many consider becoming professional esports athletes as a potential career path. However, psychological factors that may predict one's long-term success in esports are not entirely clear.
 
The current Registered Report by Martončik and colleagues (2024) offered a comprehensive test of potential predictors of long-term success in the two currently most impactful PC esports games, namely League of Legends (LoL) and Counter Strike: Global Offensive (CSGO). A wide range of predictors were examined, including native and deliberate practice, attention, intelligence, reaction time, and persistence etc. In both LoL and CSGO, deliberate practice did not meaningfully predict players' highest rank in the past 12 months, as an indicator of long-term success. Younger age predicted better performance in both titles though. Lastly, two title-specific predictors emerged: in LoL, more non-deliberate practice hours predicted better performance, while in CSGO better attention predicted better performance.
 
To explain these findings, the authors proposed the information density theory. Different games differ in the amount of knowledge that is required for achieving long-term success. For information-heavy games such as LoL, naive practice hours may be more essential for players to acquire game-relevant information via playing, compared to information-light games such as CSGO. This might also explain why deliberative practice did not meaningfully predict performance in LoL and CSGO. While this theory still needs to be further tested, the current results will be useful to individuals who are considering pursuing a professional career in esports, as well as professional and semi-professional esports teams and coaches.
 
This Stage 2 manuscript was assessed over two rounds of in-depth review. The recommenders judged the responses to the reviewers' comments were satisfactory, and that the manuscript met the Stage 2 criteria for recommendation.
 
URL to the preregistered Stage 1 protocol: https://osf.io/84zbv
 
Level of bias control achieved: Level 6. No part of the data or evidence that was used to answer the research question was generated until after IPA.
 
List of eligible PCI RR-friendly journals: 
 
References
 
Martončik, M., Karhulahti, V.-M., Jin, Y. & Adamkovič, M. (2023). Psychological predictors of long-term esports success: A Registered Report [Stage 2]. Acceptance of Version 1.7 by Peer Community in Registered Reports. https://osf.io/b6vdf
Psychological predictors of long-term esports success: A Registered ReportMarcel Martončik, Veli-Matti Karhulahti, Yaewon Jin, Matúš Adamkovič<p>The competitive play of digital games, esports, has attracted worldwide attention of hundreds of millions of young people. Although esports players are known to practice in similar ways to other athletes, it remains largely unknown what factors...Social sciencesZhang Chen2023-09-26 07:15:41 View
27 Mar 2024
STAGE 1

Impulsivity and online sports betting behaviour: Untangling the causal relationship (ISPO study)

Examining the causal pathways from impulsivity to disordered gambling in online sports betting

Recommended by based on reviews by 2 anonymous reviewers
Online sports betting is becoming increasingly popular worldwide, which has raised concerns about the negative consequences it has on both individual health and public health. To prevent and reduce these negative consequences, it is important to understand how gambling-related harms arise in the context of online sports betting. 

Impulsivity has long been recognized as a risk factor for disordered gambling, yet how impulsivity may lead to gambling-related harms is not entirely clear. In the current study, Jacob and colleagues (2024) aim to examine this question using a longitudinal cross-lagged panel design. Regular online sports bettors will be invited to fill out measures of impulsivity (including impulsive choice, impulsive action, and impulsivity personality) and gambling disorder symptoms three times at three-month intervals. Player tracking data on these players' online betting behavior in these three-month intervals will then be retrieved from the online gambling provider. Combining these data provides a unique opportunity to test the hypotheses that impulsivity may lead to riskier online gambling behavior, which in turn may lead to more gambling-related problems later on. The results of the current study will offer novel insights into the causal pathways from impulsivity to disordered gambling in online sports betting, and may also inform the development of early prevention strategies to reduce gambling-related harms.

The current Stage 1 manuscript was evaluated by two reviewers and the recommender. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
 
URL to the preregistered Stage 1 protocol: https://osf.io/7wsfh
 
Level of bias control achieved: Level 3. At least some data/evidence that will be used to the answer the research question has been previously accessed by the authors (e.g. downloaded or otherwise received), but the authors certify that they have not yet observed ANY part of the data/evidence.
 
List of eligible PCI RR-friendly journals:
 
References
 
1. Jacob, A., Joshanloo, M., Czernecka, R., & Kräplin, A. (2024). Impulsivity and online sports betting behavior: Untangling the causal relationship. In principle acceptance of Version 4 by Peer Community in Registered Reports. https://osf.io/7wsfh
Impulsivity and online sports betting behaviour: Untangling the causal relationship (ISPO study)Anne Jacob, Mohsen Joshanloo, Robert Czernecka, Anja Kräplin, <p>The rapid expansion of online sports betting has raised concerns about its potential impact on individual health and public health. In order to further develop etiological models for gambling disorder (GD) in sports betting, it is essential to ...Social sciencesZhang Chen2023-10-16 13:58:01 View
07 Apr 2023
STAGE 1

The WEIRD problem in a “non-WEIRD” context: A meta-research on the representativeness of human subjects in Chinese psychological research

How well do "non-WEIRD" participants in multi-lab studies represent their local population?

Recommended by ORCID_LOGO based on reviews by Zoltan Dienes, Patrick Forscher and Kai Hiraishi
In this protocol, Yue et al. (2023) aim to clarify whether the sample of non-WEIRD countries included in multi-lab studies is actually representative of those countries and cultures. Focusing on China, this study will compare Chinese samples in several multi-lab studies with participants in studies published in leading national Chinese journals on various aspects, including demographic data and geographic information. This work will provide useful information on the extent to which multi-lab studies are able to deal with generalizability, especially as they intend to address the generalizability problem.
 
The Stage 1 manuscript was reviewed by three experts, including two with an interest in the WEIRD problem and a wealth of experience in open science and multi-lab research, plus an expert in Bayesian statistics, which this manuscript uses. Following multilpe rounds of peer review, and based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
 
URL to the preregistered Stage 1 protocol: https://osf.io/ehw54
 
Level of bias control achieved: Level 4. At least some of the data/evidence that will be used to answer the research question already exists AND is accessible in principle to the authors (e.g. residing in a public database or with a colleague) BUT the authors certify that they have not yet accessed any part of that data/evidence.
 
List of eligible PCI RR-friendly journals: 
 
 
References
 
Yue, L., Zuo, X.-N., & Hu, C.-P. (2023) The WEIRD problem in a “non-WEIRD” context: A meta-research on the representativeness of human subjects in Chinese psychological research, in principle acceptance of Version 7 by Peer Community in Registered Reports. https://osf.io/ehw54
The WEIRD problem in a “non-WEIRD” context: A meta-research on the representativeness of human subjects in Chinese psychological researchYUE Lei, ZUO Xi-Nian, HU Chuan-Peng<p><strong>​​​​</strong><strong>​Psychological science aims at understanding human mind and behavior, but it primarily relies on subjects from Western, Educated, Industrialized, Rich, and Democratic regions, i.e., the WEIRD problem. This lack of d...Social sciencesYuki Yamada Zoltan Dienes2021-09-07 11:25:52 View
28 Dec 2021
STAGE 1
article picture

Sight vs. sound in the judgment of music performance: Cross-cultural evidence from classical piano and Tsugaru shamisen competitions

Understanding the role of visual and auditory information in evaluating musical performance

Recommended by ORCID_LOGO based on reviews by David Hughes and Kyoshiro Sasaki

In this Stage 1 Registered Report, Chiba and colleagues (2021) aim to investigate how people use information from visual and auditory modalities when evaluating musical performances. Previous studies, mainly using Western music, have reported a visual dominance, but this has not yet been clearly and consistently reported. Thus, the authors propose to evaluate both the reproducibility and generalizability of the previous findings by conducting a replication study using the methodology of the previous studies and by introducing a new experimental condition in which the Tsugaru-shamisen, a unique Japanese musical instrument, is also performed. This study could represent an important turning point in the research context of performance evaluation and would be of considerable value.

This manuscript was peer-reviewed by two experts in scientific methodology and Japanese traditional music, respectively, and during the two-round peer-review process they made a number of important points, but eventually awarded the manuscript a highly positive response. I am therefore pleased to recommend that this Stage 1 Registered Report meets our Stage 1 criteria and is worthy of in-principle acceptance. I look forward to seeing the results and discussion reported in Stage 2, with the expectation that the experiment conducted by the authors will be in strict accordance with this protocol.

*The following is a very minor comment, which I hope the authors will find helpful in the future. Of course, this is not related to hypothesis construction and does not require revision: The "Blind Audition" study cited in the introduction is very impactful, but has recently been called into question, so I am at least a little cautious when citing this study. This article may be useful. https://www.wsj.com/articles/blind-spots-in-the-blind-audition-study-11571599303

URL to the preregistered Stage 1 protocol: https://osf.io/ry2b6

Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.

List of eligible PCI RR-friendly journals:

References

  1. Chiba G, Ozaki Y, Fujii S, Savage PE (2021) Sight vs. sound in the judgment of music performance: Cross-cultural evidence from classical piano and Tsugaru shamisen competitions [Stage 1 Registered Report].  Psyarxiv, xky4j, stage 1 preregistration, in-principle acceptance of version 5 by Peer Community in Registered Reports. https://doi.org/10.31234/osf.io/xky4jhttps://doi.org/10.17605/OSF.IO/RY2B6
Sight vs. sound in the judgment of music performance: Cross-cultural evidence from classical piano and Tsugaru shamisen competitions Gakuto Chiba, Yuto Ozaki, Shinya Fujii, Patrick E. Savage<p style="text-align: justify;">​​Which information dominates in evaluating performance in music? Both experts and laypeople consistently report believing that sound should be the most important domain when judging music competitions, but experime...Social sciencesYuki Yamada Kyoshiro Sasaki2021-09-24 08:59:26 View