=============================================================================
IMPORTANT ANNOUNCEMENT: To accommodate reviewer and recommender holiday schedules, we will be closed to ALL submissions from 1st Jul - 1st Sep. During this time, reviewers can submit reviews and recommenders can issue decisions, but no new or revised submissions can be made by authors.
The one exception to this rule is that authors using the scheduled track who submit their initial Stage 1 snapshot prior to 1st Jul can choose a date within the shutdown period to submit their full Stage 1 manuscript.
We recommend that authors submit at least 1-2 weeks prior to commencement of the shutdown period to enable time to make any required revisions prior to in-depth review.
=============================================================================
We are recruiting recommenders (editors) from all research fields!
Your feedback matters! If you have authored or reviewed a Registered Report at Peer Community in Registered Reports, then please take 5 minutes to leave anonymous feedback about your experience, and view community ratings.
Latest recommendations
| Id | Title * | Authors * | Abstract * | Picture | Thematic fields * | Recommender▼ | Reviewers | Submission date | |
|---|---|---|---|---|---|---|---|---|---|
07 Apr 2023
STAGE 1
Psychological predictors of long-term esports success: A Registered ReportWhat psychological factors predict long-term success in esports?Recommended by Zhang Chen and Charlotte Pennington based on reviews by Justin Bonny and Maciej Behnke
Electronic sports (esports), the competitive play of video games, has seen a large surge in popularity over the past few decades. Millions of people nowadays participate in esports as a hobby, and many consider becoming professional esports athletes as a potential career path. However, psychological factors that may predict one's long-term success in esports have remained unclear.
In the current study, Martončik and colleagues (2023) propose to examine potential predictors of long-term esports success, in three currently most impactful PC esports games, namely League of Legends, Counter Strike: Global Offensive, and Fortnite. Based on an extensive review of the literature and four pilot studies, the authors will examine to what extent naive practice and deliberate practice, as well as other psychological factors such as attention, speed of decision-making, reaction time, teamwork, intelligence and persistence, can predictor player's highest rank in the past 12 months, as an indicator of long-term success. Deliberate practice has been proposed to play an essential role in the development of expertise in other domains, and the current study offers a test of the role of both naive and deliberate practice in long-term esports success. The novel measurement on naive and deliberate practice, developed as part of the current investigation, will also be a valuable contribution to future research on esports. Lastly, from an applied perspective, the results of the current study will be of great interest to individuals who are considering pursuing a professional career in esports, as well as professional and semi-professional esports teams and coaches. This Stage 1 manuscript was evaluated over two rounds of in-depth review. Based on the comprehensive responses to the reviewers' feedback, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA). URL to the preregistered Stage 1 protocol: https://osf.io/84zbv
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA. List of eligible PCI RR-friendly journals:
References
Martončik, M., Karhulahti, V.-M., Jin, Y. & Adamkovič, M. (2023). Psychological predictors of long-term esports success: A Registered Report, in principle acceptance of Version 1.4 by Peer Community in Registered Reports. https://osf.io/84zbv | Psychological predictors of long-term esports success: A Registered Report | Marcel Martončik, Veli-Matti Karhulahti, Yaewon Jin, Matúš Adamkovič | <p>The competitive play of digital games, esports, has attracted worldwide attention of hundreds of millions of young people. Although esports players are known to practice in similar ways to other athletes, it remains largely unknown what factors... | Social sciences | Zhang Chen | 2022-08-17 12:12:51 | |||
17 Jan 2024
STAGE 1
Revisiting the Effects of Helper Intention on Gratitude and Indebtedness: Replication and extensions Registered Report of Tsang (2006)Grateful or indebted? Revisiting the role of helper intention in gratitude and indebtednessRecommended by Zhang Chen based on reviews by Jo-Ann Tsang, Sarahanne Miranda Field and Cong Peng
When receiving a favour, we may feel grateful and/or indebted to those who have helped us. What factors determine how much gratitude and indebtedness people experience? In a seminal paper, Tsang (2006) found that people reported feeling more gratitude when the helper's intention was benevolent (e.g., helping others out of genuine concerns for other people) compared to when the helper's intention was perceived to be selfish (e.g., helping others for selfish reasons). In contrast, indebtedness was not influenced by perceived helper intention. This finding highlighted the different processes underlying gratitude and indebtedness, and also inspired later work on how these two emotions may have different downstream influences, for instance on interpersonal relationships.
So far, there has been no published direct replication of this seminal work by Tsang (2006). In the current study, Chan et al. (2024) propose to revisit the effects of helper intention on gratitude and indebtedness, by replicating and extending the original studies (Study 2 & 3) by Tsang (2006). Participants will be asked to either recall (Study 2) or read (Study 3) a scenario in which another person helped them with either benevolent or selfish intentions, and rate how much gratitude and indebtedness they would experience in such situations. The authors predict that in line with the original findings, gratitude will be more influenced by helper intention than indebtedness. To further extend the original findings, the authors will also assess people's perceived expectations for reciprocity, and their intention to reciprocate. These extensions will shed further light on how helper intention may influence beneficiaries’ experiences of gratitude and indebtedness, and their subsequent tendencies to reciprocate. This Stage 1 manuscript was evaluated over two rounds of in-depth review by three expert reviewers and the recommender. After the revisions, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA). URL to the preregistered Stage 1 protocol: https://osf.io/uyfvq
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA. List of eligible PCI RR-friendly journals:
References
1. Tsang, J.-A. (2006). The effects of helper intention on gratitude and indebtedness. Motivation and Emotion, 30, 199–205. https://doi.org/10.1007/s11031-006-9031-z 2. Chan, C. F., Lim, H. C., Lau, F. Y., Ip, W., Lui, C. F. S., Tam, K. Y. Y., & Feldman, G. (2024). Revisiting the Effects of Helper Intention on Gratitude and Indebtedness: Replication and extensions Registered Report of Tsang (2006). In principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/uyfvq | Revisiting the Effects of Helper Intention on Gratitude and Indebtedness: Replication and extensions Registered Report of Tsang (2006) | Chi Fung Chan, Hiu Ching Lim, Fung Yee Lau, Wing Ip, Chak Fong Shannon Lui, Katy Y. Y. Tam, Gilad Feldman | <p>[IMPORTANT: Abstract, method, and results were written using a randomized dataset produced by Qualtrics to simulate what these sections will look like after data collection. These will be updated following the data collection. For the purpose o... | Social sciences | Zhang Chen | 2023-01-12 09:34:50 | |||
22 Nov 2024
STAGE 1
Sugary drinks devaluation with response training helps to resist to their consumptionCan gamified response training with sugary drinks help people to resist consumption?Recommended by Zhang Chen based on reviews by Loukia Tzavella, Matthias Aulbach and Pieter Van Dessel
The excessive consumption of energy-dense but nutrient-poor foods and drinks can lead to many health problems. There is thus an increasing need for tools that may help people reduce the consumption of such foods and drinks. Training people to consistently respond or not respond to food items has been shown to reliably change their subjective evaluations of and choices for these items, mostly within laboratory settings. However, evidence on whether such trainings can also modify real consumption behavior remains mixed.
Najberg et al. developed a mobile-based response training game that combines two training tasks, one in which people consistently do not respond to sugary drinks (i.e., the go/no-go training), and one in which they consistently respond to water items rapidly (i.e., the cue-approach training). Recent work showed that after the training, participants in the experimental group reported more reduction in liking for sugary drinks and more increase in liking for water items compared to the control group. However, both groups showed equivalent reduction in self-reported consumption of sugary drinks (Najberg et al. 2023a). In the current study, Najberg and colleagues will further examine the efficacy of the gamified response training, by testing whether the training can help people resist the consumption of sugary drinks (Najberg et al. 2023b). Participants will be divided into experimental and control groups, and will receive the respective training for a minimum of seven days (and up to 20 days). After completing the training, they will be asked to avoid the trained sugary drinks, and the number of days in which they successfully adhere to this restrictive diet will be used as the dependent variable. Reporting the time at which one consumed a certain drink is presumably easier than reporting the exact volume consumed (cf. Najberg et al. 2023a). Furthermore, certain diets may require people to avoid specific foods and drinks entirely, rather than merely reduce the amount of consumption. Examining whether the training will be effective in this setting will therefore be informative. The authors will additionally examine whether the amount of training one completes, and the changes in subjective valuation of drinks after training, will be correlated with the successful avoidance of sugary drinks. These results will offer insights into the underlying mechanisms of the training and provide guidance on how they may best be implemented in applied settings. This Stage 1 manuscript was evaluated over three rounds of in-depth reviews by three expert reviewers and the recommender. The recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA). URL to the preregistered Stage 1 protocol: https://osf.io/97aez
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA. List of eligible PCI-RR-friendly journals:
1. Najberg, H., Mouthon, M., Coppin, G., & Spierer, L. (2023a). Reduction in sugar drink valuation and consumption with gamified executive control training. Scientific Reports, 13, 10659. https://doi.org/10.1038/s41598-023-36859-x
2. Najberg, H., Tapparel, M., & Spierer, L. (2023b). Sugary drinks devaluation with response training helps to resist their consumption. In principle acceptance of Version 4 by Peer Community in Registered Reports. https://osf.io/97aez | Sugary drinks devaluation with response training helps to resist to their consumption | Hugo Najberg, Malika Tapparel, Lucas Spierer | <p style="text-align: justify;">Food response training has been shown to reduce the reported value of palatable food items. These approaches may thus help to reduce unhealthy (over)consumption behaviors and its related diseases. Yet, whether and h... | Medical Sciences | Zhang Chen | 2023-06-22 12:01:20 | |||
Psychological predictors of long-term esports success: A Registered ReportPsychological predictors of long-term success in esportsRecommended by Zhang Chen and Charlotte Pennington based on reviews by Justin Bonny and Maciej Behnke
The competitive play of digital games known as ‘esports’ has surged in popularity over the past few decades. Millions of people nowadays participate in esports as a hobby, and many consider becoming professional esports athletes as a potential career path. However, psychological factors that may predict one's long-term success in esports are not entirely clear.
The current Registered Report by Martončik and colleagues (2024) offered a comprehensive test of potential predictors of long-term success in the two currently most impactful PC esports games, namely League of Legends (LoL) and Counter Strike: Global Offensive (CSGO). A wide range of predictors were examined, including native and deliberate practice, attention, intelligence, reaction time, and persistence etc. In both LoL and CSGO, deliberate practice did not meaningfully predict players' highest rank in the past 12 months, as an indicator of long-term success. Younger age predicted better performance in both titles though. Lastly, two title-specific predictors emerged: in LoL, more non-deliberate practice hours predicted better performance, while in CSGO better attention predicted better performance.
To explain these findings, the authors proposed the information density theory. Different games differ in the amount of knowledge that is required for achieving long-term success. For information-heavy games such as LoL, naive practice hours may be more essential for players to acquire game-relevant information via playing, compared to information-light games such as CSGO. This might also explain why deliberative practice did not meaningfully predict performance in LoL and CSGO. While this theory still needs to be further tested, the current results will be useful to individuals who are considering pursuing a professional career in esports, as well as professional and semi-professional esports teams and coaches.
This Stage 2 manuscript was assessed over two rounds of in-depth review. The recommenders judged the responses to the reviewers' comments were satisfactory, and that the manuscript met the Stage 2 criteria for recommendation.
URL to the preregistered Stage 1 protocol: https://osf.io/84zbv
Level of bias control achieved: Level 6. No part of the data or evidence that was used to answer the research question was generated until after IPA. List of eligible PCI RR-friendly journals: References
Martončik, M., Karhulahti, V.-M., Jin, Y. & Adamkovič, M. (2023). Psychological predictors of long-term esports success: A Registered Report [Stage 2]. Acceptance of Version 1.7 by Peer Community in Registered Reports. https://osf.io/b6vdf | Psychological predictors of long-term esports success: A Registered Report | Marcel Martončik, Veli-Matti Karhulahti, Yaewon Jin, Matúš Adamkovič | <p>The competitive play of digital games, esports, has attracted worldwide attention of hundreds of millions of young people. Although esports players are known to practice in similar ways to other athletes, it remains largely unknown what factors... | Social sciences | Zhang Chen | 2023-09-26 07:15:41 | |||
27 Mar 2024
STAGE 1
Impulsivity and online sports betting behaviour: Untangling the causal relationship (ISPO study)Examining the causal pathways from impulsivity to disordered gambling in online sports bettingRecommended by Zhang Chen based on reviews by 2 anonymous reviewers
Online sports betting is becoming increasingly popular worldwide, which has raised concerns about the negative consequences it has on both individual health and public health. To prevent and reduce these negative consequences, it is important to understand how gambling-related harms arise in the context of online sports betting.
Impulsivity has long been recognized as a risk factor for disordered gambling, yet how impulsivity may lead to gambling-related harms is not entirely clear. In the current study, Jacob and colleagues (2024) aim to examine this question using a longitudinal cross-lagged panel design. Regular online sports bettors will be invited to fill out measures of impulsivity (including impulsive choice, impulsive action, and impulsivity personality) and gambling disorder symptoms three times at three-month intervals. Player tracking data on these players' online betting behavior in these three-month intervals will then be retrieved from the online gambling provider. Combining these data provides a unique opportunity to test the hypotheses that impulsivity may lead to riskier online gambling behavior, which in turn may lead to more gambling-related problems later on. The results of the current study will offer novel insights into the causal pathways from impulsivity to disordered gambling in online sports betting, and may also inform the development of early prevention strategies to reduce gambling-related harms. The current Stage 1 manuscript was evaluated by two reviewers and the recommender. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA). URL to the preregistered Stage 1 protocol: https://osf.io/7wsfh
Level of bias control achieved: Level 3. At least some data/evidence that will be used to the answer the research question has been previously accessed by the authors (e.g. downloaded or otherwise received), but the authors certify that they have not yet observed ANY part of the data/evidence. List of eligible PCI RR-friendly journals:
References
1. Jacob, A., Joshanloo, M., Czernecka, R., & Kräplin, A. (2024). Impulsivity and online sports betting behavior: Untangling the causal relationship. In principle acceptance of Version 4 by Peer Community in Registered Reports. https://osf.io/7wsfh | Impulsivity and online sports betting behaviour: Untangling the causal relationship (ISPO study) | Anne Jacob, Mohsen Joshanloo, Robert Czernecka, Anja Kräplin, | <p>The rapid expansion of online sports betting has raised concerns about its potential impact on individual health and public health. In order to further develop etiological models for gambling disorder (GD) in sports betting, it is essential to ... | Social sciences | Zhang Chen | 2023-10-16 13:58:01 | |||
Revisiting the Effects of Helper Intention on Gratitude and Indebtedness: Replication and extensions Registered Report of Tsang (2006)Grateful or indebted? Revisiting the role of helper intention in gratitude and indebtednessRecommended by Zhang Chen based on reviews by Jo-Ann Tsang, Sarahanne Miranda Field and Cong Peng
When receiving a favor, we may feel grateful and/or indebted to those who have helped us. What factors determine the extent of gratitude and indebtedness people experience? In a seminal paper, Tsang (2006) found that people reported feeling more gratitude when the helper's intention was perceived to be benevolent rather than selfish. In contrast, indebtedness was not influenced by the perceived intention of the helper.
In the current study, Chan et al. (2025) revisited the effects of helper intention on gratitude and indebtedness, by replicating and extending the original studies (Study 2 & 3) by Tsang (2006). Participants were asked to either recall (replication of Study 2) or read (replication of Study 3) a scenario in which another person helped them with either benevolent or selfish intentions, and rate how much gratitude and indebtedness they would experience in such situations. Replicating the findings by Tsang (2006), Chan et al. (2025) found that gratitude was more strongly influenced by helper intention than indebtedness. Extending these findings, the authors further discovered that helper intention affected perceived expectations for reciprocity and reciprocity inclination. Moreover, perceived reciprocity expectations showed opposite correlations with gratitude and indebtedness. Overall, this successful replication reinforces the distinction between gratitude and indebtedness, providing a solid foundation for future research on their underlying mechanisms and downstream influences. This Stage 2 manuscript was evaluated over one round of in-depth review by three expert reviewers, and a second round of review by the recommender. After the revisions, the recommender judged that the manuscript met the Stage 2 criteria and therefore awarded a positive recommendation. URL to the preregistered Stage 1 protocol: https://osf.io/uyfvq
Level of bias control achieved: Level 6. No part of the data or evidence that was used to answer the research question was generated until after IPA. List of eligible PCI RR-friendly journals:
References
1. Tsang, J.-A. (2006). The effects of helper intention on gratitude and indebtedness. Motivation and Emotion, 30, 199–205. https://doi.org/10.1007/s11031-006-9031-z 2. Chan, C. F., Lim, H. C., Lau, F. Y., Ip, W., Lui, C. F. S., Tam, K. Y. Y., & Feldman, G. (2025). Revisiting the Effects of Helper Intention on Gratitude and Indebtedness: Replication and extensions Registered Report of Tsang (2006)[Stage 2]. Acceptance of Version 6 by Peer Community in Registered Reports. https://osf.io/gthma | Revisiting the Effects of Helper Intention on Gratitude and Indebtedness: Replication and extensions Registered Report of Tsang (2006) | Chi Fung Chan, Hiu Ching Lim, Fung Yee Lau, Wing Ip, Chak Fong Shannon Lui, Katy Y. Y. Tam, Gilad Feldman | <p>Gratitude and indebtedness are common emotions in response to a favor, yet research suggests that they are experienced differently depending on the situation. Tsang (2006) found that gratitude for a favor depended on perceived helper intention,... | Social sciences | Zhang Chen | 2024-05-16 21:38:11 | |||
The capacity of response training to help resist the consumption of sugary drinksGamified response training with sugary drinks does not facilitate adherence to a restrictive dietRecommended by Zhang Chen based on reviews by Matthias Aulbach and Pieter Van Dessel
Many people nowadays struggle with maintaining a healthy diet. Despite the intentions to eat healthily, they often over-consume highly palatable yet nutrient-poor foods and drinks, which in turn can lead to many health problems. There is therefore a need to develop tools that can help people resist the (over-)consumption of such foods and drinks.
Previous work has shown that training people to execute certain motor responses toward food items can modify their liking for these items, which may also influence their subsequent consumption behavior. Based on these findings, Najberg et al. (2023) developed a mobile game that combined two food-related response training tasks, namely the go/no-go training (Veling et al., 2017) and the cue-approach training (Schonberg et al., 2014). The experimental group was trained to consistently inhibit their responses toward sugary drinks in the go/no-go training, and consistently respond to water items in the cue-approach training (i.e., 100% consistent mapping). In the control group, the mapping between an item and response requirement was 50%, such that participants executed both go and no-go responses toward sugary drinks and water. Najberg et al. (2023) found that after the training, the experimental group reported more reduction in liking for sugary drinks and more increase in liking for water items compared to the control group. However, both groups showed equivalent reduction in self-reported consumption of sugary drinks. Using the same design (i.e., 100% vs. 50% consistency), in the current study, Najberg et al. (2024) further examined whether the combined go/no-go and cue-approach training game could help people resist the consumption of sugary drinks. Participants were divided into the experimental and control group (N = 100 and 92, respectively), and received the respective training for a minimum of seven days (and up to 20 days). After completing the training, they were asked to avoid the trained sugary drinks. The number of days in which they reported to successfully adhere to this restrictive diet was used as the main dependent variable. Contrary to their predictions, the two groups did not differ in how long they resisted the consumption of sugary drinks after training. Both groups showed equivalent reductions in liking for sugary drinks (contrary to the finding in Najberg et al., 2023), but this reduction in liking was not correlated with the number of successful days of diet in the experimental group. Lastly, those who trained for more days in the experimental group also adhered to the diet for a longer duration, but this correlation might be explained by differences in motivation across individuals. Together, these results suggest that consistently withholding responses toward sugary drinks and responding to water items does not help people resist the consumption of sugary drinks, compared to a control intervention in which the mapping is 50%. More research is therefore needed to test the effectiveness of food-related response training in changing consumption behavior outside of laboratory contexts. The Stage 2 manuscript was evaluated over three rounds of review by two expert reviewers who also assessed the Stage 1 manuscript. Following detailed responses to the recommender and the reviewers’ comments, the recommender judged that the manuscript met the Stage 2 criteria and awarded a positive recommendation. URL to the preregistered Stage 1 protocol: https://osf.io/97aez
Level of bias control achieved: Level 6. No part of the data or evidence that was used to answer the research question was generated until after IPA. List of eligible PCI-RR-friendly journals:
References
1. Najberg, H., Mouthon, M., Coppin, G., & Spierer, L. (2023). Reduction in sugar drink valuation and consumption with gamified executive control training. Scientific Reports, 13, 10659. https://doi.org/10.1038/s41598-023-36859-x 2. Veling, H., Lawrence, N. S., Chen, Z., van Koningsbruggen, G. M., & Holland, R. W. (2017). What Is Trained During Food Go/No-Go Training? A Review Focusing on Mechanisms and a Research Agenda. Current Addiction Reports, 4, 35–41. https://doi.org/10.1007/s40429-017-0131-5
3. Schonberg, T., Bakkour, A., Hover, A. M., Mumford, J. A., Nagar, L., Perez, J., & Poldrack, R. A. (2014). Changing value through cued approach: An automatic mechanism of behavior change. Nature Neuroscience, 17, 625–630. https://doi.org/10.1038/nn.3673
4. Najberg, H., Tapparel, M., & Spierer, L. (2024). The capacity of response training to help resist the consumption of sugary drinks [Stage 2]. Acceptance of Version 4 by Peer Community in Registered Reports. https://osf.io/eu7j4?view_only=4934c0215f2943cfb42e019792a30b53 | The capacity of response training to help resist the consumption of sugary drinks | Hugo Najberg, Malika Tapparel, Lucas Spierer | <p style="text-align: justify;">Food response training has been shown to reduce the reported value of palatable food items. These approaches may thus help to reduce unhealthy (over)consumption behaviors and its related diseases. Yet, whether and h... | Medical Sciences, Social sciences | Zhang Chen | 2024-06-26 11:41:16 | |||
07 Apr 2023
STAGE 1
The WEIRD problem in a “non-WEIRD” context: A meta-research on the representativeness of human subjects in Chinese psychological researchHow well do "non-WEIRD" participants in multi-lab studies represent their local population?Recommended by Yuki Yamada based on reviews by Zoltan Dienes, Patrick Forscher and Kai Hiraishi
In this protocol, Yue et al. (2023) aim to clarify whether the sample of non-WEIRD countries included in multi-lab studies is actually representative of those countries and cultures. Focusing on China, this study will compare Chinese samples in several multi-lab studies with participants in studies published in leading national Chinese journals on various aspects, including demographic data and geographic information. This work will provide useful information on the extent to which multi-lab studies are able to deal with generalizability, especially as they intend to address the generalizability problem.
The Stage 1 manuscript was reviewed by three experts, including two with an interest in the WEIRD problem and a wealth of experience in open science and multi-lab research, plus an expert in Bayesian statistics, which this manuscript uses. Following multilpe rounds of peer review, and based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
URL to the preregistered Stage 1 protocol: https://osf.io/ehw54 Level of bias control achieved: Level 4. At least some of the data/evidence that will be used to answer the research question already exists AND is accessible in principle to the authors (e.g. residing in a public database or with a colleague) BUT the authors certify that they have not yet accessed any part of that data/evidence.
List of eligible PCI RR-friendly journals:
References
Yue, L., Zuo, X.-N., & Hu, C.-P. (2023) The WEIRD problem in a “non-WEIRD” context: A meta-research on the representativeness of human subjects in Chinese psychological research, in principle acceptance of Version 7 by Peer Community in Registered Reports. https://osf.io/ehw54 | The WEIRD problem in a “non-WEIRD” context: A meta-research on the representativeness of human subjects in Chinese psychological research | YUE Lei, ZUO Xi-Nian, HU Chuan-Peng | <p><strong></strong><strong>Psychological science aims at understanding human mind and behavior, but it primarily relies on subjects from Western, Educated, Industrialized, Rich, and Democratic regions, i.e., the WEIRD problem. This lack of d... | Social sciences | Yuki Yamada | Zoltan Dienes | 2021-09-07 11:25:52 | ||
28 Dec 2021
STAGE 1
Sight vs. sound in the judgment of music performance: Cross-cultural evidence from classical piano and Tsugaru shamisen competitionsUnderstanding the role of visual and auditory information in evaluating musical performanceRecommended by Yuki Yamada based on reviews by David Hughes and Kyoshiro Sasaki
In this Stage 1 Registered Report, Chiba and colleagues (2021) aim to investigate how people use information from visual and auditory modalities when evaluating musical performances. Previous studies, mainly using Western music, have reported a visual dominance, but this has not yet been clearly and consistently reported. Thus, the authors propose to evaluate both the reproducibility and generalizability of the previous findings by conducting a replication study using the methodology of the previous studies and by introducing a new experimental condition in which the Tsugaru-shamisen, a unique Japanese musical instrument, is also performed. This study could represent an important turning point in the research context of performance evaluation and would be of considerable value. This manuscript was peer-reviewed by two experts in scientific methodology and Japanese traditional music, respectively, and during the two-round peer-review process they made a number of important points, but eventually awarded the manuscript a highly positive response. I am therefore pleased to recommend that this Stage 1 Registered Report meets our Stage 1 criteria and is worthy of in-principle acceptance. I look forward to seeing the results and discussion reported in Stage 2, with the expectation that the experiment conducted by the authors will be in strict accordance with this protocol. *The following is a very minor comment, which I hope the authors will find helpful in the future. Of course, this is not related to hypothesis construction and does not require revision: The "Blind Audition" study cited in the introduction is very impactful, but has recently been called into question, so I am at least a little cautious when citing this study. This article may be useful. https://www.wsj.com/articles/blind-spots-in-the-blind-audition-study-11571599303 URL to the preregistered Stage 1 protocol: https://osf.io/ry2b6 Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA. List of eligible PCI RR-friendly journals: References
| Sight vs. sound in the judgment of music performance: Cross-cultural evidence from classical piano and Tsugaru shamisen competitions | Gakuto Chiba, Yuto Ozaki, Shinya Fujii, Patrick E. Savage | <p style="text-align: justify;">Which information dominates in evaluating performance in music? Both experts and laypeople consistently report believing that sound should be the most important domain when judging music competitions, but experime... | | Social sciences | Yuki Yamada | Kyoshiro Sasaki | 2021-09-24 08:59:26 | |
Sight vs. sound judgments of music performance depend on relative performer quality: Cross-cultural evidence from classical piano and Tsugaru shamisen competitions [Stage 2 Registered Report]Music is appreciated cross-modally, but is culture- and context-dependentRecommended by Yuki Yamada based on reviews by Kyoshiro Sasaki and 1 anonymous reviewer
Music is not merely limited to the aural experience we garner through our auditory faculties, as commonly perceived. Rather, various studies have explored the cross-modal impact of visual stimuli on the evaluation of music. These previous studies have been confined exclusively to Western music. Hence, Chiba et al. (2023) designed a study with a focus on the Tsugaru shamisen, a renowned folk instrument indigenous to Japan, and of which the first author is an outstanding player.
The study methodology was an improved version of previous endeavors, wherein actual musical material sourced from concours performances was displayed through audio-only, video-only or both modalities. A sample of Japanese participants were then asked to evaluate the concours performances on both the piano and the Tsugaru shamisen. The results, obtained through pre-registered protocols, revealed that for both concours performances, the participants displayed a cross-modal impact of visual information on their aural evaluation of music. This effect was also found to be contingent on cultural and contextual factors. These outcomes furnish valuable evidence towards the generalizability of the interplay between sight and sound in the assessment of music. The study underwent rigorous peer-review processes in both Stage 1 and Stage 2, with three experts specializing in Japanese folk music, open science, and statistics, respectively, providing their critical assessments. Following multiple rounds of revision, the final manuscript was deemed fit for recommendation.
URL to the preregistered Stage 1 protocol: https://osf.io/ry2b6
Level of bias control achieved: Level 6. No part of the data or evidence that was used to answer the research question was generated until after IPA.
List of eligible PCI RR-friendly journals:
References
Chiba G., Ozaki Y., Fujii S., & Savage P.E. (2023). Sight vs. sound judgments of music performance depend on relative performer quality: Cross-cultural evidence from classical piano and Tsugaru shamisen competitions [Stage 2 Registered Report]. Acceptance of Version 2 by Peer Community in Registered Reports. https://doi.org/10.31234/osf.io/xky4j
| Sight vs. sound judgments of music performance depend on relative performer quality: Cross-cultural evidence from classical piano and Tsugaru shamisen competitions [Stage 2 Registered Report] | Gakuto Chiba, Yuto Ozaki, Shinya Fujii, Patrick E. Savage | <p>Which information dominates in evaluating performance in music? Both experts and laypeople consistently report believing that sound should be the most important domain when judging music competitions, but experimental studies of Western partici... |  | Social sciences | Yuki Yamada | 2022-11-30 08:04:37 |
