Understanding the role of visual and auditory information in evaluating musical performance
Sight vs. sound in the judgment of music performance: Cross-cultural evidence from classical piano and Tsugaru shamisen competitions
Recommendation: posted 28 December 2021, validated 28 December 2021
Yamada, Y. (2021) Understanding the role of visual and auditory information in evaluating musical performance. Peer Community in Registered Reports, 100003. https://doi.org/10.24072/pci.rr.100003
Related stage 2 preprints:
In this Stage 1 Registered Report, Chiba and colleagues (2021) aim to investigate how people use information from visual and auditory modalities when evaluating musical performances. Previous studies, mainly using Western music, have reported a visual dominance, but this has not yet been clearly and consistently reported. Thus, the authors propose to evaluate both the reproducibility and generalizability of the previous findings by conducting a replication study using the methodology of the previous studies and by introducing a new experimental condition in which the Tsugaru-shamisen, a unique Japanese musical instrument, is also performed. This study could represent an important turning point in the research context of performance evaluation and would be of considerable value.
This manuscript was peer-reviewed by two experts in scientific methodology and Japanese traditional music, respectively, and during the two-round peer-review process they made a number of important points, but eventually awarded the manuscript a highly positive response. I am therefore pleased to recommend that this Stage 1 Registered Report meets our Stage 1 criteria and is worthy of in-principle acceptance. I look forward to seeing the results and discussion reported in Stage 2, with the expectation that the experiment conducted by the authors will be in strict accordance with this protocol.
*The following is a very minor comment, which I hope the authors will find helpful in the future. Of course, this is not related to hypothesis construction and does not require revision: The "Blind Audition" study cited in the introduction is very impactful, but has recently been called into question, so I am at least a little cautious when citing this study. This article may be useful. https://www.wsj.com/articles/blind-spots-in-the-blind-audition-study-11571599303
URL to the preregistered Stage 1 protocol: https://osf.io/ry2b6
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.
List of eligible PCI RR-friendly journals:
- Chiba G, Ozaki Y, Fujii S, Savage PE (2021) Sight vs. sound in the judgment of music performance: Cross-cultural evidence from classical piano and Tsugaru shamisen competitions [Stage 1 Registered Report]. Psyarxiv, xky4j, stage 1 preregistration, in-principle acceptance of version 5 by Peer Community in Registered Reports. https://doi.org/10.31234/osf.io/xky4jhttps://doi.org/10.17605/OSF.IO/RY2B6
The recommender in charge of the evaluation of the article and the reviewers declared that they have no conflict of interest (as defined in the code of conduct of PCI) with the authors or with the content of the article.
Reviewed by Kyoshiro Sasaki, 28 Dec 2021
Evaluation round #1
DOI or URL of the report: https://doi.org/10.31234/osf.io/xky4j
Author's Reply, 14 Dec 2021
Decision by Yuki Yamada, posted 03 Nov 2021
I appreciate your submission to PCI RR. As you can see, we were able to receive peer reviews from two relevant researchers: one is a cognitive psychologist who is very familiar with registered reports. The other is a widely experienced expert in Japanese historical music. Before introducing the individual peer review results, I would like to inform you that this manuscript requires a major revision before it can be recommended. The reasons for this are as follows.
The former reviewer seems to acknowledge the potential significance of this work, but also points out several major issues. These may be summarized in the appropriateness of the experimental design and the justifiability of the sample size design. In particular, if this study is truly considering that historical factors (I am not sure if that is the suitable terminology) are related to the audience's performance evaluation, it should be specifically stated as a hypothesis, as pointed out by the reviewer, and the experimental design should be capable of examining it. That is, it is worth considering using a method that can detect the effects of knowledge about the historical background of the Tsugaru shamisen and about traditional performers (not the recent popular ones), and adding other popular music as an additional control condition.
The latter reviewer appreciates the article very much, but says that some technical expressions should be annotated. In fact, readers who read registered reports and are familiar with hypothesis-testing studies will have no difficulty in understanding the meaning of statistics and methodological abbreviations. However, this study has a very unique focus of research subject (i.e., Tsugaru shamisen), and the readership may be much broader than the authors envisioned. Therefore, it would be beneficial for the social impact of this study to supplement the descriptions with points even if the authors might feel they are redundant in writing usual manuscripts.However, in my opinion, adding detailed explanations of statistics in the text may reduce the readability for experts, so I thought it would be a good idea to use footnotes.
Thus, I am looking forward to receiving this manuscript again, which has been greatly improved by the review comments of both reviewers.
Reviewed by Kyoshiro Sasaki, 02 Nov 2021
Reviewed by David Hughes, 26 Oct 2021
As editor of the APA journal Psychology of Consciousness, I hope that you will consider submitting your manuscript “Sight vs. sound in the judgment of music performance: Cross-cultural evidence from classical piano and Tsugaru shamisen competitions“ for automatic acceptance by the journal—after it has been accepted PCI-RR. If you want to learn more about the journal, please consult its website www.apa.org/pubs/journals/cns. And if you decide to submit your PCI-approved manuscript to Psychology of Consciousness, please note this approval in your cover letter. Robert Kunzendorf (editor)