Please note that we will be CLOSED to ALL SUBMISSIONS from 1 December 2024 through 12 January 2025 to give our recommenders and reviewers a holiday break.
We are recruiting recommenders (editors) from all research fields!
Your feedback matters! If you have authored or reviewed a Registered Report at Peer Community in Registered Reports, then please take 5 minutes to leave anonymous feedback about your experience, and view community ratings.
Latest recommendations
| Id | Title * | Authors * ▼ | Abstract * | Picture | Thematic fields * | Recommender | Reviewers | Submission date | |
|---|---|---|---|---|---|---|---|---|---|
07 Dec 2023
STAGE 1
Investigating individual differences in linguistic statistical learning and their relation to rhythmic and cognitive abilities: A speech segmentation experiment with online neural trackingIndividual differences in linguistic statistical learning and the relationship to rhythm perceptionRecommended by Elizabeth Wonnacott based on reviews by 2 anonymous reviewers
Previous research has demonstrated that experimental participants – both adults and infants – can track syllable co-occurrences in an artificial speech stream. This statistical learning (SL) is thought to support word segmentation and to be a core component of language acquisition. There is also some evidence that SL, as measured through artificial language tasks, is related to individual differences in language learning. What is not well understood is the underpinnings of individual differences in SL. In the current study, van der Wulp et al. (2023) will investigate the relationship between auditory SL and musical – specifically rhythmic – abilities. This work takes advantage of recent methodological innovations which allow online assessment of SL via electroencephalography (EEG) measures of neural entrainment. Up to N=105 participants will be recruited (using a well specified optional stopping procedure) and will be exposed to an artificial language using this EEG method to measure their response to the language through the exposure phase. In addition, post-tests will assess participants’ learning of the artificial language using behavioural tasks, as well as their abilities in a battery of tasks measuring rhythmic, musical, and cognitive abilities, and their vocabulary size. Core analyses will investigate whether the neural signature of statistical learning is found at a group level (i.e. replicating previous work) and whether at the individual level this is related to rhythm perception. Bayes factors will be used to assess the extent of evidence for these hypothesized relationships over the null. Exploratory analyses will explore other relationships, including with working memory and vocabulary size.
The topic of individual differences in language learning and is important, but work in this area is often underpowered, and the correlational nature of the research makes it vulnerable to HARKing. In this context, the current RR looks set to make an important contribution. The Stage 1 manuscript was evaluated over two rounds of in-depth review by the recommender and two expert reviewers, and one additional round of review by the recommender, before issuing in-principle acceptance.
URL to the preregistered Stage 1 protocol: https://osf.io/2y6sx
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA. List of eligible PCI RR-friendly journals: References
1. van der Wulp, I. M., Struiksma, M. E., Batterink, L. J., & Wijnen, F. N. K. (2023). Investigating individual differences in linguistic statistical learning and their relation to rhythmic and cognitive abilities: A speech segmentation experiment with online neural tracking. In principle acceptance of Version 4 by Peer Community in Registered Reports. https://osf.io/2y6sx | Investigating individual differences in linguistic statistical learning and their relation to rhythmic and cognitive abilities: A speech segmentation experiment with online neural tracking | Iris van der Wulp, Marijn Struiksma, Laura Batterink, Frank Wijnen | <p><strong>Objective:</strong> Statistical Learning (SL) is an essential mechanism for speech segmentation. Importantly, individual differences in SL ability are associated with language acquisition. For instance, better SL correlated with a large... | Humanities, Social sciences | Elizabeth Wonnacott | 2023-05-03 10:53:51 | |||
22 Nov 2024
STAGE 1
Sugary drinks devaluation with response training helps to resist to their consumptionCan gamified response training with sugary drinks help people to resist consumption?Recommended by Zhang Chen based on reviews by Loukia Tzavella, Matthias Aulbach and Pieter Van DesselThe excessive consumption of energy-dense but nutrient-poor foods and drinks can lead to many health problems. There is thus an increasing need for tools that may help people reduce the consumption of such foods and drinks. Training people to consistently respond or not respond to food items has been shown to reliably change their subjective evaluations of and choices for these items, mostly within laboratory settings. However, evidence on whether such trainings can also modify real consumption behavior remains mixed.
Najberg et al. developed a mobile-based response training game that combines two training tasks, one in which people consistently do not respond to sugary drinks (i.e., the go/no-go training), and one in which they consistently respond to water items rapidly (i.e., the cue-approach training). Recent work showed that after the training, participants in the experimental group reported more reduction in liking for sugary drinks and more increase in liking for water items compared to the control group. However, both groups showed equivalent reduction in self-reported consumption of sugary drinks (Najberg et al. 2023a). In the current study, Najberg and colleagues will further examine the efficacy of the gamified response training, by testing whether the training can help people resist the consumption of sugary drinks (Najberg et al. 2023b). Participants will be divided into experimental and control groups, and will receive the respective training for a minimum of seven days (and up to 20 days). After completing the training, they will be asked to avoid the trained sugary drinks, and the number of days in which they successfully adhere to this restrictive diet will be used as the dependent variable. Reporting the time at which one consumed a certain drink is presumably easier than reporting the exact volume consumed (cf. Najberg et al. 2023a). Furthermore, certain diets may require people to avoid specific foods and drinks entirely, rather than merely reduce the amount of consumption. Examining whether the training will be effective in this setting will therefore be informative. The authors will additionally examine whether the amount of training one completes, and the changes in subjective valuation of drinks after training, will be correlated with the successful avoidance of sugary drinks. These results will offer insights into the underlying mechanisms of the training and provide guidance on how they may best be implemented in applied settings. This Stage 1 manuscript was evaluated over three rounds of in-depth reviews by three expert reviewers and the recommender. The recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA). URL to the preregistered Stage 1 protocol: https://osf.io/97aez
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA. List of eligible PCI-RR-friendly journals:
1. Najberg, H., Mouthon, M., Coppin, G., & Spierer, L. (2023a). Reduction in sugar drink valuation and consumption with gamified executive control training. Scientific Reports, 13, 10659. https://doi.org/10.1038/s41598-023-36859-x
2. Najberg, H., Tapparel, M., & Spierer, L. (2023b). Sugary drinks devaluation with response training helps to resist their consumption. In principle acceptance of Version 4 by Peer Community in Registered Reports. https://osf.io/97aez | Sugary drinks devaluation with response training helps to resist to their consumption | Hugo Najberg, Malika Tapparel, Lucas Spierer | <p style="text-align: justify;">Food response training has been shown to reduce the reported value of palatable food items. These approaches may thus help to reduce unhealthy (over)consumption behaviors and its related diseases. Yet, whether and h... | Medical Sciences | Zhang Chen | 2023-06-22 12:01:20 | |||
The capacity of response training to help resist the consumption of sugary drinksGamified response training with sugary drinks does not facilitate adherence to a restrictive dietRecommended by Zhang Chen based on reviews by Matthias Aulbach and Pieter Van DesselMany people nowadays struggle with maintaining a healthy diet. Despite the intentions to eat healthily, they often over-consume highly palatable yet nutrient-poor foods and drinks, which in turn can lead to many health problems. There is therefore a need to develop tools that can help people resist the (over-)consumption of such foods and drinks.
Previous work has shown that training people to execute certain motor responses toward food items can modify their liking for these items, which may also influence their subsequent consumption behavior. Based on these findings, Najberg et al. (2023) developed a mobile game that combined two food-related response training tasks, namely the go/no-go training (Veling et al., 2017) and the cue-approach training (Schonberg et al., 2014). The experimental group was trained to consistently inhibit their responses toward sugary drinks in the go/no-go training, and consistently respond to water items in the cue-approach training (i.e., 100% consistent mapping). In the control group, the mapping between an item and response requirement was 50%, such that participants executed both go and no-go responses toward sugary drinks and water. Najberg et al. (2023) found that after the training, the experimental group reported more reduction in liking for sugary drinks and more increase in liking for water items compared to the control group. However, both groups showed equivalent reduction in self-reported consumption of sugary drinks. Using the same design (i.e., 100% vs. 50% consistency), in the current study, Najberg et al. (2024) further examined whether the combined go/no-go and cue-approach training game could help people resist the consumption of sugary drinks. Participants were divided into the experimental and control group (N = 100 and 92, respectively), and received the respective training for a minimum of seven days (and up to 20 days). After completing the training, they were asked to avoid the trained sugary drinks. The number of days in which they reported to successfully adhere to this restrictive diet was used as the main dependent variable. Contrary to their predictions, the two groups did not differ in how long they resisted the consumption of sugary drinks after training. Both groups showed equivalent reductions in liking for sugary drinks (contrary to the finding in Najberg et al., 2023), but this reduction in liking was not correlated with the number of successful days of diet in the experimental group. Lastly, those who trained for more days in the experimental group also adhered to the diet for a longer duration, but this correlation might be explained by differences in motivation across individuals. Together, these results suggest that consistently withholding responses toward sugary drinks and responding to water items does not help people resist the consumption of sugary drinks, compared to a control intervention in which the mapping is 50%. More research is therefore needed to test the effectiveness of food-related response training in changing consumption behavior outside of laboratory contexts. The Stage 2 manuscript was evaluated over three rounds of review by two expert reviewers who also assessed the Stage 1 manuscript. Following detailed responses to the recommender and the reviewers’ comments, the recommender judged that the manuscript met the Stage 2 criteria and awarded a positive recommendation. List of eligible PCI-RR-friendly journals:
References
1. Najberg, H., Mouthon, M., Coppin, G., & Spierer, L. (2023). Reduction in sugar drink valuation and consumption with gamified executive control training. Scientific Reports, 13, 10659. https://doi.org/10.1038/s41598-023-36859-x 2. Veling, H., Lawrence, N. S., Chen, Z., van Koningsbruggen, G. M., & Holland, R. W. (2017). What Is Trained During Food Go/No-Go Training? A Review Focusing on Mechanisms and a Research Agenda. Current Addiction Reports, 4, 35–41. https://doi.org/10.1007/s40429-017-0131-5
3. Schonberg, T., Bakkour, A., Hover, A. M., Mumford, J. A., Nagar, L., Perez, J., & Poldrack, R. A. (2014). Changing value through cued approach: An automatic mechanism of behavior change. Nature Neuroscience, 17, 625–630. https://doi.org/10.1038/nn.3673
4. Najberg, H., Tapparel, M., & Spierer, L. (2024). The capacity of response training to help resist the consumption of sugary drinks [Stage 2]. Acceptance of Version 4 by Peer Community in Registered Reports. https://osf.io/eu7j4?view_only=4934c0215f2943cfb42e019792a30b53 | The capacity of response training to help resist the consumption of sugary drinks | Hugo Najberg, Malika Tapparel, Lucas Spierer | <p style="text-align: justify;">Food response training has been shown to reduce the reported value of palatable food items. These approaches may thus help to reduce unhealthy (over)consumption behaviors and its related diseases. Yet, whether and h... | Medical Sciences, Social sciences | Zhang Chen | 2024-06-26 11:41:16 | |||
31 May 2024
STAGE 1
Representativeness heuristic in intuitive predictions: Replication Registered Report of problems reviewed in Kahneman and Tversky (1973)The Representativeness Heuristic Revisited: Registered Replication Report of Kahneman and Tversky (1973)Recommended by Rima-Maria Rahal based on reviews by Peter Anthony White, Regis Kakinohana and Naseem Dillman-Hasso
Revisiting a true classic, this registered replication report addresses Kahneman and Tversky’s (1973) introduction of the representativeness heuristic. The heuristic refers to deviations of judgments from normative evaluations of the evidence when the stimulus fits to a prototype. For instance, when an individual is described by features stereotypically associated with a certain target group (e.g., a person who attends dance training several times a week and has a passion for singing and performing), likelihood judgments that the individual belongs to a target group (K-Pop artists) compared to a non-target group (e.g., accountants) are inflated.
The impact of the original research on the field is clearly immense and long-lasting. All the better that a systematic replication attempt is being undertaken in this registered report, which addresses studies 1 through 7 of Kahneman and Tversky’s classic 1973 paper. Chan and Feldman (2024) propose a well-powered online study, in which all studies from the original article are presented to participants within-subjects. The materials are carefully constructed and closely documented in the accompanying OSF project, where in-depth information on planned data analyses is supported with a simulated dataset. The Stage 1 manuscript was evaluated over three rounds of in-depth review. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA). URL to the preregistered Stage 1 protocol: https://osf.io/er2cq
Level of bias control achieved: Level 6. Data collection commenced during the later part of Stage 1 peer review; however, since no substantive changes to the design were made after this point, the risk of bias due to prior data observation remains zero and the manuscript therefore qualifies for Level 6.
List of eligible PCI RR-friendly journals:
References
1. Chan, H. C. & Feldman, G. (2024). Representativeness heuristic in intuitive predictions: Replication Registered Report of problems reviewed in Kahneman and Tversky (1973). In principle acceptance of Version 5 by Peer Community in Registered Reports. https://osf.io/er2cq 2. Kahneman, D., & Tversky, A. (1973). On the psychology of prediction. Psychological Review, 80(4), 237–251. https://doi.org/10.1037/h0034747
| Representativeness heuristic in intuitive predictions: Replication Registered Report of problems reviewed in Kahneman and Tversky (1973) | Hong Ching (Bruce) Chan, Gilad Feldman | <p>[IMPORTANT: Abstract, method, and results were written using a randomized dataset produced by Qualtrics to simulate what these sections will look like after data collection. These will be updated following the data collection. For the purpose o... | Social sciences | Rima-Maria Rahal | 2023-11-29 15:19:07 | |||
15 Nov 2024
STAGE 1
Attraction depending on the level of abstraction of the character descriptionsDoes reducing abstractness increase attraction? A test of Uncertainty Reduction TheoryRecommended by Chris Chambers based on reviews by Zoltan Dienes and Florian Pargent
What determines levels of interpersonal attraction? A long history of research in social psychology has highlighted a range of important factors, such as physical attractiveness, similarity of attitudes and beliefs, reciprocity of feelings, self-disclosure of personal information, and familiarity. One theme that runs through several of these characteristics is the concept of uncertainty, and in particular how reducing uncertainty in knowledge about a person influences levels of attraction. According to the Uncertainty Reduction Theory (URT), as an individual’s uncertainty in a person diminishes, levels of attraction are expected to rise. Previous research, however, has reported a mixed and somewhat complicated relationship between uncertainty and attraction, possibly moderated by the current stage of the interpersonal relationship.
One limitation of this area of enquiry is that the methods used to reduce uncertainty have tended to focus on the amount of available information rather than its quality. This shortcoming has become increasingly salient with the rise of online social networking, where people have a wide range of strategies available to reduce uncertainty through passive (non-interactive) observation, for instance by studying profile details or other online information about a person. In the current study, Kuge et al. (2024) aim to partially fill this gap by examining the role of uncertainty reduction by altering the abstractness (or specificity) of available information, rather than its quantity, particularly in an observational, non-interactive setting. According to the tenets of URT, the authors predict firstly that participants will rate a person described in more concrete terms as more attractive than one described using abstract terms, and secondly that perceived uncertainty will mediate the effect of the abstractness on levels of attraction.
To test these hypotheses, the authors begin with an online survey (N=250) to select pairs of sentences with varying levels of abstractness while ensuring they are matched for favourability. Then in the main study (N=1000) they will test the effect of the selected abstract vs. concrete expressions on levels of attractiveness, in addition to control variables such as how confident the participant is in predicting the person’s behaviour, as well as a manipulation check to confirm the effectiveness of the abstractness manipulation. Confirmation of these hypotheses would add support for URT, while disconfirmation may indicate that the theory is inadequate at explaining the drivers of attraction in online unilateral communication.
URL to the preregistered Stage 1 protocol: https://osf.io/28f4q
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.
List of eligible PCI RR-friendly journals:
References
Kuge, H., Otsubo, K., Hattori, K., Urakawa, M., & Yamada. Y (2024). Attraction depending on the level of abstraction of the character descriptions. In principle acceptance of Version 4 by Peer Community in Registered Reports. https://osf.io/28f4q
| Attraction depending on the level of abstraction of the character descriptions | Hiyori Kuge, Kai Otsubo, Kaede Hattori, Mai Urakawa, Yuki Yamada | <p>With the recent expansion of social networking platforms, we find ourselves presented with burgeoning opportunities to evaluate other people by reading their profiles without direct interactions. Therefore, it is important to examine the determ... | Social sciences | Chris Chambers | 2022-10-10 09:08:03 | |||
08 Feb 2022
STAGE 1
Arithmetic deficits in Parkinson's Disease? A registered reportGetting the numbers right in Parkinson's disease?Recommended by Zoltan Dienes based on reviews by Pia Rotshtein, Ann Dowker, Stephanie Rossit and 1 anonymous reviewer
Everyday life, including for patients taking different types of medicine, involves dealing with numbers. Even though Parkinson's disease may ordinarily be thought of as primarily being a motor disorder, there is evidence that numerical abilities decline as Parkinson's disease progresses. Further, the brain areas involved in arithmetic operations overlap with the areas that degenerate in Parkinson's disease. In this Stage 1 Registered Report, Loenneker et al. (2022) will test healthy controls, Parkinson disease patients with normal cognition, and Parkinson disease patients with mild cognitive impairment on general working memory tasks as well as arithmetic performance on the four basic operations (addition, subtraction, multiplication, division). The study aims to test whether or not there is a deficit in each operation, and the relation of any deficits to general working memory capacity. The Stage 1 manuscript was evaluated over four rounds of review (including two rounds of in-depth specialist review). Based on comprehensive responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA). URL to the preregistered Stage 1 protocol: https://osf.io/nb5fj Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA. List of eligible PCI RR-friendly journals:
References Loenneker, H. D., Liepelt-Scarfone, I., Willmes, K., Nuerk, H.-C., & Artemenko, C. (2022). Arithmetic deficits in Parkinson’s Disease? A Registered Report. Stage 1 preregistration, in principle acceptance of version 4 by Peer Community in Registered Reports. https://osf.io/nb5fj | Arithmetic deficits in Parkinson's Disease? A registered report | Hannah D. Loenneker, Inga Liepelt-Scarfone, Klaus Willmes, Hans-Christoph Nuerk, & Christina Artemenko | <p>Elderly people and patients with neurodegenerative diseases such as Parkinson’s Disease (PD) immensely rely on arithmetic skills to lead an independent life. Activities such as medication management, financial transactions or using public trans... | | Life Sciences | Zoltan Dienes | 2021-06-29 19:23:53 | ||
Dose-response of tDCS effects on motor learning and cortical excitability: a preregistered studyIncreasing stimulation intensity does not affect motor learningRecommended by Christina Artemenko based on reviews by 1 anonymous reviewer
In neurostimulation research, the parameters of a stimulation protocol crucially impact on the effects of the stimulation. Transcranial direct current stimulation (tDCS) is a neurostimulation technique that typically uses current intensities about 1-2 mA in human research to modulate motor and cognitive behavior. The current sham-controlled study by Hsu et al. (2024) applies current intensities not only of 2 mA but also of 4 mA and 6 mA and thus extends our understanding of stimulation parameters while ethical standards are preserved.
The influence of tDCS over the primary motor cortex was evaluated for neural plasticity during motor learning. Stimulation effects were tested not only behaviorally but also physiologically by motor evoked potentials elicited by transcranial magnetic stimulation (TMS). The presented pilot data were promising and underlined the feasibility of the proposed research design. The study contributes to tDCS research by uncovering reasons for controversial findings and thus increases reproducibility.
The results of the study unexpectedly revealed no stimulation effects on motor learning, neither for behavioral outcomes nor for physiological outcomes by motor evoked potentials. No evidence was found that stimulation effects linearly increase with increasing intensity. Interestingly, higher intensities were relatively well tolerated - but did not have any impact. The current findings underline the purpose of preregistrations and registered reports to act against publication bias, particulary in the field of neuromodulation. In the current case, failed replication and null findings - revealed by a methodologically sound study - are crucial to inform future research using similar stimulation protocols with the aim to modulate motor or cognitive behavior.
The Stage 2 manuscript was evaluated over one round of review. Based on detailed responses to reviewers’ and the recommender’s comments, the recommender judged that the manuscript met the Stage 2 criteria and awarded a positive recommendation.
URL to the preregistered Stage 1 protocol: https://osf.io/jyuev
Level of bias control achieved: Level 2. At least some data/evidence that was used to answer the research question had been accessed and partially observed by the authors prior to Stage 1 in-principle acceptance, but the authors certify that they had not yet observed the key variables within the data that were used to answer the research question. List of eligible PCI RR-friendly journals: References
Hsu, G., Jafari, Z. H., Ahmed, A., Edwards, D. J., Cohen, L. G., & Parra, L. C. (2024). Dose-response of tDCS effects on motor learning and cortical excitability: a preregistered study [Stage 2]. Acceptance of Version 2.1 by Peer Community in Registered Reports. https://osf.io/a42uy
| Dose-response of tDCS effects on motor learning and cortical excitability: a preregistered study | Gavin Hsu, Zhenous Hadi Jafari, Abdelrahman Ahmed, Dylan J. Edwards, Leonardo G. Cohen, Lucas C. Parra | <p>Background: Multiple studies have demonstrated that transcranial direct current stimulation (tDCS) of the primary motor cortex (M1) can influence corticospinal excitability and motor skill acquisition. However, the evidence for these effects i... |  | Engineering, Medical Sciences | Christina Artemenko | 2024-09-02 19:07:02 | ||
05 Jun 2024
STAGE 1
Dose-response of tDCS effects on motor learning and cortical excitability: a preregistered studyHow stimulation intensity affects motor learningRecommended by Christina Artemenko based on reviews by Charlotte Wiltshire and 1 anonymous reviewer
In neurostimulation research, the parameters of a stimulation protocol crucially impact on the effects of the stimulation. Transcranial direct current stimulation (tDCS) is a neurostimulation technique that typically uses current intensities about 1-2 mA in human research to modulate motor and cognitive behavior. The current sham-controlled study by Hsu et al. (2024) applies current intensities not only of 2 mA but also of 4 mA and 6 mA and thus extends our understanding of stimulation parameters while ethical standards are preserved.
The influence of tDCS over the primary motor cortex will be evaluated for neural plasticity during motor learning. Stimulation effects will be tested not only behaviorally but also physiologically by motor evoked potentials elicited by transcranial magnetic stimulation (TMS). The presented pilot data are promising and underline the feasibility of the proposed research design. The study will contribute to tDCS research by uncovering reasons for controversial findings and thus increase reproducibility.
The Stage 1 manuscript was evaluated over two rounds of in-depth review. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
URL to the preregistered Stage 1 protocol: https://osf.io/jyuev
Level of bias control achieved: Level 2. At least some data/evidence that will be used to answer the research question has been accessed and partially observed by the authors, but the authors certify that they have not yet observed the key variables within the data that will be used to answer the research question. List of eligible PCI RR-friendly journals: References
Hsu, G., Edwards, D. J., Cohen, L. G., & Parra, L. C. (2024). Dose-response of tDCS effects on motor learning and cortical excitability: a preregistered study. In principle acceptance of Version 1.3 by Peer Community in Registered Reports. https://osf.io/jyuev
| Dose-response of tDCS effects on motor learning and cortical excitability: a preregistered study | Gavin Hsu, Dylan J. Edwards, Leonardo G. Cohen, Lucas C. Parra | <p>Neuromodulatory effects of transcranial direct current stimulation (tDCS) on the primary motor cortex (M1) have been reported in terms of changes in corticospinal excitability using motor evoked potentials (MEPs), as well as behavioral effects ... | | Engineering, Life Sciences | Christina Artemenko | 2024-01-11 00:11:23 | ||
28 Dec 2021
STAGE 1
Sight vs. sound in the judgment of music performance: Cross-cultural evidence from classical piano and Tsugaru shamisen competitionsUnderstanding the role of visual and auditory information in evaluating musical performanceRecommended by Yuki Yamada based on reviews by David Hughes and Kyoshiro Sasaki
In this Stage 1 Registered Report, Chiba and colleagues (2021) aim to investigate how people use information from visual and auditory modalities when evaluating musical performances. Previous studies, mainly using Western music, have reported a visual dominance, but this has not yet been clearly and consistently reported. Thus, the authors propose to evaluate both the reproducibility and generalizability of the previous findings by conducting a replication study using the methodology of the previous studies and by introducing a new experimental condition in which the Tsugaru-shamisen, a unique Japanese musical instrument, is also performed. This study could represent an important turning point in the research context of performance evaluation and would be of considerable value. This manuscript was peer-reviewed by two experts in scientific methodology and Japanese traditional music, respectively, and during the two-round peer-review process they made a number of important points, but eventually awarded the manuscript a highly positive response. I am therefore pleased to recommend that this Stage 1 Registered Report meets our Stage 1 criteria and is worthy of in-principle acceptance. I look forward to seeing the results and discussion reported in Stage 2, with the expectation that the experiment conducted by the authors will be in strict accordance with this protocol. *The following is a very minor comment, which I hope the authors will find helpful in the future. Of course, this is not related to hypothesis construction and does not require revision: The "Blind Audition" study cited in the introduction is very impactful, but has recently been called into question, so I am at least a little cautious when citing this study. This article may be useful. https://www.wsj.com/articles/blind-spots-in-the-blind-audition-study-11571599303 URL to the preregistered Stage 1 protocol: https://osf.io/ry2b6 Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA. List of eligible PCI RR-friendly journals: References
| Sight vs. sound in the judgment of music performance: Cross-cultural evidence from classical piano and Tsugaru shamisen competitions | Gakuto Chiba, Yuto Ozaki, Shinya Fujii, Patrick E. Savage | <p style="text-align: justify;">Which information dominates in evaluating performance in music? Both experts and laypeople consistently report believing that sound should be the most important domain when judging music competitions, but experime... | | Social sciences | Yuki Yamada | Kyoshiro Sasaki | 2021-09-24 08:59:26 | |
Sight vs. sound judgments of music performance depend on relative performer quality: Cross-cultural evidence from classical piano and Tsugaru shamisen competitions [Stage 2 Registered Report]Music is appreciated cross-modally, but is culture- and context-dependentRecommended by Yuki Yamada based on reviews by Kyoshiro Sasaki and 1 anonymous reviewer
Music is not merely limited to the aural experience we garner through our auditory faculties, as commonly perceived. Rather, various studies have explored the cross-modal impact of visual stimuli on the evaluation of music. These previous studies have been confined exclusively to Western music. Hence, Chiba et al. (2023) designed a study with a focus on the Tsugaru shamisen, a renowned folk instrument indigenous to Japan, and of which the first author is an outstanding player.
The study methodology was an improved version of previous endeavors, wherein actual musical material sourced from concours performances was displayed through audio-only, video-only or both modalities. A sample of Japanese participants were then asked to evaluate the concours performances on both the piano and the Tsugaru shamisen. The results, obtained through pre-registered protocols, revealed that for both concours performances, the participants displayed a cross-modal impact of visual information on their aural evaluation of music. This effect was also found to be contingent on cultural and contextual factors. These outcomes furnish valuable evidence towards the generalizability of the interplay between sight and sound in the assessment of music. The study underwent rigorous peer-review processes in both Stage 1 and Stage 2, with three experts specializing in Japanese folk music, open science, and statistics, respectively, providing their critical assessments. Following multiple rounds of revision, the final manuscript was deemed fit for recommendation.
URL to the preregistered Stage 1 protocol: https://osf.io/ry2b6
Level of bias control achieved: Level 6. No part of the data or evidence that was used to answer the research question was generated until after IPA.
List of eligible PCI RR-friendly journals:
References
Chiba G., Ozaki Y., Fujii S., & Savage P.E. (2023). Sight vs. sound judgments of music performance depend on relative performer quality: Cross-cultural evidence from classical piano and Tsugaru shamisen competitions [Stage 2 Registered Report]. Acceptance of Version 2 by Peer Community in Registered Reports. https://doi.org/10.31234/osf.io/xky4j
| Sight vs. sound judgments of music performance depend on relative performer quality: Cross-cultural evidence from classical piano and Tsugaru shamisen competitions [Stage 2 Registered Report] | Gakuto Chiba, Yuto Ozaki, Shinya Fujii, Patrick E. Savage | <p>Which information dominates in evaluating performance in music? Both experts and laypeople consistently report believing that sound should be the most important domain when judging music competitions, but experimental studies of Western partici... |  | Social sciences | Yuki Yamada | 2022-11-30 08:04:37 |
