We are recruiting recommenders (editors) from all research fields!
Your feedback matters! If you have authored or reviewed a Registered Report at Peer Community in Registered Reports, then please take 5 minutes to leave anonymous feedback about your experience, and view community ratings.
Latest recommendations
| Id | Title | Authors | Abstract | Picture▼ | Thematic fields | Recommender | Reviewers | Submission date | |
|---|---|---|---|---|---|---|---|---|---|
Does alleviating poverty increase cognitive performance? Short- and long-term evidence from a randomized controlled trialNo strong effect of unconditional cash transfers on cognitionRecommended by Chris Chambers based on reviews by Charlotte Pennington and Matúš Adamkovič
Recent studies have revealed potential benefits of unconditional cash transfers (UCTs) on a variety of health and social outcomes, including self-reported happiness and life satisfaction (Haushofer & Shapiro, 2016), economic and financial well-being (Blattman et al., 2013; Baird et al., 2018) and educational attainment (Baird et al., 2016). Although the effects of UCTs do not always out-perform rigorous control conditions (Whillans & West, 2022), these findings prompt the question of whether the alleviation of poverty via UCTs can also influence cognitive processing and performance.
In the current study, Szaszi et al. analysed the results of a previous randomised trial of UCTs by Blattman et al. (2017) to test whether a $200 lump sum – equivalent to three months of income – administered to a sample of young men in Liberia carries both short- and long-term benefits for a range of executive functions, including attention, response inhibition, and working memory capacity. Overall, the results suggest minimal if any consequences of the intervention – the observed effects of UCTs on cognition were several times smaller than suggested by previous research, and the evidence for a positive effect was inconclusive. Extensive multiverse analyses showed that these findings were robust to a range of alternative analytical specifications, and the authors estimate that a sample size of nearly 5000 would be required to provide strong evidence.
In their Discussion, the authors explore a range of reasons for the negative findings compared with previous research, including the more rigorous and severe causal test enabled by the randomised trial design, the demographic homogeneity of the sample demographic, the use of pen-and-paper tests (cf. computerised tests in previous studies), and the delivery of a lump-sum cash transfer compared with a regular monthly installment. In addition, although the results were negative or inconclusive, there were hints that a positive effect of UCTs may be more evident in some cognitive domains than in others – in this case, potentially benefiting working memory more than inhibitory control. Further research would be required to confirm this hypothesis.
The Stage 2 manuscript was evaluated over one round of in-depth review. Based on the responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 2 criteria and awarded a positive recommendation.
URL to the preregistered Stage 1 protocol: https://osf.io/k56yv
Level of bias control achieved: Level 2. At least some data/evidence that was used to answer the research question had been accessed and partially observed by the authors prior to Stage 1 acceptance, but the authors certified that they had not yet observed the key variables within the data that would be used to answer the research question AND they took additional steps to maximise bias control and rigour.
List of eligible PCI RR-friendly journals:
References
1. Haushofer, J. & Shapiro, J. (2016). The short-term impact of unconditional cash transfers to the poor: Experimental evidence from Kenya. Quarterly Journal of Economics, 13, 1973–2042. https://doi.org/10.1093/qje/qjw025
2. Blattman, C., Fiala, N. & Martinez, S. (2013) Generating skilled self-employment in developing countries: Experimental evidence from Uganda. Quarterly Journal of Economics, 129, 697–752. https://doi.org/10.1093/qje/qjt057
3. Baird, S., McKenzie, D., & Özler, B. (2018). The effects of cash transfers on adult labor market outcomes. IZA Journal of Development and Migration, 8, 1-20. https://doi.org/10.1186/s40176-018-0131-9
4. Baird, S., Chirwa, E., De Hoop, J., & Özler, B. (2016). Girl power: cash transfers and adolescent welfare: evidence from a cluster-randomized experiment in Malawi. In African Successes, Volume II: Human Capital (pp. 139-164). University of Chicago Press. https://www.nber.org/system/files/chapters/c13380/c13380.pdf
5. Whillans, A., & West, C. (2022). Alleviating time poverty among the working poor: A pre-registered longitudinal field experiment. Scientific Reports, 12(1), 1-17. https://doi.org/10.1038/s41598-021-04352-y
6. Blattman, C., Jamison, J. C. & Sheridan, M. (2017). Reducing crime and violence: Experimental evidence from cognitive behavioral therapy in Liberia. American Economic Review, 107, 1165–1206. http://doi.org/10.1257/aer.20150503
7. Szaszi, B., Palfi, B., Neszveda, G., Taka, A., Szecsi, P., Blattman, C., Jamison, J. C., & Sheridan, M. (2022). Does alleviating poverty increase cognitive performance? Short- and long-term evidence from a randomized controlled trial. Stage 2 Registered Report, acceptance of Version 2 by Peer Community in Registered Reports. https://psyarxiv.com/4gyzh
| Does alleviating poverty increase cognitive performance? Short- and long-term evidence from a randomized controlled trial | Barnabas Szaszi, Bence Palfi, Gabor Neszveda, Aikaterini Taka, Péter Szécsi, Christopher Blattman, Julian C. Jamison, Margaret Sheridan | <p>In this Registered Report, we investigated the impact of a poverty alleviation program on cognitive performance. We analyzed data from a randomized controlled trial conducted on low-income, high-risk individuals in Liberia where a random half o... | Social sciences | Chris Chambers | 2022-07-13 12:10:49 | |||
Globally, songs and instrumental melodies are slower, higher, and use more stable pitches than speech [Stage 2 Registered Report]Strong evidence for cross-cultural regularities in music and speechRecommended by Chris Chambers based on reviews by Bob Slevc and Nai Ding
For centuries, the ubiquity of language and music across human societies has prompted scholars to speculate about their cross-cultural origins as well as their shared and unique characteristics. Depending on the extent to which contemporary theories emphasise the role of biology vs. culture, a range of hypotheses have been proposed concerning expected similarities and differences in song and speech. One class of hypotheses stemming from cultural relativism assumes a lack of universal regularities in song and speech, and therefore predicts no systematic cross-cultural relationships. On the other hand, more recent evolutionary hypotheses such as the social bonding hypothesis, motor constraint hypothesis, and sexual selection hypothesis all predict differences or similarities in specific characteristic of vocalisations, such as pitch regularity, pitch interval size, and melodic contour. Existing results are mixed in their support of these predictions.
In the current study, Ozaki et al. (2023) elucidated cross-cultural similarities and differences between speech and song in 75 different linguistic varieties spanning 21 language families. Understanding precisely how song and speech are related is methodologically challenging due to the multitude of confounds that can arise in comparing natural recordings. Here the authors overcame these difficulties with four types of carefully controlled recordings: singing, recitation of sung lyrics, spoken description of the song, and instrumental version of the sung melody. The authors then examined six features that are amenable to reliable comparison, including pitch height, temporal rate, pitch stability, timbral brightness, pitch interval size, and pitch declination. With this data in hand, the authors asked which acoustic features differ reliably between song and speech across cultures, with the expectation that song would exhibit higher pitch, slower rate and more stable pitch than speech. At the same time, the authors expected song and speech to be reliably similar in the characteristics of timbral brightness, pitch intervals and pitch contours
The findings provided strong support for the preregistered hypotheses. Relative to speech, songs exhibited higher pitch, slower temporal rate, and more stable pitches, while both songs and speech had similar pitch interval size and timbral brightness. Only one hypothesis was unsupported, with the comparison of pitch declination between song and speech turning out inconclusive. To overcome potential sources of analytic bias, the authors undertook additional robustness checks, including reanalysis of a previously published dataset of over 400 song/speech recordings; this exploratory analysis corroborated the conclusions from the confirmatory analysis. Overall this study offers a unique insight into the shared global characteristics of langage and music, with implications for understanding their cultural and biological (co)evolution.
The Stage 2 manuscript was evaluated over one round of in-depth review. Based on responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 2 criteria and therefore awarded a positive recommendation.
URL to the preregistered Stage 1 protocol: https://osf.io/jdhtz
Level of bias control achieved: Level 2. At least some data/evidence that was used to answer the research question had been accessed and partially observed by the authors, but the authors certify that they had not yet observed the key variables within the data that were be used to answer the research question AND they took additional steps to maximise bias control and rigour.
List of eligible PCI RR-friendly journals: References
1. Ozaki, Y. et al. (2023). Globally, songs and instrumental melodies are slower, higher, and use more stable pitches than speech [Stage 2 Registered Report]. Acceptance of Version 11 by Peer Community in Registered Reports. https://doi.org/10.31234/osf.io/jr9x7
| Globally, songs and instrumental melodies are slower, higher, and use more stable pitches than speech [Stage 2 Registered Report] | Yuto Ozaki, Adam Tierney, Peter Pfordresher, John Mcbride, Emmanouil Benetos, Polina Proutskova, Gakuto Chiba, Fang Liu, Nori Jacoby, Suzanne Purdy, Patricia Opondo, Tecumseh Fitch, Shantala Hegde, Martín Rocamora, Rob Thorne, Florence Ewomazino N... | <p>What, if any, similarities and differences between music and speech are consistent across cultures? Both music and language are found in all known human societies and are argued to share evolutionary roots and cognitive resources, yet no studie... | Humanities, Social sciences | Chris Chambers | 2023-05-16 17:22:17 | |||
Applying a Synergistic Mindsets Intervention to an Esports ContextSynergistic Mindset Intervention in Competitive SituationsRecommended by Veli-Matti Karhulahti based on reviews by Lee Moore, Ivan Ropovik and Jacob Keech
Mindset theories suggest that the mere belief in the malleability of human abilities can help one to develop related performance. On the other hand, one and the same performance situation can also be experienced in various affective ways, which differently contribute to performance outcomes. One theoretically justifiable premise is that appraising a performance situation as a “threat” instead of “challenge” is associated with maladaptive responses, such as impaired cardiovascular mobilization. If people could experience performance situations as positive challenges, this might also improve performance outcomes. Drawing from these connected premises, the synergistic mindset intervention was developed and tentatively found to help adolescents in stressful situations (Yeager et al., 2022).
In the present registered report, Behnke et al. (2024) built on the above to test whether the synergistic mindset intervention can help individuals in competitive gaming situations. The authors utilized one of the leading esport games, Counter-Strike: Global Offensive, and recruited its active players (N=300) into randomized control and intervention groups. The participants competed in a cash-prize tournament involving measures of affective experience and cardiovascular responses. Behnke et al. (2024) hypothesized the synergistic mindset group (SMI) to show greater challenge affective responses and superior performance outcomes. Although the SMI produced a number of positive outcomes such as more beneficial stress mindsets, the hypotheses were not corroborated but the results supported a null. This may be related to the observation that participants generally experienced the intervention positively, which, in turn, limits the potential for improving affective and physiological responses. These rigorous null results are informative by directing the SMI research program toward test designs where more participants experience strong negative stress responses. Moreover, the results encourage researchers to reassess the underlying auxiliary hypotheses regarding affective responses and performance outcomes, the relationships of which may be complicated by situational factors that are not yet fully understood. The Stage 2 manuscript was evaluated over one round of in-depth review. Three out of the four Stage 1 experts returned to review and, due to the study’s exceptionally high level of transparency, the reviewers had only minor requests for revision. As all the requested revisions were implemented carefully, the recommender judged that the manuscript met the Stage 2 criteria and awarded a positive recommendation. URL to the preregistered Stage 1 protocol: https://osf.io/z3adb Level of bias control achieved: Level 6. No part of the data or evidence that was used to answer the research question was generated until after IPA. List of eligible PCI RR-friendly journals:
References
1. Behnke M., Lakens D., Petrova K., Chwiłkowska P., Kaczmarek L. D., Jamieson J. P., & Gross J. J. (2024) Applying a Synergistic Mindsets Intervention to an Esports Context. Acceptance of Version 2 by Peer Community in Registered Reports https://osf.io/53z8e 2. Yeager D.S., Bryan C.J., Gross J.J., Murray J., Krettek D., Santos P., ... & Jamieson J.P. (2022) A synergistic mindsets intervention protects adolescents from stress. Nature 607, 512–520. https://doi.org/10.1038/s41586-022-04907-7
| Applying a Synergistic Mindsets Intervention to an Esports Context | Maciej Behnke, Daniël Lakens, Kate Petrova, Patrycja Chwiłkowska, Szymon Jęśko Białek, Maciej Kłoskowski, Wadim Krzyżaniak, Patryk Maciejewski, Lukasz D. Kaczmarek, Kacper Szymański, Jeremy P. Jamieson, James J. Gross | <p>Affective responses during stressful, high-stakes situations can play an important role in shaping performance. For example, feeling shaky and nervous at a job interview can undermine performance, whereas feeling excited during that same interv... | Social sciences | Veli-Matti Karhulahti | 2024-02-02 17:57:13 | |||
Breaking Ban: Belgium’s ineffective gambling law regulation of video game loot boxesLoot boxes remain prevalent in Belgium despite their “ban”Recommended by Veli-Matti Karhulahti based on reviews by Andrew Moshirnia, Joseph Macey and Jason Chin
Several countries currently struggle to legally interpret and deal with loot boxes, i.e. gambling-like mechanisms that have become common especially in contemporary videogame design. One of the few countries to take a clear regulation stance is Belgium, which officially announced that they interpret paid loot boxes as games of chance that violate their Gaming and Betting Act and can thus be criminally prosecuted (Naessens 2018). This announcement four years ago laid the basis for a unique social experiment where companies offering loot boxes in Belgium had to decide whether to modify their games, exit the market, or continue to monetize with loot boxes. In the present study, Xiao (2022) investigated the outcomes of this experiment both via hypotheses testing and exploratory analysis.
Using the 100 highest-grossing iPhone games in Belgium as data and applying comprehensive qualitative mechanical analysis to each title, Xiao (2022) tested three preregistered hypotheses regarding loot box prevalence. None of the hypotheses were confirmed: the prevalence rate of loot boxes in the Belgian App Store was not null but extremely high (82.0%), also among mobile games designed for minors (54.2–80.2%), and significantly more compared to global standards when assessed by a binomial test (p<.001). Corroborating a fourth hypothesis, Xiao was also able to access various UK loot boxes in Belgium. In exploratory research, Xiao received a confirmation from the Belgian Gaming Commission that even “simulated gambling games” (that do not yield monetary wins) also legally constitute gambling in Belgium.
The results are the first to describe outcomes of ban-driven loot box regulation globally. Despite Belgium’s clear statement that “paid loot boxes must be removed from the video games in order to comply with the Belgian Gaming and Betting Act” (Naessens 2018, p. 16), almost all highest-grossing iPhone games in the Belgian App Store keep offering them. The finding is important especially for the legal authorities around the world who are currently assessing their own positions in potential regulation: simple statements are unlikely to have immediate effects on international companies in local markets. On the other hand, it remains unknown how these companies have interpreted the statement and what are their distinct reasons for continuing to offer loot boxes in the Belgian App Store. It would be important in future research to investigate the companies’ perspectives.
This study (Xiao 2022) is important also from a meta-scientific perspective. It paves the way for Registered Reports in new disciplines and methods, and involves an exceptional field experiment that was carefully documented with open data and materials. Three external experts reviewed the Stage 2 manuscript twice, based on which the recommender awarded a positive recommendation.
URL to the preregistered Stage 1 protocol: https://osf.io/5mxp6 Level of bias control achieved: Level 6. No part of the data or evidence that was used to answer the research question existed prior to Stage 1 in-principle acceptance. List of eligible PCI RR-friendly journals:
References
1. Naessens, P. (2018) Research Report on Loot Boxes [English Translation]. Belgian Gaming Commission. URL: https://www.gamingcommission.be/sites/default/files/2021-08/onderzoeksrapport-loot-boxen-Engels-publicatie.pdf
2. Xiao, L.Y. (2022) Breaking Ban: Belgium’s ineffective gambling law regulation of video game loot boxes. Stage 2 Registered Report, acceptance of Version 2 by Peer Community in Registered Reports. https://doi.org/10.31219/osf.io/hnd7w
| Breaking Ban: Belgium’s ineffective gambling law regulation of video game loot boxes | Leon Y. Xiao | <p>Loot boxes in video games are gambling-like mechanics that players buy to obtain randomised rewards of varying value. Loot boxes are conceptually and psychologically similar to gambling, and loot box expenditure is positively correlated with se... |  | Humanities, Social sciences | Veli-Matti Karhulahti | 2022-07-28 12:29:57 | ||
24 Sep 2021
STAGE 1
Phenomenological Strands for Gaming Disorder and Esports Play: A Qualitative Registered ReportHow does the phenomenology of "gaming disorder" differ from intensive but non-pathological videogame play?Recommended by Chris Chambers based on reviews by Malte Elson, Peter Branney and Michelle Carras
In this Stage 1 Registered Report, Karhulahti and colleagues (2021) propose a qualitative, interview-based study of videogame play, with the central aim to understand key phenomological differences between gaming behaviour that is associated with vs. without health problems. This question is particularly important given the recent inclusion of "gaming disorder" in the WHO's International Statistical Classification of Diseases and Related Health Problems (ICD). In recent years, the validity of "gaming disorder" as an identifiable mental illness has been controversial (e.g. Van Rooij et al, 2018), as has the debate concerning purported harms or benefits of gaming for mental health. This Stage 1 manuscript describes a rigorous qualitative investigation that should provide new insights on this question, and will also include a longitudinal component to examine changes in phenomonology over time, as well as an examination of the extent to which the phenomonology of gaming is reflected in the experiences of medical experts such as doctors, nurses, and therapists who have worked with gaming-related health problems. More broadly, the manuscript breaks new ground for Registered Reports, being one of the first to focus on qualitative methods, while also making use of the Programmatic submission track in which the approved Stage 1 manuscript is intended to produce two Stage 2 manuscripts focusing on different elements of the project. Three expert reviewers with a variety of field-specialist and qualitative methodological expertise assessed the Stage 1 manuscript over two rounds of in-depth review. Following revision, the reviewers and recommender agreed that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA). URL to the preregistered Stage 1 protocol: https://osf.io/a2rwg Level of bias control achieved: Level 4. At least some of the data/evidence that will be used to answer the research question already exists AND is accessible in principle to the authors (e.g. residing in a public database or with a colleague), BUT the authors certify that they have not yet accessed any part of that data/evidence. List of eligible PCI RR-friendly journals: References
| Phenomenological Strands for Gaming Disorder and Esports Play: A Qualitative Registered Report | Veli-Matti Karhulahti, Miia Siutila, Jukka Vahlo, Raine Koskimaa | <p style="text-align: justify;">The recent inclusion of gaming disorder in the ICD-11 as a mental disorder has further increased the importance of researching the health spectrum related to gaming. A critical area in this regard is the lack of cla... | | Medical Sciences, Social sciences | Chris Chambers | 2021-06-16 20:22:24 | ||
15 Apr 2023
STAGE 1
Reconstructing Gaming Disorder: A Taxonomy by Registered ReportHow can the experiences of those who engage in video games in healthy and unhealthy ways be systematically organised?Recommended by Zoltan Dienes based on reviews by Michelle Carras, Lukas J. Gunschera and Christopher Ferguson
People are often drawn into intensive video game use in ways they or others may find troubling, harmless or even praiseworthy. Understanding these different experiences may help with integrating intensive technology use into everyday life in a healthy way.
In this programmatic submission, Karhulahti et al. (2023) will explore the gaming experiences of three groups of people (those who have sought treatment for gaming, esport players, and adolescents who play around two hours every day), using phenomenological and clinical interviews, and gaming diary logs every four months over three years. Around 200-300 participants will be recruited initially from Finland, Slovakia, and South Korea. In order to further increase cross-cultural range, the study will apply a new duplication method to collect similar data also in countries that have been studied little in the past. The aim will be to answer the questions of a) Is it possible to distinguish passionate from pathological gaming by the meanings and values that players attach to videogame play? and b) What are the design structures of videogames, which are played intensively and/or with gaming-related health problems? Ultimately, the study aims to synthesise all its data into a new taxonomic system, which can help better understand the differences and idiosyncrasies of gaming in lives across cultures.
This Stage 1 manuscript was evaluated over two rounds of in-depth review. Based on the comprehensive responses to the reviewers' feedback, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
URL to the preregistered Stage 1 protocol: https://osf.io/ekm8x Level of bias control achieved: Level 4. At least some of the data/evidence that will be used to answer the research question already exists AND is accessible in principle to the authors (e.g. residing in a public database or with a colleague) BUT the authors certify that they have not yet accessed any part of that data/evidence List of eligible PCI RR-friendly journals: References
Karhulahti, V.-M., Martončik. M., Siutila, M., Park, S., Jin, J., Adamkovič, M., Auranen, T., Na, B., & Yoon, T.-J. (2023). Reconstructing Gaming Disorder: A Taxonomy by Registered Report, in principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/ekm8x
| Reconstructing Gaming Disorder: A Taxonomy by Registered Report | Veli-Matti Karhulahti, Marcel Martončik, Miia Siutila, Solip Park, Yaewon Jin, Matúš Adamkovič, Tiina Auranen, Bora Na, Tae-Jin Yoon | <p style="text-align: justify;">Videogames have become one of the most prevalent cultural forms around the world. While their role in art, pedagogy, and everyday life keeps growing, the health debates on videogame play—gaming—culminated in 2022 wi... | | Humanities, Medical Sciences, Social sciences | Zoltan Dienes | Oluwaseyi Adeliyi, Abiola Akinnubi | 2022-10-10 15:09:55 | |
14 Feb 2024
STAGE 1
Restriction of researcher degrees of freedom through the Psychological Research Preregistration-Quantitative (PRP-QUANT) TemplateExamining the restrictiveness of the PRP-QUANT TemplateRecommended by Daniel Lakens based on reviews by Marjan Bakker and 1 anonymous reviewer
The Psychological Research Preregistration-Quantitative Template has been created in 2022 to provide more structure and detail to preregistrations. The goal of the current study is to test if the PRP-QUANT template indeed provides greater restriction of the flexibility in a study for preregistered hypotheses than other existing templates. This question is important because one concern that has been raised about the practice of preregistration is that the quality of preregistrations is often low. Metascientific research has shown that preregistrations are often of low quality (Bakker et al., 2020), and hypothesis tests from preregistrations are still selectively reported (van den Akker, van Assen, Enting, et al., 2023). It is important to improve the quality of preregistrations, and if a better template can help, it is a cost-effective approach to improve quality if the wider adoption of the better template can be promoted.
In the current study, Spitzer and Mueller (2024) will follow the procedure of a previous meta-scientific study by Heirene et al. (2021). 74 existing preregistrations with the PRP-QUANT template are available, and will be compared with an existing dataset coded by Bakker and colleagues (2020). The sample size is limited, but allows detecting some differences that would be considered large enough to matter, even though there might be smaller differences that would not be detectable based on the currently available sample size. Nevertheless, given that there is a need for improvement, even preliminary data might already be useful to provide tentative recommendations. Restrictiveness will be coded in 23 items, and adherence to or deviations from the preregistration are coded as well. As such deviations are common, the question whether this template reduced the likelihood of deviations is important. Two coders will code all studies.
The study should provide a useful initial evaluation of the PRP-QUANT template, and has the potential to have practical implications if the PRP-QUANT template shows clear benefits. Both authors have declared COI's related to the PRP-QUANT template, making the Registered Report format a fitting approach to prevent confirmation bias from influencing the reported results.
This Stage 1 manuscript was evaluated over two rounds of in-depth review by two expert reviewers and the recommender. After the revisions, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
URL to the preregistered Stage 1 protocol: https://osf.io/vhezj
Level of bias control achieved: Level 3. At least some data/evidence that will be used to the answer the research question has been previously accessed by the authors (e.g. downloaded or otherwise received), but the authors certify that they have not yet observed ANY part of the data/evidence. List of eligible PCI RR-friendly journals:
References
1. van den Akker, O. R., van Assen, M. A. L. M., Bakker, M., Elsherif, M., Wong, T. K., & Wicherts, J. M. (2023). Preregistration in practice: A comparison of preregistered and non-preregistered studies in psychology. Behavior Research Methods. https://doi.org/10.3758/s13428-023-02277-0
2. Bakker, M., Veldkamp, C. L. S., Assen, M. A. L. M. van, Crompvoets, E. A. V., Ong, H. H., Nosek, B. A., Soderberg, C. K., Mellor, D., & Wicherts, J. M. (2020). Ensuring the quality and specificity of preregistrations. PLOS Biology, 18(12), e3000937. https://doi.org/10.1371/journal.pbio.3000937
3. Spitzer, L. & Mueller, S. (2024). Stage 1 Registered Report: Restriction of researcher degrees of freedom through the Psychological Research Preregistration-Quantitative (PRP-QUANT) Template. In principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/vhezj
4. Heirene, R., LaPlante, D., Louderback, E. R., Keen, B., Bakker, M., Serafimovska, A., & Gainsbury, S. M. (2021). Preregistration specificity & adherence: A review of preregistered gambling studies & cross-disciplinary comparison. PsyArXiv. https://doi.org/10.31234/osf.io/nj4es
| Restriction of researcher degrees of freedom through the Psychological Research Preregistration-Quantitative (PRP-QUANT) Template | Lisa Spitzer & Stefanie Mueller | <p>Preregistration can help to restrict researcher degrees of freedom and thereby ensure the integrity of research findings. However, its ability to restrict such flexibility depends on whether researchers specify their study plan in sufficient de... | | Social sciences | Daniel Lakens | 2023-06-01 10:39:20 | ||
08 Sep 2022
STAGE 1
How to succeed in human modified environmentsThe role of behavioural flexibility in promoting resilience to human environmental impactsRecommended by Chris Chambers based on reviews by Gloriana Chaverri, Vedrana Šlipogor and Alizée Vernouillet
Understanding and mitigating the environmental effects of human expansion is crucial for ensuring long-term biosustainability. Recent research indicates a steep increase in urbanisation – including the expansion of cities – with global urban extent expanding by nearly 10,000 km^2 per year between 1985 and 2015 (Liu et al, 2020). The consequences of these human modified environments on animal life are significant: in order to succeed, species must adapt quickly to environmental changes, and those populations that demonstrate greater behavioural flexibility are likely to cope more effectively. These observations have, in turn, prompted the question of whether enhancing behavioural flexibility in animal species might increase their resilience to human impacts.
In the current research, Logan et al. (2022) will use a serial reversal learning paradigm to firstly understand how behavioural flexibility relates to success in avian species that are already successful in human modified environments. The authors will then deploy these flexibility interventions in more vulnerable species to establish whether behavioural training can improve success, as measured by outcomes such as foraging breadth, dispersal dynamics, and survival rate.
The Stage 1 manuscript was submitted via the programmatic track and will eventually produce three Stage 2 outputs focusing on different species (toutouwai, grackles, and jays). Following two rounds of in-depth review, the recommender judged that the manuscript met the Stage 1 criteria and awarded in-principle acceptance (IPA).
URL to the preregistered Stage 1 protocol: https://osf.io/346af
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA. List of eligible PCI RR-friendly journals: References
1. Liu, X., Huang, Y., Xu, X., Li, X., Li, X., Ciais, P., Lin, P., Gong, K., Ziegler, A. D., Chen, A., et al. (2020). High-spatiotemporal-resolution mapping of global urban change from 1985 to 2015. Nature Sustainability, 1–7. https://doi.org/10.1038/s41893-020-0521-x
2. Logan, C.J., Shaw, R., Lukas, D. & McCune, K.B. (2022). How to succeed in human modified environments, in principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/346af
| How to succeed in human modified environments | Logan CJ, Shaw R, Lukas D, McCune KB | <p>Human modifications of environments are increasing, causing global changes that other species must adjust to or suffer from. Behavioral flexibility (hereafter ‘flexibility’) could be key to coping with rapid change. Behavioral research can cont... | | Life Sciences | Chris Chambers | 2022-05-06 12:12:05 | ||
Sight vs. sound judgments of music performance depend on relative performer quality: Cross-cultural evidence from classical piano and Tsugaru shamisen competitions [Stage 2 Registered Report]Music is appreciated cross-modally, but is culture- and context-dependentRecommended by Yuki Yamada based on reviews by Kyoshiro Sasaki and 1 anonymous reviewer
Music is not merely limited to the aural experience we garner through our auditory faculties, as commonly perceived. Rather, various studies have explored the cross-modal impact of visual stimuli on the evaluation of music. These previous studies have been confined exclusively to Western music. Hence, Chiba et al. (2023) designed a study with a focus on the Tsugaru shamisen, a renowned folk instrument indigenous to Japan, and of which the first author is an outstanding player.
The study methodology was an improved version of previous endeavors, wherein actual musical material sourced from concours performances was displayed through audio-only, video-only or both modalities. A sample of Japanese participants were then asked to evaluate the concours performances on both the piano and the Tsugaru shamisen. The results, obtained through pre-registered protocols, revealed that for both concours performances, the participants displayed a cross-modal impact of visual information on their aural evaluation of music. This effect was also found to be contingent on cultural and contextual factors. These outcomes furnish valuable evidence towards the generalizability of the interplay between sight and sound in the assessment of music. The study underwent rigorous peer-review processes in both Stage 1 and Stage 2, with three experts specializing in Japanese folk music, open science, and statistics, respectively, providing their critical assessments. Following multiple rounds of revision, the final manuscript was deemed fit for recommendation.
URL to the preregistered Stage 1 protocol: https://osf.io/ry2b6
Level of bias control achieved: Level 6. No part of the data or evidence that was used to answer the research question was generated until after IPA.
List of eligible PCI RR-friendly journals:
References
Chiba G., Ozaki Y., Fujii S., & Savage P.E. (2023). Sight vs. sound judgments of music performance depend on relative performer quality: Cross-cultural evidence from classical piano and Tsugaru shamisen competitions [Stage 2 Registered Report]. Acceptance of Version 2 by Peer Community in Registered Reports. https://doi.org/10.31234/osf.io/xky4j
| Sight vs. sound judgments of music performance depend on relative performer quality: Cross-cultural evidence from classical piano and Tsugaru shamisen competitions [Stage 2 Registered Report] | Gakuto Chiba, Yuto Ozaki, Shinya Fujii, Patrick E. Savage | <p>Which information dominates in evaluating performance in music? Both experts and laypeople consistently report believing that sound should be the most important domain when judging music competitions, but experimental studies of Western partici... |  | Social sciences | Yuki Yamada | 2022-11-30 08:04:37 | ||
28 Dec 2021
STAGE 1
Sight vs. sound in the judgment of music performance: Cross-cultural evidence from classical piano and Tsugaru shamisen competitionsUnderstanding the role of visual and auditory information in evaluating musical performanceRecommended by Yuki Yamada based on reviews by David Hughes and Kyoshiro Sasaki
In this Stage 1 Registered Report, Chiba and colleagues (2021) aim to investigate how people use information from visual and auditory modalities when evaluating musical performances. Previous studies, mainly using Western music, have reported a visual dominance, but this has not yet been clearly and consistently reported. Thus, the authors propose to evaluate both the reproducibility and generalizability of the previous findings by conducting a replication study using the methodology of the previous studies and by introducing a new experimental condition in which the Tsugaru-shamisen, a unique Japanese musical instrument, is also performed. This study could represent an important turning point in the research context of performance evaluation and would be of considerable value. This manuscript was peer-reviewed by two experts in scientific methodology and Japanese traditional music, respectively, and during the two-round peer-review process they made a number of important points, but eventually awarded the manuscript a highly positive response. I am therefore pleased to recommend that this Stage 1 Registered Report meets our Stage 1 criteria and is worthy of in-principle acceptance. I look forward to seeing the results and discussion reported in Stage 2, with the expectation that the experiment conducted by the authors will be in strict accordance with this protocol. *The following is a very minor comment, which I hope the authors will find helpful in the future. Of course, this is not related to hypothesis construction and does not require revision: The "Blind Audition" study cited in the introduction is very impactful, but has recently been called into question, so I am at least a little cautious when citing this study. This article may be useful. https://www.wsj.com/articles/blind-spots-in-the-blind-audition-study-11571599303 URL to the preregistered Stage 1 protocol: https://osf.io/ry2b6 Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA. List of eligible PCI RR-friendly journals: References
| Sight vs. sound in the judgment of music performance: Cross-cultural evidence from classical piano and Tsugaru shamisen competitions | Gakuto Chiba, Yuto Ozaki, Shinya Fujii, Patrick E. Savage | <p style="text-align: justify;">Which information dominates in evaluating performance in music? Both experts and laypeople consistently report believing that sound should be the most important domain when judging music competitions, but experime... | | Social sciences | Yuki Yamada | Kyoshiro Sasaki | 2021-09-24 08:59:26 |
