Announcements
We are recruiting recommenders (editors) from all research fields!
Your feedback matters! If you have authored or reviewed a Registered Report at Peer Community in Registered Reports, then please take 5 minutes to leave anonymous feedback about your experience, and view community ratings.
Latest recommendations
Id | Title * | Authors * | Abstract * | Picture | Thematic fields * | Recommender | Reviewers▲ | Submission date | |
---|---|---|---|---|---|---|---|---|---|
Dose-response of tDCS effects on motor learning and cortical excitability: a preregistered studyGavin Hsu, Zhenous Hadi Jafari, Abdelrahman Ahmed, Dylan J. Edwards, Leonardo G. Cohen, Lucas C. Parra https://osf.io/a42uyIncreasing stimulation intensity does not affect motor learningRecommended by Christina ArtemenkoIn neurostimulation research, the parameters of a stimulation protocol crucially impact on the effects of the stimulation. Transcranial direct current stimulation (tDCS) is a neurostimulation technique that typically uses current intensities about 1-2 mA in human research to modulate motor and cognitive behavior. The current sham-controlled study by Hsu et al. (2024) applies current intensities not only of 2 mA but also of 4 mA and 6 mA and thus extends our understanding of stimulation parameters while ethical standards are preserved.
The influence of tDCS over the primary motor cortex was evaluated for neural plasticity during motor learning. Stimulation effects were tested not only behaviorally but also physiologically by motor evoked potentials elicited by transcranial magnetic stimulation (TMS). The presented pilot data were promising and underlined the feasibility of the proposed research design. The study contributes to tDCS research by uncovering reasons for controversial findings and thus increases reproducibility.
The results of the study unexpectedly revealed no stimulation effects on motor learning, neither for behavioral outcomes nor for physiological outcomes by motor evoked potentials. No evidence was found that stimulation effects linearly increase with increasing intensity. Interestingly, higher intensities were relatively well tolerated - but did not have any impact. The current findings underline the purpose of preregistrations and registered reports to act against publication bias, particulary in the field of neuromodulation. In the current case, failed replication and null findings - revealed by a methodologically sound study - are crucial to inform future research using similar stimulation protocols with the aim to modulate motor or cognitive behavior.
The Stage 2 manuscript was evaluated over one round of review. Based on detailed responses to reviewers’ and the recommender’s comments, the recommender judged that the manuscript met the Stage 2 criteria and awarded a positive recommendation.
URL to the preregistered Stage 1 protocol: https://osf.io/jyuev
Level of bias control achieved: Level 2. At least some data/evidence that was used to answer the research question had been accessed and partially observed by the authors prior to Stage 1 in-principle acceptance, but the authors certify that they had not yet observed the key variables within the data that were used to answer the research question. List of eligible PCI RR-friendly journals: References
Hsu, G., Jafari, Z. H., Ahmed, A., Edwards, D. J., Cohen, L. G., & Parra, L. C. (2024). Dose-response of tDCS effects on motor learning and cortical excitability: a preregistered study [Stage 2]. Acceptance of Version 2.1 by Peer Community in Registered Reports. https://osf.io/a42uy
| Dose-response of tDCS effects on motor learning and cortical excitability: a preregistered study | Gavin Hsu, Zhenous Hadi Jafari, Abdelrahman Ahmed, Dylan J. Edwards, Leonardo G. Cohen, Lucas C. Parra | <p>Background: Multiple studies have demonstrated that transcranial direct current stimulation (tDCS) of the primary motor cortex (M1) can influence corticospinal excitability and motor skill acquisition. However, the evidence for these effects i... | ![]() | Engineering, Medical Sciences | Christina Artemenko | 2024-09-02 19:07:02 | View | |
23 Jan 2025
STAGE 1
![]() Mapping methodological variation in experience sampling research from design to data analysis: A systematic reviewLisa Peeters, Wim Van Den Noortgate, M. Annelise Blanchard, Gudrun Eisele, Olivia Kirtley, Richard Artner, Ginette Lafit https://osf.io/8mwguMethodological Variation in the Experience Sampling Methods: Can We Do ESM Better?Recommended by Thomas EvansThe replication crisis/credibility revolution has driven a vast number of changes to our research environment (Korbmacher et al., 2023) including a much needed spotlight on issues surrounding measurement (Flake & Fried, 2020). As general understanding and awareness has increased surrounding the 'garden of forking paths' or 'researcher degrees of freedom' (Simmons et al., 2011), and the various decisions made during the scientific process that could impact the conclusions drawn by the process, so too should our interest in meta-research that tells us more about the methodological processes we follow, and how discretionary decisions may influence the design, analysis and reporting of a project.
Peeters et al. (2025) have proposed a systematic literature review of this nature, mapping the methodological variation in experience sampling methods (ESM) from the design stage all the way to dissemination. It starts this journey by mapping how ESM studies vary e.g., in design, considering a variety of factors like sample size, number of measurements, and sampling scheme. It also evaluates reporting quality, rationales provided, and captures the extent of open science practices adopted. Covering many parts of the research process that get assumed, unreported or otherwise unjustified, the proposed work looks set to springboard an important body of work that can tell us more effectively how to design, implement and report ESM studies.
The Stage 1 submission was reviewed over one round of in-depth review with two reviewers. Based on detailed responses to reviewers’ feedback, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance.
URL to the preregistered Stage 1 protocol: https://osf.io/ztvn3
Level of bias control achieved: Level 1. At least some of the data/evidence that will be used to the answer the research question has been accessed and observed by the authors, including key variables, but the authors certify that they have not yet performed any of their preregistered analyses, and in addition they have taken stringent steps to reduce the risk of bias. List of eligible PCI-RR-friendly journals:
References
1. Flake, J. K., & Fried, E. I. (2020). Measurement schmeasurement: Questionable measurement practices and how to avoid them. Advances in Methods and Practices in Psychological Science, 3, 456-465. https://doi.org/10.1177/2515245920952393
2. Korbmacher, M., Azevedo, F., Pennington, C. R., Hartmann, H., Pownall, M., Schmidt, K., ... & Evans, T. (2023). The replication crisis has led to positive structural, procedural, and community changes. Communications Psychology, 1, 3. https://doi.org/10.1038/s44271-023-00003-2
3. Peeters, L., Van Den Noortgate, W., Blanchard, M. A., Eisele, G., Kirtley, O., Artner, R., & Lafit, G. (2025). Mapping Methodological Variation in ESM Research from Design to Data Analysis: A Systematic Review. In principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/ztvn3
4. Simmons, J. P., Nelson, L. D., & Simonsohn, U. (2011). False-positive psychology: Undisclosed flexibility in data collection and analysis allows presenting anything as significant. Psychological Science, 22, 1359-1366. https://doi.org/10.1177/0956797611417632
| Mapping methodological variation in experience sampling research from design to data analysis: A systematic review | Lisa Peeters, Wim Van Den Noortgate, M. Annelise Blanchard, Gudrun Eisele, Olivia Kirtley, Richard Artner, Ginette Lafit | <p><strong>Aim</strong>. The Experience Sampling Method (ESM) has become a widespread tool to study time-varying constructs across many subfields of psychological and psychiatric research. This large variety in subfields of research and constructs... | Social sciences | Thomas Evans | 2024-09-04 10:39:37 | View | ||
Mechanisms of secularization: Testing between the rationalization and existential insecurity theoriesMartin Lang, Radim Chvaja https://doi.org/10.31234/osf.io/gy7sjUnderstanding links between secularization, rationalisation and insecurityRecommended by Adrien FillonWhat relationship can be expected between secularization, rationalization and insecurity? While some authors argue that rationalization reduces the willingness to belong to religious groups, others have suggested that insecurity increases this need to belong to religious groups.
In the current study, Lang and Chvaja (2024) adjudicated between these two possibilities using an economics game with 811 participants from two countries: US and Poland. The central question posed by the authors is whether cooperative insecurity increases the probability of joining a religious normative group. They tested the relationship between an environment (secure and insecure) and institution (which related to the norm context: religious and secular) on the probability of choosing the normative group in an experimental setting.
The authors included an adequate power analysis, alternatives for non-supported hypotheses, and filtering to ensure a high quality of data collection. They also undertook a pilot study to ensure the quality of the procedure and sensitivity of the analyses. There were only a few, minor, and well documented deviations from stage 1.
For the non-religious group, secularity increased the odds of joining the normative group when faced with insecurity. For the religious group, the results were mixed, mostly due to the unexpected high rate of participants joining the religious group in the secure environment. The researchers then pooled the regular and reversed scenarii and found support for the existential insecurity theory.
The authors concluded that both theories (the rationalization theory and the existential insecurity theory) can be at work, as the majority of the sample did not choose the religious normative group due to a potential rationalization, but they do slightly more when faced with (existential) insecurity.
The Stage 2 manuscript was evaluated over two rounds of review. Based on detailed responses to reviewers’ and the recommender’s comments, the recommender judged that the manuscript met the Stage 2 criteria and therefore awarded a positive recommendation.
URL to the preregistered Stage 1 protocol: https://osf.io/yzgek
Level of bias control achieved: Level 6. No part of the data or evidence that was used to answer the research question was generated until after IPA.
List of eligible PCI RR-friendly journals:
References 1.Lang, M. & Chvaja, R. (2024). Mechanisms of secularization: Testing between the rationalization and existential insecurity theories [Stage 2]. Acceptance of Version 2 by Peer Community in Registered Reports. https://doi.org/10.31234/osf.io/gy7sj
| Mechanisms of secularization: Testing between the rationalization and existential insecurity theories | Martin Lang, Radim Chvaja | <p>The study tests two competing explanations of the secularization process related to rationalizing worldviews and decreasing existential insecurity. While the former explanation argues that people are unwilling to join religious groups because o... | Humanities, Social sciences | Adrien Fillon | 2024-09-06 15:23:11 | View | ||
28 Jan 2025
STAGE 1
![]() See me, judge me, pay me: Gendered effort moralization in work and careLeopold H. O. Roth, Tassilo T. Tissot, Thea Fischer, S. Charlotte Masak https://osf.io/rz6yuA gender difference in effort moralization?Recommended by Adrien FillonEffort moralization is the well known idea that, unrelated to actual performance, people doing more effort are judged better, attributed more morality and seen as better collaborators than people doing less effort. However, the series of studies on this topic mostly used vignettes with a man or a neutral protagonist. The current study by Roth et al. (2025) proposes to tackle the gender problem by testing the difference in attribution morality between a man and a woman protagonist, and two contexts: a “care” and a “work” context, mirroring the stereotypes associated with men and women.
The authors included two different and adequate power analyses, various interpretation of the possible effects, and filtering to ensure a high quality of data collection. They also provide a supplementary repository including the qualtrics survey, R script, and simulated data.
The Stage 1 manuscript was evaluated over two rounds of in-depth review. Based on detailed responses to the reviewers’ and the recommender’s comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance. URL to the preregistered Stage 1 protocol: https://osf.io/xd87r Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists, and no part will be generated until after IPA. List of eligible PCI RR-friendly journals:
References
Roth, L. H. O., Tissot, T. T., Fischer, T. & Masak, S. C. (2025). See me, judge me, pay me: Gendered effort moralization in work and care. In principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/xd87r
| See me, judge me, pay me: Gendered effort moralization in work and care | Leopold H. O. Roth, Tassilo T. Tissot, Thea Fischer, S. Charlotte Masak | <p>The display of high effort at work is commonly rewarded with more positive moral judgements and increased cooperation partner attractiveness. This effect was shown to hold, even if higher effort is unrelated to better performance. Yet, current ... | Social sciences | Adrien Fillon | 2024-09-09 15:12:30 | View | ||
Michotte's research on perceptual impressions of causality: a registered replication studyPeter A. White https://osf.io/jdac7Michotte’s classic studies on the perception of causality: Replications, extensions and a sound base for further researchRecommended by Moin SyedMaking causal judgements are part of everyday life, whether seeking to understand the action of complex humans or the relations between inanimate objects in our environments. Albert Michotte’s (1963) classic book, The perception of causality, contained an extensive report of experiments demonstrating not only that observers perceive causality of inanimate shapes, but do so in manifold ways, creating different “causal impressions.” This work has been highly influential across psychology and neuroscience.
In the current study, White (2025) conducted 14 experiments aimed at replicating and extending Michotte’s work. Despite the fact that this research is foundational to current work on perception and understanding of causal relations, it has never been subject to rigorous replication. Moreover, like many research studies from that era, Michotte was sparse on details about methodology and did not rely on statistical analysis. White carried out an ambitious set of 14 experiments and 18 hypotheses that directly replicated and, in some cases, extended Michotte’s experiments. The results of the experiments were mixed, with the hypotheses evenly divided among being supported, partially supported, and not supported. The current effort by White not only brings rigorous contemporary data to classic studies of perceptual impressions of causality, but the results point to important new directions for future study on the topic. In particular, the findings suggest a need to broaden our investigations of causal explanations of movement beyond launching (i.e., contact of one object leading to motion of another) to also consider entraining (i.e., joint movement following contact) and pulling. The collected studies provide fertile ground for further testing a variety of mechanisms that explain different perceptual impressions of causality.
The Stage 2 manuscript was evaluated over three rounds of in-depth review, the first two rounds consisting of detailed comments from two reviewers and the third round consisting of a close read by the recommender. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 2 criteria and awarded a positive recommendation.
URL to the preregistered Stage 1 protocol: https://osf.io/5jx8f
Level of bias control achieved: Level 6. No part of the data or evidence that was used to answer the research question was generated until after IPA. List of eligible PCI-RR-friendly journals:
References
1. Michotte, A. (1963). The perception of causality (T. R. Miles & E. Miles, trans.). London: Methuen. (English translation of Michotte, 1954).
2. White, P. A. (2025). Michotte's research on perceptual impressions of causality: A registered replication study [Stage 2]. Acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/jdac7
| Michotte's research on perceptual impressions of causality: a registered replication study | Peter A. White | <p> Michotte (1946/1954/1963) showed that visual impressions of causality can occur in perception of simple animations of moving geometrical objects. In the launching effect, one object is perceived a... | Social sciences | Moin Syed | 2024-10-07 10:53:33 | View | ||
14 Jan 2025
STAGE 1
Implementing a rapid geographic range expansion - the role of behavior and habitat changesCorina J Logan, Kelsey B McCune, Nancy Chen, Dieter Lukas http://corinalogan.com/Preregistrations/gxpopbehaviorhabitat.htmlThe role of behavior and habitat availability on species geographic expansionRecommended by Chris ChambersNote from the PCI RR Managing Board: This Stage 1 recommendation was originally written by Esther Sebastián González for PCI Ecology on 06 Oct 2020 and was transferred to PCI Registered Reports on 14 Jan 2025 to facilitate the submission and evaluation of the resulting Stage 2 submissions. The link to the original recommendation and review history at PCI Ecology may be found at this link (and in PDF format here).
===
Understanding the relative importance of species-specific traits and environmental factors in modulating species distributions is an intriguing question in ecology [1]. Both behavioral flexibility (i.e., the ability to change the behavior in changing circumstances) and habitat availability are known to influence the ability of a species to expand its geographic range [2,3]. However, the role of each factor is context and species dependent and more information is needed to understand how these two factors interact. In this pre-registration, Logan et al. [4] explain how they will use Great-tailed grackles (Quiscalus mexicanus), a species with a flexible behavior and a rapid geographic range expansion, to evaluate the relative role of habitat and behavior as drivers of the species’ expansion [4]. The authors present very clear hypotheses, predicted results and also include alternative predictions. The rationales for all the hypotheses are clearly stated, and the methodology (data and analyses plans) are described with detail. The large amount of information already collected by the authors for the studied species during previous projects warrants the success of this study. It is also remarkable that the authors will make all their data available in a public repository, and that the pre-registration in already stored in GitHub, supporting open access and reproducible science. I agree with the three reviewers of this pre-registration about its value and I think its quality has largely improved during the review process. Thus, I am happy to recommend it and I am looking forward to seeing the results.
URL to the preregistered Stage 1 protocol: http://corinalogan.com/Preregistrations/gxpopbehaviorhabitat.html
Level of bias control achieved: Level 1. At least some of the data/evidence that will be used to the answer the research question has been accessed and observed by the authors, including key variables, but the authors certify that they have not yet performed any of their preregistered analyses, and in addition they have taken stringent steps to reduce the risk of bias.
List of eligible PCI-RR-friendly journals: References
[1] Gaston KJ. 2003. The structure and dynamics of geographic ranges. Oxford series in Ecology and Evolution. Oxford University Press, New York.
[2] Sol D, Lefebvre L. 2000. Behavioural flexibility predicts invasion success in birds introduced to new zealand. Oikos. 90(3): 599–605. https://doi.org/10.1034/j.1600-0706.2000.900317.x
[3] Hanski I, Gilpin M. 1991. Metapopulation dynamics: Brief history and conceptual domain. Biological journal of the Linnean Society. 42(1-2): 3–16. https://doi.org/10.1111/j.1095-8312.1991.tb00548.x
[4] Logan CJ, McCune KB, Chen N, Lukas D. 2020. Implementing a rapid geographic range expansion - the role of behavior and habitat changes (http://corinalogan.com/Preregistrations/gxpopbehaviorhabitat.html) In principle acceptance by PCI Ecology of the version on 16 Dec 2021 https://github.com/corinalogan/grackles/blob/0fb956040a34986902a384a1d8355de65010effd/Files/Preregistrations/gxpopbehaviorhabitat.Rmd
=======
Full review history: [link]
| Implementing a rapid geographic range expansion - the role of behavior and habitat changes | Corina J Logan, Kelsey B McCune, Nancy Chen, Dieter Lukas | <p>It is generally thought that behavioral flexibility, the ability to change behavior when circumstances change, plays an important role in the ability of a species to rapidly expand their geographic range (Chow et al., 2016; Griffin & Guez, ... | Life Sciences | Chris Chambers | 2025-01-13 12:12:15 | View | ||
15 Apr 2023
STAGE 1
![]() Reconstructing Gaming Disorder: A Taxonomy by Registered ReportVeli-Matti Karhulahti, Marcel Martončik, Miia Siutila, Solip Park, Yaewon Jin, Matúš Adamkovič, Tiina Auranen, Bora Na, Tae-Jin Yoon https://osf.io/xtbgyHow can the experiences of those who engage in video games in healthy and unhealthy ways be systematically organised?Recommended by Zoltan DienesPeople are often drawn into intensive video game use in ways they or others may find troubling, harmless or even praiseworthy. Understanding these different experiences may help with integrating intensive technology use into everyday life in a healthy way.
In this programmatic submission, Karhulahti et al. (2023) will explore the gaming experiences of three groups of people (those who have sought treatment for gaming, esport players, and adolescents who play around two hours every day), using phenomenological and clinical interviews, and gaming diary logs every four months over three years. Around 200-300 participants will be recruited initially from Finland, Slovakia, and South Korea. In order to further increase cross-cultural range, the study will apply a new duplication method to collect similar data also in countries that have been studied little in the past. The aim will be to answer the questions of a) Is it possible to distinguish passionate from pathological gaming by the meanings and values that players attach to videogame play? and b) What are the design structures of videogames, which are played intensively and/or with gaming-related health problems? Ultimately, the study aims to synthesise all its data into a new taxonomic system, which can help better understand the differences and idiosyncrasies of gaming in lives across cultures.
This Stage 1 manuscript was evaluated over two rounds of in-depth review. Based on the comprehensive responses to the reviewers' feedback, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
URL to the preregistered Stage 1 protocol: https://osf.io/ekm8x Level of bias control achieved: Level 4. At least some of the data/evidence that will be used to answer the research question already exists AND is accessible in principle to the authors (e.g. residing in a public database or with a colleague) BUT the authors certify that they have not yet accessed any part of that data/evidence List of eligible PCI RR-friendly journals: References
Karhulahti, V.-M., Martončik. M., Siutila, M., Park, S., Jin, J., Adamkovič, M., Auranen, T., Na, B., & Yoon, T.-J. (2023). Reconstructing Gaming Disorder: A Taxonomy by Registered Report, in principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/ekm8x
| Reconstructing Gaming Disorder: A Taxonomy by Registered Report | Veli-Matti Karhulahti, Marcel Martončik, Miia Siutila, Solip Park, Yaewon Jin, Matúš Adamkovič, Tiina Auranen, Bora Na, Tae-Jin Yoon | <p style="text-align: justify;">Videogames have become one of the most prevalent cultural forms around the world. While their role in art, pedagogy, and everyday life keeps growing, the health debates on videogame play—gaming—culminated in 2022 wi... | ![]() | Humanities, Medical Sciences, Social sciences | Zoltan Dienes | Abiola Akinnubi , Oluwaseyi Adeliyi | 2022-10-10 15:09:55 | View |
30 Sep 2024
STAGE 1
![]() Examining the role of action interpretation in changes in choice induced by go/no-go and approach/avoidance responsesZhang Chen, Pieter Van Dessel, Bernd Figner https://osf.io/bn5xaDoes interpretation of actions as either avoid or inhibit influence choice behaviour for candy?Recommended by Andrew Jones based on reviews by Alexander MacLellan and Katrijn HoubenExperimental research demonstrates that executing or inhibiting motor responses (or approaching / avoiding) towards a stimulus can alter the valuation of the stimulus (Yang et al., 2022). There are competing theories as to the proposed mechanisms of value change, such as increased response conflict or prediction errors (Houben & Aulbach, 2023). However, research has mostly examined response execution/inhibition and approach/avoidance in isolation and the few studies that have examined these together have focused on stimulus evaluation as an outcome.
In the present study, Chen et al. (2024) will use a novel version of a combined go/no-go / approach avoidance paradigm to test the effects on choice of consumable candy. In this task, participants are randomly assigned to make a response framed as a go / no-go action or an approach / avoidance action to control a shopping cart (Chen & Van Dessel, 2024). Following this they will complete a food choice task in which participants make a series of binary choices for different candies. Their performance on this task will lead to the receipt of real-world candy. The authors aim to test whether the same responses will lead to different effects on food choice, depending on how the response was interpreted (e.g. participants in the approach/avoidance instruction group will select Approach items more often than those in the go/no-go instruction group). The study is well powered to detect the proposed effect size of interest, and data will be analysed using Bayesian mixed-effect models. This study will shed light onto theoretical predictions of action interpretation on stimulus value and choice, which may improve the efficacy of behaviour change tools such as approach bias training in future. The Stage 1 manuscript was evaluated over two rounds of in-depth review. Based on detailed responses to the recommender and reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
URL to the preregistered Stage 1 protocol: https://osf.io/bn5xa
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.
List of eligible PCI RR-friendly journals:
References
1. Chen, Z. and Van Dessel, P. (2024). Action interpretation determines the effects of go/no-go and approach/avoidance actions on stimulus evaluation. Open Mind, 8, 898-923. https://doi.org/10.1162/opmi_a_00151 2. Chen, Z., Van Dessel, P., and Figner, B. (2024). Examining the role of action interpretation in changes in choice induced by go/no-go and approach/avoidance responses. In principle acceptance of Version 2 by Peer Community in Registered Reports. https://osf.io/bn5xa
3. Houben, K. and Aulbach, M. (2023). Is there a difference between stopping and avoiding? A review of the mechanisms underlying Go/No-Go and Approach-Avoidance training for food choice. Current Opinion in Behavioral Sciences, 49, 101245. https://doi.org/10.1016/j.cobeha.2022.101245 4. Yang, Y., Qi, L., Morys, F., Wu, Q. and Chen, H. (2022). Food-Specific Inhibition Training for Food Devaluation: A Meta-Analysis. Nutrients, 14, 1363. https://doi.org/10.3390/nu14071363 | Examining the role of action interpretation in changes in choice induced by go/no-go and approach/avoidance responses | Zhang Chen, Pieter Van Dessel, Bernd Figner | <p>Executing go/no-go (GNG) and approach/avoidance (AAT) responses toward objects can increase people’s choices for go over no-go items, and for approach over avoidance items. Some theoretical accounts explain these effects as the results of merel... | Social sciences | Andrew Jones | Alexander MacLellan, Katrijn Houben | 2024-06-17 17:57:07 | View | |
Convenience Samples and Measurement Equivalence in Replication ResearchLindsay J. Alley, Jordan Axt, Jessica Kay Flake https://osf.io/s5t3vData from students and crowdsourced online platforms do not often measure the same thingRecommended by Corina LoganComparative research is how evidence is generated to support or refute broad hypotheses (e.g., Pagel 1999). However, the foundations of such research must be solid if one is to arrive at the correct conclusions. Determining the external validity (the generalizability across situations/individuals/populations) of the building blocks of comparative data sets allows one to place appropriate caveats around the robustness of their conclusions (Steckler & McLeroy 2008). In the current study, Alley and colleagues (2023) tackled the external validity of comparative research that relies on subjects who are either university students or participating in experiments via an online platform. They determined whether data from these two types of subjects have measurement equivalence - whether the same trait is measured in the same way across groups. Although they use data from studies involved in the Many Labs replication project to evaluate this question, their results are of crucial importance to other comparative researchers whose data are generated from these two sources (students and online crowdsourcing). The authors show that these two types of subjects do not often have measurement equivalence, which is a warning to others to evaluate their experimental design to improve validity. They provide useful recommendations for researchers on how to to implement equivalence testing in their studies, and they facilitate the process by providing well annotated code that is openly available for others to use. After one round of review and revision, the recommender judged that the manuscript met the Stage 2 criteria and awarded a positive recommendation. URL to the preregistered Stage 1 protocol: https://osf.io/7gtvf
Level of bias control achieved: Level 2. At least some data/evidence that was used to answer the research question had been accessed and partially observed by the authors prior to Stage 1 IPA, but the authors certify that they had not yet observed the key variables within the data that were used to answer the research question AND they took additional steps to maximise bias control and rigour.
List of eligible PCI RR-friendly journals:
References
1. Pagel, M. (1999). Inferring the historical patterns of biological evolution. Nature, 401, 877-884. https://doi.org/10.1038/44766
2. Steckler, A. & McLeroy, K. R. (2008). The importance of external validity. American Journal of Public Health 98, 9-10. https://doi.org/10.2105/AJPH.2007.126847
3. Alley L. J., Axt, J., & Flake J. K. (2023). Convenience Samples and Measurement Equivalence in Replication Research [Stage 2 Registered Report] Acceptance of Version 2 by Peer Community in Registered Reports. https://osf.io/s5t3v
| Convenience Samples and Measurement Equivalence in Replication Research | Lindsay J. Alley, Jordan Axt, Jessica Kay Flake | <p>A great deal of research in psychology employs either university student or online crowdsourced convenience samples (Chandler & Shapiro, 2016; Strickland & Stoops, 2019) and there is evidence that these groups differ in meaningful ways ... | Social sciences | Corina Logan | Alison Young Reusser | 2023-08-31 20:26:43 | View | |
29 Jan 2025
STAGE 1
![]() Does synchronised singing enhance social bonding more than speaking does? A global experimental Stage 1 Registered ReportPatrick E. Savage, Adwoa Ampiah-Bonney, Aleksandar Arabadjiev, Adwoa Arhine, Juan F. Ariza, Joshua Silberstein Bamford, Brenda Suyanne Barbosa, Ann-Kathrin Beck, Michel Belyk, Emmanouil Benetos, Damián Ezequiel Blasi, Joseph Bulbulia, Anne Cabildo, Sasha Calhoun, Gakuto Chiba, Stephen Ithel Duran, Ulvhild Færøvik, Tecumseh Fitch, Shinya Fujii, Shira Gabriel, Felix Haiduk, Niels Chr. Hansen, Shantala Hegde, Ferenc Honbolygó, Jiawen Huang, Nori Jacoby, Yannick Jadoul, Zixuan Jia, Taeyun Jung, Csab... https://doi.org/10.31234/osf.io/pv3m9Do humans bond more when singing together or speaking together? A global investigationRecommended by Katherine MooreMusic is a universal across human cultures, but there is debate as to why and how it evolved. For example, Pinker has famously argued that music is “auditory cheesecake,” with no biological value (Pinker, 1997). Most scholars on the evolution of music make comparisons with language, another human universal that is unique to our species (Friederici, 2017). A current leading hypothesis in the evolution of music is the social bonding hypothesis, which suggests that music plays a special role in social bonding beyond the role that language plays (Savage et al., 2021).
Previous studies have provided evidence that synchronized music-making can promote social bonding (e.g. Stupacher et al., 2021). However, it is unclear whether synchronous singing provides any advantage in social bonding as compared to merely speaking. Previous work on this topic has at times lacked sufficient controls and has potentially been subject to publication bias—it could be that only the studies with statistically significant findings are in the published literature, when in fact additional experiments may have been run with unpublished null results. Also critically, prior studies have been subject to sampling bias—the vast majority are limited to a small set of cultures and musical styles, focusing primarily on English-speaking cultures and western music (Henrich & Heine, 2010). If music has evolved as a mechanism for social bonding, then it is especially critical to demonstrate its effects on social bonding across a wide range of cultures.
In a remarkable global collaboration including 88 collaborators from six continents, Savage et al. (2025) plan to collect data on synchronized singing and speech from 1710 participants across 57 research sites. Participants will be assigned to participate in (1) a synchronized singing activity, (2) a synchronized speech activity, or (3) a natural, prompted conversation.
At each research site, participants will gather in groups of 5-10 and will be randomly assigned to one of the three conditions (for the research site to be valid, it must recruit one group of participants into each condition). The experiment will start with pre-test measures of social bonding and other variables. Next, the intervention will commence. In the singing condition, participants will synchronously sing a song that is highly familiar in that culture. In the lyrics recitation condition, participants will synchronously speak printed lyrics to the songs from the singing condition (twice through, to account for speed differences in song and speech). In the conversation condition, participants will have a natural conversation in response to an ice-breaker question. Finally, each group will engage in post-test measures of social bonding as well as debriefing.
The social bonding hypothesis predicts that participants in the synchronized singing task will experience more social bonding (as measured by a pre- and post-test differences) than will participants who engage in sequential conversation or synchronous lyrics recitation in the absence of musical pitch or rhythm. The unprecedented scale of this global, cross-cultural investigation will make a great impact on the field and on our understanding of the relationship among speech, song, and social connection, regardless of the outcome.
Four expert reviewers provided valuable feedback through two rounds of review. Based on detailed responses to the reviewers’ and the recommender’s comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance.
URL to the preregistered Stage 1 protocol: https://osf.io/7t4ck
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists, and no part will be generated until after IPA.
List of eligible PCI RR-friendly journals:
References
1. Friederici, A. (2017). Language in Our Brain: The Origins of a Uniquely Human Capacity. https://doi.org/10.7551/mitpress/9780262036924.001.0001
2. Henrich, J., Heine, S. J., & Norenzayan, A. (2010). The weirdest people in the world? Behavioral and Brain Sciences, 33, 61-83. https://doi.org/10.1017/s0140525x0999152x
3. Pinker, S. (1997). How the mind works. WW Norton & Company.
4. Savage, P. E., Loui, P., Tarr, B., Schachner, A., Glowacki, L., Mithen, S., & Fitch, W. T. (2021). Music as a coevolved system for social bonding. Behavioral and Brain Sciences, 44, e59. https://doi.org/10.1017/S0140525X20000333
5. Savage, P. E. et al. (2025). Does synchronised singing enhance social bonding more than speaking does? A global experimental Stage 1 Registered Report. In principle acceptance of Version 7 by Peer Community in Registered Reports. https://osf.io/7t4ck
6. Stupacher, J., Mikkelsen, J., & Vuust, P. (2022). Higher empathy is associated with stronger social bonding when moving together with music. Psychology of Music, 50, 1511-1526. https://doi.org/10.1177/03057356211050681
| Does synchronised singing enhance social bonding more than speaking does? A global experimental Stage 1 Registered Report | Patrick E. Savage, Adwoa Ampiah-Bonney, Aleksandar Arabadjiev, Adwoa Arhine, Juan F. Ariza, Joshua Silberstein Bamford, Brenda Suyanne Barbosa, Ann-Kathrin Beck, Michel Belyk, Emmanouil Benetos, Damián Ezequiel Blasi, Joseph Bulbulia, Anne Cabildo... | <p>The evolution of music, speech, and sociality have been debated since before Darwin. The social bonding hypothesis proposes that these phenomena may be interlinked: musicality may have facilitated the evolution of social bonding beyond the poss... | ![]() | Social sciences | Katherine Moore | Anja Göritz, Melissa Brandon, Erin Hannon, Manuela Maria Marin | 2024-09-02 06:01:32 | View |
FOLLOW US
MANAGING BOARD
Chris Chambers
Zoltan Dienes
Corina Logan
Benoit Pujol
Maanasa Raghavan
Emily S Sena
Yuki Yamada