Announcements
Please note that we will be CLOSED to ALL SUBMISSIONS from 1 December 2024 through 12 January 2025 to give our recommenders and reviewers a holiday break.
We are recruiting recommenders (editors) from all research fields!
Your feedback matters! If you have authored or reviewed a Registered Report at Peer Community in Registered Reports, then please take 5 minutes to leave anonymous feedback about your experience, and view community ratings.
Latest recommendations
Id | Title * | Authors * | Abstract * | Picture▲ | Thematic fields * | Recommender | Reviewers | Submission date | |
---|---|---|---|---|---|---|---|---|---|
Personal factors and group creativity characteristics: A correlational meta-analysisAdrien Alejandro Fillon; Fabien Girandola, Nathalie Bonnardel, Jared Kenworthy, Lionel Souchet https://doi.org/10.31234/osf.io/4br6aWhich personal factors are associated with group creativity?Recommended by Julia M. RohrerWhat determines whether groups of people can come up with ideas that are both original and useful? Since the 1960s, this question has been intensively studied with the help of more or less structured group creativity activities such as brainstorming or creative problem solving, with subsequent rating of the generated ideas. In this line of research, personal factors—such as personality traits, and other interindividual differences in emotion and cognition—have received substantial attention as potential correlates of creative outcomes of group activities. This has spawned a sprawling literature that, to date, has not yet been synthesized. Thus, empirical findings in this literature, which are also sometimes contradictory, have not yet been well-integrated. In the present study, Fillon et al. (2022) conducted the first meta-analysis of correlations between personal factors and group creativity outcomes. The authors searched and synthesized the existing published literature according to predetermined criteria to (1) assess the overall relationship between a broad list of personal factors and creativity outcomes in group settings and (2) explore potential moderators of these relationships. In total, 11 studies could be included in the meta-analysis. They provided weak support for a positive correlation between self-efficacy and the three investigated group creative outcomes, number of ideas, originality of ideas, and usefulness of ideas. With respect to moderators, many of the planned analyses could not be conducted due to the low number of studies. The only finding that arose was weak evidence for the idea that time constraint moderates associations: relationships between personal factors and group creativity outcomes were slightly stronger for tasks limited to 20 minutes rather than 10 minutes. Statistical power overall was low across studies. The authors conclude their meta-analysis with the observation that the available data on the topic are very limited. They suggest that to improve our knowledge of the topic, future studies should adhere to standardized creativity methods and protocols and implement expert ratings of creativity. They also call for increasing the availability of raw data in this field of study to improve the accumulation of knowledge about links between personal factors and the creative performance of groups. The Stage 2 manuscript was evaluated over one round of in-depth review provided by the recommender and Chris Chambers, as the original reviewers were no longer available. Based on additional changes to the manuscript, the recommender judged that the manuscript met the Stage 2 criteria and awarded a positive recommendation. URL to the preregistered Stage 1 protocol: https://osf.io/nybg6
Level of bias control achieved: Level 3. At least some data/evidence that was used to answer the research question had been previously accessed by the authors (e.g. downloaded or otherwise received), but the authors certified that had not yet observed ANY part of the data/evidence prior to IPA. List of eligible PCI RR-friendly journals:
References 1. Fillon, A. A., Girandola, F., Bonnardel, N., Kenworth, J. B. & Souchet, L. (2023). Personal factors and group creativity characteristics: A correlational meta-analysis, acceptance of Version 2 by Peer Community in Registered Reports. https://psyarxiv.com/4br6a/ | Personal factors and group creativity characteristics: A correlational meta-analysis | Adrien Alejandro Fillon; Fabien Girandola, Nathalie Bonnardel, Jared Kenworthy, Lionel Souchet | <p>Previous research has investigated the relationship between personal factors and group creativity outcomes. On one side, they indicated that individual differences play a role in group creativity. On the other side, they showed that group creat... | Social sciences | Julia M. Rohrer | 2023-02-21 12:41:02 | View | ||
19 Jun 2023
STAGE 1
Revisiting the “Belief in the law of small numbers”: Conceptual replication and extensions Registered Report of problems reviewed in Tversky and Kahneman (1971) [Stage 1]Cheuk Kiu (Jeffery) HONG, Gilad FELDMAN https://osf.io/6n8jpShould we believe in the “belief in the law of small numbers?”Recommended by Moin Syed based on reviews by Romain Espinosa and Kariyushi RaoProbability and randomness are foundational statistical concepts used not only throughout the sciences, but also in our daily lives to guide our behavior and make sense of the world. Their importance and widespread use may suggest that they are easy concepts to understand, yet that seems not to be the case. A classic article by Tversky and Kahneman (1971) on the “belief in the law of small numbers” revealed that professional psychologists tended to incorrectly perceive a small sample that is randomly drawn from a population as representative of that population. This finding has been hugely influential, inspiring myriad subsequent studies into error and bias when reasoning about probability.
In the current study, Hong and Feldman (2023) propose a conceptual replication and extension of Tversky and Kahneman (1971). The original article was shockingly sparse on details regarding the method, sample, and findings, and, to our knowledge, has never been replicated. These facts are especially concerning given the foundational status that the article holds in the field. Hong and Feldman (2023) have developed a conceptual replication project, using the same approach and targeting the same claims from Tversky and Kahneman (1971), but modifying the wording of the stimuli for clarity and appropriateness for lay respondents. Although Tversky and Kahneman (1971) relied on professional psychologists as participants, many of their claims were not restricted to that population, but rather were generalized to all people—which is also how the findings have been subsequently applied. Thus, the change from professional to lay responders is entirely appropriate and the study will be diagnostic of the original claims.
Finally, Hong and Feldman (2023) extend the target study by manipulating the sample size indicated in the stimuli. Tversky and Kahneman (1971) relied on a single sample size in each scenario, leaving open the question as to how sample size might impact respondents’ reasoning. Accordingly, Hong and Feldman (2023) vary the sample size across the scenarios to determine whether participants answer differently as the sample size increases.
The Stage 1 manuscript was evaluated over two rounds of in-depth review, the first round consisting of detailed comments from two reviewers and the second round consisting of a close read by the recommender. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and was therefore awarded in-principle acceptance (IPA).
URL to the preregistered Stage 1 protocol: https://osf.io/fzbq7
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA. List of eligible PCI RR-friendly journals: References
1. Hong, C. K., & Feldman, G. (2023). Revisiting the “Belief in the law of small numbers”: Conceptual replication and extensions Registered Report of problems reviewed in Tversky and Kahneman (1971). In principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/fzbq7
2. Tversky, A., & Kahneman, D. (1971). Belief in the law of small numbers. Psychological Bulletin, 76(2), 105–110. https://doi.org/10.1037/h0031322
| Revisiting the “Belief in the law of small numbers”: Conceptual replication and extensions Registered Report of problems reviewed in Tversky and Kahneman (1971) [Stage 1] | Cheuk Kiu (Jeffery) HONG, Gilad FELDMAN | <p>This is a scheduled PCI-RR snap shot for a planned project: "Revisiting the “Belief in the law of small numbers”: Replication and extensions of problems reviewed in Tversky and Kahneman (1971)"</p> | Social sciences | Moin Syed | 2023-02-23 08:23:23 | View | ||
18 May 2023
STAGE 1
A multilab investigation into the N2pc as an indicator of attentional selectivity: Direct replication of Eimer (1996)Martin Constant, Ananya Mandal, Dariusz Asanowicz, Motonori Yamaguchi, Helge Gillmeister, Dirk Kerzel, David Luque, Francesca Pesciarelli, Thorsten Fehr, Faisal Mushtaq, Yuri G. Pavlov, Heinrich R. Liesefeld https://psyarxiv.com/3472yIs the N2pc a correlate of attentional selection? An #EEGManyLabs multi-lab registered replication of Eimer (1996)Recommended by Maxine Sherman based on reviews by Reny Baykova and Clayton HickeyThe N2pc is a lateralised ERP component that is often interpreted as a marker of attentional allocation, so much so that it is frequently used a tool in the attention literature for inferring that a stimulus was attentionally processed. This interpretation of N2pc can be traced back to the seminal work of Eimer (1996), which has been conceptually replicated many times but has never been replicated directly.
This registered direct replication by Constant et al. (2023) forms part of a larger series of large-scale, multi-lab replications of highly influential EEG papers by the #EEGManyLabs project (Pavlov et al., 2021). Seven labs (with the potential for more to sign up later), will conduct high-powered replications of the critical Experiment 2 of Eimer (1996), where in the crucial conditions, participants discriminate a target letter (M vs W) or colour (blue vs green) in the presence of a distractor. Using four preprocessing pipelines, including the original, the authors will test whether the N2pc is observed over parieto-occipital electrodes contralateral to target presentation.
The Stage 1 manuscript was evaluated over one round of in-depth review and one additional round of minor corrections. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
URL to the preregistered Stage 1 protocol: https://osf.io/dw68r
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA (so-called “primary RR”)
List of eligible PCI RR-friendly journals:
References
1. Constant, M., Mandal, A., Asanowicz, D., Yamaguchi, M., Gillmeister, H., Kerzel, D., Luque, D., Pesciarelli, F., Fehr, T., Mushtaq, F., Pavlov, Y. G. & Liesefeld, H. R. (2023). A multilab investigation into the N2pc as an indicator of attentional selectivity: Direct replication of Eimer (1996), in principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/dw68r
2. Eimer, M. (1996). The N2pc component as an indicator of attentional selectivity. Electroencephalography and Clinical Neurophysiology, 99, 225-234. https://doi.org/10.1016/0013-4694(96)95711-9
3. Pavlov, Y. G., Adamian, N., Appelhoff, S., Arvaneh, M., Benwell, C. S., Beste, C., ... & Mushtaq, F. (2021). #EEGManyLabs: Investigating the replicability of influential EEG experiments. Cortex, 144, 213-229. https://doi.org/10.1016/j.cortex.2021.03.013
| A multilab investigation into the N2pc as an indicator of attentional selectivity: Direct replication of Eimer (1996) | Martin Constant, Ananya Mandal, Dariusz Asanowicz, Motonori Yamaguchi, Helge Gillmeister, Dirk Kerzel, David Luque, Francesca Pesciarelli, Thorsten Fehr, Faisal Mushtaq, Yuri G. Pavlov, Heinrich R. Liesefeld | <p>The N2pc is widely employed as an electrophysiological marker of an attention allocation. This interpretation was in no small part driven by the observation of an N2pc elicited by an isolated relevant target object, which was reported as Experi... | Life Sciences, Social sciences | Maxine Sherman | 2023-02-24 11:41:52 | View | ||
11 Jul 2023
STAGE 1
Factors impacting effective altruism: Revisiting heuristics and biases in charity in a replication and extensions of Baron and Szymanska (2011)Mannix CHAN, Gilad FELDMAN https://osf.io/2w3zyUnderstanding biases and heuristics in charity donationsRecommended by Romain Espinosa based on reviews by Amanda Geiser and Jonathan Berman ?Decisions to give to charities are affected by numerous external and internal factors. Understanding the elements that influence donation decisions is of first-order importance for science and society. On the scientific side, understanding the determinants of charity giving contributes to the knowledge of altruistic behaviors in the presence of collective problems such as poverty, climate change, or animal welfare. On the social side, pointing out which factors affect donations can help increase pro-social behaviors and might facilitate collective actions in the case of public goods.
Previous work identified multiple mechanisms affecting altruistic donations to charities (Bekkers and Weeping, 2011). Importantly, Baron and Szymanska (2011) collected empirical evidence suggesting that people prefer (i) their donations to be directly used for projects rather than organizational costs, (ii) when charities have low past costs, (iii) to diversity their donations into several NGOs, (iv) to favor charities that deal with close peers like nationals, and (v) to give voluntarily rather than through taxes.
In the current study, Chan and Feldman seek to replicate the results of Baron and Szymanska (2011). They propose a close replication of the original study using a large sample of online participants (1,400 participants). In addition to the five mechanisms identified by the original study, they will further explore whether public donation increases contributions and whether individuals are more likely to donate when the charities’ overhead costs are paid for by other donors.
The Stage 1 manuscript was evaluated over two rounds of in-depth review. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
URL to the preregistered Stage 1 protocol: https://osf.io/gmswz
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA. List of eligible PCI RR-friendly journals:
References
1. Baron, J. & Szymanska, E. (2011). Heuristics and Biases in Charity. In D. M. Oppenheimer & C. Y. Olivola (Eds.), The Science of Giving: Experimental Approaches to the Study of Charity (pp. 215–235). Psychology Press.
2. Bekkers, R. & Wiepking, P. (2011). A Literature Review of Empirical Studies of Philanthropy. Nonprofit and Voluntary Sector Quarterly, 40, 924–973.
3. Chan, M. & Feldman, G. (2023). Factors impacting effective altruism: Revisiting heuristics and biases in charity in a replication and extensions Registered Report of Baron and Szymanska (2011), in principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/gmswz
| Factors impacting effective altruism: Revisiting heuristics and biases in charity in a replication and extensions of Baron and Szymanska (2011) | Mannix CHAN, Gilad FELDMAN | <p>This is a scheduled PCI-RR snap shot for a planned project: "Factors impacting effective altruism: Revisiting heuristics and biases in charity in a replication and extensions of Baron and Szymanska (2011)"</p> | Social sciences | Romain Espinosa | 2023-02-28 13:19:52 | View | ||
18 Jul 2023
STAGE 1
Test-Retest Reliability of the STRAQ-1: A Registered ReportOlivier Dujols; Richard A. Klein; Siegwart Lindenberg; Hans IJzerman https://psyarxiv.com/392g6A reliable measure of physical closeness in interpersonal relationships?Recommended by Moin Syed based on reviews by Jacek Buczny and Ian HusseyAttachment and interpersonal relationships are a major subject of research and clinical work in psychology. There are, accordingly, a proliferation of measurement instruments to tap into these broad constructs. The emphasis in these measures tends to be on the emotional dimensions of the relationships—how people feel about their partners and the support that they receive. However, that is not all there is to relationship quality. Increasing attention has been paid to the physical and physiological aspects of relationships, but there are few psychometrically sound measures available to assess these dimensions.
In the current study, Dujols et al. (2023) seek to assess the psychometric properties of the Social Thermoregulation and Risk Avoidance Questionnaire (STRAQ-1), a measure of physical relationships that targets social thermoregulation, or how physical proximity is used to promote warmth and closeness. The proposed project will be a thorough assessment of the measure’s reliability over time—that is, the degree to which the measure assesses the construct similarly across administrations. The authors will assess the test-retest reliability and longitudinal measurement invariance of the STRAQ-1, providing much-needed psychometric data that can build confidence in the utility of the measure.
The Stage 1 manuscript was evaluated over two rounds of in-depth review, the first round consisting of detailed comments from two reviewers and the second round consisting of a close read by the recommender. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and was therefore awarded in-principle acceptance (IPA).
URL to the preregistered Stage 1 protocol: https://osf.io/pmnk2
Level of bias control achieved: Level 3. At least some data/evidence that will be used to the answer the research question has been previously accessed by the authors (e.g. downloaded or otherwise received), but the authors certify that they have not yet observed ANY part of the data/evidence List of eligible PCI RR-friendly journals: References
1. Dujols, O., Klein, R. A., Lindenberg, S., Van Lissa, C. J., & IJzerman, H. (2023). Test-Retest Reliability of the STRAQ-1: A Registered Report. In principle acceptance of Version 2 by Peer Community in Registered Reports. https://osf.io/pmnk2
| Test-Retest Reliability of the STRAQ-1: A Registered Report | Olivier Dujols; Richard A. Klein; Siegwart Lindenberg; Hans IJzerman | <p>This Registered Report provides the first test of measurement invariance across time points and estimates of test-retest reliability for the Social Thermoregulation, Risk Avoidance Questionnaire (STRAQ-1, Vergara et al., 2019). The scale was de... | Social sciences | Moin Syed | 2023-03-01 16:07:17 | View | ||
09 Sep 2024
STAGE 1
The origin of symbolic numerical knowledge in early development – an fNIRS Registered ReportElizaveta Ivanova, Marc Joanisse, Daniel Ansari, Mojtaba Soltanlou https://osf.io/7vtdk?view_only=59385b6256b5492791f6882705c20424An fNIRS test of the neural correlates of the Cardinality Principle in typically-developing childrenRecommended by Robert McIntosh based on reviews by Ed Hubbard and 1 anonymous reviewerThe cardinality principle (CP) is a key concept in numerical cognition, which children typically acquire by the age of five. This is the understanding that each number in a counted sequence refers to a specific set of items, and that the final number represents the total size of the set. Here, Ivanova and colleagues (2024) propose an experiment to study the changes in neural activity that accompany the acquisition of this concept, focusing on activity within the parietal lobes as measured by functional near-infrared spectroscopy (fNIRS).
Typically-developing children aged from 2 years 9 months to 4 years 9 months will be assessed for their ability to give a specific number of balls from a pile: those who can give five or more correctly will be classified as CP-knowers, and those who can only give lower set sizes will be classified as subset-knowers. All children will then perform an auditory number word adaptation task while undergoing fNIRS. The adaptation task involves hearing the number word ‘two’ repeated, interspersed with deviant number words (‘four’ or ‘eight’) or a non-number word (‘rin’). The experimental hypotheses are that left parietal activations and bilateral parietal functional connectivity will be differentially greater for number than non-number deviants amongst CP-knowers than amongst subset-knowers. Each hypothesis will be tested by sequential Bayes factor analysis, with a minimum of 25 and a maximum of 46 participants per group, providing high sensitivity to detect a smallest effect size of d = .35. This study aims to provide insights into the neural underpinnings of the CP, informing theoretical models of symbolic knowledge acquisition.
The study plan was refined over four rounds of review, with input from two external reviewers, after which the recommender judged that the Stage 1 manuscript met the criteria for in-principle acceptance (IPA). URL to the preregistered Stage 1 protocol: https://osf.io/gzpk5
Level of bias control achieved: Level 4. At least some of the data/evidence that will be used to answer the research question already exists and is accessible in principle to the authors (e.g. residing in a public database or with a colleague) but the authors certify that they have not yet accessed any part of that data/evidence. List of eligible PCI RR-friendly Journals: References
Ivanova, E., Joanisse, M., Ansari, D., & Soltanlou, M. (2024). The origin of symbolic numerical knowledge in early development – an fNIRS Registered Report. In principle acceptance of Version 7 by Peer Community in Registered Reports. https://osf.io/gzpk5
| The origin of symbolic numerical knowledge in early development – an fNIRS Registered Report | Elizaveta Ivanova, Marc Joanisse, Daniel Ansari, Mojtaba Soltanlou | <p>The ability to understand that each number word in the count sequence refers to a specific set of items (e.g., ‘two’ means ‘two things’) is a milestone in cognitive development. When children reach this milestone, they are said to understand th... | Social sciences | Robert McIntosh | 2023-03-14 17:25:27 | View | ||
Communicating Dynamic Norms With Visual CuesAlaa Aldoh, Paul Sparks, Peter R. Harris https://doi.org/10.31234/osf.io/tac3jNo short-term benefit of a dynamic norm intervention on reducing indicators of meat consumptionRecommended by Chris Chambers based on reviews by Gabriela Jiga-BoyHuman meat consumption is associated with a variety of risks to health, animal welfare, sustainability, and the environment (including greenhouse gas emissions and loss of biodiversity), prompting a growing research effort to develop psychological interventions to reduce it and encourage alternative diets. At the same time, although meat consumption remains the majority choice in the UK, its prevalence is declining, with the proportion of vegetarians and vegans increasing substantially over the last two decades.
One potential tool to accelerate behaviour change is to expose people to “dynamic norm” messaging, which, rather than providing static descriptive information about the prevalence of a desired behaviour, emphasises how the desired behaviour is changing over time so that people can begin to conform to the emerging trend. Although promising in theory, previous research offers mixed evidence on the effectiveness of dynamic norms in encouraging a reduction in meat consumption, with some studies suggesting benefits and others showing no effect or even counterproductive effects. The methodological rigour of some studies is also in question.
In the present study, Aldoh et al. (2023) investigated the effectiveness of dynamic norm information (compared to static norms) on several indicators of meat consumption, including interest, attitudes, and intentions toward reducing meat consumption, as well as self-reported meat consumption itself. Using an online sample of ~1500 participants, the authors also tested the role of visual cues (including data trend graphics) in causing any effects and explored the potential longevity of the intervention over a period of 7 days. Results revealed moderate evidence for no net effect of dynamic (compared to static) norm information on meat consumption outcomes, nor any positive change over the 7-day period. However, the addition of visual cues enhanced the effect of dynamic norm messages, suggesting potential avenues for increasing the potency of future messaging interventions.
The Stage 2 manuscript was evaluated over one round of in-depth review, following which the recommender judged that the manuscript met the Stage 2 criteria and awarded a positive recommendation.
URL to the preregistered Stage 1 protocol: https://osf.io/txzvm
Level of bias control achieved: Level 6. No part of the data or evidence that was used to answer the research question was generated until after IPA.
List of eligible PCI RR-friendly journals:
References
1. Aldoh, A., Sparks, P. & Harris, P. R. (2023). Communicating dynamic norm information [Stage 2]. Acceptance of Version 1 by Peer Community in Registered Reports. https://doi.org/10.31234/osf.io/tac3j
| Communicating Dynamic Norms With Visual Cues | Alaa Aldoh, Paul Sparks, Peter R. Harris | <p>While decreasing their meat consumption is one of the most impactful behaviours an individual may carry out to reduce their carbon emissions, it is still a minority behaviour in many parts of the world. Research suggests that communicating info... | Social sciences | Chris Chambers | Gabriela Jiga-Boy, Wendy Van Lippevelde | 2023-03-15 12:58:28 | View | |
14 Aug 2023
STAGE 1
Cue-based modulation of pain stimulus expectation: do ongoing oscillations reflect changes in pain perception?Chiara Leu, Esther Glineur, Giulia Liberati https://osf.io/4v3shUnderstanding oscillatory correlates of pain expectationRecommended by Gemma Learmonth based on reviews by Zoltan Dienes, Chris Chambers and Markus PlonerRecent studies using an EEG frequency tagging approach have reported modulations of alpha, beta and theta bands at the stimulation frequency during nociceptive/painful thermal stimulation compared to non-nociceptive/non-painful vibrotactile stimulation. Prior expectations of the intensity of upcoming painful stimuli are known to strongly modulate the subjective experience of those stimuli. Thus, modulating the expectation of pain should result in a change in the modulation of oscillations if these factors are indeed linked.
In this study, Leu, Glineur and Liberati will modulate expectations of pain (low or high intensity) prior to delivering thermal cutaneous stimulation (low, medium or high intensity). They will record how intense participants expect the pain to be, and how intense they felt it to be, as well as record EEG to assess oscillatory differences across the expectation and intensity conditions.
The Stage 1 manuscript was reviewed over 5 rounds by 3 reviewers. Based on detailed responses to the reviewers’ comments and edits to the Stage 1 report, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance.
URL to the preregistered Stage 1 protocol: https://osf.io/y6fb8
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA. List of eligible PCI RR-friendly journals: References
1. Leu, C., Glineur, E. & Liberati, G. (2023). Cue-based modulation of pain stimulus expectation: do ongoing oscillations reflect changes in pain perception? In principle acceptance of Version 5 by Peer Community in Registered Reports. https://osf.io/y6fb8 | Cue-based modulation of pain stimulus expectation: do ongoing oscillations reflect changes in pain perception? | Chiara Leu, Esther Glineur, Giulia Liberati | <p>A promising stream of investigations is targeting ongoing neural oscillations and whether their modulation could be relevant for the perception of pain. Specifically, sustained periodic thermonociceptive stimuli have been shown to modulate ongo... | Medical Sciences | Gemma Learmonth | Zoltan Dienes | 2023-03-15 14:41:03 | View | |
Evaluating the Pedagogical Effectiveness of Study Preregistration in the Undergraduate DissertationMadeleine Pownall, Charlotte R. Pennington, Emma Norris, Marie Juanchich, David Smaile, Sophie Russell, Debbie Gooch, Thomas Rhys Evans, Sofia Persson, Matthew HC Mak, Loukia Tzavella, Rebecca Monk, Thomas Gough, Christopher SY Benwell, Mahmoud Elsherif, Emily Farran, Thomas Gallagher-Mitchell, Luke T. Kendrick, Julia Bahnmueller, Emily Nordmann, Mirela Zaneva, Katie Gilligan-Lee0, Marina Bazhydai, Andrew Jones, Jemma Sedgmond, Iris Holzleitner, James Reynolds, Jo Moss, Daniel Farrelly, Adam J. ... https://doi.org/10.31234/osf.io/xg2ahIncorporating open research practices into the undergraduate curriculum increases understanding of such practicesRecommended by Corina Logan based on reviews by Kelsey McCune, Neil Lewis, Jr., Lisa Spitzer and 1 anonymous reviewerIn a time when open research practices are becoming more widely used to combat questionable research practices (QRPs) in academia, this Registered Report by Pownall and colleagues (2023) empirically investigated the practice of preregistering study plans, which allows us to better understand to what degree such practices increase awareness of QRPs and whether experience with preregistration helps reduce engagement in QRPs. This investigation is timely because results from these kinds of studies are only recently becoming available and the conclusions are providing evidence that open research practices can improve research quality and reliability (e.g., Soderberg et al. 2021, Chambers & Tzavella 2022). The authors crucially focused on the effect of preregistering the undergraduate senior thesis (of psychology students in the UK), which is a key stage in the development of an academic.
Pownall and colleagues found that preregistration did not affect attitudes toward QRPs, but it did improve student understanding of open research practices. Using exploratory analyses, they additionally found that those who preregistered were those students who reported that they had more opportunity, motivation, and greater capability. This shows how important it is to incorporate the teaching of open research practices such that students can increase their capability, motivation, and opportunity to pursue such practices, whether it is preregistration or other practices that are better known to reduce QRPs (such as registered reports; Krypotos et al. 2022).
After four rounds of review and revisions, the recommender judged that the manuscript met the Stage 2 criteria and awarded a positive recommendation.
URL to the preregistered Stage 1 protocol: https://osf.io/9hjbw
Level of bias control achieved: Level 6. No part of the data or evidence that was used to answer the research question was generated until after IPA.
List of eligible PCI RR-friendly journals:
References
1. Chambers C. D. & Tzavella, L. (2022). The past, present, and future of Registered Reports. Nature Human Behaviour, 6, 29-42. https://doi.org/10.1038/s41562-021-01193-7
2. Krypotos, A. M., Mertens, G., Klugkist, I., & Engelhard, I. M. (2022). Preregistration: Definition, advantages, disadvantages, and how it can help against questionable research practices. In Avoiding Questionable Research Practices in Applied Psychology (pp. 343-357). Cham: Springer International Publishing.
3. Pownall, M., Pennington, C. R., Norris, E., Juanchich, M., Smaile, D., Russell, S., Gooch, D., Rhys Evans, T., Persson, S., Mak, M. H. C., Tzavella, L., Monk, R., Gough, T., Benwell, C. S. Y., Elsherif, M., Farran, E., Gallagher-Mitchell, T., Kendrick, L. T., Bahnmueller, J., Nordmann, E., Zaneva, M., Gilligan-Lee, K., Bazhydai, M., Jones, A., Sedgmond, J., Holzleitner, I., Reynolds, J., Moss, J., Farrelly, D., Parker, A. J. & Clark, K. (2023). Evaluating the pedagogical effectiveness of study preregistration in the undergraduate dissertation [Stage 2 Registered Report], acceptance of Version 4 by Peer Community in Registered Reports. https://psyarxiv.com/xg2ah
4. Soderberg C. K., Errington T. M., Schiavone S. R., Bottesini J., Thorn F. S., Vazire S., Esterling K. M. & Nosek B. A. (2021) Initial evidence of research quality of registered reports compared with the standard publishing model. Nature Human Behaviour, 5, 990–997. https://doi.org/10.1038/s41562-021-01142-4
| Evaluating the Pedagogical Effectiveness of Study Preregistration in the Undergraduate Dissertation | Madeleine Pownall, Charlotte R. Pennington, Emma Norris, Marie Juanchich, David Smaile, Sophie Russell, Debbie Gooch, Thomas Rhys Evans, Sofia Persson, Matthew HC Mak, Loukia Tzavella, Rebecca Monk, Thomas Gough, Christopher SY Benwell, Mahmoud El... | <p>Research shows that questionable research practices (QRPs) are present in undergraduate final-year dissertation projects. One entry-level Open Science practice proposed to mitigate QRPs is ‘study preregistration’, through which researchers outl... | Life Sciences, Social sciences | Corina Logan | 2023-03-25 11:38:54 | View | ||
27 Nov 2023
STAGE 1
Cortical voice processing in Autism Spectrum DisorderRaphaël Gautier, Emmanuelle Houy-Durand, Laurent Barantin, Frederic Briend, Marianne Latinus https://osf.io/96scmIs voice processing impacted in Autism Spectrum Disorder?Recommended by Grace Edwards and D. Samuel Schwarzkopf based on reviews by 2 anonymous reviewersVocal sounds, including both speech and non-speech sounds, have been found to activate the Superior Temporal Sulci and Gyri in comparison to non-vocal sounds. These regions, termed Temporal Voice Areas (TVAs), are considered to be involved in early voice processing and therefore critical for social interaction. TVA activation has been examined in Autism Spectrum Disorder (ASD) to determine if the characteristic difficulties in social communication and interaction are linked to an impaired early voice processing. Using functional magnetic resonance imaging (fMRI), one study found typical brain activation in TVAs for 15 out of 16 autistic participants (Schelinski et al., 2016), whereas another found atypical activation in 4 out of 5 autistic participants (Gervais et al., 2004).
Here, the inconsistencies in the previous literature propel Gautier et al. (2023) to examine brain activation of TVAs with a larger sample size (26 ASD and 26 non-ASD participants). Gautier et al. (2023) will present vocal sounds and non-vocal sounds to both groups of participants during fMRI and predict that fewer participants in the ASD group will show a preferential response to voices in TVAs compared to the non-ASD group. These results would suggest that symptoms of ASD interfere with early stages of social interaction, at the level of voice processing.
This Stage 1 manuscript was evaluated in an initial round by the co-recommenders and another two rounds of in-depth review by two expert reviewers. With these revisions, the recommenders judged that the manuscript met the Stage 1 criteria and awarded in-principle acceptance (IPA).
URL to the preregistered Stage 1 protocol: https://osf.io/538m4
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA. List of eligible PCI RR-friendly journals:
References
1. Gautier, R., Houy-Durand, E., Barantin, L., Briend, F. & Latinus, M. (2023). Cortical voice processing in Autism Spectrum Disorder. In principle acceptance of Version 4 by Peer Community in Registered Reports. https://osf.io/538m4 | Cortical voice processing in Autism Spectrum Disorder | Raphaël Gautier, Emmanuelle Houy-Durand, Laurent Barantin, Frederic Briend, Marianne Latinus | <p>Voice processing is central to social functioning. A specific brain response to vocal sounds has been described and extensively characterized in the general population but remains critically unexplored in Autism Spectrum Disorder (ASD), a condi... | Life Sciences | Grace Edwards | 2023-03-28 09:51:48 | View |
MANAGING BOARD
Chris Chambers
Zoltan Dienes
Corina Logan
Benoit Pujol
Maanasa Raghavan
Emily S Sena
Yuki Yamada