Announcements
Please note that we will be CLOSED to ALL SUBMISSIONS from 1 December 2024 through 12 January 2025 to give our recommenders and reviewers a holiday break.
We are recruiting recommenders (editors) from all research fields!
Your feedback matters! If you have authored or reviewed a Registered Report at Peer Community in Registered Reports, then please take 5 minutes to leave anonymous feedback about your experience, and view community ratings.
Latest recommendations
Id | Title * | Authors * | Abstract * | Picture | Thematic fields * | Recommender | Reviewers▼ | Submission date | |
---|---|---|---|---|---|---|---|---|---|
28 Dec 2021
STAGE 1
Sight vs. sound in the judgment of music performance: Cross-cultural evidence from classical piano and Tsugaru shamisen competitionsGakuto Chiba, Yuto Ozaki, Shinya Fujii, Patrick E. Savage https://doi.org/10.31234/osf.io/xky4jUnderstanding the role of visual and auditory information in evaluating musical performanceRecommended by Yuki Yamada based on reviews by David Hughes and Kyoshiro SasakiIn this Stage 1 Registered Report, Chiba and colleagues (2021) aim to investigate how people use information from visual and auditory modalities when evaluating musical performances. Previous studies, mainly using Western music, have reported a visual dominance, but this has not yet been clearly and consistently reported. Thus, the authors propose to evaluate both the reproducibility and generalizability of the previous findings by conducting a replication study using the methodology of the previous studies and by introducing a new experimental condition in which the Tsugaru-shamisen, a unique Japanese musical instrument, is also performed. This study could represent an important turning point in the research context of performance evaluation and would be of considerable value. This manuscript was peer-reviewed by two experts in scientific methodology and Japanese traditional music, respectively, and during the two-round peer-review process they made a number of important points, but eventually awarded the manuscript a highly positive response. I am therefore pleased to recommend that this Stage 1 Registered Report meets our Stage 1 criteria and is worthy of in-principle acceptance. I look forward to seeing the results and discussion reported in Stage 2, with the expectation that the experiment conducted by the authors will be in strict accordance with this protocol. *The following is a very minor comment, which I hope the authors will find helpful in the future. Of course, this is not related to hypothesis construction and does not require revision: The "Blind Audition" study cited in the introduction is very impactful, but has recently been called into question, so I am at least a little cautious when citing this study. This article may be useful. https://www.wsj.com/articles/blind-spots-in-the-blind-audition-study-11571599303 URL to the preregistered Stage 1 protocol: https://osf.io/ry2b6 Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA. List of eligible PCI RR-friendly journals: References
| Sight vs. sound in the judgment of music performance: Cross-cultural evidence from classical piano and Tsugaru shamisen competitions | Gakuto Chiba, Yuto Ozaki, Shinya Fujii, Patrick E. Savage | <p style="text-align: justify;">Which information dominates in evaluating performance in music? Both experts and laypeople consistently report believing that sound should be the most important domain when judging music competitions, but experime... | Social sciences | Yuki Yamada | Kyoshiro Sasaki | 2021-09-24 08:59:26 | View | |
20 Jun 2022
STAGE 1
Revisiting stigma attributions and reactions to stigma: Replication and extensions of Weiner et al. (1988)Kwan Yin (Gladys) Yeung, Gilad Feldman https://osf.io/rqdn2/Understanding the psychology of stigmasRecommended by Chris Chambers based on reviews by Charlotte Pennington and Joanne RathboneStigmas are prejudices or discrimination against people based on qualities that vary from the norm, such as a physical or mental illness, disability, sexuality, race, or one of many other personal characteristics. The harm caused by stigmatisation has made understanding the causes and potential solutions a vital area of study in psychology and public health. One of the major focuses of ongoing research is understanding the factors that determine whether a particular characteristic becomes stigmatised, and if so how the stigma might be eliminated. Previous research has found that for disease-based stigmas, the contagiousness, course, and disruptiveness of a disease can be influential. Another key determinant is the perceived cause of the stigmatised condition or characteristic. In a landmark study, Weiner et al. (1988) reported that attributes based on physical health were more likely to be perceived as being uncontrollable, stable and irreversible, prompting feelings of sympathy without anger or judgment. On the other hand, attributes related to mental health and behaviour were more likely to be regarded as controllable and reversible, prompting lack of sympathy coupled with feelings of anger and negative judgement. In a second experiment, they also found that manipulating the perception of controllability can modify emotional responses and judgments – for some stigmas (but not others), providing participants with information that a particular characteristic was controllable vs. uncontrollable was found to increase or decrease negative attributions, respectively.
In the current study, Yeung and Feldman (2022) propose to replicate Experiment 2 from Weiner et al. (1988) in a large online sample. In particular, they plan to ask how the source of a stigma is related to perceived controllability and stability, emotional reactions, and willingness to help. They also propose a range of extensions, including the inclusion of additional stigmas that have become relevant since the original study was published over 30 years ago.
The Stage 1 manuscript was evaluated over two rounds of in-depth review. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
URL to the preregistered Stage 1 protocol: https://osf.io/k957f Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.
List of eligible PCI RR-friendly journals:
References
1. Weiner, B., Perry, R. P., & Magnusson, J. (1988). An attributional analysis of reactions to stigmas. Journal of Personality and Social Psychology, 55, 738–748. https://doi.org/10.1037/0022-3514.55.5.738
2. Yeung, K. Y. & Feldman, G. (2022). Revisiting stigma attributions and reactions to stigma: Replication and extensions of Weiner et al. (1988), in principle acceptance of Version 2 by Peer Community in Registered Reports. https://osf.io/k957f
| Revisiting stigma attributions and reactions to stigma: Replication and extensions of Weiner et al. (1988) | Kwan Yin (Gladys) Yeung, Gilad Feldman | <p>This is a scheduled PCI-RR snap shot for a planned project: "Revisiting stigma attributions and reactions to stigma: Replication and extensions of Weiner et al. (1988) "</p> | Social sciences | Chris Chambers | Joanne Rathbone | 2022-02-15 10:55:13 | View | |
Beneath the label: Unsatisfactory compliance with ESRB, PEGI, and IARC industry self-regulation requiring loot box presence warning labels by video game companiesLeon Y. Xiao https://doi.org/10.31219/osf.io/asbcgFailure of industry self-regulation in loot box labellingRecommended by Chris ChambersPaid loot boxes – items bought for real-world money that offer randomised rewards – are a prevalent feature of contemporary video games (Zendle et al., 2020). Because they employ random chance to provide rewards after spending real money, loot boxes have been considered a form of gambling, raising concerns about risk of harm to children and other vulnerable users. In response, some countries have taken legal steps to regulate and even ban the use of loot boxes, with only limited success so far (Xiao, 2022). At the same time, the Entertainment Software Rating Board (ESRB) and PEGI (Pan-European Game Information) now expect games that contain loot boxes to be marked with warning labels that, in theory, will enable users (including parents) to make more informed decisions. These requirements by ESRB/PEGI are not legally binding and may be considered a form of industry self-regulation.
In the current study, Xiao (2023) investigated the effectiveness of self-regulation in the use of loot box labels. Study 1 examined the consistency of warning labels by the ESRB and PEGI, with the expectation that if self-regulation works as it should then these labels should always (or nearly always) co-occur. Study 2 established the compliance rate for labelling among popular games that are known to contain loot boxes, with a rate of ≥95% considered to be successful.
The results of both studies reveal deficiences in industry self-regulation. The consistency rate of warning labels by the ESRB and PEGI was just 39.4% in preregistered analyses, rising to 83.9% in an unregistered exploratory analysis that took into account industry responses to the findings. Even at this upper bound, this rate is lower than expected by complete (or near-complete) consistency. The results of Study 2 indicate that only 29% of games on the Google Play Store known to contain loot boxes were accurately labelled, indicating that 71% were non-compliant with industry requirements.
Following careful evaluation, the recommender judged that the manuscript met the Stage 2 criteria and awarded a positive recommendation.
URL to the preregistered Stage 1 protocol: https://osf.io/e6qbm Level of bias control achieved: Level 3. At least some data/evidence that was used to the answer the research question had been previously accessed by the authors (e.g. downloaded or otherwise received), but the authors certifed that they had not yet observed ANY part of the data/evidence prior to in-principle-acceptance.
List of eligible PCI RR-friendly journals:
References
1. Zendle, D., Meyer, R., Cairns, P., Waters, S., & Ballou, N. (2020). The prevalence of loot boxes in mobile and desktop games. Addiction, 115(9), 1768-1772. https://doi.org/10.1111/add.14973
2. Xiao, L. Y. (2022). Breaking Ban: Belgium’s ineffective gambling law regulation of video game loot boxes. Stage 2 Registered Report, acceptance of Version 2 by Peer Community in Registered Reports. https://doi.org/10.31219/osf.io/hnd7w 3. Xiao, L. Y. (2023). Beneath the label: Unsatisfactory compliance with ESRB, PEGI, and IARC industry self-regulation requiring loot box presence warning labels by video game companies, acceptance of Version 2 by Peer Community in Registered Reports. https://doi.org/10.31219/osf.io/asbcg
| Beneath the label: Unsatisfactory compliance with ESRB, PEGI, and IARC industry self-regulation requiring loot box presence warning labels by video game companies | Leon Y. Xiao | <p>Loot boxes in video games are a form of in-game transactions with randomised elements. Concerns have been raised about loot boxes’ similarities with gambling and their potential harms (e.g., overspending). Recognising players’ and parents’ conc... | Humanities, Social sciences | Chris Chambers | Jim Sauer, Pete Etchells | 2023-02-12 16:17:34 | View | |
06 Sep 2024
STAGE 1
The Role of Offender Identifiability in Second- and Third-Party PunishmentTheresa Blanke, Mathias Twardawski https://osf.io/7qzvaPunishing OffendersRecommended by Clare Conry-Murray based on reviews by Gilad Feldman and Rajarshi MajumderWhen people are less-well-known to us, it can impact how we treat them. People outside our communities may feel more anonymous or de-personalized to us, and this could impact the empathy we feel for them. Indeed, past research shows that people seem to care more for those who are who are identified to us, especially when they are victims of a crime (Small & Loewenstein, 2003). In addition, past research also shows that anonymizing victims can influence criminal behavior (Walters, 2022). Thus, social cognitive factors related to anonymity appear to affect both positive feelings (engaging in empathy) and negative activities (criminal activity) related to victims. It seems likely that anonymity can also affect how people judge criminals themselves.
This paper by Blanke and Twardawski (2024) examines how even minor identifying features can make individuals react differently to a perpetrator of a crime. A picture or name (information that may appear in the press) may impact how people perceive criminals in terms of punishment, empathy, outrage, and blame.
How people respond to anonymous or identified criminals may depend on whether the impact of the crime on the victim is made salient. Similar to the Black Sheep Effect (Marques & Paez,1994), the current paper expects that people who identify with victims are expected to punish a perpetrator more when the perpetrator’s name and image are known. This is similar to the case with an ingroup member in The Black Sheep Effect, where ingroup members are punished more for transgressions than outgroup members. For people who view the situation as a third party (and are thus less connected to the victim), an identified perpetrator is expected to lead to less punishment (and also less outrage and blame, and more empathy).
The current study focuses on pickpocketing since it is a crime that can be committed without identifying oneself to the victim. Future research should examine how the type of event impacts judgments, especially given the stigma of being a victim of some crimes. Littering and other minor violations may be seen as understandable when you see someone as a person, rather than a anonymous, impersonal criminal. On the other hand, there can be stigma to being a victim in some cases, such as the case of sexual harassment, where, research shows, perpetrators are judged more positively if they are identified, and victims, especially women, are judged more negatively if they are identified (Barak-Corren & Lewinsohn-Zamir, 2019).
People around the world engage in moral and legal transgressions, and if our judgments of them are influenced by minor features such as a photo or name, we should take action to treat people more fairly. This research will help to determine if people are influenced by these factors.
The Stage 1 manuscript underwent one round of thorough review. After considering the detailed responses to the reviewers' comments, the recommender determined that the manuscript met the Stage 1 criteria and granted in-principle acceptance (IPA).
URL to the preregistered Stage 1 protocol: https://osf.io/7qzva
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA. List of eligible PCI RR-friendly Journals:
References
1. Barak‐Corren, N., & Lewinsohn‐Zamir, D. (2019). What's in a Name? The Disparate Effects of Identifiability on Offenders and Victims of Sexual Harassment. Journal of Empirical Legal Studies, 16, 955-1000. https://doi.org/10.1111/jels.12233
2. Blanke, T. & Twardawski, M. (2024). The Role of Offender Identifiability in Second- and Third-Party Punishment. In principle acceptance of Version 2 by Peer Community in Registered Reports. https://osf.io/7qzva
3. Marques, J. M., & Paez, D. (1994). The ‘black sheep effect’: Social categorization, rejection of ingroup deviates, and perception of group variability. European Review of Social Psychology, 5, 37-68. https://doi.org/10.1080/14792779543000011
4. Small, D. A., & Loewenstein, G. (2003). Helping a victim or helping the victim: Altruism and identifiability. Journal of Risk and Uncertainty, 26, 5-16. https://doi.org/10.1023/A:1022299422219
5. Walters, G. D. (2022). Crime and social cognition: A meta-analytic review of the developmental roots of adult criminal thinking. Journal of Experimental Criminology, 18, 183-207. https://doi.org/10.1007/s11292-020-09435-w
| The Role of Offender Identifiability in Second- and Third-Party Punishment | Theresa Blanke, Mathias Twardawski | <p>The identifiability effect describes humans' tendency to exhibit different emotional and behavioral responses toward identified as compared to anonymous individuals. This phenomenon has been extensively studied within the identifiable victim ef... | Social sciences | Clare Conry-Murray | Gilad Feldman, Rajarshi Majumder | 2024-03-23 11:02:30 | View | |
Communicating Dynamic Norms With Visual CuesAlaa Aldoh, Paul Sparks, Peter R. Harris https://doi.org/10.31234/osf.io/tac3jNo short-term benefit of a dynamic norm intervention on reducing indicators of meat consumptionRecommended by Chris Chambers based on reviews by Gabriela Jiga-BoyHuman meat consumption is associated with a variety of risks to health, animal welfare, sustainability, and the environment (including greenhouse gas emissions and loss of biodiversity), prompting a growing research effort to develop psychological interventions to reduce it and encourage alternative diets. At the same time, although meat consumption remains the majority choice in the UK, its prevalence is declining, with the proportion of vegetarians and vegans increasing substantially over the last two decades.
One potential tool to accelerate behaviour change is to expose people to “dynamic norm” messaging, which, rather than providing static descriptive information about the prevalence of a desired behaviour, emphasises how the desired behaviour is changing over time so that people can begin to conform to the emerging trend. Although promising in theory, previous research offers mixed evidence on the effectiveness of dynamic norms in encouraging a reduction in meat consumption, with some studies suggesting benefits and others showing no effect or even counterproductive effects. The methodological rigour of some studies is also in question.
In the present study, Aldoh et al. (2023) investigated the effectiveness of dynamic norm information (compared to static norms) on several indicators of meat consumption, including interest, attitudes, and intentions toward reducing meat consumption, as well as self-reported meat consumption itself. Using an online sample of ~1500 participants, the authors also tested the role of visual cues (including data trend graphics) in causing any effects and explored the potential longevity of the intervention over a period of 7 days. Results revealed moderate evidence for no net effect of dynamic (compared to static) norm information on meat consumption outcomes, nor any positive change over the 7-day period. However, the addition of visual cues enhanced the effect of dynamic norm messages, suggesting potential avenues for increasing the potency of future messaging interventions.
The Stage 2 manuscript was evaluated over one round of in-depth review, following which the recommender judged that the manuscript met the Stage 2 criteria and awarded a positive recommendation.
URL to the preregistered Stage 1 protocol: https://osf.io/txzvm
Level of bias control achieved: Level 6. No part of the data or evidence that was used to answer the research question was generated until after IPA.
List of eligible PCI RR-friendly journals:
References
1. Aldoh, A., Sparks, P. & Harris, P. R. (2023). Communicating dynamic norm information [Stage 2]. Acceptance of Version 1 by Peer Community in Registered Reports. https://doi.org/10.31234/osf.io/tac3j
| Communicating Dynamic Norms With Visual Cues | Alaa Aldoh, Paul Sparks, Peter R. Harris | <p>While decreasing their meat consumption is one of the most impactful behaviours an individual may carry out to reduce their carbon emissions, it is still a minority behaviour in many parts of the world. Research suggests that communicating info... | Social sciences | Chris Chambers | Gabriela Jiga-Boy, Wendy Van Lippevelde | 2023-03-15 12:58:28 | View | |
16 Jun 2023
STAGE 1
Licensing via credentials: Replication of Monin and Miller (2001) with extensions investigating the domain-specificity of moral credentials and the association between the credential effect and trait reputational concernQinyu Xiao, Lok Ching Li, Ying Lam Au, Wing Tung Chung, See Ngueh Tan, Gilad Feldman https://osf.io/vrsd3Revisiting moral licensingRecommended by Chris Chambers based on reviews by Corey Cusimano, Marek Vranka, Štěpán Bahník and Ethan MeyersDoes being good free people up to be bad? A large literature in social psychology suggests that it might, with evidence that “moral licensing” gives people a perception that actions deemed morally questionable, or socially undesirable, will be tolerated more readily if they have demonstrated a past history of praiseworthy, moral behaviour. In a formative study, Monin and Miller (2001) reported that having a track record of moral credentials as being nonprejudiced (e.g. non-sexist or non-racist) increased the willingness of participants to later express a prejudiced attitude. For example, in their Study 2 they found that participants who built up their moral credit by selecting a Black woman in a hypothetical recruitment task were then more willing to then prefer a White man for a second job, compared to participants who did not have the opportunity to initially recommend a Black woman. These results have prompted a burgeoning literature on moral licensing, albeit one that is mixed and has been found to exhibit substantial publication bias.
In the current study, Xiao et al. (2023) propose a large online replication of Study 2 in Monin and Miller (2001), asking whether previous moral behaviours that furnish participants with moral credentials make them more likely to then engage in morally questionable behaviours. The authors will also extend earlier work by testing whether moral credentials license immoral behaviours more effectively in the same domain (e.g. within sex) than in a different domain (e.g. across sex and race), asking whether there is a negative relationship between expression of prejudice and trait reputational concern (fear of negative evaluation), and whether moral credentials attenuate any such observed relationship.
The Stage 1 manuscript was evaluated over three rounds of in-depth review. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
URL to the preregistered Stage 1 protocol: https://osf.io/uxgrk
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA. List of eligible PCI RR-friendly journals:
References
1. Monin, B., & Miller, D. T. (2001). Moral credentials and the expression of prejudice. Journal of Personality and Social Psychology, 81, 33-43. https://psycnet.apa.org/doi/10.1037/0022-3514.81.1.33
2. Xiao, Q., Ching Li, L., Au, Y. L., Chung, W. T., Tan, S. N. & Feldman, G. (2023). Licensing via credentials: Replication of Monin and Miller (2001) with extensions investigating the domain-specificity of moral credentials and the association between the credential effect and trait reputational concern, in principle acceptance of Version 5 by Peer Community in Registered Reports. https://osf.io/uxgrk | Licensing via credentials: Replication of Monin and Miller (2001) with extensions investigating the domain-specificity of moral credentials and the association between the credential effect and trait reputational concern | Qinyu Xiao, Lok Ching Li, Ying Lam Au, Wing Tung Chung, See Ngueh Tan, Gilad Feldman | <p>This is a scheduled PCI-RR snap shot for a planned project: "Licensing via credentials: Replications of Monin and Miller (2001) with extensions investigating the domain-specificity of moral credentials and associations with trait reputational c... | Social sciences | Chris Chambers | Ethan Meyers, Marek Vranka, Štěpán Bahník | 2022-02-20 04:49:16 | View | |
09 Jun 2022
STAGE 1
Revisiting diversification bias and partition dependence: Replication and extensions of Fox, Ratner, and Lieb (2005) Studies 1, 2, and 5Mei Yee (Alice) Li, Gilad Feldman https://osf.io/vkp3q/Testing the replicability of diversification bias and partition dependenceRecommended by Chris Chambers based on reviews by Craig Fox and Leo CohenWhen offered a range of options and asked to make multiple selections, how do people choose? Over the last 30 years, a key finding to emerge from behavioural economics is that people distribute their choices more evenly than would be considered optimal – a phenomenon termed “diversification bias” or the “diversification heuristic” (Read & Loewenstein, 1995). For example, when filling a plate from a buffet, you might be inclined to choose a relatively even amount of everything on offer, even when you prefer some foods over others. Similarly, when allocating savings among different investment options, people are prone to spreading their money more evenly than would maximise utility.
In an influential study, Fox et al. (2005) found that diversification bias can be shaped by so-called “partition dependence” – the tendency to allocate resources differently across options depending on how they are subjectively grouped. Such groupings could be arbitrary; so, for example, to return to the buffet example, people might diversify across high-level categories such as cooked and uncooked, savoury and sweet, or surf and turf, and then diversify across the options within those categories. The nature of level of these subjective (and potentially arbitrary) categorisations can strongly influence the final allocation of resources. Diversification bias and partition dependence have important implications for basic theory in judgment and decision-making as well as applications in behavioral economics and finance.
In the current study, Li and Feldman (2022) propose to replicate Studies 1, 2 and 5 from Fox et al. (2002) in a large online sample. In particular, they plan to ask how partitioning influences the allocation of choices between options, and the extent to which partition dependence is reduced in people with greater relevant expertise. The authors also propose extending the original study to explore individual differences in the desire for choice diversity as predictors of partition dependence.
The Stage 1 manuscript was evaluated over one round of in-depth review. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
URL to the preregistered Stage 1 protocol: https://osf.io/bx8vq Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.
List of eligible PCI RR-friendly journals: References 1. Read, D., & Loewenstein, G. (1995). Diversification bias: Explaining the discrepancy in variety seeking between combined and separated choices. Journal of Experimental Psychology: Applied, 1, 34-49. https://doi.org/10.1037/1076-898X.1.1.34
2. Fox, C. R., Ratner, R. K., & Lieb, D. S. (2005). How subjective grouping of options influences choice and allocation: Diversification bias and the phenomenon of partition dependence. Journal of Experimental Psychology: General, 134, 538-551. https://doi.org/10.1037/0096-3445.134.4.538
3. Li, M. Y. & Feldman, G. (2022). Revisiting diversification bias and partition dependence: Replication and extension of Fox, Ratner, and Lieb (2005) Studies 1, 2, and 5, in principle acceptance of Version 2 by Peer Community in Registered Reports. https://osf.io/bx8vq | Revisiting diversification bias and partition dependence: Replication and extensions of Fox, Ratner, and Lieb (2005) Studies 1, 2, and 5 | Mei Yee (Alice) Li, Gilad Feldman | <p>This is a scheduled PCI-RR snap shot for a planned project: "Revisiting diversification bias and partition dependence: Replication and extensions of Fox, Ratner, and Lieb (2005) Studies 1, 2, and 5 "</p> | Social sciences | Chris Chambers | Craig Fox, Leo Cohen | 2022-02-15 09:57:51 | View | |
25 Oct 2023
STAGE 1
Does pupillometry provide a valid measure of spatial attentional bias (pseudoneglect)?Nicola E. Burns, and Robert D. McIntosh https://osf.io/ua9jnAssessing visuospatial biases (pseudoneglect) using pupillometry: A replication and extension of Strauch et al. (2022)Recommended by Gemma Learmonth based on reviews by Christoph Strauch and Bianca Hatin‘Pseudoneglect’ is a small, lateralised bias of visuospatial attention towards the left side of space, and is typically observed in healthy adults. Recently, Strauch et al. (2022) reported that bright stimuli presented in the left visual field induced a greater constriction of the pupil (the pupillary light reflex) compared to the same bright stimuli presented in the right visual field. Further, the pupillary restriction bias was positively correlated with a behavioural measure of pseudoneglect (the greyscales task). This is potentially an important development for attention research, because the passive nature of the task, in addition to the ability to track the time course of the bias measures, could provide a new, and highly sensitive, method of studying spatial attention.
In this report, Burns and McIntosh (2023) aim to replicate and extend the study of Strauch et al. (2022). The extension centres around investigating whether the pupillary biases are influenced by recording pupillary responses from the right or left eye. In their pilot replication data, Burns & McIntosh identified a larger constriction in response to stimuli on the right side when recording from the right eye. They hypothesise that pupillary biases may be stronger to stimuli presented in the ipsilateral, rather than contralateral, side of space.
The Stage 1 manuscript was reviewed over 2 rounds by 2 reviewers, including the authors of the study being replicated. Based on detailed responses to the reviewers’ comments and edits to the Stage 1 report, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance.
URL to the preregistered Stage 1 protocol: https://osf.io/ua9jn
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA. List of eligible PCI-RR-friendly journals:
References
1. Strauch, C., Romein, C., Naber, M., Van der Stigchel, S. & Ten Brink, A. F. (2022). The orienting response drives pseudoneglect—Evidence from an objective pupillometric method. Cortex, 151, 259-271.
2. Burns, N. E. & McIntosh, R. D. (2023). Does pupillometry provide a valid measure of spatial attentional bias (pseudoneglect)? In principle acceptance of Version 2 by Peer Community in Registered Reports. https://osf.io/ua9jn | Does pupillometry provide a valid measure of spatial attentional bias (pseudoneglect)? | Nicola E. Burns, and Robert D. McIntosh | <p>Strauch et al. (2022) introduced a novel approach to assess biases of visual attention, by measuring pupillary constriction in response to split-field stimuli, in which a bright patch is presented to one visual field and a dark patch to the oth... | Social sciences | Gemma Learmonth | Christoph Strauch | 2023-07-12 18:27:28 | View | |
31 May 2023
STAGE 1
Defacing biases in manual and automated quality assessments of structural MRI with MRIQCCéline Provins, Yasser Alemán-Gómez, Jonas Richiardi, Russell A. Poldrack, Patric Hagmann, Oscar Esteban https://osf.io/qcketThe impact of removing facial features on quality measures of structural MRI scansRecommended by D. Samuel Schwarzkopf based on reviews by Catherine Morgan and Cassandra Gould van PraagData sharing is perhaps the most fundamental step for increasing the transparency and reproducibility of scientific research. However, the goals of open science must be tempered by ethical considerations, protecting the privacy and safety of research participants. Bridging this gap causes challenges for many fields, such as human neuroimaging. Brain images, as measured with magnetic resonance imaging (MRI), are unique to the participant and therefore contain identifying information by definition. One way to mitigate the risk to participants arising from public data sharing has been "defacing" the MRI scans, i.e., literally removing the part of the image that contains the face and surrounding tissue, while preserving the brain structure. This procedure however also removes information that is not (or at least minimally) identifiable. It also remains unclear whether defacing the images affects image quality and thus the information necessary for addressing many research questions.
The current study by Provins et al. (2023) seeks to address this question. Leveraging a publicly available "IXI dataset" comprising hundreds of T1-weighted structural MRI scans, they will assess the effect of defacing on manual and automatic estimates of image quality. Specifically, the researchers will compare image quality ratings by experts for a subset of 185 images. They hypothesise that images in which facial features have been removed are typically assigned higher quality ratings. Moreover, using a full data set of 580 images, which have been obtained across three scanning sites, they will also test the impact defacing MRI scans has on automated quality measures obtained with MRIQC software. The results of this study should have important implications for open science policy and for designing the optimal procedures for sharing structural MRI data in an ethical way. For example, if the authors' hypothesis is confirmed, studies relying on MRI quality measures might be better served by a custodianship model where identifiable data is shared under strict conditions, rather than relying on publishing defaced data. More generally, the outcome of this study may have significant legal implications in many jurisdictions.
The Stage 1 manuscript was evaluated at the inital triage stage by the Recommender and PCI:RR team, and another round of in-depth review by two experts. After a detailed response and substantial revisions, the recommender judged the manuscript met the Stage 1 criteria and awarded in-principle acceptance (IPA).
URL to the preregistered Stage 1 protocol: https://osf.io/qcket (under temporary private embargo)
Level of bias control achieved: Level 2. At least some data/evidence that will be used to answer the research question has been accessed and partially observed by the authors, but the authors certify that they have not yet observed the key variables within the data that will be used to answer the research question AND they have taken additional steps to maximise bias control and rigour. List of eligible PCI RR-friendly journals:
References
1. Provins, C., Savary, E., Alemán-Gómez, Y., Richiardi, J., Poldrack, R. A., Hagmann, P. & Esteban, O. (2023). Defacing biases in manual and automated quality assessments of structural MRI with MRIQC, in principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/qcket
| Defacing biases in manual and automated quality assessments of structural MRI with MRIQC | Céline Provins, Yasser Alemán-Gómez, Jonas Richiardi, Russell A. Poldrack, Patric Hagmann, Oscar Esteban | <p>A critical requirement before data-sharing of human neuroimaging is removing facial features to protect individuals’ privacy. However, not only does this process redact identifiable information about individuals, but it also removes non-identif... | Medical Sciences | D. Samuel Schwarzkopf | Cassandra Gould van Praag, Catherine Morgan, Abiola Akinnubi | 2022-11-28 10:59:32 | View | |
17 Jan 2023
STAGE 1
Similarities and differences in a global sample of song and speech recordingsCorresponding authors: Yuto Ozaki and Patrick E. Savage (Keio University, Japan). Full list of 80 authors is in the manuscript https://psyarxiv.com/jr9x7Exploring cross-cultural variation in speech and songRecommended by Chris Chambers based on reviews by Bob Slevc, Nai Ding and 1 anonymous reviewerFor centuries, the ubiquity of language and music across human societies has prompted scholars to speculate about their cross-cultural origins as well as their shared and unique characteristics. Depending on the extent to which contemporary theories emphasise the role of biology vs. culture, a range of hypotheses have been proposed concerning expected similarities and differences in song and speech. One class of hypotheses stemming from cultural relativism assumes a lack of universal regularities in song and speech, and therefore predicts no systematic cross-cultural relationships. On the other hand, more recent evolutionary hypotheses such as the social bonding hypothesis, motor constraint hypothesis, and sexual selection hypothesis all predict differences or similarities in specific characteristic of vocalisations, such as pitch regularity, pitch interval size, and melodic contour. Existing results are mixed in their support of these predictions.
In the current study, Ozaki et al. (2022) embark on an ambitious project to elucidate cross-cultural similarities and differences between speech and song in 81 different linguistic varieties spanning 23 language families. Understanding precisely how song and speech are related is methodologically challenging due to the multitude of confounds that can arise in comparing natural recordings. Here the authors overcome these difficulties with four types of carefully controlled recordings: singing, recitation of sung lyrics, spoken description of the song, and instrumental version of the sung melody. The authors will then examine six features that are amenable to reliable comparison, including pitch height, temporal rate, pitch stability, timbral brightness, pitch interval size, and pitch declination. With this data in hand, the authors will ask which acoustic features differ reliably between song and speech across cultures, with the expectation that song will exhibit higher pitch, slower rate and more stable pitch than speech. At the same time, the authors expect song and speech to be reliably similar in the characteristics of timbral brightness, pitch intervals and pitch contours. In addition to these confirmatory tests, the authors will explore variation across a range of additional stimulus characteristics and ancillary research questions.
The Stage 1 manuscript was evaluated over two rounds of in-depth review. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
URL to the preregistered Stage 1 protocol: https://osf.io/jdhtz
Level of bias control achieved: Level 2. At least some data/evidence that will be used to answer the research question has been accessed and partially observed by the authors, but the authors certify that they have not yet observed the key variables within the data that will be used to answer the research question AND they have taken additional steps to maximise bias control and rigour.
List of eligible PCI RR-friendly journals: References
1. Ozaki, Y., Savage P. E. et al. (2022). Similarities and differences in a global sample of song and speech recordings, in principle acceptance of Version 2 by Peer Community in Registered Reports. https://osf.io/jdhtz
| Similarities and differences in a global sample of song and speech recordings | Corresponding authors: Yuto Ozaki and Patrick E. Savage (Keio University, Japan). Full list of 80 authors is in the manuscript | <p>What, if any, similarities and differences between song and speech are consistent across cultures? Both song and speech are found in all known human societies and are argued to share evolutionary roots and cognitive resources, yet no studies ha... | Social sciences | Chris Chambers | Bob Slevc, Nai Ding | 2022-09-16 16:03:10 | View |
MANAGING BOARD
Chris Chambers
Zoltan Dienes
Corina Logan
Benoit Pujol
Maanasa Raghavan
Emily S Sena
Yuki Yamada