Submit a report

Announcements

Please note that we will be CLOSED to ALL SUBMISSIONS from 1 December 2024 through 12 January 2025 to give our recommenders and reviewers a holiday break.

We are recruiting recommenders (editors) from all research fields!

Your feedback matters! If you have authored or reviewed a Registered Report at Peer Community in Registered Reports, then please take 5 minutes to leave anonymous feedback about your experience, and view community ratings.

Latest recommendationsrssmastodon

IdTitle * Authors * Abstract * PictureThematic fields * RecommenderReviewersSubmission date
11 Sep 2024
STAGE 2
(Go to stage 1)

A Laboratory Experiment on Using Different Financial-Incentivization Schemes in Software-Engineering Experimentation

Bug detection in software engineering: which incentives work best?

Recommended by ORCID_LOGO based on reviews by Edson OliveiraJr
Bug detection is central to software engineering, but what motivates programmers to perform as optimally as possible? Despite a long history of economic experiments on incentivisation, there is surprisingly little research on how different incentives shape software engineering performance.
 
In the current study, Bershadskyy et al. (2024) undertook an experiment to evaluate how the pay-off functions associated with different financial incentives influence the performance of participants in identifying bugs during code review. The authors hypothesised that performance-based incentivisation would result in higher average performance, as defined using the F1-score, and that different incentivisation schemes may also differ in their effectiveness.
 
The results did not support the preregistered predictions, with no statistically significant differences in F1-score observed between groups that received performance-based incentives compared to a control group that received no incentive. Exploratory analyses suggested some potential trends of interest, but the main implication of this work is methodological: that experiments in this field require substantially larger sample sizes to provide definitive tests. The current work is valuable in providing a novel unbiased insight on the magnitude of this challenge, which is now primed for further investigation.
 
The Stage 2 manuscript was evaluated over one round of in-depth review. Based on detailed responses to the recommender and reviewer's comments, the recommender judged that the manuscript met the Stage 2 criteria and awarded a positive recommendation.
 
URL to the preregistered Stage 1 protocol: https://osf.io/s36c2
 
Level of bias control achieved: Level 6. No part of the data or evidence that was used to answer the research question was generated until after IPA. 
 
List of eligible PCI RR-friendly journals:
 
 
References
 
Bershadskyy, D., Krüger, J., Çalıklı, G., Siegmar, O., Zabel, S., Greif, J. and Heyer, R. (2024). A Laboratory Experiment on Using Different Financial-Incentivization Schemes in Software-Engineering Experimentation. Acceptance of Version 8 by Peer Community in Registered Reports. https://arxiv.org/pdf/2202.10985
A Laboratory Experiment on Using Different Financial-Incentivization Schemes in Software-Engineering ExperimentationDmitri Bershadskyy, Jacob Krüger, Gül Çalıklı, Siegmar Otto, Sarah Zabel, Jannik Greif, Robert Heyer<p>In software-engineering research, many empirical studies are conducted with open-source or industry developers. However, in contrast to other research communities like economics or psychology, only few experiments use financial incentives (i.e....Computer scienceChris Chambers2024-03-20 07:44:51 View
09 Sep 2024
STAGE 2
(Go to stage 1)

The effects of isolated game elements on adherence rates in food response inhibition training

Using gamification to improve food response inhibition training

Recommended by ORCID_LOGO based on reviews by Miguel Vadillo and Daniel Phipps
A poor diet has severe detrimental health effects, and attempts to reduce caloric intake often prove unsuccessful. Unhealthy foods, high in fat, sugar, and salt tend to be highly appetitive, and can undermine individuals’ ability to refrain themselves from consuming them. Computerized cognitive retraining techniques have shown promise in curbing the intake of unhealthy foods and promoting weight loss. However, in real-world scenarios, adherence to such retraining programs can be suboptimal, potentially diminishing their effectiveness.
 
In the present study, Maclellan et al. (2024) aimed to investigate whether the incorporation of gamified elements, transforming the cognitive retraining task into a game-like experience, can enhance adherence and overall intervention effectiveness by boosting engagement and motivation.
 
Upon testing the main hypotheses, the authors found mostly non-significant effects of adding gamified elements to adherence, motivation, or effectiveness of food response inhibition training programs. These results hold high relevance, as indeed there has been a push in introducing gamified elements to cognitive retraining programs. These findings should guide future developments in the field of cognitive retraining.
 
The Stage 2 manuscript was evaluated over one round of review and revision. Based on detailed evaluations by two expert reviewers, the recommender judged that the manuscript met the Stage 2 criteria and awarded a positive recommendation.
 
URL to the preregistered Stage 1 protocol: https://osf.io/jspf3

Level of bias control achieved: Level 6. No part of the data or evidence that was used to answer the research question was generated until after IPA.
 
List of eligible PCI RR-friendly journals:
 
References
 
MacLellan, A., Pennington, C. R., Lawrence, N., Westwood, S. J., Jones, A., Slegrova, A., Sung, B., Parker, L., Relph, L., Miranda, J. O., Shakeel, M., Mouka, E., Lovejoy, C., Chung, C., Lash, S., Suhail, Y., Nag M., and Button​, K. S. (2024). The effects of isolated game elements on adherence rates in food response inhibition training​ [Stage 2]. Acceptance of Version 3 by Peer Community in Registered Reports.
The effects of isolated game elements on adherence rates in food response inhibition trainingAlexander MacLellan, Charlotte R. Pennington, Natalia Lawrence, Samuel J. Westwood, Andrew Jones, Anna Slegrova, Beatrice Sung, Louise Parker, Luke Relph, Jessica O. Miranda, Maryam Shakeel, Elizabeth Mouka, Charlotte Lovejoy, Chaebin Chung, Sabel...<p>Introduction: Poor diet and the consumption of foods high in fat, sugar and salt are common causes of numerous health conditions and premature mortality. Computerised food response inhibition training (food-RIT) is a type of intervention found ...Social sciencesMateo Leganes-Fonteneau2024-06-28 23:29:31 View
09 Sep 2024
STAGE 1

The effects of isolated game elements on adherence rates in food-based response inhibition training

Using gamification to improve food response inhibition training

Recommended by ORCID_LOGO based on reviews by Miguel Vadillo and 2 anonymous reviewers
A poor diet has severe detrimental health effects, and attempts to reduce caloric intake often prove unsuccessful. Unhealthy foods, high in fat, sugar, and salt tend to be highly appetitive, and can undermine individuals’ ability to refrain themselves from consuming them. Computerized cognitive retraining techniques have shown promise in curbing the intake of unhealthy foods and promoting weight loss. However, in real-world scenarios, adherence to such retraining programs can be suboptimal, potentially diminishing their effectiveness.
 
In the present study, Maclellan et al. (2023) aim to investigate whether the incorporation of gamified elements, transforming the cognitive retraining task into a game-like experience, can enhance adherence and overall intervention effectiveness by boosting engagement and motivation. These findings could deepen our understanding of the mechanisms through which cognitive retraining mitigates caloric intake and pave the way for more compelling and successful interventions.
 
The Stage 1 manuscript was evaluated over one round of review and revision. Based on detailed evaluations by two expert reviewers, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
 
URL to the preregistered Stage 1 protocol: https://osf.io/jspf3 (under temporary private embargo)

Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.
 
List of eligible PCI RR-friendly journals:
 

References
 
1. MacLellan, A., Pennington, C., Lawrence, N., Westwood, S., Jones, A., & Button, K. (2023). The effects of isolated game elements on adherence rates in food-based response inhibition training. In principle acceptance of Version 1.6 by Peer Community in Registered Reports. https://osf.io/jspf3

The effects of isolated game elements on adherence rates in food-based response inhibition trainingAlexander MacLellan, Charlotte Pennington, Natalia Lawrence, Samuel Westwood, Andrew Jones, Katherine Button<p>Introduction: Poor diet, and the consumption of foods high in fat, sugar and salt are common causes of premature mortality and health conditions. Computerised response inhibition training has been proposed to devalue these foods by learning to ...Social sciencesMateo Leganes-Fonteneau2023-07-14 16:24:03 View
09 Sep 2024
STAGE 1

The origin of symbolic numerical knowledge in early development – an fNIRS Registered Report

An fNIRS test of the neural correlates of the Cardinality Principle in typically-developing children

Recommended by ORCID_LOGO based on reviews by Ed Hubbard and 1 anonymous reviewer
The cardinality principle (CP) is a key concept in numerical cognition, which children typically acquire by the age of five. This is the understanding that each number in a counted sequence refers to a specific set of items, and that the final number represents the total size of the set. Here, Ivanova and colleagues (2024) propose an experiment to study the changes in neural activity that accompany the acquisition of this concept, focusing on activity within the parietal lobes as measured by functional near-infrared spectroscopy (fNIRS).
 
Typically-developing children aged from 2 years 9 months to 4 years 9 months will be assessed for their ability to give a specific number of balls from a pile: those who can give five or more correctly will be classified as CP-knowers, and those who can only give lower set sizes will be classified as subset-knowers. All children will then perform an auditory number word adaptation task while undergoing fNIRS. The adaptation task involves hearing the number word ‘two’ repeated, interspersed with deviant number words (‘four’ or ‘eight’) or a non-number word (‘rin’). The experimental hypotheses are that left parietal activations and bilateral parietal functional connectivity will be differentially greater for number than non-number deviants amongst CP-knowers than amongst subset-knowers. Each hypothesis will be tested by sequential Bayes factor analysis, with a minimum of 25 and a maximum of 46 participants per group, providing high sensitivity to detect a smallest effect size of d = .35. This study aims to provide insights into the neural underpinnings of the CP, informing theoretical models of symbolic knowledge acquisition.

The study plan was refined over four rounds of review, with input from two external reviewers, after which the recommender judged that the Stage 1 manuscript met the criteria for in-principle acceptance (IPA).
 
URL to the preregistered Stage 1 protocol: https://osf.io/gzpk5

Level of bias control achieved: Level 4. At least some of the data/evidence that will be used to answer the research question already exists and is accessible in principle to the authors (e.g. residing in a public database or with a colleague) but the authors certify that they have not yet accessed any part of that data/evidence.
 
List of eligible PCI RR-friendly Journals:
 
 
References
 
Ivanova, E., Joanisse, M., Ansari, D., & Soltanlou, M. (2024). The origin of symbolic numerical knowledge in early development – an fNIRS Registered Report. In principle acceptance of Version 7 by Peer Community in Registered Reports. https://osf.io/gzpk5
The origin of symbolic numerical knowledge in early development – an fNIRS Registered ReportElizaveta Ivanova, Marc Joanisse, Daniel Ansari, Mojtaba Soltanlou<p>The ability to understand that each number word in the count sequence refers to a specific set of items (e.g., ‘two’ means ‘two things’) is a milestone in cognitive development. When children reach this milestone, they are said to understand th...Social sciencesRobert McIntosh2023-03-14 17:25:27 View
09 Sep 2024
STAGE 1

How Effortful is Boredom? Studying Self-Control Demands Through Pupillometry

Unmasking the effort of boredom: A deeper look into self-control dynamics

Recommended by ORCID_LOGO based on reviews by Jonas Dora, Julia Englert, Erik Bijleveld and 1 anonymous reviewer
Effective effort regulation is central for self-control and has been a focus of psychological research for many decades. It is well established that challenging cognitive tasks, which impose self-control demands due to their complexity, are perceived as more effortful and require greater physiological activation than simpler tasks. However, the experience and allocation of effort during a task, whether easy or difficult, likely depends on more than these inherent self-control demands. Another key factor is boredom, which can arise during task execution. Yet, the role of boredom and the interplay with perceived task difficulty over time remains underexamined.
 
Based on these considerations, Radtke et al. (2024) aim to examine how boredom and task difficulty influence both subjective and objective measures of effort. They propose that subjective cognitive effort consists of both boredom-related and difficulty-related components, hypothesizing that both factors together more accurately predict objective effort allocation than task difficulty alone. The proposed study will use a within-subject design, in which participants perform two versions of the Stroop task: an easy version with only congruent trials and a hard version. Thought probes during the task will track subjective boredom, fatigue, perceived difficulty, and effort. Phasic and stimulus-evoked pupil dilation will serve as an objective index of cognitive effort, while a subsequent flanker task will assess effects on secondary task performance. 
 
The authors predict that the easy Stroop version will result in lower perceived difficulty but higher boredom, as well as fewer errors and faster reaction times compared to the hard version. Over time, boredom and perceived effort due to boredom are expected to increase, while perceived task difficulty and effort attributed to difficulty are anticipated to decrease. Linear Mixed Models will be employed to determine whether phasic and stimulus-evoked pupil dilation can be predicted by effort attributed to boredom, difficulty, or both. This innovative approach combines objective and subjective measures and promises to deepen our understanding of the cognitive demands posed by boredom, with significant implications for research on effort regulation and motivation. 
 
The Stage 1 manuscript was evaluated by four expert reviewers in two rounds of in-depth review. Following responses from the authors, the recommender determined that Stage 1 criteria were met and awarded in-principle acceptance (IPA).
 
URL to the preregistered Stage 1 protocol: https://osf.io/38qz4

Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.
 
List of eligible PCI RR-friendly Journals:
 
 
References

Radtke, V., Wolff, W., & Martarelli, C. S. (2024). How effortful is boredom? Studying self-control demands through pupillometry. In principle acceptance of Version 2 by Peer Community in Registered Reports. https://osf.io/38qz4
How Effortful is Boredom? Studying Self-Control Demands Through PupillometryVanessa C. Radtke, Wanja Wolff, Corinna S. Martarelli<p>Self-control is essential for managing our actions, yet its exertion is perceived as effortful. Performing a task may require effort not only because of its inherent difficulty but also due to its potential for inducing boredom, as boredom has ...Humanities, Social sciencesThomas Meyer2023-11-21 17:56:13 View
09 Sep 2024
STAGE 1

Does concern regarding climate change impact subsequent mental health? A longitudinal analysis using data from the Avon Longitudinal Study of Parents and Children (ALSPAC)

Does concern regarding climate change impact subsequent mental health?

Recommended by ORCID_LOGO based on reviews by Anna Castiglione and Esther Papies
The link between climate change and health is becoming increasingly clear, and problematic (IPCC, 2023). While most agree that climate change is a problem (Vlasceanu et al., 2024) and evidence is starting to emerge that individual's wellbeing can benefit from engaging in proenvironmental behaviour (Prinzing, 2023), there is little robust longitudinal evidence available to make causal claims about the complex and inter-related nature of these types of effects.
 
In their proposed study, Major-Smith et al. (2024) use the Avon Longitudinal Study of Parents and Children to explore whether climate concern has a causal impact upon mental health. Strategic use of this pre-existing data allows consideration of both confounding bias and reverse causality to provide more rigorous evidence for this causal effect. The second research question (whether climate action moderates this relationship) is of both personal and professional interest, as someone who struggles with climate anxiety, and plants hundred of trees annually to try and mitigate the dread. Capable of exploring the potential for individual-level climate action to have a double effect - directly help with climate change mitigation and also an individuals' mental health, the proposed research is a rewarding and insightful line of inquiry in a domain desperate for a more rapid and rigorous evidence-base.
 
The Stage 1 manuscript was evaluated over one round of review. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
 
URL to the preregistered Stage 1 protocol: https://osf.io/t6d3k
 
Level of bias control achieved: Level 2. At least some data/evidence that will be used to answer the research question has been accessed and partially observed by the authors, but the authors certify that they have not yet observed the key variables within the data that will be used to answer the research question AND they have taken additional steps to maximise bias control and rigour.
 
List of eligible PCI RR-friendly Journals:
 
 
References
 
 
2. Major-Smith, D., Halstead, I., & Major-Smith, K. (2024) Does concern regarding climate change impact subsequent mental health? A longitudinal analysis using data from the Avon Longitudinal Study of Parents and Children (ALSPAC). In principle acceptance of Version 2 by Peer Community in Registered Reports. https://osf.io/t6d3k
 
3. Prinzing, M. (2023). Proenvironmental Behavior Increases Subjective Well-Being: Evidence From an Experience-Sampling Study and a Randomized Experiment. Psychological Science. https://doi.org/10.1177/09567976241251766
 
4. Vlasceanu, M., Doell, K. C., Bak-Coleman, J. B., Todorova, B., Berkebile-Weinberg, M. M., Grayson, S. J., ... & Lutz, A. E. (2024). Addressing climate change with behavioral science: A global intervention tournament in 63 countries. Science Advances, 10, eadj5778. https://doi.org/10.1126/sciadv.adj5778
Does concern regarding climate change impact subsequent mental health? A longitudinal analysis using data from the Avon Longitudinal Study of Parents and Children (ALSPAC)Daniel Major-Smith, Isaac Halstead, Katie Major-Smith<p>Climate change is having a substantial – and increasingly severe – impact on our planet, affecting people’s health, security and livelihoods. As a consequence, the concept of ‘climate anxiety’ has recently been developed to characterise the psy...Medical Sciences, Social sciencesThomas Evans2024-05-24 15:50:50 View
06 Sep 2024
STAGE 1

Do individual differences in cognitive ability or personality predict noticing in inattentional blindness tasks?

Are individual difference in inattentional blindness related to cognitive abilities or personality traits?

Recommended by ORCID_LOGO based on reviews by Ruben Arslan and 1 anonymous reviewer
Despite inattentional blindness being a widely recognized and researched phenomenon — popularized by experiments like the invisible gorilla — the evidence on how individual differences affect the occurrence of inattentional blindness has remained inconsistent, largely due to small sample sizes and methodological variations.
 
In this context, Daniel J. Simons, known for his role in bringing public attention to inattentional blindness, along with Yifan Ding, Connor M. Hults, and Brent W. Roberts, presents an ambitious yet well-constructed registered report that addresses this critical gap in the literature. Their report outlines a comprehensive investigation into whether individual differences in cognitive ability or personality traits can predict the likelihood of noticing unexpected objects in various inattentional blindness tasks. The two proposed studies — one focusing on cognitive predictors and the other on personality predictors — arguably represent the most extensive single-sample tests to date on this topic.
 
The authors propose a robust methodology that includes a total of 2,000 participants (1,000 per study). The study design features three distinct inattentional blindness tasks with varying levels of demand to assess the generalizability of the findings across different experimental contexts. In Study 1, cognitive measures such as matrix reasoning and operation span — both well-established indicators of fluid intelligence and working memory — are utilized. Study 2 incorporates a range of personality measures, including the Big Five personality traits and attention-related traits (e.g., ADHD and obsessive-compulsive characteristics).
 
The report also presents a detailed analysis plan with pre-specified primary and secondary outcomes, strong justifications for the sample size, and clearly defined criteria for data inclusion and exclusion. The authors intend to employ multiple statistical techniques, such as correlation analyses and regression models, along with rigorous checks for replicability, to explore the relationship between individual differences and inattentional blindness.
 
Overall, this registered report is a well-justified and meticulously planned investigation into the role of individual differences in inattentional blindness. The proposed studies have the potential to make a significant contribution to our understanding of the cognitive and personality factors that influence the noticing of unexpected objects. The rigorous experimental design, large sample sizes, and adherence to open science practices make this a valuable addition to the literature.

Based on the strengths of the proposal and the authors' responsiveness to the detailed feedback from two reviewers, the recommender justed that the manuscript met the Stage 1 criteria and awarded in-principle acceptance (IPA).

URL to the preregistered Stage 1 protocol: https://osf.io/xtwfs (under temporary private embargo)
 
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.
 
List of eligible PCI RR-friendly Journals:
 
 
References
 
Simons, D. J., Ding, Y., Hults, C. M., & Roberts, B. W. (2024). Registered Report: Do individual differences in cognitive ability or personality predict noticing in inattentional blindness tasks? In principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/xtwfs
 
Do individual differences in cognitive ability or personality predict noticing in inattentional blindness tasks?Daniel J. Simons, Yifan Ding, Connor M. Hults, Brent W. Roberts<p>People often fail to notice unexpected objects or events when they focus attention on another task or different aspects of a scene. Recently, a number of studies have examined whether individual differences in cognitive abilities or personality...Social sciencesGidon Frischkorn2024-03-28 21:52:33 View
06 Sep 2024
STAGE 1

The Role of Offender Identifiability in Second- and Third-Party Punishment

Punishing Offenders

Recommended by ORCID_LOGO based on reviews by Gilad Feldman and Rajarshi Majumder
When people are less-well-known to us, it can impact how we treat them. People outside our communities may feel more anonymous or de-personalized to us, and this could impact the empathy we feel for them. Indeed, past research shows that people seem to care more for those who are who are identified to us, especially when they are victims of a crime (Small & Loewenstein, 2003). In addition, past research also shows that anonymizing victims can influence criminal behavior (Walters, 2022).  Thus, social cognitive factors related to anonymity appear to affect both positive feelings (engaging in empathy) and negative activities (criminal activity) related to victims. It seems likely that anonymity can also affect how people judge criminals themselves.
 
This paper by Blanke and Twardawski (2024) examines how even minor identifying features can make individuals react differently to a perpetrator of a crime. A picture or name (information that may appear in the press) may impact how people perceive criminals in terms of punishment, empathy, outrage, and blame.
 
How people respond to anonymous or identified criminals may depend on whether the impact of the crime on the victim is made salient. Similar to the Black Sheep Effect (Marques & Paez,1994), the current paper expects that people who identify with victims are expected to punish a perpetrator more when the perpetrator’s name and image are known. This is similar to the case with an ingroup member in The Black Sheep Effect, where ingroup members are punished more for transgressions than outgroup members. For people who view the situation as a third party (and are thus less connected to the victim), an identified perpetrator is expected to lead to less punishment (and also less outrage and blame, and more empathy).
 
The current study focuses on pickpocketing since it is a crime that can be committed without identifying oneself to the victim. Future research should examine how the type of event impacts judgments, especially given the stigma of being a victim of some crimes. Littering and other minor violations may be seen as understandable when you see someone as a person, rather than a anonymous, impersonal criminal.  On the other hand, there can be stigma to being a victim in some cases, such as the case of sexual harassment, where, research shows, perpetrators are judged more positively if they are identified, and victims, especially women, are judged more negatively if they are identified (Barak-Corren & Lewinsohn-Zamir, 2019).
 
People around the world engage in moral and legal transgressions, and if our judgments of them are influenced by minor features such as a photo or name, we should take action to treat people more fairly. This research will help to determine if people are influenced by these factors.
 
The Stage 1 manuscript underwent one round of thorough review. After considering the detailed responses to the reviewers' comments, the recommender determined that the manuscript met the Stage 1 criteria and granted in-principle acceptance (IPA).
 
URL to the preregistered Stage 1 protocol: https://osf.io/7qzva
 
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.
 
List of eligible PCI RR-friendly Journals:
 
 
References
 
1. Barak‐Corren, N., & Lewinsohn‐Zamir, D. (2019). What's in a Name? The Disparate Effects of Identifiability on Offenders and Victims of Sexual Harassment. Journal of Empirical Legal Studies, 16, 955-1000. https://doi.org/10.1111/jels.12233
 
2. Blanke, T. & Twardawski, M. (2024). The Role of Offender Identifiability in Second- and Third-Party Punishment. In principle acceptance of Version 2 by Peer Community in Registered Reports. https://osf.io/7qzva
 
3. Marques, J. M., & Paez, D. (1994). The ‘black sheep effect’: Social categorization, rejection of ingroup deviates, and perception of group variability. European Review of Social Psychology, 5, 37-68. https://doi.org/10.1080/14792779543000011
 
4. Small, D. A., & Loewenstein, G. (2003). Helping a victim or helping the victim: Altruism and identifiability. Journal of Risk and Uncertainty, 26, 5-16. https://doi.org/10.1023/A:1022299422219
 
5. Walters, G. D. (2022). Crime and social cognition: A meta-analytic review of the developmental roots of adult criminal thinking. Journal of Experimental Criminology, 18, 183-207. https://doi.org/10.1007/s11292-020-09435-w
The Role of Offender Identifiability in Second- and Third-Party PunishmentTheresa Blanke, Mathias Twardawski<p>The identifiability effect describes humans' tendency to exhibit different emotional and behavioral responses toward identified as compared to anonymous individuals. This phenomenon has been extensively studied within the identifiable victim ef...Social sciencesClare Conry-Murray Gilad Feldman, Rajarshi Majumder2024-03-23 11:02:30 View
06 Sep 2024
STAGE 2
(Go to stage 1)

One and only SNARC? Spatial-Numerical Associations are not fully flexible and depend on both relative and absolute magnitude

A Registered Report demonstration that the SNARC effect depends on absolute as well as relative number magnitude

Recommended by ORCID_LOGO based on reviews by Claudia Gianelli
The Spatial-Numerical Association of Response Codes (SNARC) effect refers to the fact that smaller numbers receive faster responses with the left hand, and larger numbers with the right hand (Dehaene et al., 1993). This robust finding implies that numbers are associated with space, being represented on a mental number line that progresses from left to right. The SNARC effect is held to depend on relative number magnitude, with the mental number line dynamically adjusting to the numerical range used in a given context. This characterisation is based on significant effects of relative number magnitude, with no significant influence of absolute number magnitude. However, a failure to reject the null hypothesis is not firm evidence for the absence of an effect. In this Registered Report, Roth and colleagues (2024) report two large-sample online experiments, with a Bayesian statistical approach to confirm—or refute—a role for absolute number magnitude in modulating the classic SNARC effect (smallest effect size of interest, d = 0.15).
 
Experiment 1 closely followed Dehaene’s (1993) original methods, and found strong evidence for an influence of relative magnitude, and moderate-to-strong evidence against an influence of absolute magnitude. Experiment 2 was designed to exclude some potential confounds in the original method, and this second experiment found strong evidence for both relative and absolute magnitude effects, of comparable effect sizes (in the range of d = .24 to .42). This registered study demonstrates that the SNARC effect is not ‘fully flexible’, in the sense of depending only on relative number magnitude; it is also shaped by absolute magnitude.
 
This Stage 2 manuscript was evaluated by the recommender and one external reviewer. Following appropriate minor revisions, the recommender judged that the manuscript met the Stage 2 criteria for recommendation.
 
URL to the preregistered Stage 1 protocol: https://osf.io/ae2c8
 
Level of bias control achieved: Level 6. No part of the data or evidence that was used to answer the research question was generated until after IPA.
 
List of eligible PCI RR-friendly journals:
 
 
References
 
1. Dehaene, S., Bossini, S., & Giraux, P. (1993). The mental representation of parity and number magnitude. Journal of Experimental Psychology: General, 122, 371–396. https://doi.org/10.1037/0096-3445.122.3.371
 
2. Roth, L., Caffier, J., Reips, U.-D., Nuerk, H.-C., Overlander, A. T. & Cipora, K. (2023). One and only SNARC? Spatial-Numerical Associations are not fully flexible and depend on both relative and absolute magnitude [Stage 2]. Acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/epnd4
One and only SNARC? Spatial-Numerical Associations are not fully flexible and depend on both relative and absolute magnitudeLilly Roth, John Caffier, Ulf-Dietrich Reips, Hans-Christoph Nuerk, Annika Tave Overlander, Krzysztof Cipora<p>Numbers are associated with space, but it is unclear how flexible these associations are. We investigated whether the SNARC effect (Spatial-Numerical Association of Response Codes; Dehaene et al., 1993; i.e., faster responses to small/large num...Life SciencesRobert McIntosh2024-06-10 15:00:30 View
06 Sep 2024
STAGE 1

Barriers and facilitators to the adoption and promotion of Open Science practices in psychology. The case of Slovakia

What are the barriers and facilitators to open science practices for researchers, policy makers and media representatives in Slovakia?

Recommended by ORCID_LOGO based on reviews by Crystal Steltenpohl, Peter Branney, Andrea E. Abele-Brehm , Emma Norris and 1 anonymous reviewer
Open science practices (OSPs, e.g., preregistration, open materials, code and data) aim to enhance the transparency, integrity, and reproducibility of research. Recent work, however, has highlighted various facilitators and barriers perceived by researchers in implementing these, which can either enhance or hinder their success. Little is known about these barriers in the context of Slovakia, and such perceptions are rarely investigated for policy makers and media representatives who are also embedded in the research ecosystem.
 
In their Stage 1 Registered Report, Marcel Martončik and colleagues aim to map the perceptions and experiences of barriers and facilitators of OSPs that are unique to different stakeholder groups in Slovakia. They will conduct both semi-structured interviews and focus groups with a diverse sample of postgraduate students, researchers, policymakers, and media representatives from the field of psychology. Reflexive thematic analysis will identify overarching themes regarding such barriers and facilitators which will provide valuable insights into the support required to make OSPs normative across different stakeholder groups.
 
Four expert reviewers assessed the Stage 1 manuscript across two rounds of in-depth review. Based on the authors' detailed and informed responses to the reviewer’s comments, the recommender judged that the manuscript met the Stage 1 criteria and awarded in principle acceptance (IPA).
 
URL to the preregistered Stage 1 protocol: https://osf.io/n86um
 
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.
 
List of eligible PCI RR-friendly Journals:
 
 
References
 
Martončik, M., Adamkovič, M., Baník G., Fedáková, D., Issmailová, S., Kačmár, P., Kentoš, M., Majdáková, V., Papcunová, J., & Vargová, L. (2024). Barriers and facilitators to the adoption and promotion of Open Science practices in psychology. The case of Slovakia. In principle acceptance of Version 1.1 by Peer Community in Registered Reports. https://osf.io/n86um
Barriers and facilitators to the adoption and promotion of Open Science practices in psychology. The case of SlovakiaMarcel Martončik, Matúš Adamkovič, Gabriel Baník, Denisa Fedáková, Samar Issmailová, Pavol Kačmár, Michal Kentoš, Viktória Majdáková, Jana Papcunová, Lenka Vargová<p>Various responsible research practices emphasizing transparency, such as open<br>data, open code, open peer review, and preregistration, have been introduced to<br>enhance the reproducibility and replicability of findings. The ongoing initiativ...Social sciencesCharlotte Pennington2024-04-29 14:39:12 View