Announcements
We are recruiting recommenders (editors) from all research fields!
Your feedback matters! If you have authored or reviewed a Registered Report at Peer Community in Registered Reports, then please take 5 minutes to leave anonymous feedback about your experience, and view community ratings.
Latest recommendations
Id | Title * ▲ | Authors * | Abstract * | Picture | Thematic fields * | Recommender | Reviewers | Submission date | |
---|---|---|---|---|---|---|---|---|---|
How does the phrasing of house edge information affect gamblers’ perceptions and level of understanding? A Registered ReportPhilip Newall, Richard James, Olivia Maynard https://doi.org/10.31234/osf.io/pfnzdDoes relaying ‘house edge’ information influence gambler’s perceived chances of winning and their factual understanding of the statistical outcomes?Recommended by Charlotte Pennington based on reviews by Zhang Chen and Graeme KnibbMany products that can impact upon health and wellbeing (e.g., alcohol, food) relay information to consumers about the potential risks. However, such information is commonly provided in suboptimal format for gambling-related products. To encourage safer gambling, research has therefore recommended that information about the average loss from a gambling product (“house edge”) or percentage payout (“return-to-player”) should be communicated, with the former translating to better perceived understanding by gamblers. This Registered Report aimed to experimentally compare two phrasings of the house edge against a control return-to-player to arrive at the most effective phrasing to aid gambler’s perceived chances of winning and their factual understanding of the statistical outcomes of their bet. Using a hypothetical gambling scenario, a sample of 3,333 UK-based online gamblers received one of three phrasings: an original house-edge (“his game keeps 10% of all money bet on average”), an alternative house-edge (“on average this game is programmed to cost you 10% of your stake on each bet”) or return-to-player (“this game has an average percentage payout of 90%”). Two outcome measures were employed to judge the effectiveness of this information: gamblers’ perceived changes of winning and factual understanding. The findings indicate that the two-house edge formats were more effective in communicating gambling-related harms than the return-to-player format, but the original house edge phrasing appeared to be the most optimal as it decreased gambler’s perceived chances of winning and increased their factual understanding compared to return-to-player. These results can therefore inform public health policies to reduce gambling-related harm by presenting the most effective communication of gambling risk.
After two in-depth reviews, the recommender judged that the manuscript met the Stage 2 criteria and awarded a positive recommendation.
URL to the preregistered Stage 1 protocol: https://osf.io/5npy9
Level of bias control achieved: Level 6. No part of the data or evidence that was used to answer the research question was generated until after IPA. List of eligible PCI RR-friendly journals:
References
1. Newall, P. W. S., James, R. J. E. & Maynard, O. M. (2023). How does the phrasing of house edge information affect gamblers’ perceptions and level of understanding? A Registered Report. Acceptance of Version 2 by Peer Community in Registered Reports. https://doi.org/10.31234/osf.io/pfnzd | How does the phrasing of house edge information affect gamblers’ perceptions and level of understanding? A Registered Report | Philip Newall, Richard James, Olivia Maynard | <p>The provision of information to consumers is a common input to tackling various public health issues. By comparison to the information given on food and alcohol products, information on gambling products is either not given at all, or shown in ... | Social sciences | Charlotte Pennington | Zhang Chen | 2023-01-09 14:56:36 | View | |
09 Sep 2024
STAGE 1
How Effortful is Boredom? Studying Self-Control Demands Through PupillometryVanessa C. Radtke, Wanja Wolff, Corinna S. Martarelli https://osf.io/eujpa?view_only=12191f02a5db4689b00b42bab7dbd522Unmasking the effort of boredom: A deeper look into self-control dynamicsRecommended by Thomas Meyer based on reviews by Jonas Dora, Julia Englert, Erik Bijleveld and 1 anonymous reviewerEffective effort regulation is central for self-control and has been a focus of psychological research for many decades. It is well established that challenging cognitive tasks, which impose self-control demands due to their complexity, are perceived as more effortful and require greater physiological activation than simpler tasks. However, the experience and allocation of effort during a task, whether easy or difficult, likely depends on more than these inherent self-control demands. Another key factor is boredom, which can arise during task execution. Yet, the role of boredom and the interplay with perceived task difficulty over time remains underexamined.
Based on these considerations, Radtke et al. (2024) aim to examine how boredom and task difficulty influence both subjective and objective measures of effort. They propose that subjective cognitive effort consists of both boredom-related and difficulty-related components, hypothesizing that both factors together more accurately predict objective effort allocation than task difficulty alone. The proposed study will use a within-subject design, in which participants perform two versions of the Stroop task: an easy version with only congruent trials and a hard version. Thought probes during the task will track subjective boredom, fatigue, perceived difficulty, and effort. Phasic and stimulus-evoked pupil dilation will serve as an objective index of cognitive effort, while a subsequent flanker task will assess effects on secondary task performance.
The authors predict that the easy Stroop version will result in lower perceived difficulty but higher boredom, as well as fewer errors and faster reaction times compared to the hard version. Over time, boredom and perceived effort due to boredom are expected to increase, while perceived task difficulty and effort attributed to difficulty are anticipated to decrease. Linear Mixed Models will be employed to determine whether phasic and stimulus-evoked pupil dilation can be predicted by effort attributed to boredom, difficulty, or both. This innovative approach combines objective and subjective measures and promises to deepen our understanding of the cognitive demands posed by boredom, with significant implications for research on effort regulation and motivation.
The Stage 1 manuscript was evaluated by four expert reviewers in two rounds of in-depth review. Following responses from the authors, the recommender determined that Stage 1 criteria were met and awarded in-principle acceptance (IPA).
URL to the preregistered Stage 1 protocol: https://osf.io/38qz4
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA. List of eligible PCI RR-friendly Journals:
References Radtke, V., Wolff, W., & Martarelli, C. S. (2024). How effortful is boredom? Studying self-control demands through pupillometry. In principle acceptance of Version 2 by Peer Community in Registered Reports. https://osf.io/38qz4
| How Effortful is Boredom? Studying Self-Control Demands Through Pupillometry | Vanessa C. Radtke, Wanja Wolff, Corinna S. Martarelli | <p>Self-control is essential for managing our actions, yet its exertion is perceived as effortful. Performing a task may require effort not only because of its inherent difficulty but also due to its potential for inducing boredom, as boredom has ... | Humanities, Social sciences | Thomas Meyer | 2023-11-21 17:56:13 | View | ||
09 Jul 2023
STAGE 1
How Intelligence Interviewees Mentally Identify Relevant InformationDavid A. Neequaye & Alexandra Lorson https://psyarxiv.com/bpdn2How an interviewee knows what information is key to disclose or withholdRecommended by Zoltan Dienes based on reviews by 2 anonymous reviewersResearch on interviewing has often focused on topics (such as aiding memory of witnesses) which presume the interviewee has already correctly identified the precise information that the interviewer is really after. But how does an informant know what sort of information is asked for, a precondition for an informant to then choose to provide the information or withhold it (depending on their own interests)?
In this study, Neequaye and Lorson will ask subjects to take the role of an informant about a criminal gang, with the further instructions to be cooperative or resistant in helping the interviewer obtain the information they want. In one study, the participants will be asked merely to identify what information the interviewer wants. In the second study, the participants will answer the interviewer's questions, disclosing whatever information they feel best suits their interest. Crucially, the level of detail of the questions will be manipulated, such that the question specifies a clear objective or not. The Stage 1 manuscript was evaluated over three rounds of in-depth review. Based on detailed responses to the reviewers’ comments and edits to the stage 1 report, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA). URL to the preregistered Stage 1 protocol: https://osf.io/82qtn Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA. List of eligible PCI RR-friendly journals: References
1. Neequaye, D. A., & Lorson, A. (2022). How Intelligence Interviewees Mentally Identify Relevant Information, in principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/82qtn
| How Intelligence Interviewees Mentally Identify Relevant Information | David A. Neequaye & Alexandra Lorson | <p>This research explores how intelligence interviewees mentally identify the relevant information at their disposal, which they may or may not disclose. We theorize that interviewees mentally identify applicable information items by estimating th... | Humanities, Social sciences | Zoltan Dienes | 2022-02-25 22:20:40 | View | ||
How Intelligence Interviewees Mentally Identify Relevant InformationDavid A. Neequaye & Alexandra Lorson https://doi.org/10.31234/osf.io/bpdn2How an interviewee knows what information is key to disclose or withholdRecommended by Zoltan Dienes based on reviews by 1 anonymous reviewerResearch on interviewing has often focused on topics (such as aiding memory of witnesses) which presume the interviewee has already correctly identified the precise information that the interviewer is really after. But how does an informant know what sort of information is asked for, a precondition for an informant to then choose to provide the information or withhold it (depending on their own interests)?
In this study, Neequaye and Lorson (2023) asked subjects to take the role of an informant about a criminal gang, with the further instructions to be cooperative or resistant in helping the interviewer obtain the information they want. In one study, the participants were asked merely to identify what information the interviewer wants. In the second study, the participants answered the interviewer's questions, disclosing whatever information they felt best suited their interest. Crucially, the level of detail of the questions was manipulated, such that the question specified a clear objective or not. Contrary to the theory, mental designation preferences indicated that interviewees generally assume interviewers wanted to know complete details, irrespective of question specificity. The Stage 2 manuscript was evaluated over one round of in-depth review. Based on responses to the comments, the recommender judged that the manuscript met the Stage 2 criteria and therefore awarded a positive recommendation. URL to the preregistered Stage 1 protocol: https://osf.io/82qtn Level of bias control achieved: Level 6. No part of the data or evidence that was used to answer the research question was generated until after IPA. List of eligible PCI RR-friendly journals: References
1. Neequaye, D. A., & Lorson, A. (2023). How Intelligence Interviewees Mentally Identify Relevant Information [Stage 2]. Acceptance of of Version 10 by Peer Community in Registered Reports. https://doi.org/10.31234/osf.io/bpdn2
| How Intelligence Interviewees Mentally Identify Relevant Information | David A. Neequaye & Alexandra Lorson | <p>This research explored how intelligence interviewees mentally identify the relevant information at their disposal. We theorized that interviewees estimate the interviewer’s objectives based on how they frame any attempt to solicit information. ... | Social sciences | Zoltan Dienes | 2023-05-24 06:57:09 | View | ||
17 Jan 2023
STAGE 1
How long does it take to form a habit?: A Multi-Centre Replicationde Wit, S., Bieleke, M., Fletcher, P.C., Horstmann, A., Schüler, J., Brinkhof, L.P., Gunschera, L.J., Murre, J.M.J. https://osf.io/hpsft/?view_only=c8ec62553146496e8b5e4d100a0f08b5How much practice is needed before daily actions are performed in a way that feels habitual?Recommended by Zoltan Dienes based on reviews by Benjamin Gardner, Wendy Wood and Adam TakacsEven small changes in daily life can have a significant impact on one’s health, for example going to the gym at regular times and eating a healthy breakfast. But how long must we do something before it becomes a habit? Lally et al. (2010) tracked the subjective automaticity of a novel, daily (eating or exercise-related) routine. Based on 39 participants, they found a median time of 66 days. This estimate has never been replicated with their exact procedure, so the question remains of how well this holds up. Yet the estimate is useful for knowing how long we have to effortfully make ourselves perform an action until we will do it automatically.
In the current study, de Wit et al. (2023) propose a four-centre near-exact replication of Lally et al. (2010), for which they aim to test 800 subjects to provide a precise estimate of the time it takes to form a habit.
The Stage 1 manuscript was evaluated over four rounds of review. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
URL to the preregistered Stage 1 protocol: https://osf.io/bj9r2 Level of bias control achieved: Level 4. At least some of the data/evidence that will be used to answer the research question already exists AND is accessible in principle to the authors (e.g. residing in a public database or with a colleague), BUT the authors certify that they have not yet accessed any part of that data/evidence.
List of eligible PCI RR-friendly journals:
References
1. Lally, P., van Jaarsveld, C. H. M., Potts, H. W. W., & Wardle, J. (2010). How are habits formed: Modelling habit formation in the real world. European Journal of Social Psychology, 40, 998–1009. https://doi.org/10.1002/ejsp.674
2. de Wit, S., Bieleke, M., Fletcher, P. C., Horstmann, A., Schüler, J., Brinkhof, L. P., Gunschera, L. J., AND Murre, J. M. J. (2023). How long does it take to form a habit?: A Multi-Centre Replication, in principle acceptance of Version 4 by Peer Community in Registered Reports. https://osf.io/bj9r2
| How long does it take to form a habit?: A Multi-Centre Replication | de Wit, S., Bieleke, M., Fletcher, P.C., Horstmann, A., Schüler, J., Brinkhof, L.P., Gunschera, L.J., Murre, J.M.J. | <p>How long does it take to form a habit? This question will be addressed by an innovative study by Lally et al. (2010), in which they tracked the subjective automaticity of a novel, daily (eating or exercise-related) routine, using the Self-Repor... | Social sciences | Zoltan Dienes | 2022-05-26 09:54:26 | View | ||
08 Sep 2022
STAGE 1
How to succeed in human modified environmentsLogan CJ, Shaw R, Lukas D, McCune KB http://corinalogan.com/ManyIndividuals/mi1.htmlThe role of behavioural flexibility in promoting resilience to human environmental impactsRecommended by Chris Chambers based on reviews by Gloriana Chaverri, Vedrana Šlipogor and Alizée VernouilletUnderstanding and mitigating the environmental effects of human expansion is crucial for ensuring long-term biosustainability. Recent research indicates a steep increase in urbanisation – including the expansion of cities – with global urban extent expanding by nearly 10,000 km^2 per year between 1985 and 2015 (Liu et al, 2020). The consequences of these human modified environments on animal life are significant: in order to succeed, species must adapt quickly to environmental changes, and those populations that demonstrate greater behavioural flexibility are likely to cope more effectively. These observations have, in turn, prompted the question of whether enhancing behavioural flexibility in animal species might increase their resilience to human impacts.
In the current research, Logan et al. (2022) will use a serial reversal learning paradigm to firstly understand how behavioural flexibility relates to success in avian species that are already successful in human modified environments. The authors will then deploy these flexibility interventions in more vulnerable species to establish whether behavioural training can improve success, as measured by outcomes such as foraging breadth, dispersal dynamics, and survival rate.
The Stage 1 manuscript was submitted via the programmatic track and will eventually produce three Stage 2 outputs focusing on different species (toutouwai, grackles, and jays). Following two rounds of in-depth review, the recommender judged that the manuscript met the Stage 1 criteria and awarded in-principle acceptance (IPA).
URL to the preregistered Stage 1 protocol: https://osf.io/wbsn6
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA. List of eligible PCI RR-friendly journals: References
1. Liu, X., Huang, Y., Xu, X., Li, X., Li, X., Ciais, P., Lin, P., Gong, K., Ziegler, A. D., Chen, A., et al. (2020). High-spatiotemporal-resolution mapping of global urban change from 1985 to 2015. Nature Sustainability, 1–7. https://doi.org/10.1038/s41893-020-0521-x
2. Logan, C.J., Shaw, R., Lukas, D. & McCune, K.B. (2022). How to succeed in human modified environments, in principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/wbsn6
| How to succeed in human modified environments | Logan CJ, Shaw R, Lukas D, McCune KB | <p>Human modifications of environments are increasing, causing global changes that other species must adjust to or suffer from. Behavioral flexibility (hereafter ‘flexibility’) could be key to coping with rapid change. Behavioral research can cont... | Life Sciences | Chris Chambers | 2022-05-06 12:12:05 | View | ||
17 Jan 2022
STAGE 1
Identifying Gaming Disorders by Ontology: A Nationally Representative Registered ReportVeli-Matti Karhulahti, Jukka Vahlo, Marcel Martončik, Matti Munukka, Raine Koskimaa, Mikaela von Bonsdorff https://osf.io/mpz9q/Do different screening instruments for ‘gaming disorder’ measure the same or different construct(s)?Recommended by Charlotte Pennington based on reviews by Daniel Dunleavy, Linda Kaye, David Ellis and 1 anonymous reviewerThere is considerable debate regarding the relationship between excessive gaming and mental health problems. Whilst the diagnostic classification of “gaming disorder” has now been included in the WHO’s International Classification of Diseases (ICD-11), the APA decided not to include this diagnosis in their Diagnostic and Statistical Manual of Mental Disorders (DSM-5) because the literature “suffers from a lack of a standard definition from which to derive prevalence data” (APA 2013, p. 796). Furthermore, screening instruments that aim to provide diagnostic classifications derive from different ontologies and it is not known whether they identify equivalent prevalence rates of ‘gaming disorder’ or even the same individuals. In this Stage 1 Registered Report, Karhulahti et al. (2022) aim to assess how screening instruments that derive from different ontologies differ in identifying associated problem groups. A nationally representative sample of 8000 Finnish individuals will complete four screening measures to assess the degree of overlap between identified prevalence (how many?), who they identify (what characteristics?) and the health of their identified groups (how healthy?). If these four ontologically diverse instruments operate similarly, this will support the notion of a single “gaming disorder” construct. If, however, the instruments operate differently, this will suggest that efforts should be directed toward assessing the clinical (ir)relevance of multiple constructs. This rigorous study will therefore have important implications for the conceptualisation and measurement of “gaming disorder”, contributing to the debate around the mixed findings of gaming-related health problems. Four expert reviewers with field expertise assessed the Stage 1 manuscript over three rounds of in-depth review. Based on detailed and informed responses to the reviewers' comments, the recommender decided that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA). URL to the preregistered Stage 1 protocol: https://osf.io/usj5b Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA. List of eligible PCI RR-friendly journals:
References
| Identifying Gaming Disorders by Ontology: A Nationally Representative Registered Report | Veli-Matti Karhulahti, Jukka Vahlo, Marcel Martončik, Matti Munukka, Raine Koskimaa, Mikaela von Bonsdorff | <p style="text-align: justify;">Gaming-related health problems have been researched since the 1980s with numerous different “ontologies” as reference systems, from self-assessed “game addiction” to “pathological gambling” (in the DSM-IV), “interne... | Medical Sciences, Social sciences | Charlotte Pennington | 2021-08-25 23:08:26 | View | ||
16 Aug 2023
STAGE 1
Identifying relevant experiences to the measurement of social media experience via focus groups with young people: A registered reportJo Hickman Dunne, Louise Black, Emily Banwell, Pratyasha Nanda, Molly Anderton, Lily Corke Butters, Ola Demkowicz, Brittany Davidson, Pamela Qualter, Neil Humphrey, Caroline Jay, and Margarita Panayiotou https://psyarxiv.com/erjvz/A mental health perspective to adolescents’ social media experiencesRecommended by Veli-Matti Karhulahti based on reviews by Amy Orben, Jana Papcunova, Lisa Orchard, Elena Gordon-Petrovskaya and Gaurav SaxenaMeasuring people’s experiences, thoughts, and mental processes has always been a core challenge of psychological science (e.g. Nisbett & Wilson 1977). When such measurement further relates to rapidly changing and conceptually diverse human-technology interactions, the task becomes even more difficult due to protean, multidimensional constructs. A good understanding of a construct is a basic step in its measurement (Borsboom 2005).
In the present registered report, Hickman Dunne et al. (2023) carry out a focus group study with adolescents (n=32) aged 11 to 15 in Northwest England to improve the understanding of constructs related to social media and mental health experiences. The work is carried out as part of a long-term measure development project. The authors apply reflexive thematic analysis to explore adolescents’ social media use experiences and related motivations in the light of mental health, in addition to which the adolescents’ own views of benefits and risks are mapped out. A particular strength of the design is the engagement of three Young Researchers who will co-facilitate the focus groups and be involved in the analysis. The research plan also meets high reflexivity and transparency criteria, and as such, can significantly contribute to future scale development as well as our general understanding of adolescents’ social media experiences. The Stage 1 manuscript was reviewed over two rounds by five unique reviewers, one of which participated in both rounds. The reviewers’ expertise ranged from social media and technology use research to health psychology and qualitative methods. Based on careful revisions and detailed responses to the reviewers’ comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance. URL to the preregistered Stage 1 protocol: https://osf.io/w24ec
Level of bias control achieved: Level 2. At least some data/evidence that will be used to answer the research question has been accessed and partially observed by the authors, but the authors certify that they have not yet observed the key variables within the data that will be used to answer the research question. List of eligible PCI RR-friendly journals: References
1. Borsboom, D. (2005). Measuring the mind: Conceptual issues in contemporary psychometrics. Cambridge University Press. 3. Nisbett, R. E., & Wilson, T. D. (1977). Telling more than we can know: Verbal reports on mental processes. Psychological review, 84, 231–259. https://doi.org/10.1037/0033-295X.84.3.231
2. Hickman Dunne J., Black L., Banwell E., Nanda P., Anderton M, Butters L.C., Demkowicz O., Davidson B., Qualter P., Humphrey N., Jay C., and Panayiotou M. (2023). Identifying relevant dimensions to the measurement of adolescent social media experience via focus groups with young people: A registered report. In principle acceptance of Version 5 by Peer Community in Registered Reports. https://osf.io/w24ec | Identifying relevant experiences to the measurement of social media experience via focus groups with young people: A registered report | Jo Hickman Dunne, Louise Black, Emily Banwell, Pratyasha Nanda, Molly Anderton, Lily Corke Butters, Ola Demkowicz, Brittany Davidson, Pamela Qualter, Neil Humphrey, Caroline Jay, and Margarita Panayiotou | <p>Background: While work on the relationship between social media use and adolescent mental health has allowed for some progress, research in this area is still relatively new and shows mixed evidence. This is partly the consequence of a rapidly ... | Computer science, Social sciences | Veli-Matti Karhulahti | 2023-06-14 21:10:43 | View | ||
Impact of analytic decisions on test-retest reliability of individual and group estimates in functional magnetic resonance imaging: a multiverse analysis using the monetary incentive delay taskMichael I. Demidenko, Jeanette A. Mumford, Russell A. Poldrack https://doi.org/10.1101/2024.03.19.585755Exploring determinants of test-retest reliability in fMRI: a study with the Monetary Incentive Delay TaskRecommended by Dorothy Bishop based on reviews by Xiangzhen Kong and 1 anonymous reviewerFunctional magnetic resonance imaging has been used to explore brain-behaviour relationships for many years, with proliferation of a wide range of sophisticated analytic procedures. However, rather scant attention has been paid to the reliability of findings. Concerns have been growing failures to replicate findings in some fields, but it is hard to know how far this is a consequence of underpowered studies, flexible analytic pipelines, or variability within and between participants. Demidenko et al. (2024) took advantage of the availability of three existing datasets, including the Adolescent Brain Cognitive Development (ABCD) study, the Michigan Longitudinal Study, and the Adolescent Risk Behavior Study, which all included a version of the Monetary Incentive Delay task measured in two sessions. These were entered into a multiverse analysis, which considered how within-subject and between-subject variance varies according to four analytic factors: smoothing (5 levels), motion correction (6 levels), task modelling (3 levels) and task contrasts (4 levels). They also considered how sample size affects estimates of reliability. The results have important implications for the those using fMRI with the Monetary Incentive Delay Task, and also raise questions more broadly about use of fMRI indices to study individual differences. Motion correction had relatively little impact on the ICC, and the effect size of the smoothing kernel was modest. Larger impacts on reliability were associated with choice of contrast (implicit baseline giving larger effects) and task parameterization. But perhaps the most sobering message from this analysis is that although activation maps from group data were reasonably reliable, the ICC, used as an index of reliability for individual levels of activation, was consistently low. This raises questions about the suitability of the Monetary Incentive Delay Task for studying individual differences. Another point is that reliability estimates become more stable as sample size increases; researchers may want to consider whether the trade-off between cost and gain in precision is justified for sample sizes above 250. I did a quick literature search on Web of Science: at the time of writing the search term ("Monetary Delay Task" AND fMRI) yielded 410 returns, indicating that this is a popular method in cognitive neuroscience. The detailed analyses reported here will repay study for those who are planning further research using this task. The Stage 2 manuscript was evaluated over one round of in-depth review. Based on detailed responses to the reviewer's and recommender's comments, the recommender judged that the manuscript met the Stage 2 criteria and awarded a positive recommendation. URL to the preregistered Stage 1 protocol: https://osf.io/nqgeh
Level of bias control achieved: Level 2. At least some data/evidence that was used to answer the research question had been accessed and partially observed by the authors prior to IPA, but the authors certify that they had not yet sufficiently observed the key variables within the data to be able to answer the research questions and they took additional steps to maximise bias control and rigour.
List of eligible PCI RR-friendly journals:
References 1. Demidenko, M. I., Mumford, J. A., & Poldrack, R. A. (2024). Impact of analytic decisions on test-retest reliability of individual and group estimates in functional magnetic resonance imaging: a multiverse analysis using the monetary incentive delay task [Stage 2]. Acceptance of Version 5 by Peer Community in Registered Reports. https://www.biorxiv.org/content/10.1101/2024.03.19.585755v4 | Impact of analytic decisions on test-retest reliability of individual and group estimates in functional magnetic resonance imaging: a multiverse analysis using the monetary incentive delay task | Michael I. Demidenko, Jeanette A. Mumford, Russell A. Poldrack | <p>Empirical studies reporting low test-retest reliability of individual blood oxygen-level dependent (BOLD) signal estimates in functional magnetic resonance imaging (fMRI) data have resurrected interest among cognitive neuroscientists in methods... | Life Sciences, Social sciences | Dorothy Bishop | 2024-03-21 02:23:30 | View | ||
22 Oct 2023
STAGE 1
Implicit Ideologies: Do Right-Wing Authoritarianism and Social Dominance Orientation Predict Implicit Attitudes?Jesse S Reid, Yoel Inbar https://osf.io/gsj75Do social dominance orientation and right wing authoritarianism similarly predict both explicit and implicit attitudes?Recommended by Thomas Evans based on reviews by Luisa Liekefett, Oluwaseyi Adeliyi, Abiola Akinnubi ? and 1 anonymous reviewerMeasurement is a vital activity for all research areas, but we so often fail to provide sufficient clarity, rigor and transparency about it, undermining the validity of our studies' conclusions (Flake & Fried, 2020). This concern is of wide societal interest when applied to the domains of ideology and attitudes where measurements of both implicit and explicit attitudes are assumed to reflect the same underlying concept. The extent to which this can be accepted is undermined by mixed evidence demonstrating a lack of consensus on the extent to which relevant psychological factors similarly predict both implicit and explicit attitudes.
In the proposed study, Reid & Inbar (2023) question these assumptions through use of the Project Implicit dataset, exploring the extent to which social dominance orientation (SDO) and right wing authoritarianism (RWA) similarly predict implicit and explicit attitudes. This work is ideally suited for publication through the Registered Reports format because whilst we may expect that relationships between SDO/RWA are similar in effect size across measures of both implicit and explicit attitude (because they tap into the same underlying attitude), there is great scope to acknowledge a more complex set of findings which may not be immediately interpretable or coherent. The proposed work will help us unpack further the assumptions surrounding measurement of attitudes and can help us better understand the extent to which SDO and RWA predict atittudes.
The Stage 1 manuscript was evaluated over three rounds of in-depth review. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
URL to the preregistered Stage 1 protocol: https://osf.io/zv4jw
Level of bias control achieved: Level 5. All of the data or evidence that will be used to answer the research question already exist, but are currently inaccessible to the authors and thus unobservable prior to IPA (e.g. held by a gatekeeper) List of eligible PCI-RR-friendly journals: References:
1. Flake, J. K. & Fried, E. I. (2020). Measurement schmeasurement: Questionable measurement practices and how to avoid them. Advances in Methods and Practices in Psychological Science, 3, 456-465. https://doi.org/10.1177/2515245920952393
2. Reid, J. & Inbar, Y. (2023). Implicit Ideologies: Do Right-Wing Authoritarianism and Social Dominance Orientation Predict Implicit Attitudes? In principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/zv4jw
| Implicit Ideologies: Do Right-Wing Authoritarianism and Social Dominance Orientation Predict Implicit Attitudes? | Jesse S Reid, Yoel Inbar | <p>A wide variety of attitudes, beliefs and behaviours can be predicted by political ideology – and more specifically, by the two ideological scales of Right-Wing Authoritarianism (RWA; a preference for authority and tradition) and Social Dominanc... | Social sciences | Thomas Evans | 2023-04-08 01:53:30 | View |
MANAGING BOARD
Chris Chambers
Zoltan Dienes
Corina Logan
Benoit Pujol
Maanasa Raghavan
Emily S Sena
Yuki Yamada