Submit a report

Announcements

We are recruiting recommenders (editors) from all research fields!

Your feedback matters! If you have authored or reviewed a Registered Report at Peer Community in Registered Reports, then please take 5 minutes to leave anonymous feedback about your experience, and view community ratings.

Latest recommendations

IdTitle * Authors * Abstract * Picture▲Thematic fields * RecommenderReviewersSubmission date
04 Oct 2024
STAGE 2
(Go to stage 1)

Implicit Ideologies: Do Right-Wing Authoritarianism and Social Dominance Orientation Predict Implicit Attitudes?

Do social dominance orientation and right wing authoritarianism similarly predict both explicit and implicit attitudes?

Recommended by ORCID_LOGO based on reviews by Luisa Liekefett and 1 anonymous reviewer
Measurement is a vital activity for all research areas, but we so often fail to provide sufficient clarity, rigor and transparency about it, undermining the validity of our studies' conclusions (Flake & Fried, 2020). This concern is of wide societal interest when applied to the domains of ideology and attitudes where measurements of both implicit and explicit attitudes are assumed to reflect the same underlying concept. The extent to which this can be accepted is undermined by mixed evidence demonstrating a lack of consensus on the extent to which relevant psychological factors similarly predict both implicit and explicit attitudes.
 
In the current study, Reid & Inbar (2023) question these assumptions through use of the Project Implicit dataset, exploring the extent to which social dominance orientation (SDO) and right wing authoritarianism (RWA) similarly predict implicit and explicit attitudes. This work was ideally suited for publication through the Registered Reports format because whilst it may have been expected that relationships between SDO/RWA are similar in effect size across measures of both implicit and explicit attitude (because they tap into the same underlying attitude), there was great scope to acknowledge a more complex set of findings which may not be immediately interpretable or coherent.
 
As expected, the results were not completely unambiguous, but the mostly consistent relationships between implicit attitudes and RWA/SDO provided evidence towards both implicit and explict measures capturing the same underlying construct. These results also provide a useful step forward in our discussion of measurement in this domain, acknowledging the complexity of the tradeoff between reliability and specificity.
 
The Stage 2 manuscript was evaluated over two rounds of in-depth review. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 2 criteria and awarded a positive recommendation. 
 
URL to the preregistered Stage 1 protocol: https://osf.io/zv4jw
 
Level of bias control achieved: Level 5. All of the data or evidence that was used to answer the research question existed before the research commenced but was inaccessible to the authors and thus unobservable prior to IPA.
 
List of eligible PCI-RR-friendly journals:
 
References
 
1. Flake, J. K. & Fried, E. I. (2020). Measurement schmeasurement: Questionable measurement practices and how to avoid them. Advances in Methods and Practices in Psychological Science, 3, 456-465. https://doi.org/10.1177/2515245920952393
 
2. Reid, J. & Inbar, Y. (2024). Implicit Ideologies: Do Right-Wing Authoritarianism and Social Dominance Orientation Predict Implicit Attitudes? [Stage 2]. Acceptance of Version 6 by Peer Community in Registered Reports. https://doi.org/10.31234/osf.io/8udps
Implicit Ideologies: Do Right-Wing Authoritarianism and Social Dominance Orientation Predict Implicit Attitudes? Jesse S Reid, Yoel Inbar<p>Many social and political attitudes, beliefs and behaviours can be predicted by Right-Wing Authoritarianism (RWA; a preference for authority and tradition) and Social Dominance Orientation (SDO; a preference for social hierarchies and inequalit...Social sciencesThomas Evans Luisa Liekefett, Anonymous2024-04-02 19:47:51 View
14 Jun 2024
STAGE 2
(Go to stage 1)

Do prediction errors of perceived exertion inform the level of running pleasure?

Running pleasure results from finding it easier than you thought you would

Recommended by ORCID_LOGO based on reviews by Jasmin Hutchinson and 1 anonymous reviewer
The reward value of a stimulus is based on an error in prediction: Things going better than predicted. Could this learning principle, often tested on short acting stimuli, also apply to a long lasting episode, like going for a run? Could how rewarding a run is be based on the run going better than predicted?
 
Understanding the conditions under which exercise is pleasurable could of course be relevant to tempting people to do more of it! In the current study, Brevers et al. (2024) asked people before a daily run to predict the amount of perceived exertion they would experience; then just after the run, to rate the retrospective amount of perceived exertion actually experienced. The difference between the two ratings was the prediction error. Participants also rated their remembered pleasure in running. As hypothesized, the authors found that running pleasure increased linearly with how much retrospective exertion was than predicted.
 
The Stage 2 manuscript received one round of review from two external reviewers, then some minor comments from the recommender, after which it was judged to satisfy the Stage 2 criteria and was awarded a positive recommendation.
 
URL to the preregistered Stage 1 protocol: https://osf.io/xh724
 
Level of bias control achieved: Level 6. No part of the data or evidence that was used to answer the research question was generated until after IPA.
 
List of eligible PCI RR-friendly journals:
 
 
References
 
1. Brevers, D., Martinent, G., Oz, I. T., Desmedt, O. & de Geus, B. (2024). Do prediction errors of perceived exertion inform the level of running pleasure? [Stage 2]. In principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/xfgqp
Do prediction errors of perceived exertion inform the level of running pleasure? Damien Brevers, Guillaume Martinent, İrem Tuğçe Öz, Olivier Desmedt, Bas de Geus<p>Humans have the ability to mentally project themselves into future events (prospective thinking) to promote the implementation of health-oriented behaviors, such as the planning of daily physical exercise sessions. Nevertheless, it is currently...Social sciencesZoltan Dienes2024-04-26 11:58:57 View
06 Jun 2024
STAGE 2
(Go to stage 1)

Associations of fear, anger, happiness, and hope with risk judgments: Revisiting appraisal-tendency framework with a replication and extensions Registered Report of Lerner and Keltner (2001)

Mixed evidence for the Appraisal-Tendency Framework in explaining links between emotion and decision-making

Recommended by ORCID_LOGO based on reviews by Kelly Wolfe and Max Primbs
How do emotions interact with cognition? The last 40 years has witnessed the rise of cognitive-appraisal theories, which propose that emotions can be differentiated along an axis of cognitive dimensions such as certainty, pleasantness, attentional activity, control, anticipated effort, and responsibility (Smith and Ellsworth, 1985). Early tests of such theories focused especially on the impact of the valence – pleasantness/unpleasantness – of emotions on judgment and decision-making, finding, for instance, that negative mood induction can heighten pessimistic estimates of risk (Johnson & Tversky, 1983).
 
The Appraisal-Tendency Framework proposed by Lerner and Keltner (2000) refined cognitive-appraisal theory by proposing that specific emotions trigger a predisposition to appraise future (or hypothetical) events in line with the central appraisal dimensions that triggered the emotion, even when the emotion and the judgment are unrelated. For example, an individual who is triggered to become fearful of a heightened risk, such as nuclear war, may then exhibit heightened pessimism about risks unrelated to war. The Appraisal-Tendency Framework also predicts relationships between traits, such as fear, anger and risk-taking/risk-seeking tendencies. In an influential paper, Lerner and Keltner (2001) reported direct empirical support for the Appraisal-Tendency Framework, which aside from its influence in cognitive/affective psychology has had considerable impact in behavioural economics, moral psychology, and studies of consumer behaviour.
 
In the current study, Lu et al. (2024) replicated three key studies from Lerner and Keltner (2001) in a large online sample. Through a combination of replication and extension, the authors probed the relationship between various trait emotions (including fear, anger, happiness, and hope) and trait characteristics of risk seeking and optimistic risk assessment. The authors also examined how the ambiguity of triggering events moderates the relationship between specific emotions and risk judgments.
 
Overall, the results provide mixed support for the predictions of the Appraisal-Tendency Framework. Trait anger and trait happiness were positively associated with risk-seeking and optimistic risk estimates, while trait fear was negatively associated with optimistic risk assessment (although a reliable association between fear and risk-seeking was not observed). The original finding of Lerner and Keltner (2001) that the valence-based approach applied to risk optimism for unambiguous events was not supported. In addition, there was no reliable evidence for a positive relationship between hope and risk-seeking preference or optimistic risk estimates. The authors conclude that future research should consider a wider range of emotions to develop a more complete understanding of the link to risk-related judgment and decision-making.
 
The Stage 2 manuscript was evaluated over one round of in-depth review. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 2 criteria and therefore awarded a positive recommendation.
 
URL to the preregistered Stage 1 protocol: https://osf.io/8yu2x
 
Level of bias control achieved: Level 6. No part of the data or evidence that was used to answer the research question was generated until after IPA. 
 
List of eligible PCI RR-friendly journals:
 
References
 
1. Smith, C. A., & Ellsworth, P. C. (1985). Patterns of cognitive appraisal in emotion. Journal of Personality and Social Psychology, 48, 813-838. https://doi.org/10.1037/0022-3514.48.4.813
 
2. Johnson, E. J., & Tversky, A. (1983). Affect, generalization, and the perception of risk. Journal of Personality and Social Psychology, 45(1), 20–31. https://doi.org/10.1037/0022-3514.45.1.20
 
3. Lerner, J. S., & Keltner, D. (2000). Beyond valence: Toward a model of emotion-specific influences on judgment and choice. Cognition & Emotion, 14, 473-493. https://doi.org/10.1080/026999300402763 
 
4. Lerner, J. S., & Keltner, D. (2001). Fear, anger, and risk. Journal of Personality and Social Psychology, 81, 146–159. https://doi.org/10.1037/0022-3514.81.1.146
  
5. Lu, S., Efendić, E., & Feldman, G. (2024). Associations of fear, anger, happiness, and hope with risk judgments: Revisiting appraisal-tendency framework with a replication and extensions Registered Report of Lerner and Keltner (2001) [Stage 2]. Acceptance of Version 2 by Peer Community in Registered Reports. https://osf.io/xytsw
Associations of fear, anger, happiness, and hope with risk judgments: Revisiting appraisal-tendency framework with a replication and extensions Registered Report of Lerner and Keltner (2001)Sirui Lu; Emir Efendić; Gilad Feldman<p>The appraisal-tendency framework proposed that specific emotions predispose individuals to appraise future events corresponding to the core appraisal themes of the emotions. In a Registered Report with a US American online Amazon Mechanical Tur...Social sciencesChris Chambers2024-04-26 16:55:30 View
06 Mar 2025
STAGE 1

The role of extra-striate areas in conscious motor behavior: a registered report with Fast-Optical Imaging

Neural underpinning of conscious perception of visual stimuli disentangled from motor confounds

Recommended by ORCID_LOGO based on reviews by 3 anonymous reviewers
The debate about consciousness and its neural underpinnings is a hot topic in cognitive neuroscience that has driven innovative original research and theoretical frameworks (Dehaene et al., 2006; Lamme, 2006). Consciousness itself can be defined and studied from different perspectives, such as neuropsychology (Laureys et al., 2004; Monti, 2012), applied philosophy (Blanke & Metzinger, 2009), and experimental cognitive neuroscience (Dehaene & Changeux, 2011). However, after several decades of research via different methods and from different perspectives, basic questions regarding consciousness and its neural underpinnings are still debated (Chalmers, 2010). One of the reasons for this ongoing debate is that consciousness cannot be easily disentangled from confounds, such as involvement of other cognitive processes like memory, language, and so forth (Dehaene & Changeux, 2011).
 
In the current study, Colombari et al. (2025) focus on disentangling neural markers of conscious visual perception from motoric responses. To this end, the study uses a cutting-edge neuroimaging technique, Event-Related Optical Signal (EROS), to measure the neural responses during a Go/No-Go detection task, which is especially designed to gauge visual perception regardless of response production. The study, therefore, is instrumental in addressing the neural foundation of conscious visual perception and is well situated to advance our understanding of consciousness and its neural underpinnings.
 
The Stage 1 submission was evaluated by three expert reviewers. After several rounds of revision, the recommender determined that the manuscript met the Stage 1 criteria and awarded in-principle acceptance (IPA).
 
URL to the preregistered Stage 1 protocol: https://osf.io/8ya2t
 
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.
 
List of eligible PCI RR-friendly journals:
 
 
References
 
1. Blanke, O., & Metzinger, T. (2009). Full-body illusions and minimal phenomenal selfhood. Trends in Cognitive Sciences, 13, 7-13. https://doi.org/10.1016/j.tics.2008.10.003
 
2. Chalmers, D. J. (2010). Facing Up to the Problem of Consciousness. In The Character of Consciousness (pp. 3-34). Oxford University Press. https://doi.org/10.1093/acprof:oso/9780195311105.003.0001 
 
3. Colombari, E., Parisi, G., Mele, S., Mazzi, C., & Savazzi, S. (2025). The role of extra-striate areas in conscious motor behavior: a registered report with Fast-Optical Imaging. In principle acceptance of Version 5 by Peer Community in Registered Reports. https://osf.io/8ya2t
 
4. Dehaene, S., & Changeux, J. P. (2011). Experimental and theoretical approaches to conscious processing. Neuron, 70, 200-227. https://doi.org/10.1016/j.neuron.2011.03.018 
 
5. Dehaene, S., Changeux, J. P., Naccache, L., Sackur, J., & Sergent, C. (2006). Conscious, preconscious, and subliminal processing: a testable taxonomy. Trends in Cognitive Sciences, 10, 204-211. https://doi.org/10.1016/j.tics.2006.03.007 
 
6. Lamme, V. A. (2006). Towards a true neural stance on consciousness. Trends in Cognitive Sciences, 10, 494-501. https://doi.org/10.1016/j.tics.2006.09.001 
 
7. Laureys, S., Owen, A. M., & Schiff, N. D. (2004). Brain function in coma, vegetative state, and related disorders. The Lancet Neurology, 3, 537-546. https://doi.org/10.1016/s1474-4422(04)00852-x 
 
8. Monti, M. M. (2012). Cognition in the vegetative state. Annual Review of Clinical Psychology, 8, 431-454. https://doi.org/10.1146/annurev-clinpsy-032511-143050
The role of extra-striate areas in conscious motor behavior: a registered report with Fast-Optical ImagingElisabetta Colombari, Giorgia Parisi, Sonia Mele, Chiara Mazzi, Silvia Savazzi<p>Disclosing the brain areas responsible for the emergence of visual awareness and their timing of activation represents one of the major challenges in consciousness research. In particular, isolating the neural processes strictly related to cons...Life Sciences, Social sciencesAnoushiravan Zahedi 2024-04-26 22:44:25 View
25 Sep 2024
STAGE 2
(Go to stage 1)

Factors impacting effective altruism: Revisiting heuristics and biases in charity in a replication and extensions Registered Report of Baron and Szymanska (2011)

Understanding biases and heuristics in charity donations

Recommended by ORCID_LOGO based on reviews by Amanda Geiser and Jonathan Berman

Decisions to give to charities are affected by numerous external and internal factors. Understanding the elements influencing donation decisions is of first-order importance for science and society. On the scientific side, understanding the determinants of charity-giving contributes to the knowledge of altruistic behaviors in the presence of collective problems such as poverty, climate change, or animal welfare. On the social side, pointing out which factors affect donations can help increase prosocial behaviors and might facilitate collective actions in the case of public goods.  

Previous work has identified multiple mechanisms affecting altruistic donations to charities (Bekkers and Wiepking, 2011). Importantly, Baron and Szymanska (2011) collected empirical evidence suggesting that people prefer (i) their donations to be directly used for projects rather than organizational costs, (ii) when charities have low past costs, (iii) to diversity their donations into several NGOs, (iv) to favor charities that deal with close peers like nationals, and (v) to give voluntarily rather than through taxes. 

Here, Chan and Feldman (2024) conducted a close replication of Studies 1 to 4 of Baron and Szymanska (2011) using a large sample of online participants (four studies, overall N=1,403). In their replication, the authors found supporting evidence for the phenomena reported in the original study. In particular, people were more likely to donate to charities with lower organizational and lower past costs, to diversify their donations, and to show ingroup/nationalist preferences with larger donations to NGOs helping local over foreign children. Chan and Feldman (2024) ran additional analyses that indicated validity concerns regarding the analysis and questions that resulted in finding a preference for voluntary donations over taxation. In their added extensions that went beyond the original study, they also found that donors preferred to donate to charities whose overhead costs are paid for by other donors and unexpected evidence that making donations anonymous increased rather than decreased contributions.

The Stage 2 manuscript was evaluated over one round of in-depth review by the recommender and two expert reviewers. Following revision, the recommender judged that the manuscript met the Stage 2 criteria and awarded a positive recommendation.
 
URL to the preregistered Stage 1 protocol: https://osf.io/gmswz
 
Level of bias control achieved: Level 6. No part of the data or evidence that was used to answer the research question was generated until after IPA.
 
List of eligible PCI RR-friendly journals:
 
 
References
 
1. Baron, J. and Szymanska, E. (2011). Heuristics and Biases in Charity. In D. M. Oppenheimer and C. Y. Olivola (Eds.), The Science of Giving: Experimental Approaches to the Study of Charity (pp. 215–235). Psychology Press. https://doi.org/10.4324/9780203865972
 
2. Bekkers, R. and Wiepking, P. (2011). A Literature Review of Empirical Studies of Philanthropy. Nonprofit and Voluntary Sector Quarterly, 40, 924–973. https://doi.org/10.1177/0899764010380927
 
3. Chan, M. and Feldman, G. (2024). Factors impacting effective altruism: Revisiting heuristics and biases in charity in a replication and extensions Registered Report of Baron and Szymanska (2011) [Stage 2]. Acceptance of Version 5 by Peer Community in Registered Reports. https://osf.io/4etkp
Factors impacting effective altruism: Revisiting heuristics and biases in charity in a replication and extensions Registered Report of Baron and Szymanska (2011)Mannix Chan, Gilad Feldman<p>Individuals who donate to charity may be affected by various biases and donate inefficiently. In a replication and extension Registered Report with a US Amazon Mechanical Turk sample using CloudResearch (N = 1403), we replicated Studies 1 to 4 ...Social sciencesRomain Espinosa2024-04-27 02:28:49 View
06 Sep 2024
STAGE 1

Barriers and facilitators to the adoption and promotion of Open Science practices in psychology. The case of Slovakia

What are the barriers and facilitators to open science practices for researchers, policy makers and media representatives in Slovakia?

Recommended by ORCID_LOGO based on reviews by Crystal Steltenpohl, Peter Branney, Andrea E. Abele-Brehm , Emma Norris and 1 anonymous reviewer
Open science practices (OSPs, e.g., preregistration, open materials, code and data) aim to enhance the transparency, integrity, and reproducibility of research. Recent work, however, has highlighted various facilitators and barriers perceived by researchers in implementing these, which can either enhance or hinder their success. Little is known about these barriers in the context of Slovakia, and such perceptions are rarely investigated for policy makers and media representatives who are also embedded in the research ecosystem.
 
In their Stage 1 Registered Report, Marcel Martončik and colleagues aim to map the perceptions and experiences of barriers and facilitators of OSPs that are unique to different stakeholder groups in Slovakia. They will conduct both semi-structured interviews and focus groups with a diverse sample of postgraduate students, researchers, policymakers, and media representatives from the field of psychology. Reflexive thematic analysis will identify overarching themes regarding such barriers and facilitators which will provide valuable insights into the support required to make OSPs normative across different stakeholder groups.
 
Four expert reviewers assessed the Stage 1 manuscript across two rounds of in-depth review. Based on the authors' detailed and informed responses to the reviewer’s comments, the recommender judged that the manuscript met the Stage 1 criteria and awarded in principle acceptance (IPA).
 
URL to the preregistered Stage 1 protocol: https://osf.io/n86um
 
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.
 
List of eligible PCI RR-friendly Journals:
 
 
References
 
Martončik, M., Adamkovič, M., Baník G., Fedáková, D., Issmailová, S., Kačmár, P., Kentoš, M., Majdáková, V., Papcunová, J., & Vargová, L. (2024). Barriers and facilitators to the adoption and promotion of Open Science practices in psychology. The case of Slovakia. In principle acceptance of Version 1.1 by Peer Community in Registered Reports. https://osf.io/n86um
Barriers and facilitators to the adoption and promotion of Open Science practices in psychology. The case of SlovakiaMarcel Martončik, Matúš Adamkovič, Gabriel Baník, Denisa Fedáková, Samar Issmailová, Pavol Kačmár, Michal Kentoš, Viktória Majdáková, Jana Papcunová, Lenka Vargová<p>Various responsible research practices emphasizing transparency, such as open<br>data, open code, open peer review, and preregistration, have been introduced to<br>enhance the reproducibility and replicability of findings. The ongoing initiativ...Social sciencesCharlotte Pennington2024-04-29 14:39:12 View
08 Mar 2025
STAGE 1

Noninvasive Neuromodulation of Visual Perception and Neural Connectivity in Body Dysmorphic Disorder: A Registered Report

Understanding the combined effects of brain stimulation and visual attention modification in body dysmorphic disorder

Recommended by ORCID_LOGO based on reviews by Samuel Westwood and 1 anonymous reviewer
This study by Diaz-Fong et al. (2025) plans to investigate body dysmorphic disorder (BDD), an understudied psychiatric condition marked by distortions in the perception of a patients’ physical appearance. The authors build on evidence that perceptual symptoms in BDD are underpinned by attentional biases, which may relate to abnormal visual processing and neural connectivity in the dorsal visual stream (DVS; reduced activation) and the ventral visual stream (VVS; increased activation). Prior evidence suggests that activation in the DVS and the VVS may be modifiable by both non-invasive neuromodulation (including transcranial magnetic stimulation), as well as behavioural interventions such as the Visual Modification (ModV) paradigm, which has been suggested to reduce patients’ foveal attention to perceived bodily defects. The ModV paradigm has been specifically linked with altered VVS and DVS activation and connectivity. 
 
Here the authors will test in a within-subject crossover design (N = 40) whether neural connectivity and visual perceptual biases in BDD and subclinical BDD can be modified by combining the effects of altered visual attention in the ModV paradigm with repetitive transcranial magnetic stimulation (continuous and intermittent theta burst stimulation; cTBS and iTBS). By combining a behavioural and an exogenous intervention, the authors predict an increase in the magnitude of clinically meaningful improvements in attentional biases in BDD, with iTBS expected to enhance, and cTBS expected to inhibit the effects of visual attention modification through ModV on neural connectivity (measured using fMRI) and visual processing. More specifically, the effect of TBS is hypothesised to be stronger after patients perform ModV.
 
The Stage 1 manuscript was evaluated by two experts who performed in-depth peer review across multiple rounds of revisions. The authors were responsive in editing their manuscript based on the reviewers’ comments and dedicated much effort to increasing the clarity and interpretability of their power analyses. The revised manuscript was judged to meet the Stage 1 criteria and was awarded in-principle acceptance (IPA). 

URL to the preregistered Stage 1 protocol: https://osf.io/ks425 (under temporary private embargo)
 
Level of bias control achieved: Level 3. At least some data/evidence that will be used to the answer the research question has been previously accessed by the authors (e.g. downloaded or otherwise received), but the authors certify that they have not yet observed any part of the data/evidence.
 
List of eligible PCI RR-friendly journals:
 
 
References
 
Diaz-Fong, J. P., Lewis, M., Qian, J., Wong, W.-W., Leuchter, A. F., Tadayonnejad, R., Voineskos, D., Konstantinou, G., Lam, E., Blumberger, D. M., Feusner, J. D. (2025). Noninvasive neuromodulation of visual perception and neural connectivity in body dysmorphic disorder: a registered report. In principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/ks425
Noninvasive Neuromodulation of Visual Perception and Neural Connectivity in Body Dysmorphic Disorder: A Registered ReportJoel P. Diaz-Fong, Madison Lewis, Jessica Qian, Wan-Wa Wong, Andrew F. Leuchter, Reza Tadayonnejad, Daphne Voineskos, Gerasimos Konstantinou, Eileen Lam, Daniel M. Blumberger, Jamie D. Feusner<p>Body dysmorphic disorder is a debilitating and understudied psychiatric condition characterized by perceptual distortions pertaining to one’s physical appearance. Current evidence suggests that abnormalities in visual processing likely underlie...Medical SciencesAnna Elisabeth Fürtjes Micheal Fox, Andreas Horn, David A. McCormick, Biyu He, Paul Fitzgerald, Yang Dan, Tim Constandinou, Song Luan, Steven Cohen, Samuel Westwood, Philip Lewis, Anonymous2024-05-02 01:31:43 View
27 Nov 2024
STAGE 1

Does Truth Pay? Investigating the Effectiveness of the Bayesian Truth Serum with an Interim Payment: A Registered Report

Do interim payments promote honesty in self-report? A test of the Bayesian Truth Serum

Recommended by ORCID_LOGO and ORCID_LOGO based on reviews by Philipp Schoenegger, Sarahanne Miranda Field and Martin Schnuerch
Surveys that measure self-report are a workhorse in psychology and the social sciences, providing a vital window into beliefs, attitudes and emotions, both at the level of groups and individuals. The validity of self-report data, however, is an enduring methodological concern, with self-reports vulnerable to a range of response biases, including (among others) the risk of social desirability bias in which, rather than responding honestly, participants answer questions in a way that they believe will be viewed favourably by others. One proposed solution to socially desirable responding is the so-called Bayesian Truth Serum (BTS), which aims to incentivise truthfulness by taking into account the relationship between an individual’s response and their belief about the dominant (or most likely) response given by other people, and then assigning a high truthfulness score to answers that are surprisingly common.
 
Although valid in theory (under a variety of assumptions), questions remain regarding the empirical utility of the BTS. One area of concern is participants’ uncertainty regarding incentives for truth-telling – if participants don’t understand the extent to which telling the truth is in their own interests (or they don’t believe that it matters) then the validity of the BTS is undermined. In the current study, Neville and Williams (2024) aim to test the role of clarifying incentives, particularly for addressing social desirability bias when answering sensitive questions. The authors will administer an experimental survey design including sensitive questions, curated from validated scales, that are relevant to current social attitudes and sensitivities (e.g. “Men are not particularly discriminated against”, “Younger people are usually more productive than older people at their jobs”). Three groups of participants will complete the survey under different incentive conditions: the BTS delivered alone in standard format, the BTS with an interim bonus payment that is awarded to participants (based on their BTS score) half-way through the survey to increase certainty in incentives, and a Regular Incentive control group in which participants receive payment without additional incentives.
 
The authors will then address two questions: whether the BTS overall effectively incentivises honesty (the contrast of BTS alone + BTS with interim payment vs the Regular Incentive group), and whether interim payments, specifically, further boost assumed honesty (the contrast of BTS alone vs BTS with interim payment). Regardless of how the results turn out, the study promises to shed light on the effectiveness of the BTS and its dependence on the visibility of incentives, with implications for survey design in psychology and beyond.
 
The Stage 1 manuscript was evaluated over two rounds of in-depth review. Based on ​detailed responses to reviewers’ and the recommender’s comments, the recommenders judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance.​​​
 
URL to the preregistered Stage 1 protocol: https://osf.io/vuh8b
 
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.
 
List of eligible PCI-RR-friendly journals:

 
References
 
Neville, C. M & Williams, M. N. (2024). Does Truth Pay? Investigating the Effectiveness of the Bayesian
Truth Serum with an Interim Payment: A Registered Report. In principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/vuh8b
Does Truth Pay? Investigating the Effectiveness of the Bayesian Truth Serum with an Interim Payment: A Registered Report Claire M. Neville, Matt N. Williams<p>Self-report data is vital in psychological research, but biases like careless responding and socially desirable responding can compromise its validity. While various methods are employed to mitigate these biases, they have limitations. The Baye...Social sciencesRomain Espinosa Martin Schnuerch, Sarahanne Miranda Field, Philipp Schoenegger2024-05-02 06:40:18 View
16 Oct 2024
STAGE 1

How perceptual ability shapes memory: An investigation in healthy special populations

Putting the enhanced processing account of perception and memory to the test

Recommended by ORCID_LOGO based on reviews by Ariel Kershner and Katherine Moore
The enhanced processing account suggests that domain-specific expertise enhances the processing of information in that domain, such as enhanced color perception in visual artists and grapheme-color synaesthetes. A previous study (Ovalle-Fresa et al., 2021) found support for this account in both synaesthetes and non-synaesthete color experts; however, to fully understand the domain specificity of enhanced processing, other domains of expertise should be investigated and compared against each other in a double dissociation.
 
In this Stage 1 manuscript, Sachdeva et al. (2024) will investigate whether an enhanced processing account can explain domain-specific expertise in groups of color experts (i.e., visual artists) / grapheme-color synaesthetes and spatial experts (i.e., architects) / sequence-space synaesthetes. The spatial domain was chosen to compare to color since color and spatial processing recruit two distinctive cortical visual pathways: the ventral and dorsal streams, respectively. If enhanced processing is domain specific, then color experts / grapheme-color synaesthetes should show selective perceptual and memory performance enhancements for color tasks but not spatial tasks; and vice versa for spatial experts and sequence-space synaesthetes. The authors of this planned study further propose that perceptual performance should predict memory performance in the domain of expertise only; and that synaesthetes and non-synaesthetes with the same domain of expertise should perform similarly to each other.
 
To address these hypotheses, four independent groups will be recruited: grapheme-color synaesthetes, visual artists, sequence-space synaesthetes, and architects. Individuals with overlapping expertise and synaesthesia (e.g., visual artists who also have grapheme-color synaesthesia) will be excluded. Perception, short-term memory, and long-term memory for color (3 tasks) and space (3 tasks) will be assessed in all groups, and the authors will compare groups (synaesthetes, non-synaesthetes), domains of expertise (color, space), and task feature (color, space) in 2x2x2 linear mixed models. For all models, the authors predict that a significant interaction between domain of expertise and task feature will provide evidence for the domain specificity of the enhanced processing account. Additional analyses concerning working memory load (one, three, or five items) in the short-term memory tasks, and testing day (one, two, or three days post-training) in the long-term memory tasks, will be conducted to more deeply explore potential performance enhancements related to domain-specific expertise. Although these analyses may potentially provide additional evidence in favor of the hypothesized direction of effects, any deviation from predicted may pose a challenge for the interpretation of results. Nevertheless, this planned study is methodologically rigorous, and comprehensive in its aims.
 
The Stage 1 submission was evaluated by the recommender and two expert reviewers. Following revisions, the recommender judged that the manuscript met the Stage 1 criteria and awarded in-principle acceptance (IPA).
 
URL to the preregistered Stage 1 protocol: https://osf.io/6wn4m

Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.
 
List of eligible PCI RR-friendly journals:
 
References
 
1. Ovalle-Fresa, R., Ankner, S., & Rothen, N. (2021). Enhanced perception and memory: Insights from synesthesia and expertise. Cortex, 140, 14-25. https://doi.org/10.1016/j.cortex.2021.01.024

2. Sachdeva, D. & Whelan, E., Ovalle-Fresa, R., Rey-Mermet, A., Ward, J., & Rothen, N.. (2024). How perceptual ability shapes memory: An investigation in healthy special populations. In principle acceptance of Version 2 by Peer Community in Registered Reports. https://osf.io/6wn4m
 
How perceptual ability shapes memory: An investigation in healthy special populationsChhavi Sachdeva, Emily Whelan, Rebecca Ovalle-Fresa, Alodie Rey-Mermet, Jamie Ward, Nicolas Rothen<p>The enhanced processing account posits a close connection between visual perceptual ability and memory. This account finds support in studies involving special populations with conditions based on neural changes in the ventral visual pathway, s...Life SciencesReshanne Reeder Ariel Kershner, Katherine Moore2024-05-03 14:15:43 View
22 Nov 2024
STAGE 2
(Go to stage 1)

Identifying relevant dimensions to the measurement of social media experience via focus groups with young people

A mental health perspective to adolescents’ social media experiences

Recommended by ORCID_LOGO based on reviews by Amy Orben, Jana Papcunova and Elena Gordon-Petrovskaya
Measuring people’s experiences, thoughts, and mental processes has always been a core challenge of psychological science (e.g. Nisbett & Wilson 1977). When such measurement relates to rapidly changing and conceptually diverse human-technology interactions, the task becomes even more difficult due to protean, multidimensional constructs. A good understanding of a construct is a basic step in its measurement (Borsboom 2005).  
 
In the present registered report—carried out as part of a long-term measure development project—Dunne et al. (2024) carried out a focus group study with adolescents (n=26) aged 11 to 15 in Northwest England to improve the understanding of constructs related to social media and mental health. The authors applied reflexive thematic analysis to explore adolescents’ social media use experiences and related motivations in the light of mental health.
 
The data and research process led to a construction of five themes, which were connected to mental health in direct and indirect ways. The participants voiced direct experiences of anxiety, self-esteem, and social aspects that reflect a mental health network where social media play diverse roles. Indirect implications of coping and self-control were found to supplement the network. Taken together, the themes and their implications to wellbeing make a valuable contribution to the evolving qualitative understanding young people's social media use in the UK (e.g., Conroy et al. 2023) and serve as a useful basis for future measure development.
 
A particular strength of the work was the engagement of three Young Researchers who co-facilitated the focus groups and were involved in the analysis. The research meets high reflexivity and transparency criteria, and the carefully constructed supplementary materials provide informative details especially for measure developers. Finally, the authors must be commended for sharing these valuable data for reuse.
 
The Stage 2 manuscript was reviewed over two rounds by three unique reviewers. The reviewers’ expertise ranged from social media and technology use research to health psychology and qualitative methods. Based on careful revisions and detailed responses to the reviewers’ comments, the recommender judged that the manuscript met the Stage 2 criteria and awarded a positive recommendation.
 
URL to the preregistered Stage 1 protocol: https://osf.io/w24ec
 
Level of bias control achieved: Level 2. At least some data/evidence had been accessed and partially observed by the authors prior to IPA, but the authors certify that they have not yet observed the key variables within the data that were used to answer the research question.
 
List of eligible PCI-RR-friendly journals: 
 
 
References
 
1. Borsboom, D. (2005). Measuring the mind: Conceptual issues in contemporary psychometrics. Cambridge University Press.
 
2. Conroy, D., Chadwick, D., Fullwood, C., & Lloyd, J. (2023). “You have to know how to live with it without getting to the addiction part”: British young adult experiences of smartphone overreliance and disconnectivity. Psychology of Popular Media, 12, 471-480. https://doi.org/10.1037/ppm0000425
 
3. Dunne, J. H., Black, L., Banwell, E., Nanda, P., Anderton, M, Butters, L.C., Demkowicz, O., Davies, J., Davidson, B., Qualter, P., Humphrey, N., Jay, C., & Panayiotou, M. (2024). Identifying relevant dimensions to the measurement of adolescent social media experience via focus groups with young people [Stage 2]. Acceptance of Version 9 by Peer Community in Registered Reports. https://doi.org/10.31234/osf.io/erjvz
 
4. Nisbett, R. E., & Wilson, T. D. (1977). Telling more than we can know: Verbal reports on mental processes. Psychological review, 84, 231-259. https://doi.org/10.1037/0033-295X.84.3.231
Identifying relevant dimensions to the measurement of social media experience via focus groups with young peopleJo Hickman Dunne, Louise Black, Molly Anderton, Pratyasha Nanda, Emily Banwell, Lily Corke Butters, Ola Demkowicz, Jade Davies, Brittany I Davidson, Pamela Qualter, Neil Humphrey, Caroline Jay, Margarita Panayiotou<p>While work on the relationship between social media use and adolescent mental health has allowed for some progress, research in this area is still relatively new and shows mixed evidence. This is partly the consequence of a rapidly changing fie...Social sciencesVeli-Matti Karhulahti2024-05-03 20:40:41 View