=============================================================================
IMPORTANT ANNOUNCEMENT: To accommodate reviewer and recommender holiday schedules, we will be closed to ALL submissions from 1st Jul - 1st Sep. During this time, reviewers can submit reviews and recommenders can issue decisions, but no new or revised submissions can be made by authors.
The one exception to this rule is that authors using the scheduled track who submit their initial Stage 1 snapshot prior to 1st Jul can choose a date within the shutdown period to submit their full Stage 1 manuscript.
We recommend that authors submit at least 1-2 weeks prior to commencement of the shutdown period to enable time to make any required revisions prior to in-depth review.
=============================================================================
We are recruiting recommenders (editors) from all research fields!
Your feedback matters! If you have authored or reviewed a Registered Report at Peer Community in Registered Reports, then please take 5 minutes to leave anonymous feedback about your experience, and view community ratings.
Latest recommendations
| Id | Title * | Authors * | Abstract * | Picture | Thematic fields * | Recommender▲ | Reviewers | Submission date | |
|---|---|---|---|---|---|---|---|---|---|
26 Jun 2024
STAGE 1
Do Scarcity-Related Cues Affect the Sustained Attentional Performance of the Poor and the Rich Differently?How does economic status moderate the effect of scarcity cues on attentional performance?Recommended by Matti Vuorre based on reviews by Ernst-Jan de Bruijn and Leon Hilbert
This Stage 1 registered report by Szecsi et al. (2024) seeks to clarify whether individuals' economic conditions moderate how scarcity cues affect their attentional performance. This idea has been previously explored: Here, the authors aim to clarify understanding of the how scarcity cues affect cognition by studying a large and diverse Hungarian sample with improved experimental methods.
Specifically, while it has been previously reported that financially less well-off individuals' are differentially affected by finance-related stimuli (e.g. Shah et al., 2018), Szecsi et al. (2024) argue that prior studies have used small samples with insufficient consideration of potentially important demographic variables. Therefore, the generalizability of prior studies might be lacking.
Second, Szecsi et al. (2024) aim to conduct a more realistic experiment by asking participants to free-associate in response to financial scarcity-related cues, whereas prior studies have often focused on simply querying for rating responses, which might not sufficiently engage the related cognitive mechanisms that could be most affected.
In the proposed study, then, the authors will rigorously test whether financially less well-off individuals have lower attentional performance while experiencing scarcity-related cues than individuals who are financially better off, and that attentional performance does not differ while experiencing non-scarcity related cues. Ultimately, Szecsi et al. propose to shed light on theories of scarcity-related cognition that posit overall decrements in attentional performance irrespective of individuals' financial status.
The Stage 1 manuscript was initially reviewed by two experts in the area, who both recommended several improvements to the study. The authors then thoroughly revised their write-up and protocol, and the two reviewers were satisfied with the substance of these revisions. Based on these evaluations, the recommender judged that the Stage 1 criteria were met and awarded in-principle acceptance. There were remaining editorial clarifications and suggestions which the authors can incorporate in their eventual Stage 2 report.
URL to the preregistered Stage 1 protocol: https://osf.io/3zdyb
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA. List of eligible PCI RR-friendly journals: References
1. Shah, A. K., Zhao, J., Mullainathan, S., & Shafir, E. (2018). Money in the mental lives of the poor. Social Cognition, 36, 4-19. https://doi.org/10.1521/soco.2018.36.1.4
2. Szecsi, P., Bognar, M., & Szaszi, B., (2024). Do Scarcity-Related Cues Affect the Sustained Attentional Performance of the Poor and the Rich Differently? In principle acceptance of Version 2 by Peer Community in Registered Reports. https://osf.io/3zdyb
| Do Scarcity-Related Cues Affect the Sustained Attentional Performance of the Poor and the Rich Differently? | Peter Szecsi, Miklos Bognar, Barnabas Szaszi | <p>Cues related to financial scarcity are commonly present in the daily environment shaping people’s mental lives. However, the results are mixed on whether such scarcity-related cues disproportionately deteriorate the cognitive performance of poo... | Social sciences | Matti Vuorre | Leon Hilbert, Ernst-Jan de Bruijn | 2024-01-18 14:29:03 | ||
28 Apr 2025
STAGE 1
Language models accurately infer correlations between psychological items and scales from text aloneUsing large language models to predict relationships among survey scales and items from textRecommended by Matti Vuorre based on reviews by Hu Chuan-Peng, Johannes Breuer and 1 anonymous reviewer
How are the thousands of existing, and yet to be created, psychological measurement instruments related, and how reliable are they? Hommel and Arslan (2024) have trained a language model--SurveyBot3000--to provide answers to these questions efficiently and without human intervention.
In their Stage 1 submission, the authors describe the training and pilot validation of a statistical model whose inputs are psychological measurement items or scales, and outputs are the interrelationships between the items, scales, and their reliabilities. The pilot results are promising: SurveyBot3000's predicted inter-scale correlations were extremely strongly associated with empirical correlations from existing human data.
The authors now plan for a further examination their model's performance and validity. They will collect novel test data across a large number of subjects, and again test the model's performance fully out of sample. Reviewers deemed these plans, and their associated planned analyses suitable. The anticipated results--along with already existing pilot results--promise a very useful methodological innovation to aid researchers in both selecting and evaluating existing measures, and developing and testing new measures.
The Stage 1 submission was reviewed twice by three reviewers each with expertise in the area. All reviewers identified the initial submission as timely and important, and suggested mostly editorial improvements that could be made to the Stage 1 report. After two rounds of review, the relatively minor remaining suggestions can be taken into account during preparation of the Stage 2 report.
URL to the preregistered Stage 1 protocol: https://osf.io/2c8hf
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA. List of eligible PCI RR-friendly journals:
References
Hommel, B. E., & Arslan, R. C. (2024). Language models accurately infer correlations between psychological items and scales from text alone. In principle acceptance of Version 4 by Peer Community in Registered Reports. https://osf.io/2c8hf
| Language models accurately infer correlations between psychological items and scales from text alone | Björn E. Hommel, Ruben C. Arslan | <p>Many behavioural scientists do not agree on core constructs and how they should be measured. Different literatures measure related constructs, but the connections are not always obvious to readers and meta-analysts. Many measures in behavioural... | Computer science, Social sciences | Matti Vuorre | Hu Chuan-Peng, Johannes Breuer, Anonymous | 2024-04-22 14:09:41 | ||
Language models accurately infer correlations between psychological items and scales from text aloneUsing large language models to predict relationships among survey scales and itemsRecommended by Matti Vuorre based on reviews by Hu Chuan-Peng, Johannes Breuer and Zak Hussain
How are the thousands of existing, and yet to be created, psychological measurement instruments related, and how reliable are they? Here, Hommel and Arslan (2025) trained a language model--SurveyBot3000--to provide answers to these questions efficiently and without human intervention.
In their Stage 1 submission, the authors described the training and pilot validation of a statistical model whose inputs are psychological measurement items or scales, and outputs are the interrelationships between the items and scales, and their reliabilities. The pilot results were promising: SurveyBot3000's predicted inter-scale correlations were strongly associated with empirical correlations from existing human data.
In this Stage 2 report, the authors further examined the model's performance and validity. In accordance with their Stage 1 plans, they collected new data from 450 demographically diverse participants, and tested the model's performance fully out of sample. The model's item-to-item correlations correlated at r=.59 with corresponding item-to-item correlations from human participants. The scale-to-scale correlations were even more accurate at r=.83, indicating reasonable performance. Nevertheless, the authors remain justifiably cautious in their recommendation that the "synthetic estimates can guide an investigation but need to be followed up by human researchers with human data."
The authors documented all deviations between Stage 2 execution and Stage 1 plans in extensive online supplements. These supplements also addressed other potential issues, such as the potential for data leakage (finding the results in the training data) and robustness of results across different exclusion criteria.
The authors' proposed psychometric approach and tool, which is freely available as an online app, could prove valuable for researchers either looking to use or adapt existing scales or items, or when developing new scales or items. More generally, these results add to the growing literature on human-AI research collaboration and highlight a practical application of these tools that remain novel to many researchers in the field. As such, this Stage 2 report and SurveyBot3000 promise to contribute positively to the field.
The Stage 2 report was evaluated by two reviewers who also reviewed the Stage 1 report, and a new expert in the field. On aggregate, the reviewers' comments were helpful but relatively minor; the authors improved their work in a resubmission, and the recommender judged accordingly that the manuscript met the Stage 2 criteria for recommendation.
URL to the preregistered Stage 1 protocol: https://osf.io/2c8hf
Level of bias control achieved: Level 6. No part of the data or evidence that was used to answer the research question was generated until after IPA. List of eligible PCI RR-friendly journals:
References
Hommel, B. E. & Arslan, R. C. (2025). Language models accurately infer correlations between psychological items and scales from text alone [Stage 2]. Acceptance of Version 4 by Peer Community in Registered Reports. https://doi.org/10.31234/osf.io/kjuce_v4 | Language models accurately infer correlations between psychological items and scales from text alone | Björn E. Hommel, Ruben C. Arslan | <p>Many behavioural scientists do not agree on core constructs and how they should be measured. Different literatures measure related constructs, but the connections are not always obvious to readers and meta-analysts. Many measures in behavioural... | Life Sciences, Social sciences | Matti Vuorre | 2025-02-03 16:05:59 | |||
18 May 2023
STAGE 1
A multilab investigation into the N2pc as an indicator of attentional selectivity: Direct replication of Eimer (1996)Is the N2pc a correlate of attentional selection? An #EEGManyLabs multi-lab registered replication of Eimer (1996)Recommended by Maxine Sherman based on reviews by Reny Baykova and Clayton Hickey
The N2pc is a lateralised ERP component that is often interpreted as a marker of attentional allocation, so much so that it is frequently used a tool in the attention literature for inferring that a stimulus was attentionally processed. This interpretation of N2pc can be traced back to the seminal work of Eimer (1996), which has been conceptually replicated many times but has never been replicated directly.
This registered direct replication by Constant et al. (2023) forms part of a larger series of large-scale, multi-lab replications of highly influential EEG papers by the #EEGManyLabs project (Pavlov et al., 2021). Seven labs (with the potential for more to sign up later), will conduct high-powered replications of the critical Experiment 2 of Eimer (1996), where in the crucial conditions, participants discriminate a target letter (M vs W) or colour (blue vs green) in the presence of a distractor. Using four preprocessing pipelines, including the original, the authors will test whether the N2pc is observed over parieto-occipital electrodes contralateral to target presentation.
The Stage 1 manuscript was evaluated over one round of in-depth review and one additional round of minor corrections. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
URL to the preregistered Stage 1 protocol: https://osf.io/dw68r
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA (so-called “primary RR”)
List of eligible PCI RR-friendly journals:
References
1. Constant, M., Mandal, A., Asanowicz, D., Yamaguchi, M., Gillmeister, H., Kerzel, D., Luque, D., Pesciarelli, F., Fehr, T., Mushtaq, F., Pavlov, Y. G. & Liesefeld, H. R. (2023). A multilab investigation into the N2pc as an indicator of attentional selectivity: Direct replication of Eimer (1996), in principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/dw68r
2. Eimer, M. (1996). The N2pc component as an indicator of attentional selectivity. Electroencephalography and Clinical Neurophysiology, 99, 225-234. https://doi.org/10.1016/0013-4694(96)95711-9
3. Pavlov, Y. G., Adamian, N., Appelhoff, S., Arvaneh, M., Benwell, C. S., Beste, C., ... & Mushtaq, F. (2021). #EEGManyLabs: Investigating the replicability of influential EEG experiments. Cortex, 144, 213-229. https://doi.org/10.1016/j.cortex.2021.03.013
| A multilab investigation into the N2pc as an indicator of attentional selectivity: Direct replication of Eimer (1996) | Martin Constant, Ananya Mandal, Dariusz Asanowicz, Motonori Yamaguchi, Helge Gillmeister, Dirk Kerzel, David Luque, Francesca Pesciarelli, Thorsten Fehr, Faisal Mushtaq, Yuri G. Pavlov, Heinrich R. Liesefeld | <p>The N2pc is widely employed as an electrophysiological marker of an attention allocation. This interpretation was in no small part driven by the observation of an N2pc elicited by an isolated relevant target object, which was reported as Experi... | Life Sciences, Social sciences | Maxine Sherman | 2023-02-24 11:41:52 | |||
07 Mar 2025
STAGE 1
On the neural substrates of mind wandering and dynamic thought: A drug and brain stimulation studyDoes dopamine availability influence the effect of brain stimulation on mind-wandering?Recommended by Maxine Sherman based on reviews by Chris Chambers, Jonathan Smallwood and 1 anonymous reviewer
Mind-wandering broadly refers to the phenomenon by which a person's thoughts are directed towards internally generated states as opposed to being directed towards those that are task-relevant. It has been proposed that mind-wandering and cognitive control are supported by overlapping neural systems. While neuroimaging work has implicated prefrontal cortex in both mind-wandering and cognitive control, studies testing its causal role using transcranial direct current stimulation (tDCS) have been inconclusive.
In this study, Rasmussen and colleagues will test whether the effects of prefrontal cortex tDCS on mind-wandering are mediated by dopaminergic availablility, which is known to be important for cognitive control. Using noninvasive brain stimuluation (prefrontal cortex tDCS vs sham) and a pharmacological intervention (levodopa vs. placebo), the authors will test for a causal role of both prefrontal cortex and dopamine availability in mind-wandering, and whether dopamine availability alters the effect of tDCS on mind-wandering.
The Stage 1 manuscript was evaluated over two rounds of in-depth review. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
URL to the preregistered Stage 1 protocol: https://osf.io/ujp7e
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA. List of eligible PCI RR-friendly journals: References
1. Rasmussen, T., Dux, P. E. & Filmer, H. (2024). On the neural substrates of mind wandering and dynamic thought: A drug and brain stimulation study. In principle acceptance of Version 2 by Peer Community in Registered Reports. https://osf.io/ujp7e
| On the neural substrates of mind wandering and dynamic thought: A drug and brain stimulation study | Tara Rasmussen, Paul E. Dux and Hannah Filmer | <p>The impact of mind wandering on our daily lives ranges from diminishing productivity, to facilitating creativity and problem solving. There is evidence that distinct internal thought types can be modulated by transcranial direct current stimula... | Life Sciences, Social sciences | Maxine Sherman | Anonymous, Chris Chambers, Jonathan Smallwood | 2023-11-08 05:11:42 | ||
On the neural substrates of mind wandering and dynamic thought: A drug and brain stimulation studyDoes dopamine availability influence the effect of brain stimulation on mind-wandering?Recommended by Maxine Sherman based on reviews by Chris Chambers and 1 anonymous reviewer
Mind-wandering broadly refers to the phenomenon by which a person's thoughts are directed towards internally generated states as opposed to being directed towards those that are task-relevant. It has been proposed that mind-wandering and cognitive control are supported by overlapping neural systems. While neuroimaging work has implicated prefrontal cortex in both mind-wandering and cognitive control, studies testing its causal role using transcranial direct current stimulation (tDCS) have been inconclusive.
Here, Rasmussen and colleagues (2025) put to a strict test the question of whether the effects of prefrontal cortex tDCS on mind-wandering are mediated by dopaminergic availablility, which is known to be important for cognitive control. Using noninvasive brain stimuluation (prefrontal cortex tDCS vs sham) and a pharmacological intervention (levodopa vs. placebo), they found that contrary to some previous work, stimulation of prefrontal cortex does not alter mind-wandering. By contrast, in the absence of stimulation, increasing dopamine availability via levodopa reduced the frequency of freely moving thought. Together, these results clarify the degree to which prefrontal cortex tDCS and dopamine play a causal role in mind-wandering
The Stage 2 manuscript was evaluated over one round of in-depth review. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 2 criteria and awarded a positive recommendation.
URL to the preregistered Stage 1 protocol: https://osf.io/ujp7e
Level of bias control achieved: Level 6. No part of the data or evidence that was used to answer the research question was generated until after IPA. List of eligible PCI RR-friendly journals: References
Rasmussen, T., Dux, P. E. & Filmer, H. (2025). On the neural substrates of mind wandering and dynamic thought: A drug and brain stimulation study [Stage 2]. Acceptance of Version 2 by Peer Community in Registered Reports. https://doi.org/10.1101/2024.11.02.620526
| On the neural substrates of mind wandering and dynamic thought: A drug and brain stimulation study | Tara Rasmussen, Paul E. Dux and Hannah Filmer | <p>The impact of mind wandering on our daily lives ranges from diminishing productivity, to facilitating creativity and problem solving. There is evidence that distinct internal thought types can be modulated by transcranial direct current stimula... | Life Sciences, Medical Sciences | Maxine Sherman | 2024-10-28 03:18:20 | |||
30 Jun 2023
STAGE 1
Justice in the Eye of the Beholder: How Comparison Framing Affects the Perception of Global Inequality Through Social Emotions and Justice SensitivityWhy are there variations in perceptions of inequality?Recommended by Moin Syed based on reviews by Mario Gollwitzer and Sa-Kiera Hudson
Inequalities in income, wealth, and opportunities are rampant both between and within nations around the world. Making strides to rectify inequalities requires examining how people come to understand them as well as the psychological processes that translate those understandings into reparative actions. There is some evidence for a “comparative framing effect,” in which the group that is initially referenced impacts judgements by communicating salient information and the appropriate reference point. Research on this comparative framing effect suggests that focusing on disadvantage, relative to advantage, leads to a more negative assessment and intentions to engage in action to reduce the inequality.
In two pilot studies (reported in the current proposal) focused on global inequalities (low-income vs high-income countries), Schnepf et al. (2023) did not find evidence for a main effect of framing on perceived legitimacy of the inequality or intentions to engage in action. They did, however, find some evidence for an interaction with the perceived size of the inequality. When the low-income country was the subject of the comparison, larger perceptions of the size of the inequality were associated with greater intentions to engage in action (both studies) and greater perceptions of the differences as illegitimate (Study 1 only). Moreover, they found some evidence in both studies that negative social emotions such as guilt and shame were the mechanism that explained why perceiving greater inequality in the low-income framing condition was associated with the outcomes.
In the current study, Schnepf et al. (2023) build upon these two pilot studies to conduct a high-quality replication and a stronger test of their hypotheses. Most notably, the proposed Registered Report uses a much larger sample, providing adequate statistical power to detect relatively small interaction effects. Additionally, the proposed project manipulates the size of the inequality that is being evaluated, rather than relying on participants’ perceptions. Finally, the study includes “justice sensitivity,” or the degree to which individuals assess inequality as unfair as an additional hypothesized moderator, and “social dominance orientation” as an exploratory moderator. Along with the pilot studies, the proposed project will represent a strong test of several hypotheses relevant to many different areas of social and personality psychology.
The Stage 1 manuscript was evaluated over two rounds of in-depth peer review, both of which consisted of substantial comments from two scholars with relevant expertise. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and was therefore awarded in-principle acceptance (IPA).
URL to the preregistered Stage 1 protocol: https://osf.io/pgyvw
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA. List of eligible PCI RR-friendly journals:
References
1. Schnepf, J., Reese, G., Bruckmüller, S., Braun, M., Rotzinger, J., & Martiny, S. E. (2023). Justice in the eye of the beholder: How comparison framing affects the perception of global inequality through social emotions and justice sensitivity. In principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/pgyvw
| Justice in the Eye of the Beholder: How Comparison Framing Affects the Perception of Global Inequality Through Social Emotions and Justice Sensitivity | Julia Schnepf, Gerhard Reese, Susanne Bruckmüller, Maike Braun, Julia Rotzinger, Sarah E. Martiny | <p>Global inequality is one of today’s major challenges. How people mentally represent inequality is often determined by its comparative framing. In the present work, we seek to analyze whether putting the focus of a comparison on the disadvantage... | Social sciences | Moin Syed | 2021-12-11 15:41:26 | |||
14 Nov 2023
STAGE 1
Scrolling to wisdom: the impact of social media news exposure on knowledge perceptionMight we know less about current events than we think we do?Recommended by Moin Syed based on reviews by Adrien Fillon, Erik Løhre and Moritz Ingendahl
We are bombarded with news about current events from multiple sources: print media, digital media, friends, family, and more. At the same time, there is an imperative to “stay informed” and be knowledgeable of happenings both local and global. But how much knowledge do we actually gain from this bombardment of information? How informed are we really? It turns out that our perceptions of our knowledge tends to overstate our actual knowledge of a topic. This “illusion of knowledge” effect has been studied across a wide variety of contexts, but is especially relevant for understanding how people learn about and interact with politicized topics.
In the current study, Ruzzante et al. (2023) propose to further our understanding of the illusion of knowledge effect in the context of news exposure on social media. They will use an online pre-post experimental design that assesses participants’ perceived knowledge of a number of topics prior to the manipulation, which involves exposure to different social media news feeds, coming two weeks later. Central to the study, participants will be randomized to news stories that differ in their degree of self-involvement, that is how emotionally involved the topics are. Ruzzante et al. will test the hypothesis that more highly self-involved topics (e.g., abortion) will lead to a greater illusion of knowledge effect than less self-involved topics (e.g., feline immunodeficiency).
The Stage 1 manuscript was evaluated over two rounds of in-depth peer review, the first consisting of substantial comments from three scholars with relevant expertise, and the second consisting of a close review by the recommender. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and was therefore awarded in-principle acceptance (IPA).
URL to the preregistered Stage 1 protocol: https://osf.io/qa7tb
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA. List of eligible PCI RR-friendly journals:
References
1. Ruzzante, F., Cevolani, G., & Panizza, F. (2023). Scrolling to wisdom: The impact of social media news exposure on knowledge perception. In principle acceptance of Version 5 by Peer Community in Registered Reports. https://osf.io/qa7tb
| Scrolling to wisdom: the impact of social media news exposure on knowledge perception | Federica Ruzzante, Gustavo Cevolani, Folco Panizza | <p>The present study aims to test the effect of exposure to news in a social media environment on people’s perceived knowledge of selected topics and on the “illusion of knowledge” effect, i.e., the overestimation of one’s perceived knowledge rela... | Social sciences | Moin Syed | 2022-10-12 21:16:51 | |||
19 Jun 2023
STAGE 1
Revisiting the “Belief in the law of small numbers”: Conceptual replication and extensions Registered Report of problems reviewed in Tversky and Kahneman (1971) [Stage 1]Should we believe in the “belief in the law of small numbers?”Recommended by Moin Syed based on reviews by Romain Espinosa and Kariyushi Rao
Probability and randomness are foundational statistical concepts used not only throughout the sciences, but also in our daily lives to guide our behavior and make sense of the world. Their importance and widespread use may suggest that they are easy concepts to understand, yet that seems not to be the case. A classic article by Tversky and Kahneman (1971) on the “belief in the law of small numbers” revealed that professional psychologists tended to incorrectly perceive a small sample that is randomly drawn from a population as representative of that population. This finding has been hugely influential, inspiring myriad subsequent studies into error and bias when reasoning about probability.
In the current study, Hong and Feldman (2023) propose a conceptual replication and extension of Tversky and Kahneman (1971). The original article was shockingly sparse on details regarding the method, sample, and findings, and, to our knowledge, has never been replicated. These facts are especially concerning given the foundational status that the article holds in the field. Hong and Feldman (2023) have developed a conceptual replication project, using the same approach and targeting the same claims from Tversky and Kahneman (1971), but modifying the wording of the stimuli for clarity and appropriateness for lay respondents. Although Tversky and Kahneman (1971) relied on professional psychologists as participants, many of their claims were not restricted to that population, but rather were generalized to all people—which is also how the findings have been subsequently applied. Thus, the change from professional to lay responders is entirely appropriate and the study will be diagnostic of the original claims.
Finally, Hong and Feldman (2023) extend the target study by manipulating the sample size indicated in the stimuli. Tversky and Kahneman (1971) relied on a single sample size in each scenario, leaving open the question as to how sample size might impact respondents’ reasoning. Accordingly, Hong and Feldman (2023) vary the sample size across the scenarios to determine whether participants answer differently as the sample size increases.
The Stage 1 manuscript was evaluated over two rounds of in-depth review, the first round consisting of detailed comments from two reviewers and the second round consisting of a close read by the recommender. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and was therefore awarded in-principle acceptance (IPA).
URL to the preregistered Stage 1 protocol: https://osf.io/fzbq7
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA. List of eligible PCI RR-friendly journals: References
1. Hong, C. K., & Feldman, G. (2023). Revisiting the “Belief in the law of small numbers”: Conceptual replication and extensions Registered Report of problems reviewed in Tversky and Kahneman (1971). In principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/fzbq7
2. Tversky, A., & Kahneman, D. (1971). Belief in the law of small numbers. Psychological Bulletin, 76(2), 105–110. https://doi.org/10.1037/h0031322
| Revisiting the “Belief in the law of small numbers”: Conceptual replication and extensions Registered Report of problems reviewed in Tversky and Kahneman (1971) [Stage 1] | Cheuk Kiu (Jeffery) HONG, Gilad FELDMAN | <p>This is a scheduled PCI-RR snap shot for a planned project: "Revisiting the “Belief in the law of small numbers”: Replication and extensions of problems reviewed in Tversky and Kahneman (1971)"</p> | Social sciences | Moin Syed | 2023-02-23 08:23:23 | |||
18 Jul 2023
STAGE 1
Test-Retest Reliability of the STRAQ-1: A Registered ReportA reliable measure of physical closeness in interpersonal relationships?Recommended by Moin Syed based on reviews by Jacek Buczny and Ian Hussey
Attachment and interpersonal relationships are a major subject of research and clinical work in psychology. There are, accordingly, a proliferation of measurement instruments to tap into these broad constructs. The emphasis in these measures tends to be on the emotional dimensions of the relationships—how people feel about their partners and the support that they receive. However, that is not all there is to relationship quality. Increasing attention has been paid to the physical and physiological aspects of relationships, but there are few psychometrically sound measures available to assess these dimensions.
In the current study, Dujols et al. (2023) seek to assess the psychometric properties of the Social Thermoregulation and Risk Avoidance Questionnaire (STRAQ-1), a measure of physical relationships that targets social thermoregulation, or how physical proximity is used to promote warmth and closeness. The proposed project will be a thorough assessment of the measure’s reliability over time—that is, the degree to which the measure assesses the construct similarly across administrations. The authors will assess the test-retest reliability and longitudinal measurement invariance of the STRAQ-1, providing much-needed psychometric data that can build confidence in the utility of the measure.
The Stage 1 manuscript was evaluated over two rounds of in-depth review, the first round consisting of detailed comments from two reviewers and the second round consisting of a close read by the recommender. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and was therefore awarded in-principle acceptance (IPA).
URL to the preregistered Stage 1 protocol: https://osf.io/pmnk2
Level of bias control achieved: Level 3. At least some data/evidence that will be used to the answer the research question has been previously accessed by the authors (e.g. downloaded or otherwise received), but the authors certify that they have not yet observed ANY part of the data/evidence List of eligible PCI RR-friendly journals: References
1. Dujols, O., Klein, R. A., Lindenberg, S., Van Lissa, C. J., & IJzerman, H. (2023). Test-Retest Reliability of the STRAQ-1: A Registered Report. In principle acceptance of Version 2 by Peer Community in Registered Reports. https://osf.io/pmnk2
| Test-Retest Reliability of the STRAQ-1: A Registered Report | Olivier Dujols; Richard A. Klein; Siegwart Lindenberg; Hans IJzerman | <p>This Registered Report provides the first test of measurement invariance across time points and estimates of test-retest reliability for the Social Thermoregulation, Risk Avoidance Questionnaire (STRAQ-1, Vergara et al., 2019). The scale was de... | Social sciences | Moin Syed | 2023-03-01 16:07:17 |
