Submit a report

Announcements

Please note that we will be CLOSED to ALL SUBMISSIONS from 1 December 2024 through 12 January 2025 to give our recommenders and reviewers a holiday break.

We are recruiting recommenders (editors) from all research fields!

Your feedback matters! If you have authored or reviewed a Registered Report at Peer Community in Registered Reports, then please take 5 minutes to leave anonymous feedback about your experience, and view community ratings.

Latest recommendationsrssmastodon

IdTitle * Authors * Abstract * PictureThematic fields * RecommenderReviewersSubmission date
17 Jan 2024
STAGE 1

Revisiting the Effects of Helper Intention on Gratitude and Indebtedness: Replication and extensions Registered Report of Tsang (2006)

Grateful or indebted? Revisiting the role of helper intention in gratitude and indebtedness

Recommended by based on reviews by Jo-Ann Tsang, Sarahanne Miranda Field and Cong Peng
When receiving a favour, we may feel grateful and/or indebted to those who have helped us. What factors determine how much gratitude and indebtedness people experience? In a seminal paper, Tsang (2006) found that people reported feeling more gratitude when the helper's intention was benevolent (e.g., helping others out of genuine concerns for other people) compared to when the helper's intention was perceived to be selfish (e.g., helping others for selfish reasons). In contrast, indebtedness was not influenced by perceived helper intention. This finding highlighted the different processes underlying gratitude and indebtedness, and also inspired later work on how these two emotions may have different downstream influences, for instance on interpersonal relationships.

So far, there has been no published direct replication of this seminal work by Tsang (2006). In the current study, Chan et al. (2024) propose to revisit the effects of helper intention on gratitude and indebtedness, by replicating and extending the original studies (Study 2 & 3) by Tsang (2006). Participants will be asked to either recall (Study 2) or read (Study 3) a scenario in which another person helped them with either benevolent or selfish intentions, and rate how much gratitude and indebtedness they would experience in such situations. The authors predict that in line with the original findings, gratitude will be more influenced by helper intention than indebtedness. To further extend the original findings, the authors will also assess people's perceived expectations for reciprocity, and their intention to reciprocate. These extensions will shed further light on how helper intention may influence beneficiaries’ experiences of gratitude and indebtedness, and their subsequent tendencies to reciprocate.

This Stage 1 manuscript was evaluated over two rounds of in-depth review by three expert reviewers and the recommender. After the revisions, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
 
URL to the preregistered Stage 1 protocol: https://osf.io/uyfvq
 
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA. 
 
List of eligible PCI RR-friendly journals:
 
 
References

1. Tsang, J.-A. (2006). The effects of helper intention on gratitude and indebtedness. Motivation and Emotion, 30, 199–205. https://doi.org/10.1007/s11031-006-9031-z

2. Chan, C. F., Lim, H. C., Lau, F. Y., Ip, W., Lui, C. F. S., Tam, K. Y. Y., & Feldman, G. (2024). Revisiting the Effects of Helper Intention on Gratitude and Indebtedness: Replication and extensions Registered Report of Tsang (2006). In principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/uyfvq
Revisiting the Effects of Helper Intention on Gratitude and Indebtedness: Replication and extensions Registered Report of Tsang (2006)Chi Fung Chan, Hiu Ching Lim, Fung Yee Lau, Wing Ip, Chak Fong Shannon Lui, Katy Y. Y. Tam, Gilad Feldman<p>[IMPORTANT: Abstract, method, and results were written using a randomized dataset produced by Qualtrics to simulate what these sections will look like after data collection. These will be updated following the data collection. For the purpose o...Social sciencesZhang Chen2023-01-12 09:34:50 View
23 Mar 2023
STAGE 2
(Go to stage 1)

Revisiting the links between numeracy and decision making: Replication Registered Report of Peters et al. (2006) with an extension examining confidence

Assessing the replicability of specific links between numeracy and decision-making

Recommended by ORCID_LOGO based on reviews by Elena Rusconi
Numeracy – the ability to understand and work with numbers – is associated with a wide range of social and health-related outcomes, including socioeconomic status, employment, literacy, reasoning, and life satisfaction. A substantial body of evidence has also shown links between numeracy and decision-making, prompting the question of how it relates to finer-grained measures of reasoning, judgment and affect/emotion.
 
In the current study, Zhu and Feldman repeated four influential experiments from a study by Peters et al. (2006), which reported links between numeracy and performance on a variety of decision-making tasks, including attribute framing, frequency-percentage framing, susceptibility to affective influences, and various cognitive biases. The authors also explored several extended questions, including refinements of the original hypotheses and an examination of the relationship between numeracy and confidence in numeric judgments (subjective numeracy).
 
The results broadly constitute a successful replication, with higher numeracy associated with weaker attribute framing and susceptibility to bias. The relationship between numeracy and the frequency-percentage framing effect – that is, the change in decision-making when numbers are presented as frequencies (e.g. 5 out of 100) rather than percentages (e.g. 5%) – was inconclusive for the main analysis that treated numeracy as a categorical variable (low vs. high); however the link emerged reliably in exploratory analyses that considered numeracy as a continuous variable. The outcomes of the extended analyses were mixed, revealing evidence for a potentially weak relationship between numeracy and confidence.
 
The Stage 2 manuscript was evaluated over one round of in-depth review. Based on detailed responses to the reviewer's comments, the recommender judged that the manuscript met the Stage 2 criteria and awarded a positive recommendation.
 
URL to the preregistered Stage 1 protocol: https://osf.io/r73fb
 
Level of bias control achieved: Level 6. No part of the data or evidence that was used to answer the research question was generated until after IPA. 
 
List of eligible PCI RR-friendly journals:
 
 
References
 
1. Zhu, M. & Feldman, G. (2022). Revisiting the links between numeracy and decision making: Replication Registered Report of Peters et al. (2006) with an extension examining confidence. Acceptance of Version 5 by Peer Community in Registered Reports. https://osf.io/62wqb
 
2. Peters, E., Västfjäll, D., Slovic, P., Mertz, C. K., Mazzocco, K., & Dickert, S. (2006). Numeracy and decision making. Psychological Science, 17, 407-413. https://doi.org/10.1111%2Fj.1467-9280.2006.01720.x
Revisiting the links between numeracy and decision making: Replication Registered Report of Peters et al. (2006) with an extension examining confidenceMinrui Zhu, Gilad Feldman<p>Numeracy is individuals’ capacity to understand and process basic probability and numerical information required to make decisions. We conducted a Replication Registered Report of Peters et al. (2006) examining numeracy as a predictor of positi...Social sciencesChris Chambers2023-01-16 10:34:09 View
11 Apr 2023
STAGE 1

The link between Empathy and Forgiveness: Replication and extensions of McCullough et al. (1997)'s Study 1

Is empathy important for forgiveness?

Recommended by ORCID_LOGO based on reviews by Wenrui Cao, James Bartlett and Saleh Shuqair
Forgiveness is a core feature of human psychology in which a person makes a deliberate decision to cease negative emotions or attitudes toward an offender who has done them harm. The concept of interpersonal forgiveness is deeply embedded across societies, but much remains to be understood about how it actually works. What are its key ingredients and why does it occur in the first place? Research in social psychology has demonstrated a range of personal and social benefits of forgiveness, giving rise to two dominant mechanistic accounts – one that positions empathy as the driving factor and another that centres motivated reasoning (Donovan & Priester, 2017).
 
In the current study, Chan and Feldman (2023) seek to replicate a formative study by McCullough et al (1997) that led to the so-called Empathy Model of forgiveness. According to this theory, forgiving is a motivational change facilitated (crucially) by empathy, promoting constructive over destructive behaviour toward the offender. Chan and Feldman will replicate Study 1 from McCullough et al., measuring the correlational relationship between apology, forgiving, and empathy for offenders, and exploring whether forgiving is associated with increased conciliation and decreased avoidance motivation. As well as closely replicating the original study, the authors will extend it to test the more severe hypothesis that empathy causally influences forgiveness. To achieve this, they will experimentally manipulate empathy by adding two groups to the design: one in which participants are asked to recall hurtful past experiences in which they were not empathetic to the offender, and another in which they were highly empathetic.
 
The Stage 1 manuscript was evaluated over two rounds of in-depth review. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
 
URL to the preregistered Stage 1 protocol: https://osf.io/q78fs
 
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA. 
 
List of eligible PCI RR-friendly journals:
 
References
 
1. Donovan, L. A. N., & Priester, J. R. (2017). Exploring the psychological processes underlying interpersonal forgiveness: The superiority of motivated reasoning over empathy. Journal of Experimental Social Psychology, 71, 16-30. https://doi.org/10.1016/j.jesp.2017.02.005
 
2. Chan, C. F. & Feldman, G. (2023). The link between Empathy and Forgiveness: Replication and extensions of McCullough et al. (1997)'s Study 1, in principle acceptance of Version 2 by Peer Community in Registered Reports. https://osf.io/q78fs
The link between Empathy and Forgiveness: Replication and extensions of McCullough et al. (1997)'s Study 1Chan Chi Fung, Gilad Feldman <p>[IMPORTANT: Abstract, method, and results were written using a randomized dataset produced by Qualtrics to simulate what these sections will look like after data collection. These will be updated following the data collection. For the purpose o...Social sciencesChris Chambers Wenrui Cao, James Bartlett2023-01-25 11:15:13 View
24 Sep 2023
STAGE 1

Sensorimotor Effects in Surprise Word Memory – a Registered Report

Evaluating adaptive and attentional accounts of sensorimotor effects in word recognition memory

Recommended by ORCID_LOGO based on reviews by Gordon Feld and Adam Osth
Words have served as stimuli in memory experiments for over a century. What makes some words stand out in memory compared to others? One plausible answer is that semantically rich words are more distinctive and therefore exhibit a mirror effect in recognition memory experiments where they are likely to be correctly endorsed and also less likely to be confused with other words (Glanzer & Adams, 1985). Semantic richness can arise due to extensive prior experience with the word in multiple contexts but can also arise due to sensorimotor grounding, i.e., direct perceptual and action-based experience with the concepts represented by the words (e.g. pillow, cuddle). However, previous experiments have revealed inconsistent recognition memory performance patterns for words based on different types of sensorimotor grounding (Dymarska et al., 2023). Most surprisingly, body-related words such as cuddle and fitness exhibited greater false alarm rates. 

In the current study, Dymarska and Connell (2023) propose to test two competing theories that can explain the increased confusability of body-related words: 1) the adaptive account - contextual elaboration-based strategies activate other concepts related to body and survival, increasing confusability; and 2) the attentional account - somatic attentional mechanisms automatically induce similar tactile and interoceptive experiences upon seeing body-related words leading to less distinctive memory traces. The adaptive account leads to different predictions under intentional and incidental memory conditions. Specifically, contextual elaboration strategies are unlikely to be employed when participants do not expect a memory test and therefore in an incidental memory task, body-related words should not lead to inflated false alarm rates (see Hintzman (2011) for a discussion on incidental memory tasks and the importance of how material is processed during memory tasks). However, the attentional account is not dependent on the task instructions or the knowledge about an upcoming memory test. 

Here, Dymarska and Connell (2023) have designed an incidental recognition memory experiment with over 5000 words, disguised as a lexical decision task using carefully matched pseudowords during the encoding phase. The sample size will be determined by using a sequential hypothesis testing plan with Bayes Factors. To test the predictions of the adaptive and attentional accounts, the authors derive a set of lexical and sensorimotor variables (including a body-component) after dimensionality reduction of a comprehensive set of lexical and semantic word features. The analysis will involve running both Bayesian and frequentist hierarchical linear regression to explain four different measures of recognition memory performance based on the key sensorimotor variables and other baseline/confounding variables. While this analysis plan enables a comparison with the earlier results from an expected memory test (Dymarska et al., 2023), the current study is self-contained in that it is possible to distinguish the adaptive and attentional accounts based on the effect of body component scores on hit rate and false alarm rate.

The study plan was refined across two rounds of review, with input from two external reviewers after which the recommender judged that the study satisfied the Stage 1 criteria for in-principle acceptance (IPA).
 
URL to the preregistered Stage 1 protocol: https://osf.io/ck5bg
 
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.
 
List of eligible PCI RR-friendly journals:
 
References
 
Dymarska, A. & Connell, L. (2023). Sensorimotor Effects in Surprise Word Memory – a Registered Report. In principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/ck5bg

Dymarska, A., Connell, L. & Banks, B. (2023). More is Not Necessarily Better: How Different Aspects of Sensorimotor Experience Affect Recognition Memory for Words. Journal of Experimental Psychology: Language, Memory, Cognition. Advance online publication. https://dx.doi.org/10.1037/xlm0001265 

Glanzer, M., & Adams, J. K. (1985). The mirror effect in recognition memory. Memory & cognition, 13, 8-20.

Hintzman, D. L. (2011). Research strategy in the study of memory: Fads, fallacies, and the search for the “coordinates of truth”. Perspectives on Psychological Science, 6(3), 253-271.
Sensorimotor Effects in Surprise Word Memory – a Registered ReportAgata Dymarska, Louise Connell<p>Sensorimotor grounding of semantic information elicits inconsistent effects on word memory, depending on which type of experience is involved, with some aspects of sensorimotor information facilitating memory performance while others inhibit it...Social sciencesVishnu Sreekumar2023-01-31 15:21:17 View
25 Jun 2023
STAGE 1

Reference points and decision-making: Impact of status quo and defaults in a conceptual replication and extensions Registered Report of Dinner et al. (2011)

Understanding the impact of status quo bias and the default effect on decision-making

Recommended by ORCID_LOGO based on reviews by Laurens van Gestel, Julia Nolte and Sylvain Chabé-Ferret
Everyday decisions can often be biased by how different options are presented and which choices were made previously, over and above whichever option is rationally preferable. Two such major biases in judgment and decision-masking are status quo bias and the default effect. The status quo bias reflects a tendency for people to choose an option that has already been implemented or represents the current state of affairs (for instance, choosing to remain with a current energy supplier rather than switching to a different one, even when the current supplier provides less value for money), while the default effect is a bias toward taking a course of action that would occur automatically in the absence of an active choice (such as the pre-selected energy supplier in questionnaire). Status quo bias and default effects can overlap or diverge: the status quo option will often be the same as the default, while on other occasions the default option in a choice set will be determined by other factors and differ from the option that was already implemented.
 
In the current study, Yam and Feldman (2023) propose a replication and extension of an influential study by Dinner et al. (2011) that purported to examine default effects but, arguably, actually studied its nearby cousin, status quo bias. Using a large online sample, the authors will independently test for the existence of both status quo bias and the default effect, before then asking whether (and if so how) status quo bias and default effects interact and how they are related to several potential explanatory variables, including perceived effort (which may be lower for the status quo or default) and endorsements (whether through direct recommendations or indirectly through perceived norms). The authors also build in additional manipulation checks and comprehension checks, in addition to exploratory analyses examining (among other variables), the political orientation of participants.
 
The Stage 1 manuscript was evaluated over two rounds of in-depth review. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
 
URL to the preregistered Stage 1 protocol: https://osf.io/ep3jh
 
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.
 
List of eligible PCI RR-friendly journals:
 
References
 
1. Dinner, I., Johnson, E. J., Goldstein, D. G., & Liu, K. (2011). Partitioning default effects: Why people choose not to choose. Journal of Experimental Psychology: Applied, 17, 332– 341. https://doi.org/10.1037/a0024354

2. Yam, M. L. M.  & Feldman, G. (2023). Reference points and decision-making: Impact of status quo and defaults in a conceptual replication and extensions Registered Report of Dinner et al. (2011), in principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/ep3jh
Reference points and decision-making: Impact of status quo and defaults in a conceptual replication and extensions Registered Report of Dinner et al. (2011)Monique Moon Ling YAM, Gilad Feldman <p>This is a scheduled PCI-RR snap shot for a planned project: "Default, status quo, and past behavior effects: Examining impact of reference points on decisions in a replication and extensions of Dinner et al. (2011)"</p>Social sciencesChris Chambers2023-02-02 06:02:29 View
15 Jun 2023
STAGE 1

Revisiting the impact of affection on insurance purchase and claim decision-making: Replication and extensions Registered Report of Hsee and Kunreuther (2000)

Understanding how object-oriented emotional attachment influences economic response to loss

Recommended by ORCID_LOGO based on reviews by Bence Palfi, Rima-Maria Rahal and Fausto Gonzalez
Emotion is a well-established mediator of decision-making, including prospective economic decisions, but does it affect the way we respond economically to loss? According to classic economic theories, when an object is lost and cannot be recovered, our emotional attachment to that object should be irrelevant for decisions such as choosing whether to claim insurance or compensation. Intriguingly, however, this does not appear to be the case: in a series of experiments, Hsee and Kunreuther (2000) found that when people have higher affection towards an object, they are more sensitive to its loss and are more willing to claim compensation or purchase insurance for the object. They explained these findings according to an influential “consolation hypothesis” in which people see insurance compensation as means to mitigate against the emotional distress associated with property loss.
 
Using a large online sample (N=1000), Law and Feldman (2023) propose to replicate four of six studies from Hsee and Kunreuther (2000), each asking (primarily) whether people with higher affection towards an object are more willing to claim compensation or purchase insurance for that object. In each experiment, participants are randomly assigned to either a high affection group or a low affection group and then given a scenario in which the level of affection to an object is correspondingly manipulated while the monetary value is held constant. For example, for high affection: “You liked the now-damaged painting very much and you fell in love with it at first sight. Although you paid only $100, it was worth a lot more to you”, and for low affection: “You were not particularly crazy about the now-damaged painting. You paid $100 for it, and that’s about how much you think it was worth.” A range of dependent measures are then collected, including the maximum hours participants would be willing to spend driving to claim compensation, the maximum amount participants would be willing to pay for insurance, and how likely participants would be to claim compensation or purchase insurance. As part of the replication, the authors have also built in manipulation checks to confirm that the scenarios influenced participants' (imagined) level of affection for the object, and a range of exploratory analyses.
 
The Stage 1 manuscript was evaluated over two rounds of in-depth review. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
 
URL to the preregistered Stage 1 protocol: https://osf.io/b7y5z
 
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.
 
List of eligible PCI RR-friendly journals:
 
 
References
 
1. Hsee, C. K., & Kunreuther, H. C. (2000). The affection effect in insurance decisions. Journal of Risk and Uncertainty, 20, 141-159. https://doi.org/10.1023/A:1007876907268

2. Law, Y. Y. & Feldman, G. (2023). Revisiting the impact of affection on insurance purchase and claim decision-making: Replication and extensions Registered Report of Hsee and Kunreuther (2000), in principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/b7y5z
Revisiting the impact of affection on insurance purchase and claim decision-making: Replication and extensions Registered Report of Hsee and Kunreuther (2000)Yan Yi (Veronica) Law, Gilad Feldman<p>This is a scheduled PCI-RR snap shot for a planned project: "Revisiting the impact of affection on insurance purchase and claim decision-making: Replication and extensions of Hsee and Kunreuther (2000)"</p>Social sciencesChris Chambers2023-02-02 11:02:51 View
23 Mar 2023
STAGE 2
(Go to stage 1)

Revisiting the role of public exposure and moral beliefs on feelings of shame and guilt: Replication Registered Report of Smith et al. (2002)’s Study 1

The effect of public exposure and moral beliefs on feelings of shame and guilt

Recommended by ORCID_LOGO based on reviews by Uriel Haran
Shame and guilt are powerful negative emotions that are notable for their external vs. internal focus: while shame is generally experienced in response to public scrutiny, guilt arises from a self-directed, private evaluation. In a formative study, Smith et al. (2002) asked whether the level of public exposure influenced levels of shame and guilt arising from one's transgressions, and found that, compared to private situations, public exposure was more strongly associated with shame than with guilt. Since then, these findings have had significant implications for theories and applications of moral psychology.
 
In the current study, Zhang et al. (2023) directly replicated Smith et al. (2002) in a large online sample, revisiting two critical questions from Study 1: (a) whether public exposure affects the magnitude of shame and guilt over one’s misconduct, and (b) whether stronger moral belief increases guilt and shame over one’s misconduct. The results fail to confirm the original conclusions: both public exposure and manipulation of moral beliefs were found to influence shame and guilt, with no reliable evidence that shame was influenced more strongly than guilt. These findings thus constitute a non-replication and offer a challenge to theoretical models that hinge on the separability of shame and guilt as separate constructs.
 
The Stage 2 manuscript was evaluated over one round of in-depth review. Based on detailed responses to the reviewer's comments, the recommender judged that the manuscript met the Stage 2 criteria and awarded a positive recommendation.
 
URL to the preregistered Stage 1 protocol: https://osf.io/j7kt2
 
Level of bias control achieved: Level 6. No part of the data or evidence that was used to answer the research question was generated until after IPA. 
 
List of eligible PCI RR-friendly journals:
 
References
 
1. Smith, R. H., Webster, J. M., Parrott, W. G., & Eyre, H. L. (2002). The role of public exposure in moral and nonmoral shame and guilt. Journal of Personality and Social Psychology, 83, 138-159. https://doi.apa.org/doi/10.1037/0022-3514.83.1.138
 
2. Zhang, Y., Cheung, F. C., Wong, H.T., Yuen, L. Y., Sin, H. C., Chow, H. T. & Feldman, G. (2023). Revisiting the role of public exposure and moral beliefs on feelings of shame and guilt: Replication Registered Report of Smith et al. (2002)’s Study 1. Acceptance of Version 5 by Peer Community in Registered Reports. https://osf.io/jpx87
Revisiting the role of public exposure and moral beliefs on feelings of shame and guilt: Replication Registered Report of Smith et al. (2002)’s Study 1 Yikang Zhang, Fung Chit (Jack) Cheung, Hei Tung (Patrina) Wong, Lok Yee (Noel) Yuen, Hui Ching (Rachel) Sin, Hiu Tung Kristy Chow, Gilad Feldman<p>Shame and guilt are unpleasant self-conscious emotions associated with negative evaluations of oneself or one’s behavior. Smith et al. (2002) demonstrated that shame and guilt are distinct and are impacted differently by public exposure, that i...Social sciencesChris Chambers2023-02-03 10:58:20 View
14 Apr 2023
STAGE 1

Can playing Dungeons and Dragons be good for you? A registered exploratory pilot program using offline Tabletop Role-Playing Games (TTRPGs) to mitigate social anxiety and reduce problematic involvement in multiplayer online videogames

Expanding the Intervention Potential of Tabletop Role-Playing Games

Recommended by ORCID_LOGO based on reviews by Charlotte Pennington, Matúš Adamkovič and Matti Vuorre
The human capacity and need for play has been recognized as a central psychotherapeutic component for a long time (e.g. Winnicott 1971). More recently, experts have started developing specialized digital gameplay to be used as therapeutic tools and even utilizing existing videogames for similar purposes (see Ceranoglu 2010). On the other hand, the concerns about some players becoming overinvolved in videogames also led the World Health Organization to include “gaming disorder” in the 11th edition of the International Classification of Diseases, which echoes the nuance required to address human-technology relationships in general.  
 
In the present registered report, Billieux et al. (2023) make use of analog structured role-play in a new intervention aiming to mitigate social anxiety and problematic gaming patterns in online gamers. The authors carry out an exploratory pilot to test a 10-week protocol over three modules inspired by the well-known Dungeons & Dragons franchise. Through multiple single-case design, the authors explore the feasibility of the intervention and its effectiveness on social skills, self-esteem, loneliness, assertiveness, and gaming disorder symptoms.
 
The Stage 1 manuscript was evaluated over two rounds by three experts with experimental specializations in psychopathology and gaming. Based on the comprehensive responses to the reviewers' feedback, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
 
URL to the preregistered Stage 1 protocol: https://osf.io/h7qat

Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.
 
List of eligible PCI RR-friendly journals
 
 
References
 
1. Billieux  J., Bloch J., Rochat L., Fournier L., Georgieva I., Eben C., Andersen M. M., King D. L., Simon O., Khazaal Y. & Lieberoth A. (2023). Can playing Dungeons and Dragons be good for you? A registered exploratory pilot program using offline Tabletop Role-Playing Games (TTRPGs) to mitigate social anxiety and reduce problematic involvement in multiplayer online videogames. In principle acceptance of Version 2 by Peer Community in Registered Reports. https://osf.io/h7qat
 
2. Ceranoglu, T. (2010). Video Games in Psychotherapy. Review of General Psychology, 14 (2). https://doi.org/10.1037/a0019439
 
3. Winnicott, D. (1971/2009). Playing and Reality. Routledge.
Can playing Dungeons and Dragons be good for you? A registered exploratory pilot program using offline Tabletop Role-Playing Games (TTRPGs) to mitigate social anxiety and reduce problematic involvement in multiplayer online videogamesJoël Billieux, Jonathan Bloch, Lucien Rochat, Loïs Fournier, Iliyana Georgieva, Charlotte Eben, Marc Malmdorf Andersen, Daniel Luke King, Olivier Simon, Yasser Khazaal, Andreas Lieberoth<p><strong>Background</strong>. Gamers with poor self-concept, high social anxiety, and high loneliness are more at risk of problematic involvement in videogames and particularly in massively multiplayer online role-playing games (MMORPGs) than ot...Social sciencesVeli-Matti Karhulahti Matti Vuorre, Matúš Adamkovič, Charlotte Pennington2023-02-06 11:09:55 View
11 Sep 2023
STAGE 1

Researcher Predictions of Effect Generalizability Across Global Samples

Can psychology researchers predict which effects will generalise across cultures?

Recommended by ORCID_LOGO based on reviews by Michèle Nuijten, Ian Hussey, Jim Grange and Matthias Stefan
Compared to the wealth of debate surrounding replicability and transparency, relatively little attention has been paid to the issue of generalisability – the extent to which research findings hold across different samples, cultures, and other parameters. Existing research suggests that researchers in psychology are prone to generalisation bias, relying on narrow samples (e.g. drawn predominantly from US or European undergraduate samples) to draw broad conclusions about the mind and behaviour. While recent attempts to address generalisability concerns have been made – such as journals requiring explicit statements acknowledging constraints on generality – addressing this bias at root, and developing truly generalisable methods and results, requires a deeper understanding of how researchers perceive generalisability in the first place.
 
In the current study, Schmidt et al. (2023) tackle the issue of cross-cultural generalisability using four large-scale international studies that are being conducted as part of the Psychological Science Accelerator (PSA) – a globally distributed network of researchers in psychology that coordinates crowdsourced research projects across six continents. Specifically, participants (who will be PSA research members) will estimate the probability that an expected focal effect will be observed both overall and within regional subsamples of the PSA studies. They will also predict the size of these focal effects overall and by region.
 
Using this methodology, the authors plan to ask two main questions: first whether researchers can accurately predict the generalisability of psychological phenomena in upcoming studies, and second whether certain researcher characteristics (including various measures of expertise, experience, and demographics) are associated with the accuracy of generalisability predictions. Based on previous evidence that scientists can successfully predict the outcomes of research studies, the authors expect to observe a positive association between predicted and actual outcomes and effect sizes. In secondary analyses, the authors will also test if researchers can predict when variables that capture relevant cultural differences will moderate the focal effects – if so, this would suggest that at least some researchers have a deeper understanding as to why the effects generalise (or not) across cultural contexts.
 
The Stage 1 manuscript was evaluated over two rounds of in-depth review. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
 
URL to the preregistered Stage 1 protocol: https://osf.io/vwqsa (under temporary private embargo)
 
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.
 
List of eligible PCI RR-friendly journals:
 
 
References
 
1. Schmidt, K., Silverstein, P. & Chartier, C. R. (2023). Registered Report: Researcher Predictions of Effect Generalizability Across Global Samples. In principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/vwqsa
Researcher Predictions of Effect Generalizability Across Global SamplesKathleen Schmidt, Priya Silverstein, & Christopher R. Chartier<p>The generalizability of effects is an increasing concern among researchers in psychological science. Traditionally, the field has relied on university samples from Europe and North America to make claims about humans writ large. The proposed re...Social sciencesChris Chambers2023-02-16 03:49:35 View
13 May 2023
STAGE 2
(Go to stage 1)

Personal factors and group creativity characteristics: A correlational meta-analysis

Which personal factors are associated with group creativity?

Recommended by ORCID_LOGO

What determines whether groups of people can come up with ideas that are both original and useful? Since the 1960s, this question has been intensively studied with the help of more or less structured group creativity activities such as brainstorming or creative problem solving, with subsequent rating of the generated ideas.

In this line of research, personal factors—such as personality traits, and other interindividual differences in emotion and cognition—have received substantial attention as potential correlates of creative outcomes of group activities. This has spawned a sprawling literature that, to date, has not yet been synthesized. Thus, empirical findings in this literature, which are also sometimes contradictory, have not yet been well-integrated.

In the present study, Fillon et al. (2022) conducted the first meta-analysis of correlations between personal factors and group creativity outcomes. The authors searched and synthesized the existing published literature according to predetermined criteria to (1) assess the overall relationship between a broad list of personal factors and creativity outcomes in group settings and (2) explore potential moderators of these relationships. 

In total, 11 studies could be included in the meta-analysis. They provided weak support for a positive correlation between self-efficacy and the three investigated group creative outcomes, number of ideas, originality of ideas, and usefulness of ideas. With respect to moderators, many of the planned analyses could not be conducted due to the low number of studies. The only finding that arose was weak evidence for the idea that time constraint moderates associations: relationships between personal factors and group creativity outcomes were slightly stronger for tasks limited to 20 minutes rather than 10 minutes. Statistical power overall was low across studies.

The authors conclude their meta-analysis with the observation that the available data on the topic are very limited. They suggest that to improve our knowledge of the topic, future studies should adhere to standardized creativity methods and protocols and implement expert ratings of creativity. They also call for increasing the availability of raw data in this field of study to improve the accumulation of knowledge about links between personal factors and the creative performance of groups.

The Stage 2 manuscript was evaluated over one round of in-depth review provided by the recommender and Chris Chambers, as the original reviewers were no longer available. Based on additional changes to the manuscript, the recommender judged that the manuscript met the Stage 2 criteria and awarded a positive recommendation.

 
URL to the preregistered Stage 1 protocol: https://osf.io/nybg6
 
Level of bias control achieved: Level 3. At least some data/evidence that was used to answer the research question had been previously accessed by the authors (e.g. downloaded or otherwise received), but the authors certified that had not yet observed ANY part of the data/evidence prior to IPA.
 
List of eligible PCI RR-friendly journals:
 

 

References

1. Fillon, A. A., Girandola, F., Bonnardel, N., Kenworth, J. B. & Souchet, L. (2023). Personal factors and group creativity characteristics: A correlational meta-analysis, acceptance of Version 2 by Peer Community in Registered Reports. https://psyarxiv.com/4br6a/

Personal factors and group creativity characteristics: A correlational meta-analysisAdrien Alejandro Fillon; Fabien Girandola, Nathalie Bonnardel, Jared Kenworthy, Lionel Souchet<p>Previous research has investigated the relationship between personal factors and group creativity outcomes. On one side, they indicated that individual differences play a role in group creativity. On the other side, they showed that group creat...Social sciencesJulia M. Rohrer2023-02-21 12:41:02 View