Announcements
We are recruiting recommenders (editors) from all research fields!
Your feedback matters! If you have authored or reviewed a Registered Report at Peer Community in Registered Reports, then please take 5 minutes to leave anonymous feedback about your experience, and view community ratings.
259 records found
Latest recommendations
Id | Title * | Authors * ▼ | Abstract * | Picture | Thematic fields * | Recommender | Reviewers | Submission date | |
---|---|---|---|---|---|---|---|---|---|
30 May 2024
STAGE 1
![]() Does learning more about others impact liking them?: Replication and extension Registered Report of Norton et al. (2007)’s Lure of AmbiguityZöe Horsham, Ashleigh Haydock-Symonds, Hirotaka Imada, Hiu Ching Tai, Wing Lam Lau, Tsz Lui Shum, Yuqing Zeng, Hiu Tang Chow, Gilad Feldman https://osf.io/eygzpDoes familiarity really breed contempt?Recommended by Yuki YamadaIn interpersonal evaluation, the amount of information available about the other person has a significant impact. Norton et al. (2007) conducted systematic experiments suggesting a 'less is more' effect – that a lack of information leads to a more positive evaluation. However, subsequent studies have not always reached the same conclusion.
In the current study, Horsham et al. (2024) aim to address this issue by conducting direct and conceptual replications of the Norton et al. (2007) experiments, as well as additional extensive experiments focusing on the effects of curiosity. The authors seek to confirm in a reliable way the relationship between ambiguity and liking, and even to clarify the factors that mediate this relationship. The results should significantly advance our understanding of the importance of information management in interpersonal relationships.
The Stage 1 manuscript was peer-reviewed by two experts; after four rounds of review and based on their revisions and detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and awarded it in-principle acceptance (IPA).
URL to the preregistered Stage 1 protocol: https://osf.io/7mc4y
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA. List of eligible PCI RR-friendly journals:
References
1. Norton, M. I., Frost, J. H., & Ariely, D. (2007). Less is more: The lure of ambiguity, or why familiarity breeds contempt. Journal of Personality and Social Psychology, 92, 97-105. https://doi.org/10.1037/0022-3514.92.1.97
2. Horsham, Z., Haydock-Symonds, A., Imada, H., Tai, H. C., Lau, W. L., Shum, T. L., Zeng, Y., Chow, H. T., & Feldman, G., (2024). Does learning more about others impact liking them? Replication and extension Registered Report of Norton et al. (2007)’s Lure of Ambiguity. In principle acceptance of Version 4 by Peer Community in Registered Reports. https://osf.io/7mc4y
| Does learning more about others impact liking them?: Replication and extension Registered Report of Norton et al. (2007)’s Lure of Ambiguity | Zöe Horsham, Ashleigh Haydock-Symonds, Hirotaka Imada, Hiu Ching Tai, Wing Lam Lau, Tsz Lui Shum, Yuqing Zeng, Hiu Tang Chow, Gilad Feldman | <p>[IMPORTANT: Abstract, method, and results were written using a randomized dataset produced by Qualtrics to simulate what these sections will look like after data collection. These will be updated following the data collection. For the purpose o... | Social sciences | Yuki Yamada | Zoltan Kekecs | 2023-07-11 12:33:00 | View | |
07 May 2024
STAGE 1
![]() Revisiting the Psychology of Waste: Replication and extensions Registered Report of Arkes (1996)Zijin Zhu, Gilad Feldman https://osf.io/xcthsWhen do perceptions of wastefulness affect how people make choices?Recommended by Douglas MarkantHow do perceptions of wastefulness affect how people make choices? In an influential set of studies examining different conceptions of wasteful behavior (overspending, underutilization, and sunk costs), Arkes (1996) found a systematic aversion to wastefulness in decision making, even when choosing to avoid wastefulness has no economic value or works against personal interest. While these findings have been influential in basic and applied research, there have been no attempts to directly replicate the results. Moreover, the original study has several methodological limitations, including the use of relatively small samples and gaps in statistical analysis and reporting.
In this Stage 1 manuscript, Zhu and Feldman (2024) propose to conduct a high-powered replication of Arkes (1996) using an online sample of participants. The authors will incorporate several extensions to improve methodological rigor relative to the original article, including added comprehension checks, checks of the wastefulness manipulations, a within-subjects design, and a quantitative analysis of participants’ self-reported motivations for their choices. The results of the study will provide insight into the robustness of the original findings, while also better distinguishing wastefulness aversion from other potential reasons behind participants' decisions.
The Stage 1 submission was evaluated by the recommender and two expert reviewers. After two rounds of revision, the recommender determined that the manuscript met the Stage 1 criteria and awarded in-principle acceptance (IPA).
URL to the preregistered Stage 1 protocol: https://osf.io/r7tsw
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA. List of eligible PCI RR-friendly journals:
References
1. Arkes, H. R. (1996). The psychology of waste. Journal of Behavioral Decision Making, 9,
213-224. https://doi.org/10.1002/(SICI)1099-0771(199609)9:3%3C213::AID-BDM230%3E3.0.CO;2-1 2. Zhu, Z. & Feldman, G. (2024). Revisiting the Psychology of Waste: Replication and extensions Registered Report of Arkes (1996). In principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/r7tsw
| Revisiting the Psychology of Waste: Replication and extensions Registered Report of Arkes (1996) | Zijin Zhu, Gilad Feldman | <p>[IMPORTANT: Abstract, method, and results were written using a randomized dataset produced by Qualtrics to simulate what these sections will look like after data collection. These will be updated following the data collection. For the purpose o... | Social sciences | Douglas Markant | 2024-01-11 06:55:16 | View | ||
Revisiting the Psychology of Waste: Replication and extensions Registered Report of Arkes (1996)Zijin Zhu, Gilad Feldman https://osf.io/2jnc8When do perceptions of wastefulness affect how people make choices?Recommended by Douglas MarkantWhen does the perceived wastefulness of different actions affect people's choices? In an influential set of studies examining different conceptions of wastefulness (overspending, underutilization, and sunk costs), Arkes (1996) found a systematic aversion to wastefulness in decision making, even when choosing to avoid wastefulness has no economic value or works against personal interest. While these findings have been influential in basic and applied research, there have been no attempts to directly replicate the results. Moreover, the original study had several methodological limitations, including the use of relatively small samples and critical gaps in statistical reporting and analyses.
In the current study, Zhu and Feldman (2024) conducted a high-powered replication of Arkes (1996) using an online sample of participants (N=659). The authors incorporated several extentions to improve the methodological rigor relative to the original article, including comprehension checks, manipulation checks, a within-subjects design, and a novel quantitative analysis of participants' self-reported motivations for their choices. The authors successfully replicated the effect of perceived wastefulness on two of the three scenarios used in the original article, but participants' self-reported reasons for their choices only provided partial support for the role of perceived wastefulness in decisions, with behavioral consistency and maximizing economic value also playing a role. The original effect was not observed in a third scenario, with a failed manipulation check that may indicate changes in the perceptions of wastefulness in the domain (tax preparation). Overall, the results provide some support for the role of wastefulness aversion in decision making, while also showing that perceived wastefulness might be outweighted by other considerations depending on how people interpret or reason about a situation.
The Stage 2 manuscript was evaluated over one round of in-depth review by the recommender and two expert reviewers. Following revision, the recommender judged that the manuscript met the Stage 2 criteria and awarded a positive recommendation.
URL to the preregistered Stage 1 protocol: https://osf.io/r7tsw
Level of bias control achieved: Level 6. No part of the data or evidence that was used to answer the research question was generated until after IPA. List of eligible PCI RR-friendly journals:
References
1. Arkes, H. R. (1996). The psychology of waste. Journal of Behavioral Decision Making, 9,
213-224. https://doi.org/10.1002/(SICI)1099-0771(199609)9:3%3C213::AID-BDM230%3E3.0.CO;2-1 2. Zhu, Z. and Feldman, G. (2024). Revisiting the Psychology of Waste: Replication and extensions Registered Report of Arkes (1996) [Stage 2]. Acceptance of Version 5 by Peer Community in Registered Reports. https://osf.io/2jnc8
| Revisiting the Psychology of Waste: Replication and extensions Registered Report of Arkes (1996) | Zijin Zhu, Gilad Feldman | <p>Arkes (1996) demonstrated a phenomenon of wastefulness avoidance, showing that people’s decisions are impacted by wastefulness, making decisions that avoid appearing wasteful. In a Registered Report with a Prolific sample (N = 659), we conducte... | Social sciences | Douglas Markant | 2024-06-04 19:00:58 | View | ||
Action interpretation determines the effects of go/no-go and approach/avoidance actions on food choiceZhang Chen, Pieter Van Dessel, Jordi Serverius, Daxun Zhu, Bernd Figner https://osf.io/preprints/psyarxiv/6xhw4_v2Does interpretation of actions as either avoid or inhibit influence choice behaviour for candy?Recommended by Andrew Jones based on reviews by Alexander MacLellan and Katrijn HoubenExperimental research demonstrates that executing or inhibiting motor responses (or approaching / avoiding) towards a stimulus can alter the valuation of the stimulus (Yang et al., 2022). There are competing theories as to the proposed mechanisms of value change, such as increased response conflict or prediction errors (Houben & Aulbach, 2023). However, research has mostly examined response execution/inhibition and approach/avoidance in isolation and the few studies that have examined these together have focused on stimulus evaluation as an outcome.
In the current study Chen et al. (2025) set out to examine how action interpretations (e.g. go vs approach) can impact individuals food-choices. This is important for cognitive bias modification approaches which aim to manipulate these actions to promote behaviour change (Iannazzo et al., 2024; Veling et al., 2021), but also theoretical accounts which suggest certain motor-responses acquire valence. Here there are two groups randomised to receive instructions to either go/no-go or approach/avoid images of candy in novel training task (Chen et al., 2019).
The results of the experiment suggested that despite both groups making the same responses (pressing a space bar vs not), the framing of the response as go vs approach and no-go vs avoidance influenced subsequent food-choice (i.e. responses framed as approach increased the probability of choosing approach items over avoidance items, but not go items over no-go items). As the authors state, these findings cast doubt on theoretical models which suggest there are ‘hardwired’ links between specific go/approach responses and appetitive systems or specific no-go/avoidance responses and aversive systems. They also suggest these responses aren’t valenced, but acquire valence through interpretation of the action. These findings can also inform future studies into cognitive bias modification. The Stage 2 manuscript was evaluated over two rounds of in-depth review by two reviewers with expertise in the relevant area, who also assessed the Stage 1 manuscript. Based on the authors’ careful responses and revisions, the revised manuscript was judged to meet the Stage 2 criteria and was awarded a positive recommendation. URL to the preregistered Stage 1 protocol: https://osf.io/bn5xa
Level of bias control achieved: Level 6. No part of the data or evidence that was used to answer the research question was generated until after IPA. List of eligible PCI RR-friendly journals:
References
1. Chen, Z., Van Dessel, P., Serverius, J., Zhu, D. & Figner, B. (2025). Action interpretation determines the effects of go/no-go and approach/avoidance actions on food choice. Acceptance of Version 2 by Peer Community in Registered Reports. https://doi.org/10.31234/osf.io/6xhw4_v2
2. Chen, Z., & Van Dessel, P. (2024). Action Interpretation Determines the Effects of Go/No-Go and Approach/Avoidance Actions on Stimulus Evaluation. Open Mind, 8, 898–923. https://doi.org/10.1162/opmi_a_00151
3. Houben, K. and Aulbach, M. (2023). Is there a difference between stopping and avoiding? A review of the mechanisms underlying Go/No-Go and Approach-Avoidance training for food choice. Current Opinion in Behavioral Sciences, 49, 101245. https://doi.org/10.1016/j.cobeha.2022.101245
4. Iannazzo, L. H., Hayden, M. J., Lawrence, N. S., Kakoschke, N., Hughes, L. K., Van Egmond, K., … Staiger, P. K. (2024). Inhibitory control training to reduce appetitive behaviour: a meta-analytic investigation of effectiveness, potential moderators, and underlying mechanisms of change. Health Psychology Review, 1–31. https://doi.org/10.1080/17437199.2024.2410018 5. Veling, H., Verpaalen, I. A. M., Liu, H., Mosannenzadeh, F., Becker, D., & Holland, R. W. (2021). How can food choice best be trained? Approach-avoidance versus go/no-go training. Appetite, 163, 105226. https://doi.org/10.1016/j.appet.2021.105226 6. Yang, Y., Qi, L., Morys, F., Wu, Q. & Chen, H. (2022). Food-Specific Inhibition Training for Food Devaluation: A Meta-Analysis. Nutrients, 14, 1363. https://doi.org/10.3390/nu14071363
| Action interpretation determines the effects of go/no-go and approach/avoidance actions on food choice | Zhang Chen, Pieter Van Dessel, Jordi Serverius, Daxun Zhu, Bernd Figner | <p>Executing go/no-go and approach/avoidance responses toward objects can increase people's choices of go over no-go items, and of approach over avoidance items. Some theoretical accounts explain these effects as the results of merely executing th... | Social sciences | Andrew Jones | 2024-11-24 11:21:55 | View | ||
30 Sep 2024
STAGE 1
![]() Examining the role of action interpretation in changes in choice induced by go/no-go and approach/avoidance responsesZhang Chen, Pieter Van Dessel, Bernd Figner https://osf.io/bn5xaDoes interpretation of actions as either avoid or inhibit influence choice behaviour for candy?Recommended by Andrew Jones based on reviews by Alexander MacLellan and Katrijn HoubenExperimental research demonstrates that executing or inhibiting motor responses (or approaching / avoiding) towards a stimulus can alter the valuation of the stimulus (Yang et al., 2022). There are competing theories as to the proposed mechanisms of value change, such as increased response conflict or prediction errors (Houben & Aulbach, 2023). However, research has mostly examined response execution/inhibition and approach/avoidance in isolation and the few studies that have examined these together have focused on stimulus evaluation as an outcome.
In the present study, Chen et al. (2024) will use a novel version of a combined go/no-go / approach avoidance paradigm to test the effects on choice of consumable candy. In this task, participants are randomly assigned to make a response framed as a go / no-go action or an approach / avoidance action to control a shopping cart (Chen & Van Dessel, 2024). Following this they will complete a food choice task in which participants make a series of binary choices for different candies. Their performance on this task will lead to the receipt of real-world candy. The authors aim to test whether the same responses will lead to different effects on food choice, depending on how the response was interpreted (e.g. participants in the approach/avoidance instruction group will select Approach items more often than those in the go/no-go instruction group). The study is well powered to detect the proposed effect size of interest, and data will be analysed using Bayesian mixed-effect models. This study will shed light onto theoretical predictions of action interpretation on stimulus value and choice, which may improve the efficacy of behaviour change tools such as approach bias training in future. The Stage 1 manuscript was evaluated over two rounds of in-depth review. Based on detailed responses to the recommender and reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
URL to the preregistered Stage 1 protocol: https://osf.io/bn5xa
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.
List of eligible PCI RR-friendly journals:
References
1. Chen, Z. and Van Dessel, P. (2024). Action interpretation determines the effects of go/no-go and approach/avoidance actions on stimulus evaluation. Open Mind, 8, 898-923. https://doi.org/10.1162/opmi_a_00151 2. Chen, Z., Van Dessel, P., and Figner, B. (2024). Examining the role of action interpretation in changes in choice induced by go/no-go and approach/avoidance responses. In principle acceptance of Version 2 by Peer Community in Registered Reports. https://osf.io/bn5xa
3. Houben, K. and Aulbach, M. (2023). Is there a difference between stopping and avoiding? A review of the mechanisms underlying Go/No-Go and Approach-Avoidance training for food choice. Current Opinion in Behavioral Sciences, 49, 101245. https://doi.org/10.1016/j.cobeha.2022.101245 4. Yang, Y., Qi, L., Morys, F., Wu, Q. and Chen, H. (2022). Food-Specific Inhibition Training for Food Devaluation: A Meta-Analysis. Nutrients, 14, 1363. https://doi.org/10.3390/nu14071363 | Examining the role of action interpretation in changes in choice induced by go/no-go and approach/avoidance responses | Zhang Chen, Pieter Van Dessel, Bernd Figner | <p>Executing go/no-go (GNG) and approach/avoidance (AAT) responses toward objects can increase people’s choices for go over no-go items, and for approach over avoidance items. Some theoretical accounts explain these effects as the results of merel... | Social sciences | Andrew Jones | Alexander MacLellan, Katrijn Houben | 2024-06-17 17:57:07 | View | |
Globally, songs and instrumental melodies are slower, higher, and use more stable pitches than speech [Stage 2 Registered Report]Yuto Ozaki, Adam Tierney, Peter Pfordresher, John Mcbride, Emmanouil Benetos, Polina Proutskova, Gakuto Chiba, Fang Liu, Nori Jacoby, Suzanne Purdy, Patricia Opondo, Tecumseh Fitch, Shantala Hegde, Martín Rocamora, Rob Thorne, Florence Ewomazino Nweke, Dhwani Sadaphal, Parimal Sadaphal, Shafagh Hadavi, Shinya Fujii, Sangbuem Choo, Marin Naruse, Utae Ehara, Latyr Sy, Mark Lenini Parselelo, Manuel Anglada-Tort, Niels Chr. Hansen, Felix Haiduk, Ulvhild Færøvik, Violeta Magalhães, Wojciech Krzyżanow... https://doi.org/10.31234/osf.io/jr9x7Strong evidence for cross-cultural regularities in music and speechRecommended by Chris ChambersFor centuries, the ubiquity of language and music across human societies has prompted scholars to speculate about their cross-cultural origins as well as their shared and unique characteristics. Depending on the extent to which contemporary theories emphasise the role of biology vs. culture, a range of hypotheses have been proposed concerning expected similarities and differences in song and speech. One class of hypotheses stemming from cultural relativism assumes a lack of universal regularities in song and speech, and therefore predicts no systematic cross-cultural relationships. On the other hand, more recent evolutionary hypotheses such as the social bonding hypothesis, motor constraint hypothesis, and sexual selection hypothesis all predict differences or similarities in specific characteristic of vocalisations, such as pitch regularity, pitch interval size, and melodic contour. Existing results are mixed in their support of these predictions.
In the current study, Ozaki et al. (2023) elucidated cross-cultural similarities and differences between speech and song in 75 different linguistic varieties spanning 21 language families. Understanding precisely how song and speech are related is methodologically challenging due to the multitude of confounds that can arise in comparing natural recordings. Here the authors overcame these difficulties with four types of carefully controlled recordings: singing, recitation of sung lyrics, spoken description of the song, and instrumental version of the sung melody. The authors then examined six features that are amenable to reliable comparison, including pitch height, temporal rate, pitch stability, timbral brightness, pitch interval size, and pitch declination. With this data in hand, the authors asked which acoustic features differ reliably between song and speech across cultures, with the expectation that song would exhibit higher pitch, slower rate and more stable pitch than speech. At the same time, the authors expected song and speech to be reliably similar in the characteristics of timbral brightness, pitch intervals and pitch contours
The findings provided strong support for the preregistered hypotheses. Relative to speech, songs exhibited higher pitch, slower temporal rate, and more stable pitches, while both songs and speech had similar pitch interval size and timbral brightness. Only one hypothesis was unsupported, with the comparison of pitch declination between song and speech turning out inconclusive. To overcome potential sources of analytic bias, the authors undertook additional robustness checks, including reanalysis of a previously published dataset of over 400 song/speech recordings; this exploratory analysis corroborated the conclusions from the confirmatory analysis. Overall this study offers a unique insight into the shared global characteristics of langage and music, with implications for understanding their cultural and biological (co)evolution.
The Stage 2 manuscript was evaluated over one round of in-depth review. Based on responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 2 criteria and therefore awarded a positive recommendation.
URL to the preregistered Stage 1 protocol: https://osf.io/jdhtz
Level of bias control achieved: Level 2. At least some data/evidence that was used to answer the research question had been accessed and partially observed by the authors, but the authors certify that they had not yet observed the key variables within the data that were be used to answer the research question AND they took additional steps to maximise bias control and rigour.
List of eligible PCI RR-friendly journals: References
1. Ozaki, Y. et al. (2023). Globally, songs and instrumental melodies are slower, higher, and use more stable pitches than speech [Stage 2 Registered Report]. Acceptance of Version 11 by Peer Community in Registered Reports. https://doi.org/10.31234/osf.io/jr9x7
| Globally, songs and instrumental melodies are slower, higher, and use more stable pitches than speech [Stage 2 Registered Report] | Yuto Ozaki, Adam Tierney, Peter Pfordresher, John Mcbride, Emmanouil Benetos, Polina Proutskova, Gakuto Chiba, Fang Liu, Nori Jacoby, Suzanne Purdy, Patricia Opondo, Tecumseh Fitch, Shantala Hegde, Martín Rocamora, Rob Thorne, Florence Ewomazino N... | <p>What, if any, similarities and differences between music and speech are consistent across cultures? Both music and language are found in all known human societies and are argued to share evolutionary roots and cognitive resources, yet no studie... | Humanities, Social sciences | Chris Chambers | 2023-05-16 17:22:17 | View | ||
07 Dec 2023
STAGE 1
![]() Is conscious perception necessary to direct attention? A replication of Jiang et al. (2006)Yung-Jung Chen, Ryan B Scott, Zoltan Dienes https://osf.io/preprints/psyarxiv/jwgv3/Can sexually salient stimuli direct attention outside of conscious awareness?Recommended by Reshanne ReederAre attention and consciousness inherently intertwined or distinct aspects of cognition? One report (Jiang et al. 2006) presented clear results in evidence of the latter. In this earlier study, the authors used a continuous flash suppression (CFS) paradigm which presents a colorful pattern to the dominant eye and stimuli of interest to the non-dominant eye; the colorful pattern masks the relevant stimulus from awareness. On each trial, the authors presented a sexually stimulating image and a scrambled image on different sides of a computer screen during CFS. They found that, even though participants were not consciously aware of the images, intact images that matched participants' sexual orientation could still capture attention.
Despite these seemingly clear results, the authors of the current Stage 1 manuscript pointed out that CFS studies are often not replicated, and the paper by Jiang et al. (2006) is no exception. Therefore, Chen et al. (2023) seek to replicate this study using a Bayesian (rather than NHST) analytic approach. This method will allow the authors to determine the strength of evidence for their hypotheses.
In this Stage 1 manuscript, Chen et al. present an introduction that motivates the replication, and a pilot study that replicated the procedure of Jiang et al. (2006) conducted with 21 participants. This led to a well-motivated statistical sampling plan and some small design changes for the main experiment, such as adding a staircasing procedure to remove potential performance ceiling effects, and using less extreme wording for stimulus attractiveness ratings. A clear study design template is presented, detailing the different hypotheses that will be tested, and what different outcomes would indicate.
The Stage 1 submission was evaluated by the recommender and two expert reviewers. Following revisions, the recommender judged that the manuscript met the Stage 1 criteria and awarded in-principle acceptance (IPA).
URL to the preregistered Stage 1 protocol: https://osf.io/b2ncp
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.
List of eligible PCI RR-friendly journals:
References 1. Jiang, Y., Costello, P., Fang, F., Huang, M., & He, S. (2006). A gender-and sexual orientation-dependent spatial attentional effect of invisible images. Proceedings of the National Academy of Sciences, 103, 17048-17052. https://doi.org/10.1073/pnas.0605678103
2. Chen, Y.-J., Scott, R.B., & Dienes, Z. (2023). Is conscious perception necessary to direct attention? A replication of Jiang et al. (2006). In principle acceptance of Version 2 by Peer Community in Registered Reports. https://osf.io/b2ncp
| Is conscious perception necessary to direct attention? A replication of Jiang et al. (2006) | Yung-Jung Chen, Ryan B Scott, Zoltan Dienes | <p>The relationship between attention and consciousness has been debated for the past few decades. Observing attentional biases induced by visual stimuli below conscious threshold is one way of providing evidence for the independence of attention ... | Social sciences | Reshanne Reeder | 2023-10-11 22:02:33 | View | ||
07 Apr 2023
STAGE 1
![]() The WEIRD problem in a “non-WEIRD” context: A meta-research on the representativeness of human subjects in Chinese psychological researchYUE Lei, ZUO Xi-Nian, HU Chuan-Peng https://osf.io/dkmt3/How well do "non-WEIRD" participants in multi-lab studies represent their local population?Recommended by Yuki YamadaIn this protocol, Yue et al. (2023) aim to clarify whether the sample of non-WEIRD countries included in multi-lab studies is actually representative of those countries and cultures. Focusing on China, this study will compare Chinese samples in several multi-lab studies with participants in studies published in leading national Chinese journals on various aspects, including demographic data and geographic information. This work will provide useful information on the extent to which multi-lab studies are able to deal with generalizability, especially as they intend to address the generalizability problem.
The Stage 1 manuscript was reviewed by three experts, including two with an interest in the WEIRD problem and a wealth of experience in open science and multi-lab research, plus an expert in Bayesian statistics, which this manuscript uses. Following multilpe rounds of peer review, and based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
URL to the preregistered Stage 1 protocol: https://osf.io/ehw54 Level of bias control achieved: Level 4. At least some of the data/evidence that will be used to answer the research question already exists AND is accessible in principle to the authors (e.g. residing in a public database or with a colleague) BUT the authors certify that they have not yet accessed any part of that data/evidence.
List of eligible PCI RR-friendly journals:
References
Yue, L., Zuo, X.-N., & Hu, C.-P. (2023) The WEIRD problem in a “non-WEIRD” context: A meta-research on the representativeness of human subjects in Chinese psychological research, in principle acceptance of Version 7 by Peer Community in Registered Reports. https://osf.io/ehw54 | The WEIRD problem in a “non-WEIRD” context: A meta-research on the representativeness of human subjects in Chinese psychological research | YUE Lei, ZUO Xi-Nian, HU Chuan-Peng | <p><strong></strong><strong>Psychological science aims at understanding human mind and behavior, but it primarily relies on subjects from Western, Educated, Industrialized, Rich, and Democratic regions, i.e., the WEIRD problem. This lack of d... | Social sciences | Yuki Yamada | Zoltan Dienes | 2021-09-07 11:25:52 | View | |
11 Apr 2024
STAGE 1
![]() Do pain and effort increase prosocial contributions?: Revisiting the Martyrdom Effect with a Replication and extensions Registered Report of Olivola and Shafir (2013)Yim Tung (Emanuel) Cheng, Gilad Feldman https://osf.io/7njh8More pain, more prosocial? Assessing the Martyrdom EffectRecommended by Rima-Maria RahalThe Martyrdom Effect is a behavioral tendency in which individuals exhibit greater generosity when their acts of giving entail effort or self-sacrifice (Olivola & Shafir, 2013). Giving at a personal cost, in this mindset, is associated with ascribing and inferring more meaning and value to charitable giving or other forms of generosity than in instances where no particular pain or effort is required to enact prosocial behavior. Arguably, the Martyrdom Effect’s ability to boost prosocial behavior therefore departs from other theories of behavior change postulating that easy options to act prosocially could boost contributions (e.g., default effects in charitable giving, see Altmann et al., 2019; Goswami & Urminsky, 2016). Because they introduce complexity to the debate about encouraging prosocial behavior, three studies from Olivola and Shafir (2013) are now being addressed in this Registered Report by Cheng and Feldman (2024).
Combining these three studies in a high-powered within-subjects replication attempt, transparently communicating necessary deviations from the original design and carefully outlining the analysis strategy, the current study will offer insights into the robustness of prior findings on the role of effort and pain in determining donations. The Stage 1 manuscript was evaluated by two reviewers and the recommender. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA). URL to the preregistered Stage 1 protocol: https://osf.io/aq89u
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.
List of eligible PCI RR-friendly journals:
References
1. Altmann, S., Falk, A., Heidhues, P., Jayaraman, R., & Teirlinck, M. (2019). Defaults and Donations: Evidence from a Field Experiment. The Review of Economics and Statistics, 101, 808-826. https://doi.org/10.1162/rest_a_00774
2. Cheng, Y. T. & Feldman, G. (2024). Do pain and effort increase prosocial contributions?: Revisiting the Martyrdom Effect with a Replication and extensions Registered Report of Olivola and Shafir (2013). In principle acceptance of Version 2 by Peer Community in Registered Reports. https://osf.io/aq89u
3. Goswami, I., & Urminsky, O. (2016). When should the Ask be a Nudge? The Effect of Default Amounts on Charitable Donations. Journal of Marketing Research, 53, 829-846. https://doi.org/10.1509/jmr.15.0001
4. Olivola, C. Y., & Shafir, E. (2013). The Martyrdom Effect: When Pain and Effort Increase Prosocial Contributions. Journal of Behavioral Decision Making, 26, 91-105. https://doi.org/10.1002/bdm.767
| Do pain and effort increase prosocial contributions?: Revisiting the Martyrdom Effect with a Replication and extensions Registered Report of Olivola and Shafir (2013) | Yim Tung (Emanuel) Cheng, Gilad Feldman | <p>[IMPORTANT: Abstract, method, and results were written using a randomized dataset produced by Qualtrics to simulate what these sections will look like after data collection. These will be updated following the data collection. For the purpose o... | Social sciences | Rima-Maria Rahal | Vanessa Clemens, Liesbeth Mann | 2023-11-30 12:32:25 | View | |
11 Jun 2024
STAGE 1
![]() The effects of memory distrust toward commission and omission on recollection-belief correspondence and memory errorsYikang Zhang, Henry Otgaar, Robert A. Nash, Chunlin Li https://osf.io/gf6tpManipulating what is believed about what is rememberedRecommended by Zoltan DienesWe may not believe what our memory tells us: Memory may deliver a compelling recollection we believe did not happen (we know we were not there at the time); and we may know an event happened that we fail to remember (even for when we were not drunk!). That is, there can be distrust in remembering and distrust in forgetting. Previous work by the authors has looked at this through a signal detection lens, reporting in separate studies that people who have distrust in remembering have either a high or low criterion for saying "old" (Zhang et al, 2023, 2024a). A plausible explanation for these contrasting results is that the criterion can either be the means by which false memories are generated enabling the distrust (low criterion); or rather, in conditions where accuracy is at stake, the means for compensating for the distrust (high criterion).
In the current study by Zhang et al (2024b), participants will be incentivised to be as accurate as possible, and in a memory test given feedback about commission errors or, in another group, ommission errors. As a manipulation check, the authors will test that the feedback increases distrust in remembering or distrust in forgetting, respectively, compared to a no feedback control group. Crucially, the authors hypothesize that people will adjust the criterion to say "old" in a compensatory way in each group. The study uses inference by intervals to provide a fairly severe test of this hypothesis.
The Stage 1 manuscript was evaluated over multiple rounds of in-depth review. Based on detailed responses to the reviewers' and recommender's comments, the recommender judged that the manuscript met the Stage 1 criteria and awarded in-principle acceptance (IPA).
URL to the preregistered Stage 1 protocol: https://osf.io/x69qt
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA. List of eligible PCI RR-friendly journals:
References
1. Zhang, Y., Qi, F., Otgaar, H., Nash, R. A., & Jelicic, M. (2023). A Tale of Two Distrusts: Memory Distrust towards Commission and Omission Errors in the Chinese Context. Journal of Applied Research in Memory and Cognition. https://doi.org/10.1037/mac0000134
2. Zhang, Y., Otgaar, H., Nash, R. A., & Rosar, L. (2024). Time and memory distrust shape the dynamics of recollection and belief-in-occurrence. Memory, 32, 484–501. https://doi.org/10.1080/09658211.2024.2336166
3. Zhang, Y., Otgaar, H., Nash, R. A., & Li, C. (2024b). The effects of memory distrust toward commission and omission on recollection-belief correspondence and memory errors. In principle acceptance of Version 5 by Peer Community in Registered Reports. https://osf.io/x69qt
| The effects of memory distrust toward commission and omission on recollection-belief correspondence and memory errors | Yikang Zhang, Henry Otgaar, Robert A. Nash, Chunlin Li | <p>Our appraisals and beliefs about our memory functioning shape how we reconstruct and report specific memory episodes. Research has shown that people differ in the extent to which they are skeptical about their memories, which is termed memory d... | Social sciences | Zoltan Dienes | 2023-09-21 09:08:32 | View |
FOLLOW US
MANAGING BOARD
Chris Chambers
Zoltan Dienes
Corina Logan
Benoit Pujol
Maanasa Raghavan
Emily S Sena
Yuki Yamada