Announcements
We are recruiting recommenders (editors) from all research fields!
Your feedback matters! If you have authored or reviewed a Registered Report at Peer Community in Registered Reports, then please take 5 minutes to leave anonymous feedback about your experience, and view community ratings.
279 records found
Latest recommendations
Id | Title * ▲ | Authors * | Abstract * | Picture | Thematic fields * | Recommender | Reviewers | Submission date | |
---|---|---|---|---|---|---|---|---|---|
Stage 2 Registered Report: Stress regulation via being in nature and social support in adults, a meta-analysisAlessandro Sparacio, Ivan Ropovik, Gabriela M. Jiga-Boy, Adar Cem Lağap, Hans IJzerman https://doi.org/10.31234/osf.io/a4zmjDoes emotional support and being in nature influence stress?Recommended by Chris ChambersStress is a familiar presence in modern life and may be rising in severity (Almeida et al., 2020). As a key driver of many health problems, controlling stress and its impacts is a central goal in clinical and health psychology, yet the effectiveness of existing interventions to regulate stress remains unclear.
In the current study, Sparacio et al tackled this question from a meta-analytic perspective, focusing on a corpus of existing research that has addressed the efficacy of two specific stress regulation interventions: being in nature and emotional social support. As well as evaluating the evidential content of the relevant literatures, the authors also examined signs of publication bias and the moderating role of personality traits.
After correcting for publication bias, the results reveal evidence that being in nature is effective at reducing stress while emotional social support is not. The moderating role of personality for both interventions was inconclusive due to lack of evidence. In addition, the quality of the surveyed literature was found to be low overall, suffering from a high risk of bias and high rate of statistical reporting errors. The authors offer several recommendations to improve the rigour and quality of studies in this field, including open data, open materials, code review, preregistration and the use of Registered Reports.
The Stage 2 manuscript was evaluated over one round of in-depth review. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 2 criteria and awarded a positive recommendation.
URL to the preregistered Stage 1 protocol: https://osf.io/c25qw
Level of bias control achieved: Level 3. At least some data/evidence that was used to the answer the research question had been previously accessed by the authors (e.g. downloaded or otherwise received), but the authors certify that they did not observe ANY part of the data/evidence prior to Stage 1 IPA.
List of eligible PCI RR-friendly journals:
References
1. Almeida, D. M., Charles, S. T., Mogle, J., Drewelies, J., Aldwin, C. M., Spiro, A. III, & Gerstorf, D. (2020). Charting adult development through (historically changing) daily stress processes. American Psychologist, 75(4), 511–524. https://doi.org/10.1037/amp0000597
2. Sparacio, A., Ropovik, I., Jiga-Boy, G. M., Lağap, A. C. & IJzerman, H. (2023). Stage 2 Registered Report: Stress regulation via being in nature and social support in adults, a meta-analysis. Acceptance of version 2 by Peer Community in Registered Reports. https://doi.org/10.31234/osf.io/a4zmj
| Stage 2 Registered Report: Stress regulation via being in nature and social support in adults, a meta-analysis | Alessandro Sparacio, Ivan Ropovik, Gabriela M. Jiga-Boy, Adar Cem Lağap, Hans IJzerman | <p>In this meta-analysis, the authors investigated whether being in nature and emotional social support are reliable strategies to downregulate stress. We retrieved all the relevant articles that investigated a connection between one of these two ... | Social sciences | Chris Chambers | 2023-01-09 09:32:27 | View | ||
22 Nov 2024
STAGE 1
![]() Sugary drinks devaluation with response training helps to resist to their consumptionHugo Najberg, Malika Tapparel, Lucas Spierer https://osf.io/uv8dr?view_only=4934c0215f2943cfb42e019792a30b53Can gamified response training with sugary drinks help people to resist consumption?Recommended by Zhang ChenThe excessive consumption of energy-dense but nutrient-poor foods and drinks can lead to many health problems. There is thus an increasing need for tools that may help people reduce the consumption of such foods and drinks. Training people to consistently respond or not respond to food items has been shown to reliably change their subjective evaluations of and choices for these items, mostly within laboratory settings. However, evidence on whether such trainings can also modify real consumption behavior remains mixed.
Najberg et al. developed a mobile-based response training game that combines two training tasks, one in which people consistently do not respond to sugary drinks (i.e., the go/no-go training), and one in which they consistently respond to water items rapidly (i.e., the cue-approach training). Recent work showed that after the training, participants in the experimental group reported more reduction in liking for sugary drinks and more increase in liking for water items compared to the control group. However, both groups showed equivalent reduction in self-reported consumption of sugary drinks (Najberg et al. 2023a). In the current study, Najberg and colleagues will further examine the efficacy of the gamified response training, by testing whether the training can help people resist the consumption of sugary drinks (Najberg et al. 2023b). Participants will be divided into experimental and control groups, and will receive the respective training for a minimum of seven days (and up to 20 days). After completing the training, they will be asked to avoid the trained sugary drinks, and the number of days in which they successfully adhere to this restrictive diet will be used as the dependent variable. Reporting the time at which one consumed a certain drink is presumably easier than reporting the exact volume consumed (cf. Najberg et al. 2023a). Furthermore, certain diets may require people to avoid specific foods and drinks entirely, rather than merely reduce the amount of consumption. Examining whether the training will be effective in this setting will therefore be informative. The authors will additionally examine whether the amount of training one completes, and the changes in subjective valuation of drinks after training, will be correlated with the successful avoidance of sugary drinks. These results will offer insights into the underlying mechanisms of the training and provide guidance on how they may best be implemented in applied settings. This Stage 1 manuscript was evaluated over three rounds of in-depth reviews by three expert reviewers and the recommender. The recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA). URL to the preregistered Stage 1 protocol: https://osf.io/97aez
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA. List of eligible PCI-RR-friendly journals:
1. Najberg, H., Mouthon, M., Coppin, G., & Spierer, L. (2023a). Reduction in sugar drink valuation and consumption with gamified executive control training. Scientific Reports, 13, 10659. https://doi.org/10.1038/s41598-023-36859-x
2. Najberg, H., Tapparel, M., & Spierer, L. (2023b). Sugary drinks devaluation with response training helps to resist their consumption. In principle acceptance of Version 4 by Peer Community in Registered Reports. https://osf.io/97aez | Sugary drinks devaluation with response training helps to resist to their consumption | Hugo Najberg, Malika Tapparel, Lucas Spierer | <p style="text-align: justify;">Food response training has been shown to reduce the reported value of palatable food items. These approaches may thus help to reduce unhealthy (over)consumption behaviors and its related diseases. Yet, whether and h... | Medical Sciences | Zhang Chen | 2023-06-22 12:01:20 | View | ||
Sunk cost effects for time versus money: Replication and extensions Registered Report of Soman (2001)Nikolay PETROV, Yin Kan (Megan) CHAN, Cheuk Nam (Chris) LAU, Tin Ho (Donald) KWOK, Lok Ching (Estelle) CHOW, Wai Yan (Vivian) LO, Wenkai SONG, Gilad FELDMAN https://doi.org/10.17605/OSF.IO/PM264Mixed evidence for the hypothesis that sunk cost effects are weaker for time than moneyRecommended by Chris ChambersThe sunk cost fallacy is a cognitive bias in which people persist with a decision that is no longer optimal because of previous resources they have invested (now considered to be spent or “sunk”). Most of us will have heard sunk costs reflected in the saying “throwing good money after bad”, but sunk costs can, in theory, occur more broadly, whether for money, time or any other resource-limited investment. The sunk cost effect for money has been widely studied and appears robust; in contrast, the sunk cost effect for time is more uncertain, and is potentially moderated by the age of respondents (and likely resource availability), the fact that time is irreplaceable, and the tendency for people to account for time less easily than they do for money. In an impactful study, Soman (2001) found that the sunk cost effect for time was indeed weaker than for money, although this finding has not been widely replicated.
In the current study, Petrov et al. (2023) replicated three studies (1, 2 and 5) from Soman (2001), asking whether sunk costs are weaker for time than for money, and then testing whether the relative absence of a sunk time cost arises from the inability of participants to account for time or due to more rational beliefs in the evaluation of past time investments.
Results provided mixed support for the original findings. Consistent with Soman (2001), the sunk cost effect for money was reliably stronger than for time in Study 1; however, sunk costs for both money and time were comparable in Study 2 (and if anything, slightly stronger for time). The indirect replication of Study 5 from Soman (2001) found that the sunk cost effect for time was not significantly influenced by accounting for time, either using education or by highlighting opportunity costs. Robustness checks confirmed the main preregistered outcomes while also ruling out a range of potential alternative explanations. Overall, the results suggest that that sunk cost effects for time are more context-dependent and empirically volatile than sunk costs for money.
URL to the preregistered Stage 1 protocol: https://osf.io/65htv Level of bias control achieved: Level 6. No part of the data or evidence that was used to answer the research question was generated until after IPA.
List of eligible PCI RR-friendly journals:
References
1. Soman, D. (2001). The mental accounting of sunk time costs: Why time is not like money. Journal of Behavioral Decision Making,14, 169-185. https://doi.org/10.1002/bdm.370
2. Petrov, N. B., Chan, Y. K., Lau, C. N., Kwok, T. H., Chow, L. C., Lo, W. Y. V, Song W., & Feldman, G. (2023). Sunk cost effects for time versus money: Replication and extensions Registered Report of Soman (2001), acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/q9s6p
| Sunk cost effects for time versus money: Replication and extensions Registered Report of Soman (2001) | Nikolay PETROV, Yin Kan (Megan) CHAN, Cheuk Nam (Chris) LAU, Tin Ho (Donald) KWOK, Lok Ching (Estelle) CHOW, Wai Yan (Vivian) LO, Wenkai SONG, Gilad FELDMAN | <p>The sunk cost effect is the tendency for an individual's decision-making to be impacted by unrecoverable previous investments of resources. Soman (2001) found that sunk cost effect is weaker for time than for money (Studies 1 and 2) and that th... | Social sciences | Chris Chambers | 2023-04-18 20:57:24 | View | ||
24 Apr 2024
STAGE 1
![]() Synaesthesia as a Model for Assessing Individual Differences in Visual Perception and Memory PerformanceEmily Whelan, Chhavi Sachdeva, Rebecca Ovalle-Fresa, Nicolas Rothen and Jamie Ward https://osf.io/6h8dxWhat can synaesthesia tell us about links between perception and memory?Recommended by Reshanne ReederWhat is the relationship between perception and memory? Although these topics are typically investigated separately, there is evidence that these cognitive processes may be related: for example, individuals with synaesthesia may experience both enhancements in visual acuity and visual memory; and individuals with amnesia may also show deficits in visual perceptual processing. However, comprehensive evidence for the relationship between perception and different forms of memory (both short-term and long-term) is currently lacking.
In this Stage 1 manuscript, Whelan et al. (2024) seek to elucidate this relationship by investigating individual differences in perception and memory in a general population sample (i.e., in synaesthetes, non-synaesthetic relatives, and controls). There are two accounts that may explain enhanced perception and memory in synaesthesia: a ‘dual-coding’ account, which suggests that the extra perceptual information often experienced in synaesthesia (e.g., seeing colors for different letters of the alphabet) may contribute to encoding richer information in sensory memory; and an ‘enhanced processing’ account, which posits that enhanced perception and memory in synaesthesia may be due to genetic or environmental factors not directly related to synaesthetic experiences. In the former case, synaesthetes should perform more similarly to each other than to their non-synaesthetic relatives; in the latter case, non-synaesthetic relatives of synaesthetes should show similar perceptual and memory benefits. The current study should therefore find evidence in favor of one of these accounts over the other. In addition to this, the authors will generate multidimensional cognitive profiles of synaesthetes and their relatives, compared to non-synaethetes, including perception, memory, mental imagery and cognitive styles.
The Stage 1 submission was evaluated by the recommender and two expert reviewers. Following revisions, the recommender judged that the manuscript met the Stage 1 criteria and awarded in-principle acceptance (IPA).
URL to the preregistered Stage 1 protocol: https://osf.io/6h8dx (under temporary private embargo) Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA. List of eligible PCI RR-friendly journals:
References
1. Whelan, E., Sachdeva, C., Ovalle-Fresa, R., Rothen R., & Ward, J. (2024). Synaesthesia as a Model for Assessing Individual Differences in Visual Perception and Memory Performance. In principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/6h8dx
| Synaesthesia as a Model for Assessing Individual Differences in Visual Perception and Memory Performance | Emily Whelan, Chhavi Sachdeva, Rebecca Ovalle-Fresa, Nicolas Rothen and Jamie Ward | <p>In this study, the cognitive profile of synaesthesia (a perceptual condition in which primary experiences, such as perceiving digits or words, elicit extra secondary sensations) is used as a model system to assess visual perceptual abilities an... | Social sciences | Reshanne Reeder | 2023-11-07 13:02:39 | View | ||
16 Sep 2022
STAGE 1
![]() Taking A Closer Look At The Bayesian Truth Serum: A Registered ReportPhilipp Schoenegger & Steven Verheyen https://osf.io/xw6hnUnderstanding the key ingredients of the Bayesian Truth SerumRecommended by Ljerka OstojicThe Bayesian Truth Serum, first introduced by Prelec (2004) rewards participants based on how surprisingly common their own answers are in relation to the actual distribution of answers. As such, it has been suggested as a possible incentive-compatible design for survey studies in different disciplines that rely on participants’ self-reports about their true preferences (Schoenegger, 2021).
In this study, Schoenegger and Verheyen propose to replicate the results reported by Schoenegger (2021) and to directly investigate whether the effect elicited by the manipulations known as the Bayesian Truth Serum is distinct from its separate constituent parts.
The Stage 1 manuscript was evaluated over one round of in-depth review. Based on detailed responses to the reviewers’ comments and edits to the stage 1 report, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
URL to the preregistered Stage 1 protocol: https://osf.io/dkvms
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.
List of eligible PCI RR-friendly journals:
References
1. Prelec, D. (2004). A Bayesian Truth Serum for Subjective Data. Science, 306(5695), 462-466. https://doi.org/10.1126/science.1102081
2. Schoenegger, P. (2021). Experimental Philosophy and the Incentivisation Challenge: a Proposed Application of the Bayesian Truth Serum. Review of Philosophy and Psychology https://doi.org/10.1007/s13164-021-00571-4
3. Schoenegger, P., & Verheyen, S. (2022). Taking A Closer Look At The Bayesian Truth Serum: A Registered Report. Stage 1 Registered Report, in principle acceptance of Version 2 by Peer Community in Registered Reports. https://osf.io/dkvms
| Taking A Closer Look At The Bayesian Truth Serum: A Registered Report | Philipp Schoenegger & Steven Verheyen | <p>Over the past decades, psychology and its cognate disciplines have undergone substantial reform, ranging from advances in statistical methodology to significant changes in academic norms. One aspect of experimental design that has received comp... | Social sciences | Ljerka Ostojic | 2021-12-06 17:36:15 | View | ||
Taking A Closer Look At The Bayesian Truth Serum: A Registered ReportPhilipp Schoenegger & Steven Verheyen https://doi.org/10.31219/osf.io/9zvqjReassessing the use of the Bayesian Truth Serum as an incentive-compatible design for self-reportsRecommended by Ljerka OstojicDifferent disciplines and research areas that rely on participants’ self-reports to accrue data on participants’ true preferences are faced with the question to what extent the former can be equated with the latter. Using monetary incentivisation for study participation may influence this relationship, and researchers, especially in economics, have been discussing how to develop and implement incentive-compatible research designs, i.e., those in which the incentivisation yields the best payoff for the participant if they report their true preferences (Hertwig & Ortmann, 2011; Baillon, 2017). The Bayesian Truth Serum, first introduced by Prelec (2004), according to which participants are rewarded based on how surprisingly common their own answers are relative to the actual distribution of answers, has been proposed as a possible incentive-compatible design for survey studies that rely on participants’ self-reports about their true preferences (Schoenegger, 2021).
In this study, Schoenegger and Verheyen (2022) ran a replication of the study by Schoenegger (2021) and assessed whether the effect elicited by the manipulations known as the Bayesian Truth Serum is distinct from its separate constituent parts. The authors report that the manipulation did not yield a significant difference compared to control conditions, which they interpret as a failure to replicate the original results. At the same time, the authors are careful in drawing conclusions as to the usefulness of the Bayesian Truth Serum for self-report studies using Likert-scale items in general, as they emphasise that smaller effect sizes may be of interest and that the results may differ when different items are used.
The Stage 2 manuscript was evaluated by two reviewers, one of whom reviewed the first Stage 1 submission, and the other one of whom reviewed the manuscript specifically to assess statistical questions.
Following a careful revision by the authors, the recommender judged that the manuscript meets the Stage 2 criteria and awarded a positive recommendation.
URL to the preregistered Stage 1 protocol: https://osf.io/dkvms
Level of bias control achieved: Level 6. No part of the data or evidence that was used to answer the research question existed prior to Stage 1 in-principle acceptance.
List of eligible PCI RR-friendly journals:
References
1. Baillon, A. (2017). Bayesian markets to elicit private information. Proceedings of the National Academy of Science, 114(30), 7985-7962. https://doi.org/10.1073/pnas.1703486114
2. Hertwig, R. & Ortmann (2001). Experimental practices in economics: a methodlogical challenge for psychologists? Behavioral and Brain Sciences, 24(3), 383-403. https://doi.org/10.1037/e683322011-032
3. Prelec, D. (2004). A Bayesian Truth Serum for Subjective Data. Science, 306(5695), 462-466. https://doi.org/10.1126/science.1102081
4. Schoenegger, P. (2021). Experimental Philosophy and the Incentivisation Challenge: a Proposed Application of the Bayesian Truth Serum. Review of Philosophy and Psychology https://doi.org/10.1007/s13164-021-00571-4
5. Schoenegger, P., & Verheyen, S. (2022). Taking A Closer Look At The Bayesian Truth Serum: A Registered Report. Stage 2 Registered Report, in principle acceptance of Version 3 by Peer Community in Registered Reports. https://doi.org/10.31219/osf.io/9zvqj
| Taking A Closer Look At The Bayesian Truth Serum: A Registered Report | Philipp Schoenegger & Steven Verheyen | <p>Over the past decade, psychology and its cognate disciplines have undergone substantial scientific reform, ranging from advances in statistical methodology to significant changes in academic norms. One aspect of experimental design that has rec... | Social sciences | Ljerka Ostojic | 2022-06-11 14:39:38 | View | ||
09 Jul 2024
STAGE 1
![]() Test-Retest Reliability in Functional Magnetic Resonance Imaging: Impact of Analytical Decisions on Individual and Group Estimates in the Monetary Incentive Delay TaskMichael I. Demidenko, Jeanette A. Mumford, Russell A. Poldrack https://osf.io/rv859?view_only=deaf7a8d461641749f143504b2a3150bExploring determinants of test-retest reliabilty in fMRIRecommended by Dorothy BishopFunctional magnetic resonance imaging (fMRI) has been used to explore brain-behaviour relationships for many years, with proliferation of a wide range of sophisticated analytic procedures. However, rather scant attention has been paid to the reliability of findings. Concerns have been growing following failures to replicate findings in some fields, but it is hard to know how far this is a consequence of underpowered studies, flexible analytic pipelines, or variability within and between participants.
Demidenko et al. (2023) plan a study that will be a major step forward in addressing these issues. They take advantage of the availability of three existing datasets, the Adolescent Brain Cognitive Development (ABCD) study, the Michigan Longitudinal Study, and the Adolescent Risk Behavior Study, which all included a version of the Monetary Incentive Delay task measured in two sessions. This gives ample data for a multiverse analysis, which will consider how within-subject and between-subject variance varies according to four analytic factors: smoothing (5 levels), motion correction (6 levels), task modelling (3 levels) and task contrasts (4 levels). They will also consider how sample size affects estimates of reliability. This will involve a substantial amount of analysis.
The study is essentially focused on estimation, although specific predictions are presented regarding the combinations of factors expected to give optimal reliability. The outcome will be a multiverse of results which will allow us to see how different pipeline decisions for this task affect reliability. In many ways, null results – finding that at least some factors have little effect on reliability – would be a positive finding for the field, as it would mean that we could be more relaxed when selecting an analytic pathway. A more likely outcome, however, is that analytic decisions will affect reliability, and this information can then guide future studies and help develop best practice guidelines. As one reviewer noted, we can’t assume that results from this analysis will generalise to other tasks, but this analysis with a widely-used task is an important step towards better and more consistent methods in fMRI.
The researchers present a fully worked out plan of action, with supporting scripts that have been developed in pilot testing. The Stage 1 manuscript received in-depth evaluation from three expert reviewers and the recommender. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
URL to the preregistered Stage 1 protocol: https://osf.io/nqgeh
Level of bias control achieved: Level 2. At least some data/evidence that will be used to answer the research question has been accessed and partially observed by the authors, but the authors certify that they have not yet sufficiently observed the key variables within the data to be able to answer the research questions AND they have taken additional steps to maximise bias control and rigour.
List of eligible PCI RR-friendly journals:
References 1. Demidenko, M. I., Mumford, J. A., & Poldrack, R. A. (2023). Test-Retest Reliability in Functional Magnetic Resonance Imaging: Impact of Analytical Decisions on Individual and Group Estimates in the Monetary Incentive Delay Task. In principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/nqgeh | Test-Retest Reliability in Functional Magnetic Resonance Imaging: Impact of Analytical Decisions on Individual and Group Estimates in the Monetary Incentive Delay Task | Michael I. Demidenko, Jeanette A. Mumford, Russell A. Poldrack | <p>Empirical studies reporting low test-retest reliability of individual neural estimates in functional magnetic resonance imaging (fMRI) data have resurrected interest among cognitive neuroscientists in methods that may improve reliability in fMR... | Life Sciences, Social sciences | Dorothy Bishop | 2023-04-17 22:27:54 | View | ||
18 Jul 2023
STAGE 1
![]() Test-Retest Reliability of the STRAQ-1: A Registered ReportOlivier Dujols; Richard A. Klein; Siegwart Lindenberg; Hans IJzerman https://psyarxiv.com/392g6A reliable measure of physical closeness in interpersonal relationships?Recommended by Moin SyedAttachment and interpersonal relationships are a major subject of research and clinical work in psychology. There are, accordingly, a proliferation of measurement instruments to tap into these broad constructs. The emphasis in these measures tends to be on the emotional dimensions of the relationships—how people feel about their partners and the support that they receive. However, that is not all there is to relationship quality. Increasing attention has been paid to the physical and physiological aspects of relationships, but there are few psychometrically sound measures available to assess these dimensions.
In the current study, Dujols et al. (2023) seek to assess the psychometric properties of the Social Thermoregulation and Risk Avoidance Questionnaire (STRAQ-1), a measure of physical relationships that targets social thermoregulation, or how physical proximity is used to promote warmth and closeness. The proposed project will be a thorough assessment of the measure’s reliability over time—that is, the degree to which the measure assesses the construct similarly across administrations. The authors will assess the test-retest reliability and longitudinal measurement invariance of the STRAQ-1, providing much-needed psychometric data that can build confidence in the utility of the measure.
The Stage 1 manuscript was evaluated over two rounds of in-depth review, the first round consisting of detailed comments from two reviewers and the second round consisting of a close read by the recommender. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and was therefore awarded in-principle acceptance (IPA).
URL to the preregistered Stage 1 protocol: https://osf.io/pmnk2
Level of bias control achieved: Level 3. At least some data/evidence that will be used to the answer the research question has been previously accessed by the authors (e.g. downloaded or otherwise received), but the authors certify that they have not yet observed ANY part of the data/evidence List of eligible PCI RR-friendly journals: References
1. Dujols, O., Klein, R. A., Lindenberg, S., Van Lissa, C. J., & IJzerman, H. (2023). Test-Retest Reliability of the STRAQ-1: A Registered Report. In principle acceptance of Version 2 by Peer Community in Registered Reports. https://osf.io/pmnk2
| Test-Retest Reliability of the STRAQ-1: A Registered Report | Olivier Dujols; Richard A. Klein; Siegwart Lindenberg; Hans IJzerman | <p>This Registered Report provides the first test of measurement invariance across time points and estimates of test-retest reliability for the Social Thermoregulation, Risk Avoidance Questionnaire (STRAQ-1, Vergara et al., 2019). The scale was de... | Social sciences | Moin Syed | 2023-03-01 16:07:17 | View | ||
Test-Retest Reliability of the STRAQ-1: A Registered ReportOlivier Dujols, Siegwart Lindenberg, Caspar J. van Lissa, Hans IJzerman https://doi.org/10.31234/osf.io/392g6We may not be measuring physical closeness in interpersonal relationships as reliably as we thinkRecommended by Moin SyedAttachment and interpersonal relationships are a major subject of research and clinical work in psychology. There are, accordingly, a proliferation of measurement instruments to tap into these broad constructs. The emphasis in these measures tends to be on the emotional dimensions of the relationships—how people feel about their partners and the support that they receive. However, that is not all there is to relationship quality. Increasing attention has been paid to the physical and physiological aspects of relationships, but there are few psychometrically sound measures available to assess these dimensions.
In the current study, Dujols et al. (2024) assessed the psychometric properties of the Social Thermoregulation and Risk Avoidance Questionnaire (STRAQ-1), a measure of physical relationships that targets social thermoregulation, or how physical proximity is used to promote warmth and closeness. The project consists of a thorough assessment of the measure’s reliability over time—that is, the degree to which the measure assesses the construct similarly across administrations, in a sample of 183 French university students.
The authors assessed the longitudinal measurement invariance and test-restest reliability of the STRAQ-1. Longitudinal measurement invariance across two time points was only found for two of the four subscales. Similarly, test-retest reliability varied by subscale, ranging from poor to good. Taken together, the study suggests caution in using the STRAQ-1 scale as a reliable measure of physical relationships. The study highlights the need for continued assessment of the reliability of widely used measures, particularly reliability over time, and serves as a model for a rigorous analytic approach for doing so.
The Stage 2 manuscript was evaluated over two rounds of in-depth review, the first round consisting of comments from two reviewers and the second round consisting of a close read by the recommender. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 2 criteria and therefore awarded a positive recommendation.
URL to the preregistered Stage 1 protocol: https://osf.io/pmnk2
Level of bias control achieved: Level 3. At least some data/evidence that was used to the answer the research question was accessed by the authors prior to Stage 1 IPA (e.g. downloaded or otherwise received) but the authors certify that they had not observed ANY part of the data/evidence until after Stage 1 IPA. List of eligible PCI RR-friendly journals:
References
1. Dujols, O., Klein, R. A., Lindenberg, S., Van Lissa, C. J., & IJzerman, H. (2024). Test-Retest Reliability of the STRAQ-1: A Registered Report [Stage 2]. Acceptance of Version 10 by Peer Community in Registered Reports. https://osf.io/preprints/psyarxiv/392g6
| Test-Retest Reliability of the STRAQ-1: A Registered Report | Olivier Dujols, Siegwart Lindenberg, Caspar J. van Lissa, Hans IJzerman | <p>This Registered Report provides the first test of measurement invariance across time points and estimates of test-retest reliability for the Social Thermoregulation, Risk Avoidance Questionnaire (STRAQ-1, Vergara et al., 2019). The scale was de... | Social sciences | Moin Syed | 2024-01-11 16:01:41 | View | ||
The capacity of response training to help resist the consumption of sugary drinksHugo Najberg, Malika Tapparel, Lucas Spierer https://osf.io/eu7j4?view_only=4934c0215f2943cfb42e019792a30b53Gamified response training with sugary drinks does not facilitate adherence to a restrictive dietRecommended by Zhang ChenMany people nowadays struggle with maintaining a healthy diet. Despite the intentions to eat healthily, they often over-consume highly palatable yet nutrient-poor foods and drinks, which in turn can lead to many health problems. There is therefore a need to develop tools that can help people resist the (over-)consumption of such foods and drinks.
Previous work has shown that training people to execute certain motor responses toward food items can modify their liking for these items, which may also influence their subsequent consumption behavior. Based on these findings, Najberg et al. (2023) developed a mobile game that combined two food-related response training tasks, namely the go/no-go training (Veling et al., 2017) and the cue-approach training (Schonberg et al., 2014). The experimental group was trained to consistently inhibit their responses toward sugary drinks in the go/no-go training, and consistently respond to water items in the cue-approach training (i.e., 100% consistent mapping). In the control group, the mapping between an item and response requirement was 50%, such that participants executed both go and no-go responses toward sugary drinks and water. Najberg et al. (2023) found that after the training, the experimental group reported more reduction in liking for sugary drinks and more increase in liking for water items compared to the control group. However, both groups showed equivalent reduction in self-reported consumption of sugary drinks. Using the same design (i.e., 100% vs. 50% consistency), in the current study, Najberg et al. (2024) further examined whether the combined go/no-go and cue-approach training game could help people resist the consumption of sugary drinks. Participants were divided into the experimental and control group (N = 100 and 92, respectively), and received the respective training for a minimum of seven days (and up to 20 days). After completing the training, they were asked to avoid the trained sugary drinks. The number of days in which they reported to successfully adhere to this restrictive diet was used as the main dependent variable. Contrary to their predictions, the two groups did not differ in how long they resisted the consumption of sugary drinks after training. Both groups showed equivalent reductions in liking for sugary drinks (contrary to the finding in Najberg et al., 2023), but this reduction in liking was not correlated with the number of successful days of diet in the experimental group. Lastly, those who trained for more days in the experimental group also adhered to the diet for a longer duration, but this correlation might be explained by differences in motivation across individuals. Together, these results suggest that consistently withholding responses toward sugary drinks and responding to water items does not help people resist the consumption of sugary drinks, compared to a control intervention in which the mapping is 50%. More research is therefore needed to test the effectiveness of food-related response training in changing consumption behavior outside of laboratory contexts. The Stage 2 manuscript was evaluated over three rounds of review by two expert reviewers who also assessed the Stage 1 manuscript. Following detailed responses to the recommender and the reviewers’ comments, the recommender judged that the manuscript met the Stage 2 criteria and awarded a positive recommendation. URL to the preregistered Stage 1 protocol: https://osf.io/97aez
Level of bias control achieved: Level 6. No part of the data or evidence that was used to answer the research question was generated until after IPA. List of eligible PCI-RR-friendly journals:
References
1. Najberg, H., Mouthon, M., Coppin, G., & Spierer, L. (2023). Reduction in sugar drink valuation and consumption with gamified executive control training. Scientific Reports, 13, 10659. https://doi.org/10.1038/s41598-023-36859-x 2. Veling, H., Lawrence, N. S., Chen, Z., van Koningsbruggen, G. M., & Holland, R. W. (2017). What Is Trained During Food Go/No-Go Training? A Review Focusing on Mechanisms and a Research Agenda. Current Addiction Reports, 4, 35–41. https://doi.org/10.1007/s40429-017-0131-5
3. Schonberg, T., Bakkour, A., Hover, A. M., Mumford, J. A., Nagar, L., Perez, J., & Poldrack, R. A. (2014). Changing value through cued approach: An automatic mechanism of behavior change. Nature Neuroscience, 17, 625–630. https://doi.org/10.1038/nn.3673
4. Najberg, H., Tapparel, M., & Spierer, L. (2024). The capacity of response training to help resist the consumption of sugary drinks [Stage 2]. Acceptance of Version 4 by Peer Community in Registered Reports. https://osf.io/eu7j4?view_only=4934c0215f2943cfb42e019792a30b53 | The capacity of response training to help resist the consumption of sugary drinks | Hugo Najberg, Malika Tapparel, Lucas Spierer | <p style="text-align: justify;">Food response training has been shown to reduce the reported value of palatable food items. These approaches may thus help to reduce unhealthy (over)consumption behaviors and its related diseases. Yet, whether and h... | Medical Sciences, Social sciences | Zhang Chen | 2024-06-26 11:41:16 | View |
FOLLOW US
MANAGING BOARD
Chris Chambers
Zoltan Dienes
Corina Logan
Benoit Pujol
Maanasa Raghavan
Emily S Sena
Yuki Yamada