Please note that we will be CLOSED to ALL SUBMISSIONS from 1 December 2024 through 12 January 2025 to give our recommenders and reviewers a holiday break.
We are recruiting recommenders (editors) from all research fields!
Your feedback matters! If you have authored or reviewed a Registered Report at Peer Community in Registered Reports, then please take 5 minutes to leave anonymous feedback about your experience, and view community ratings.
Latest recommendations
| Id | Title * ▼ | Authors * | Abstract * | Picture | Thematic fields * | Recommender | Reviewers | Submission date | |
|---|---|---|---|---|---|---|---|---|---|
07 Dec 2023
STAGE 1
Investigating individual differences in linguistic statistical learning and their relation to rhythmic and cognitive abilities: A speech segmentation experiment with online neural trackingIndividual differences in linguistic statistical learning and the relationship to rhythm perceptionRecommended by Elizabeth Wonnacott based on reviews by 2 anonymous reviewers
Previous research has demonstrated that experimental participants – both adults and infants – can track syllable co-occurrences in an artificial speech stream. This statistical learning (SL) is thought to support word segmentation and to be a core component of language acquisition. There is also some evidence that SL, as measured through artificial language tasks, is related to individual differences in language learning. What is not well understood is the underpinnings of individual differences in SL. In the current study, van der Wulp et al. (2023) will investigate the relationship between auditory SL and musical – specifically rhythmic – abilities. This work takes advantage of recent methodological innovations which allow online assessment of SL via electroencephalography (EEG) measures of neural entrainment. Up to N=105 participants will be recruited (using a well specified optional stopping procedure) and will be exposed to an artificial language using this EEG method to measure their response to the language through the exposure phase. In addition, post-tests will assess participants’ learning of the artificial language using behavioural tasks, as well as their abilities in a battery of tasks measuring rhythmic, musical, and cognitive abilities, and their vocabulary size. Core analyses will investigate whether the neural signature of statistical learning is found at a group level (i.e. replicating previous work) and whether at the individual level this is related to rhythm perception. Bayes factors will be used to assess the extent of evidence for these hypothesized relationships over the null. Exploratory analyses will explore other relationships, including with working memory and vocabulary size.
The topic of individual differences in language learning and is important, but work in this area is often underpowered, and the correlational nature of the research makes it vulnerable to HARKing. In this context, the current RR looks set to make an important contribution. The Stage 1 manuscript was evaluated over two rounds of in-depth review by the recommender and two expert reviewers, and one additional round of review by the recommender, before issuing in-principle acceptance.
URL to the preregistered Stage 1 protocol: https://osf.io/2y6sx
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA. List of eligible PCI RR-friendly journals: References
1. van der Wulp, I. M., Struiksma, M. E., Batterink, L. J., & Wijnen, F. N. K. (2023). Investigating individual differences in linguistic statistical learning and their relation to rhythmic and cognitive abilities: A speech segmentation experiment with online neural tracking. In principle acceptance of Version 4 by Peer Community in Registered Reports. https://osf.io/2y6sx | Investigating individual differences in linguistic statistical learning and their relation to rhythmic and cognitive abilities: A speech segmentation experiment with online neural tracking | Iris van der Wulp, Marijn Struiksma, Laura Batterink, Frank Wijnen | <p><strong>Objective:</strong> Statistical Learning (SL) is an essential mechanism for speech segmentation. Importantly, individual differences in SL ability are associated with language acquisition. For instance, better SL correlated with a large... | Humanities, Social sciences | Elizabeth Wonnacott | 2023-05-03 10:53:51 | |||
Insufficient evidence of a positive association between chronic loneliness and anthropomorphism: Replication and extension Registered Report of Epley et al. (2008)Weak-to-no evidence for a positive link between loneliness and anthropomorphismRecommended by Chris Chambers based on reviews by John Protzko
Anthropomorphism is a widespread phenomenon in which people instil non-human entities or objects with human-like characteristics, such as motivations, intentions, and goals. Although common, the tendency to anthropomorphise varies between people, and a growing body of psychological research has examined the importance of various individual differences. One major theoretical account of anthropomorphism (Epley et al. 2007) suggests that sociality motivation – the drive to establish social relationships – is a key moderator of the phenomenon. In support of this account, some evidence suggests that people who experience greater loneliness (a proposed marker of sociality motivation) are more likely to anthropomorphise. In an influential series of studies, Epley et al. (2008) found that anthropomorphism and loneliness were positively correlated and that inducing participants experimentally to feel more lonely led to greater anthropomorphism. Later studies, however, produced more mixed results, particularly concerning the effectiveness of the experimental interventions.
In the current study, Elsherif et al. (2024) undertook a partial replication of Epley et al. (2008), focusing on the correlational relationship between anthropomorphism and loneliness, with extensions to examine free will beliefs, anthropomorphism for supernatural beings (in addition to objects/gadgets), and the extent to which participants judged objects/gadgets to be controllable. The results revealed no reliable evidence for a positive relationship between anthropomorphism and loneliness. Analyses of the extended questions revealed that the perceived controllability of gadgets was associated negatively with anthropomorphism and that free will belief was associated positively with belief in anthropomorphism of supernatural beings. Broadly, the current findings constitute a non-replication of Epley et al. (2008). The authors conclude by calling for more direct and conceptual replications to establish the link (if any) between sociality motivation and anthropomorphism.
The Stage 2 manuscript was evaluated over one round of in-depth review. Based on detailed responses to the reviewer's and recommender's comments, the recommender judged that the manuscript met the Stage 2 criteria and awarded a positive recommendation.
URL to the preregistered Stage 1 protocol: https://osf.io/by89c Level of bias control achieved: Level 6. No part of the data or evidence that was used to answer the research question was generated until after IPA.
List of eligible PCI RR-friendly journals:
References
1. Epley, N., Waytz, A., & Cacioppo, J. T. (2007). On seeing human: A three-factor theory of anthropomorphism. Psychological Review, 114, 864–886. https://doi.org/10.1037/0033-295X.114.4.864
2. Epley, N., Akalis, S., Waytz, A., & Cacioppo, J. T. (2008). Creating social connection through inferential reproduction: Loneliness and perceived agency in gadgets, Gods, and greyhounds. Psychological Science, 19, 114–120. https://doi.org/10.1111/j.1467-9280.2008.02056.x
3. Elsherif, M., Pomareda, C., Xiao, Q., Chu, H. Y., Tang, M. C., Wong, T. H., Wu, Y. & Feldman, G. (2024). Insufficient evidence of a positive association between chronic loneliness and anthropomorphism: Replication and extension Registered Report of Epley et al. (2008) [Stage 2]. Acceptance of Version 6 by Peer Community in Registered Reports. https://osf.io/x96kn
| Insufficient evidence of a positive association between chronic loneliness and anthropomorphism: Replication and extension Registered Report of Epley et al. (2008) | Qinyu Xiao, Mahmoud Elsherif, Hoi Yan Chu, Ming Chun Tang, Ting Hin (Angus) Wong, Yiming Wu, Christina Pomareda, Gilad Feldman | <p>Human beings have a fundamental need to connect with others. Epley, Akalis, et al. (2008) found that people higher in chronic loneliness had a stronger tendency to anthropomorphize non-human objects, presumably for fulfilling unmet needs for so... | Social sciences | Chris Chambers | 2024-03-27 16:17:16 | |||
24 Sep 2024
STAGE 1
Independent Comparative Evaluation of the Pupil Neon - A New Mobile Eye-trackerAssessing the Promise of Affordable, Mobile Eye-Tracking Devices: Evaluation of the Pupil NeonRecommended by Rima-Maria Rahal based on reviews by Lisa Spitzer and Benedikt Ehinger
Studying eye-gaze has long been employed as a central method for understanding attentional dynamics and cognitive processes in a variety of domains. The development of affordable, mobile eye-tracking devices, such as the Pupil Neon, promises new opportunities to extend this research beyond the contexts in which traditional eye-trackers have been available. But how good are such novel devices at detecting variables relevant for the study of eye movements and pupil dilations?
Foucher, Krug and Sauter (2024) propose an independent evaluation of the Pupil Neon eye-tracker using the Ehinger et al. (2019) test battery, comparing its performance with a traditional EyeLink 1000 Plus device. In an empirical study, participants will be asked to perform a wide variety of tasks while eye movements and pupil dilations are tracked using both devices. Results on the strengths and weaknesses, as well as potential use cases of the Pupil Neon will be informative for subsequent eye-tracking research.
The Stage 1 manuscript was evaluated over two rounds of in-depth review. Based on detailed responses to the recommender and reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA). URL to the preregistered Stage 1 protocol: https://osf.io/3kc5t
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.
List of eligible PCI RR-friendly journals:
References: 1. Ehinger, B. V., Groß, K., Ibs, I., and König, P. (2019). A New Comprehensive Eye-Tracking Test Battery Concurrently Evaluating the Pupil Labs Glasses and the Eyelink 1000. PeerJ, 7, e7086. https://doi.org/10.7717/peerj.7086 2. Foucher, V., Krug, A., and Sauter, M. (2024). Independent Comparative Evaluation of the Pupil Neon - A New Mobile Eye-tracker. In principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/3kc5t | Independent Comparative Evaluation of the Pupil Neon - A New Mobile Eye-tracker | Valentin Foucher, Alina Krug, Marian Sauter | <p>Due to the rapid adoption of (mobile) eye-tracking devices in both academic and consumer research, it becomes more important that the increasing number of datasets is based on reliable recordings. This study provides an independent evaluation o... | Engineering, Life Sciences, Social sciences | Rima-Maria Rahal | 2024-05-29 10:29:06 | |||
Inconclusive evidence for associations between adverse experiences in adulthood and working memory performanceAdversity and working memory: Nuanced effects underpinned by rigorous methodologyRecommended by Yuki Yamada based on reviews by Kathryn Bates and 1 anonymous reviewer
Adverse environments involving threat, uncertainty, deprivation, and stress have been shown to have significant impacts on cognition and development. In this Stage 2 manuscript, Vermeent et al. (2024) adhere to their Stage 1 protocol, investigating the effects of adversity on working memory (WM) using a comprehensive, psychometric modeling approach. The authors aimed to clarify seemingly contradictory findings from previous research: The evidence for working memory capacity impairments in adverse environments versus the possibility that adversity might enhance specific aspects of WM, such as updating ability. Moreover, they examined the effects of distinct types of adversity—neighborhood threat, material deprivation, and unpredictability—on WM performance.
The results of the study were, overall, inconclusive: the authors did not find consistent associations between adversity and either WM capacity or WM updating ability. Despite using a large sample and employing latent variable modeling, the study did not reveal significant effects that were either clearly positive or negative for any type of adversity examined. In addition, no evidence for equivalence to zero associations was found. The lack of clear associations suggests that the relationship between adversity and WM is likely more complex than previously thought.
As with the Stage 1 evaluation, this manuscript has undergone a rigorous peer review process at Stage 2. The reviewers included specialists in child and youth cognitive development. The constructive feedback from the reviewers ensured that the pre-registered protocol was followed accurately, deviations were reported appropriately, and all concerns raised were addressed satisfactorily. These processes helped to refine Vermeent et al.'s methods and confirm that the planned analysis was followed. Despite the inconclusive results, this study makes a significant contribution to our understanding of the subtle effects of adversity on working memory by providing transparent and rigorous findings that add valuable data to the field. Therefore, I am fully confident that this manuscript is suitable for Stage 2 recommendation.
URL to the preregistered Stage 1 protocol: https://osf.io/dp7wc
Level of bias control achieved: Level 3. At least some data/evidence that was used to the answer the research question had been previously accessed by the authors (e.g. downloaded or otherwise received), but the authors certify that they had not yet observed ANY part of the data/evidence until after Stage 1 in-principle acceptance. List of eligible PCI RR-friendly journals:
References
1. Vermeent, S., Schubert, A.-L., DeJoseph, M. L., Denissen, J. J. A, van Gelder, J.-L. & Frankenhuis, W. E. (2024). Inconclusive evidence for associations between adverse experiences in adulthood and working memory performance [Stage 2]. Acceptance of Version 3 by Peer Community in Registered Reports. https://github.com/StefanVermeent/liss_wm_profiles_2023/blob/master/manuscript/stage2_tracked.pdf
| Inconclusive evidence for associations between adverse experiences in adulthood and working memory performance | Stefan Vermeent, Anna-Lena Schubert, Meriah L. DeJoseph, Jaap J. A. Denissen, Jean-Louis van Gelder, Willem E. Frankenhuis | <p>Decades of research have shown that adversity tends to be associated with lower working memory (WM) performance. This literature has mainly focused on impairments in the capacity to hold information available in WM for further processing. Howev... | Social sciences | Yuki Yamada | 2024-06-25 15:25:13 | |||
27 Mar 2024
STAGE 1
Impulsivity and online sports betting behaviour: Untangling the causal relationship (ISPO study)Examining the causal pathways from impulsivity to disordered gambling in online sports bettingRecommended by Zhang Chen based on reviews by 2 anonymous reviewersOnline sports betting is becoming increasingly popular worldwide, which has raised concerns about the negative consequences it has on both individual health and public health. To prevent and reduce these negative consequences, it is important to understand how gambling-related harms arise in the context of online sports betting.
Impulsivity has long been recognized as a risk factor for disordered gambling, yet how impulsivity may lead to gambling-related harms is not entirely clear. In the current study, Jacob and colleagues (2024) aim to examine this question using a longitudinal cross-lagged panel design. Regular online sports bettors will be invited to fill out measures of impulsivity (including impulsive choice, impulsive action, and impulsivity personality) and gambling disorder symptoms three times at three-month intervals. Player tracking data on these players' online betting behavior in these three-month intervals will then be retrieved from the online gambling provider. Combining these data provides a unique opportunity to test the hypotheses that impulsivity may lead to riskier online gambling behavior, which in turn may lead to more gambling-related problems later on. The results of the current study will offer novel insights into the causal pathways from impulsivity to disordered gambling in online sports betting, and may also inform the development of early prevention strategies to reduce gambling-related harms. The current Stage 1 manuscript was evaluated by two reviewers and the recommender. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA). URL to the preregistered Stage 1 protocol: https://osf.io/7wsfh
Level of bias control achieved: Level 3. At least some data/evidence that will be used to the answer the research question has been previously accessed by the authors (e.g. downloaded or otherwise received), but the authors certify that they have not yet observed ANY part of the data/evidence. List of eligible PCI RR-friendly journals:
References
1. Jacob, A., Joshanloo, M., Czernecka, R., & Kräplin, A. (2024). Impulsivity and online sports betting behavior: Untangling the causal relationship. In principle acceptance of Version 4 by Peer Community in Registered Reports. https://osf.io/7wsfh | Impulsivity and online sports betting behaviour: Untangling the causal relationship (ISPO study) | Anne Jacob, Mohsen Joshanloo, Robert Czernecka, Anja Kräplin, | <p>The rapid expansion of online sports betting has raised concerns about its potential impact on individual health and public health. In order to further develop etiological models for gambling disorder (GD) in sports betting, it is essential to ... | Social sciences | Zhang Chen | 2023-10-16 13:58:01 | |||
22 Oct 2023
STAGE 1
Implicit Ideologies: Do Right-Wing Authoritarianism and Social Dominance Orientation Predict Implicit Attitudes?Do social dominance orientation and right wing authoritarianism similarly predict both explicit and implicit attitudes?Recommended by Thomas Evans based on reviews by Luisa Liekefett, Oluwaseyi Adeliyi, Abiola Akinnubi ? and 1 anonymous reviewer
Measurement is a vital activity for all research areas, but we so often fail to provide sufficient clarity, rigor and transparency about it, undermining the validity of our studies' conclusions (Flake & Fried, 2020). This concern is of wide societal interest when applied to the domains of ideology and attitudes where measurements of both implicit and explicit attitudes are assumed to reflect the same underlying concept. The extent to which this can be accepted is undermined by mixed evidence demonstrating a lack of consensus on the extent to which relevant psychological factors similarly predict both implicit and explicit attitudes.
In the proposed study, Reid & Inbar (2023) question these assumptions through use of the Project Implicit dataset, exploring the extent to which social dominance orientation (SDO) and right wing authoritarianism (RWA) similarly predict implicit and explicit attitudes. This work is ideally suited for publication through the Registered Reports format because whilst we may expect that relationships between SDO/RWA are similar in effect size across measures of both implicit and explicit attitude (because they tap into the same underlying attitude), there is great scope to acknowledge a more complex set of findings which may not be immediately interpretable or coherent. The proposed work will help us unpack further the assumptions surrounding measurement of attitudes and can help us better understand the extent to which SDO and RWA predict atittudes.
The Stage 1 manuscript was evaluated over three rounds of in-depth review. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
URL to the preregistered Stage 1 protocol: https://osf.io/zv4jw
Level of bias control achieved: Level 5. All of the data or evidence that will be used to answer the research question already exist, but are currently inaccessible to the authors and thus unobservable prior to IPA (e.g. held by a gatekeeper) List of eligible PCI-RR-friendly journals: References:
1. Flake, J. K. & Fried, E. I. (2020). Measurement schmeasurement: Questionable measurement practices and how to avoid them. Advances in Methods and Practices in Psychological Science, 3, 456-465. https://doi.org/10.1177/2515245920952393
2. Reid, J. & Inbar, Y. (2023). Implicit Ideologies: Do Right-Wing Authoritarianism and Social Dominance Orientation Predict Implicit Attitudes? In principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/zv4jw
| Implicit Ideologies: Do Right-Wing Authoritarianism and Social Dominance Orientation Predict Implicit Attitudes? | Jesse S Reid, Yoel Inbar | <p>A wide variety of attitudes, beliefs and behaviours can be predicted by political ideology – and more specifically, by the two ideological scales of Right-Wing Authoritarianism (RWA; a preference for authority and tradition) and Social Dominanc... | Social sciences | Thomas Evans | 2023-04-08 01:53:30 | |||
Implicit Ideologies: Do Right-Wing Authoritarianism and Social Dominance Orientation Predict Implicit Attitudes?Do social dominance orientation and right wing authoritarianism similarly predict both explicit and implicit attitudes?Recommended by Thomas Evans based on reviews by Luisa Liekefett and 1 anonymous reviewer
Measurement is a vital activity for all research areas, but we so often fail to provide sufficient clarity, rigor and transparency about it, undermining the validity of our studies' conclusions (Flake & Fried, 2020). This concern is of wide societal interest when applied to the domains of ideology and attitudes where measurements of both implicit and explicit attitudes are assumed to reflect the same underlying concept. The extent to which this can be accepted is undermined by mixed evidence demonstrating a lack of consensus on the extent to which relevant psychological factors similarly predict both implicit and explicit attitudes.
In the current study, Reid & Inbar (2023) question these assumptions through use of the Project Implicit dataset, exploring the extent to which social dominance orientation (SDO) and right wing authoritarianism (RWA) similarly predict implicit and explicit attitudes. This work was ideally suited for publication through the Registered Reports format because whilst it may have been expected that relationships between SDO/RWA are similar in effect size across measures of both implicit and explicit attitude (because they tap into the same underlying attitude), there was great scope to acknowledge a more complex set of findings which may not be immediately interpretable or coherent.
As expected, the results were not completely unambiguous, but the mostly consistent relationships between implicit attitudes and RWA/SDO provided evidence towards both implicit and explict measures capturing the same underlying construct. These results also provide a useful step forward in our discussion of measurement in this domain, acknowledging the complexity of the tradeoff between reliability and specificity.
The Stage 2 manuscript was evaluated over two rounds of in-depth review. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 2 criteria and awarded a positive recommendation.
URL to the preregistered Stage 1 protocol: https://osf.io/zv4jw
Level of bias control achieved: Level 5. All of the data or evidence that was used to answer the research question existed before the research commenced but was inaccessible to the authors and thus unobservable prior to IPA. List of eligible PCI-RR-friendly journals:
References
1. Flake, J. K. & Fried, E. I. (2020). Measurement schmeasurement: Questionable measurement practices and how to avoid them. Advances in Methods and Practices in Psychological Science, 3, 456-465. https://doi.org/10.1177/2515245920952393 2. Reid, J. & Inbar, Y. (2024). Implicit Ideologies: Do Right-Wing Authoritarianism and Social Dominance Orientation Predict Implicit Attitudes? [Stage 2]. Acceptance of Version 6 by Peer Community in Registered Reports. https://doi.org/10.31234/osf.io/8udps | Implicit Ideologies: Do Right-Wing Authoritarianism and Social Dominance Orientation Predict Implicit Attitudes? | Jesse S Reid, Yoel Inbar | <p>Many social and political attitudes, beliefs and behaviours can be predicted by Right-Wing Authoritarianism (RWA; a preference for authority and tradition) and Social Dominance Orientation (SDO; a preference for social hierarchies and inequalit... | Social sciences | Thomas Evans | Anonymous, Luisa Liekefett | 2024-04-02 19:47:51 | ||
Impact of analytic decisions on test-retest reliability of individual and group estimates in functional magnetic resonance imaging: a multiverse analysis using the monetary incentive delay taskExploring determinants of test-retest reliability in fMRI: a study with the Monetary Incentive Delay TaskRecommended by Dorothy Bishop based on reviews by Xiangzhen Kong and 1 anonymous reviewer
Functional magnetic resonance imaging has been used to explore brain-behaviour relationships for many years, with proliferation of a wide range of sophisticated analytic procedures. However, rather scant attention has been paid to the reliability of findings. Concerns have been growing failures to replicate findings in some fields, but it is hard to know how far this is a consequence of underpowered studies, flexible analytic pipelines, or variability within and between participants. Demidenko et al. (2024) took advantage of the availability of three existing datasets, including the Adolescent Brain Cognitive Development (ABCD) study, the Michigan Longitudinal Study, and the Adolescent Risk Behavior Study, which all included a version of the Monetary Incentive Delay task measured in two sessions. These were entered into a multiverse analysis, which considered how within-subject and between-subject variance varies according to four analytic factors: smoothing (5 levels), motion correction (6 levels), task modelling (3 levels) and task contrasts (4 levels). They also considered how sample size affects estimates of reliability. The results have important implications for the those using fMRI with the Monetary Incentive Delay Task, and also raise questions more broadly about use of fMRI indices to study individual differences. Motion correction had relatively little impact on the ICC, and the effect size of the smoothing kernel was modest. Larger impacts on reliability were associated with choice of contrast (implicit baseline giving larger effects) and task parameterization. But perhaps the most sobering message from this analysis is that although activation maps from group data were reasonably reliable, the ICC, used as an index of reliability for individual levels of activation, was consistently low. This raises questions about the suitability of the Monetary Incentive Delay Task for studying individual differences. Another point is that reliability estimates become more stable as sample size increases; researchers may want to consider whether the trade-off between cost and gain in precision is justified for sample sizes above 250. I did a quick literature search on Web of Science: at the time of writing the search term ("Monetary Delay Task" AND fMRI) yielded 410 returns, indicating that this is a popular method in cognitive neuroscience. The detailed analyses reported here will repay study for those who are planning further research using this task. The Stage 2 manuscript was evaluated over one round of in-depth review. Based on detailed responses to the reviewer's and recommender's comments, the recommender judged that the manuscript met the Stage 2 criteria and awarded a positive recommendation. URL to the preregistered Stage 1 protocol: https://osf.io/nqgeh
Level of bias control achieved: Level 2. At least some data/evidence that was used to answer the research question had been accessed and partially observed by the authors prior to IPA, but the authors certify that they had not yet sufficiently observed the key variables within the data to be able to answer the research questions and they took additional steps to maximise bias control and rigour.
List of eligible PCI RR-friendly journals:
References 1. Demidenko, M. I., Mumford, J. A., & Poldrack, R. A. (2024). Impact of analytic decisions on test-retest reliability of individual and group estimates in functional magnetic resonance imaging: a multiverse analysis using the monetary incentive delay task [Stage 2]. Acceptance of Version 5 by Peer Community in Registered Reports. https://www.biorxiv.org/content/10.1101/2024.03.19.585755v4 | Impact of analytic decisions on test-retest reliability of individual and group estimates in functional magnetic resonance imaging: a multiverse analysis using the monetary incentive delay task | Michael I. Demidenko, Jeanette A. Mumford, Russell A. Poldrack | <p>Empirical studies reporting low test-retest reliability of individual blood oxygen-level dependent (BOLD) signal estimates in functional magnetic resonance imaging (fMRI) data have resurrected interest among cognitive neuroscientists in methods... |  | Life Sciences, Social sciences | Dorothy Bishop | 2024-03-21 02:23:30 | ||
16 Aug 2023
STAGE 1
Identifying relevant experiences to the measurement of social media experience via focus groups with young people: A registered reportA mental health perspective to adolescents’ social media experiencesRecommended by Veli-Matti Karhulahti based on reviews by Amy Orben, Jana Papcunova, Lisa Orchard, Elena Gordon-Petrovskaya and Gaurav Saxena
Measuring people’s experiences, thoughts, and mental processes has always been a core challenge of psychological science (e.g. Nisbett & Wilson 1977). When such measurement further relates to rapidly changing and conceptually diverse human-technology interactions, the task becomes even more difficult due to protean, multidimensional constructs. A good understanding of a construct is a basic step in its measurement (Borsboom 2005).
In the present registered report, Hickman Dunne et al. (2023) carry out a focus group study with adolescents (n=32) aged 11 to 15 in Northwest England to improve the understanding of constructs related to social media and mental health experiences. The work is carried out as part of a long-term measure development project. The authors apply reflexive thematic analysis to explore adolescents’ social media use experiences and related motivations in the light of mental health, in addition to which the adolescents’ own views of benefits and risks are mapped out. A particular strength of the design is the engagement of three Young Researchers who will co-facilitate the focus groups and be involved in the analysis. The research plan also meets high reflexivity and transparency criteria, and as such, can significantly contribute to future scale development as well as our general understanding of adolescents’ social media experiences. The Stage 1 manuscript was reviewed over two rounds by five unique reviewers, one of which participated in both rounds. The reviewers’ expertise ranged from social media and technology use research to health psychology and qualitative methods. Based on careful revisions and detailed responses to the reviewers’ comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance. URL to the preregistered Stage 1 protocol: https://osf.io/w24ec
Level of bias control achieved: Level 2. At least some data/evidence that will be used to answer the research question has been accessed and partially observed by the authors, but the authors certify that they have not yet observed the key variables within the data that will be used to answer the research question. List of eligible PCI RR-friendly journals: References
1. Borsboom, D. (2005). Measuring the mind: Conceptual issues in contemporary psychometrics. Cambridge University Press. 3. Nisbett, R. E., & Wilson, T. D. (1977). Telling more than we can know: Verbal reports on mental processes. Psychological review, 84, 231–259. https://doi.org/10.1037/0033-295X.84.3.231
2. Hickman Dunne J., Black L., Banwell E., Nanda P., Anderton M, Butters L.C., Demkowicz O., Davidson B., Qualter P., Humphrey N., Jay C., and Panayiotou M. (2023). Identifying relevant dimensions to the measurement of adolescent social media experience via focus groups with young people: A registered report. In principle acceptance of Version 5 by Peer Community in Registered Reports. https://osf.io/w24ec | Identifying relevant experiences to the measurement of social media experience via focus groups with young people: A registered report | Jo Hickman Dunne, Louise Black, Emily Banwell, Pratyasha Nanda, Molly Anderton, Lily Corke Butters, Ola Demkowicz, Brittany Davidson, Pamela Qualter, Neil Humphrey, Caroline Jay, and Margarita Panayiotou | <p>Background: While work on the relationship between social media use and adolescent mental health has allowed for some progress, research in this area is still relatively new and shows mixed evidence. This is partly the consequence of a rapidly ... | Computer science, Social sciences | Veli-Matti Karhulahti | 2023-06-14 21:10:43 | |||
Identifying relevant experiences to the measurement of social media experience via focus groups with young peopleA mental health perspective to adolescents’ social media experiencesRecommended by Veli-Matti Karhulahti based on reviews by Amy Orben, Jana Papcunova and Elena Gordon-Petrovskaya
Measuring people’s experiences, thoughts, and mental processes has always been a core challenge of psychological science (e.g. Nisbett & Wilson 1977). When such measurement relates to rapidly changing and conceptually diverse human-technology interactions, the task becomes even more difficult due to protean, multidimensional constructs. A good understanding of a construct is a basic step in its measurement (Borsboom 2005).
In the present registered report—carried out as part of a long-term measure development project—Dunne et al. (2024) carried out a focus group study with adolescents (n=26) aged 11 to 15 in Northwest England to improve the understanding of constructs related to social media and mental health. The authors applied reflexive thematic analysis to explore adolescents’ social media use experiences and related motivations in the light of mental health. The data and research process led to a construction of five themes, which were connected to mental health in direct and indirect ways. The participants voiced direct experiences of anxiety, self-esteem, and social aspects that reflect a mental health network where social media play diverse roles. Indirect implications of coping and self-control were found to supplement the network. Taken together, the themes and their implications to wellbeing make a valuable contribution to the evolving qualitative understanding young people's social media use in the UK (e.g., Conroy et al. 2023) and serve as a useful basis for future measure development. A particular strength of the work was the engagement of three Young Researchers who co-facilitated the focus groups and were involved in the analysis. The research meets high reflexivity and transparency criteria, and the carefully constructed supplementary materials provide informative details especially for measure developers. Finally, the authors must be commended for sharing these valuable data for reuse. The Stage 2 manuscript was reviewed over two rounds by three unique reviewers. The reviewers’ expertise ranged from social media and technology use research to health psychology and qualitative methods. Based on careful revisions and detailed responses to the reviewers’ comments, the recommender judged that the manuscript met the Stage 2 criteria and awarded a positive recommendation. URL to the preregistered Stage 1 protocol: https://osf.io/w24ec Level of bias control achieved: Level 2. At least some data/evidence had been accessed and partially observed by the authors prior to IPA, but the authors certify that they have not yet observed the key variables within the data that were used to answer the research question. List of eligible PCI-RR-friendly journals:
References
1. Borsboom, D. (2005). Measuring the mind: Conceptual issues in contemporary psychometrics. Cambridge University Press. 2. Conroy, D., Chadwick, D., Fullwood, C., & Lloyd, J. (2023). “You have to know how to live with it without getting to the addiction part”: British young adult experiences of smartphone overreliance and disconnectivity. Psychology of Popular Media, 12, 471-480. https://doi.org/10.1037/ppm0000425 3. Dunne, J. H., Black, L., Banwell, E., Nanda, P., Anderton, M, Butters, L.C., Demkowicz, O., Davies, J., Davidson, B., Qualter, P., Humphrey, N., Jay, C., & Panayiotou, M. (2024). Identifying relevant dimensions to the measurement of adolescent social media experience via focus groups with young people [Stage 2]. Acceptance of Version 9 by Peer Community in Registered Reports. https://doi.org/10.31234/osf.io/erjvz
4. Nisbett, R. E., & Wilson, T. D. (1977). Telling more than we can know: Verbal reports on mental processes. Psychological review, 84, 231-259. https://doi.org/10.1037/0033-295X.84.3.231 | Identifying relevant experiences to the measurement of social media experience via focus groups with young people | Jo Hickman Dunne, Louise Black, Molly Anderton, Pratyasha Nanda, Emily Banwell, Lily Corke Butters, Ola Demkowicz, Jade Davies, Brittany I Davidson, Pamela Qualter, Neil Humphrey, Caroline Jay, Margarita Panayiotou | <p>While work on the relationship between social media use and adolescent mental health has allowed for some progress, research in this area is still relatively new and shows mixed evidence. This is partly the consequence of a rapidly changing fie... | Social sciences | Veli-Matti Karhulahti | 2024-05-03 20:40:41 |
