Recommendation

A closer look at working memory changing with adversity

ORCID_LOGO based on reviews by Kathryn Bates and 1 anonymous reviewer
A recommendation of:

Working memory performance in adverse environments: Enhanced, impaired, or intact?

Abstract

EN
AR
ES
FR
HI
JA
PT
RU
ZH-CN
Submission: posted 30 October 2023
Recommendation: posted 28 March 2024, validated 28 March 2024
Cite this recommendation as:
Yamada, Y. (2024) A closer look at working memory changing with adversity. Peer Community in Registered Reports, . https://rr.peercommunityin.org/PCIRegisteredReports/articles/rec?id=588

Related stage 2 preprints:

Recommendation

Adverse environments involving threat, uncertainty, deprivation and stress can cause significant and long-lasting harm to cognition and development. In this Stage 1 protocol, Vermeent and colleagues (2024) aim to simultaneously test with a single paradigm and statistical model for findings from previous studies showing that human working memory capacity is impaired in adverse environments, as well as other evidence suggesting that adversity may actually enhance updating of working memory. Furthermore, they will also investigate whether working memory is related to each of the adversity types: threat, deprivation, and unpredictability.
 
The findings of this study should help clarify how working memory functions in combination with adversity, and will provide insight into the development of better interventions and training methods for optimal performance in a variety of environments.
 
The manuscript was reviewed by two experts and the recommender. Following two rounds of peer review, and based on detailed responses to the reviewers' comments, I, the recommender, judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
 
URL to the preregistered Stage 1 protocol: https://osf.io/dp7wc
 
Level of bias control achieved: Level 3. At least some data/evidence that will be used to the answer the research question has been previously accessed by the authors (e.g. downloaded or otherwise received), but the authors certify that they have not yet observed ANY part of the data/evidence.
 
List of eligible PCI RR-friendly journals:
 
References

1. Vermeent, S., Schubert, A.-L., DeJoseph, M. L., Denissen, J. J. A, van Gelder, J.-L. & Frankenhuis, W. E. (2024). Working memory performance in adverse environments: Enhanced, impaired, or intact? In principle acceptance of Version 2 by Peer Community in Registered Reports. https://osf.io/dp7wc
Conflict of interest:
The recommender in charge of the evaluation of the article and the reviewers declared that they have no conflict of interest (as defined in the code of conduct of PCI) with the authors or with the content of the article.

Reviewed by anonymous reviewer 1, 13 Mar 2024

The authors have addressed all of the concerns raised in an exceptionally thorough and satisfactory manner. Their point-by-point responses are well-reasoned and supported by additional clarifications and revisions to the manuscript. The changes made have significantly improved the quality and clarity of the work. I appreciate the authors' responsiveness and their commitment to strengthening the paper based on the feedback provided. With the revisions made, I believe the manuscript is now in excellent shape and ready for going to the next stage.


Evaluation round #1

DOI or URL of the report: https://github.com/StefanVermeent/liss_wm_profiles_2023/blob/46a2eaa2961e07f8d9f9b96af6a0b50661305a98/manuscript/PCIRR-Stage1-Snapshot.pdf

Version of the report: PCIRR-Stage1-Snapshot.pdf

Author's Reply, 12 Mar 2024

Decision by ORCID_LOGO, posted 14 Feb 2024, validated 15 Feb 2024

We apologize for the delay in completing the peer review due to several troubles.
Two experts have checked your Stage 1 manuscript. Overall, as you can see, the evaluation is positive, but it appears that you can improve on both the introduction and the methods. In particular, the flows toward the hypotheses may need considerable revision in terms of consistency with previous studies and appropriate hypothesis generation. Also, both reviewers made important comments about the sample. Please see the peer review comments for more details.
We very much look forward to receiving your revised manuscript!

Reviewed by anonymous reviewer 1, 05 Feb 2024

This registered report will examine whether adversity is related to lower or intact working memory (WM) performance. The authors will isolate variance in performance related to WM capacity from variance in performance related to updating ability as the two measures covary. They will combine existing and new data, and estimate participants' exposure to neighborhood threat, material deprivation, and unpredictability as measures of adversity. Structural equation modeling will be used to analyze the relationship between adversity and WM measures.

 

The relationship between working memory and the experience of adversity is a topic of great practical and clinical importance, especially in psychology and related fields of research. 

 

However, the significance of this as basic research is not clear enough, and there appear to be some major problems, as discussed below.

 

First, to the best of my knowledge, most previous research has supported that adversity is negatively associated with performance on WM tasks and executive function. It is true that some other research also showed no relationship between adversity and WM performance, but only a few studies reported the positive relationship between adversity and WM/executive function. In fact, the authors relied on research by Young and colleagues for this aspect. If the authors wish to test two hypotheses (deficit-based and adaptation-based models), they should cite more research on the adaptation-based models and justify that the research question in this study is worth investigating.

 

In addition, whether their argument can apply to other aspects of executive function is unclear. Previous research consistently showed that adversity can negatively affect children’ and adults’ executive function performance. Is WM special?

 

 

Second, and relatedly, although the authors compare the two hypotheses from the perspective of work memory capacity and updating, there are several other aspects that should be considered to explain different results in previous studies. For example, the two models may differ in the age of the participants and the population. Research supporting the adaptation model (i.e., Young and colleagues' research) has generally included children, whereas research supporting the deficit model has included both adults and children. Furthermore, the adaptation model may only be supported in a specific population (e.g., US), whereas negative effects on WM and executive function are observed globally (Western, Asian, and African).

This point is important because the authors will be using data from participants between the ages of 18 and 55. If their results support one model, we cannot determine whether the measures of working memory or the age of the participants/population are critical factors.

 

Third, the term "adversity" is ill-defined and somewhat vague. It encompasses a very broad range of indicators other than those used in this study. For example, some researchers use socioeconomic status to refer to it, while others refer to family criminal history or abuse, using the Adverse Childhood Experiences questionnaire. The authors must explain how the measures of adversity may affect the relationship between adversity and WM and justify why they chose their measure to address the research questions in this study. Also, for the analyses, they will be calculating composite scores without analyzing the relationship between the measures (e.g., Neighborhood Threat Composite). They should analyze the relationship between the measures, such as confirmatory factor analyses.

Reviewed by ORCID_LOGO, 14 Feb 2024

I recommend this manuscript to be accepted at Stage 1 with just a few clarifications.
 
The rationale is mapped out clearly with a strong theoretical and methodological basis for the study. Research questions and hypotheses are outlined in detail. What is the rationale for creating composite scores for adversity measures? Perceived and objective measures of crime, for example, might show different relationships to WM, and these nuances are lost in a composite score. Explanation of this choice would be useful.
 
In terms of the framework, how will you determine “lowered”, “intact”, and “enhanced”? Arguably you would need a repeated measures design with manipulations to determine whether WM was lowered or enhanced. Moreover, how would you define an intact score? Adjusting the language to reflect regression analyses would be more suitable, e.g., higher threat predicts lower WM capacity.
 
The methods are mostly outlined in detail. The authors describe two datasets collected via the LISS with multiple timepoints. Will the 800 participants be randomly selected? And will they be selected from one or more timepoints? What if a participant has data from all time points and another only has data for one timepoint? This should be explained more clearly. It is also not clear what the final sentence (point 4) of the “Data access” section is referring to – what do you mean by later timepoint? It might be helpful to label the timepoints at the start of the method section and use those labels throughout.
 
The number of trials is missing from the task descriptions; this is needed for future replication. For the updating task, 18 trials are referred to. Is this total number of trials or number of trials for the updating condition? Number of trials per condition and per task is needed. Can the authors explain why only 18 trials in this case? Is this enough trials to accurately capture performance?
 
The data analysis plan is well thought out with appropriate steps, control variables, and model fit checks.

User comments

No user comments yet