Recommendation

No strong effect of unconditional cash transfers on cognition

based on reviews by Charlotte Pennington and Matúš Adamkovič
A recommendation of:
toto

Does alleviating poverty increase cognitive performance? Short- and long-term evidence from a randomized controlled trial

Abstract
Submission: posted 13 July 2022
Recommendation: posted 23 October 2022

This is a stage 2 based on:

Does alleviating poverty increase cognitive performance? Short- and long- term evidence from a randomized controlled trial
Barnabas Szaszi, Bence Palfi, Gabor Neszveda, Aikaterini Taka, Peter Szecsi, Christopher Blattman, Julian C. Jamison, Margaret Sheridan
https://osf.io/2r8a9/?view_only=1781fb681edc4cdeb61287172cd14ba2

Recommendation

Recent studies have revealed potential benefits of unconditional cash transfers (UCTs) on a variety of health and social outcomes, including self-reported happiness and life satisfaction (Haushofer & Shapiro, 2016), economic and financial well-being (Blattman et al., 2013; Baird et al., 2018) and educational attainment (Baird et al., 2016). Although the effects of UCTs do not always out-perform rigorous control conditions (Whillans & West, 2022), these findings prompt the question of whether the alleviation of poverty via UCTs can also influence cognitive processing and performance.
 
In the current study, Szaszi et al. analysed the results of a previous randomised trial of UCTs by Blattman et al. (2017) to test whether a $200 lump sum – equivalent to three months of income – administered to a sample of young men in Liberia carries both short- and long-term benefits for a range of executive functions, including attention, response inhibition, and working memory capacity. Overall, the results suggest minimal if any consequences of the intervention – the observed effects of UCTs on cognition were several times smaller than suggested by previous research, and the evidence for a positive effect was inconclusive. Extensive multiverse analyses showed that these findings were robust to a range of alternative analytical specifications, and the authors estimate that a sample size of nearly 5000 would be required to provide strong evidence.
 
In their Discussion, the authors explore a range of reasons for the negative findings compared with previous research, including the more rigorous and severe causal test enabled by the randomised trial design, the demographic homogeneity of the sample demographic, the use of pen-and-paper tests (cf. computerised tests in previous studies), and the delivery of a lump-sum cash transfer compared with a regular monthly installment. In addition, although the results were negative or inconclusive, there were hints that a positive effect of UCTs may be more evident in some cognitive domains than in others – in this case, potentially benefiting working memory more than inhibitory control. Further research would be required to confirm this hypothesis.
 
The Stage 2 manuscript was evaluated over one round of in-depth review. Based on the responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 2 criteria and awarded a positive recommendation.
 
URL to the preregistered Stage 1 protocol: https://osf.io/k56yv
 
Level of bias control achieved: Level 2. At least some data/evidence that was used to answer the research question had been accessed and partially observed by the authors prior to Stage 1 acceptance, but the authors certified that they had not yet observed the key variables within the data that would be used to answer the research question AND they took additional steps to maximise bias control and rigour.
 
List of eligible PCI RR-friendly journals:
 
 
References
 
1. Haushofer, J. & Shapiro, J.  (2016). The short-term impact of unconditional cash transfers to the poor: Experimental evidence from Kenya. Quarterly Journal of Economics, 13, 1973–2042. https://doi.org/10.1093/qje/qjw025
 
2. Blattman, C., Fiala, N. & Martinez, S. (2013) Generating skilled self-employment in developing countries: Experimental evidence from Uganda. Quarterly Journal of Economics, 129, 697–752. https://doi.org/10.1093/qje/qjt057
 
3. Baird, S., McKenzie, D., & Özler, B. (2018). The effects of cash transfers on adult labor market outcomes. IZA Journal of Development and Migration, 8, 1-20. https://doi.org/10.1186/s40176-018-0131-9
 
4. Baird, S., Chirwa, E., De Hoop, J., & Özler, B. (2016). Girl power: cash transfers and adolescent welfare: evidence from a cluster-randomized experiment in Malawi. In African Successes, Volume II: Human Capital (pp. 139-164). University of Chicago Press. https://www.nber.org/system/files/chapters/c13380/c13380.pdf
 
5. Whillans, A., & West, C. (2022). Alleviating time poverty among the working poor: A pre-registered longitudinal field experiment. Scientific Reports, 12(1), 1-17. https://doi.org/10.1038/s41598-021-04352-y
 
6. Blattman, C., Jamison, J. C. & Sheridan, M. (2017). Reducing crime and violence: Experimental evidence from cognitive behavioral therapy in Liberia. American Economic Review, 107, 1165–1206. http://doi.org/10.1257/aer.20150503
 
7. Szaszi, B., Palfi, B., Neszveda, G., Taka, A., Szecsi, P., Blattman, C., Jamison, J. C., & Sheridan, M. (2022). Does alleviating poverty increase cognitive performance? Short- and long-term evidence from a randomized controlled trial. Stage 2 Registered Report, acceptance of Version 2 by Peer Community in Registered Reports. https://psyarxiv.com/4gyzh
Cite this recommendation as:
Chris Chambers (2022) No strong effect of unconditional cash transfers on cognition. Peer Community in Registered Reports, . https://rr.peercommunityin.org/articles/rec?id=257
Conflict of interest:
The recommender in charge of the evaluation of the article and the reviewers declared that they have no conflict of interest (as defined in the code of conduct of PCI) with the authors or with the content of the article.

Evaluation round #1

DOI or URL of the report: https://psyarxiv.com/4gyzh

Author's Reply, 08 Oct 2022

Decision by , posted 06 Aug 2022, validated 24 Oct 2022

The two reviewers who assessed the Stage 1 submission kindly returned to evaluate the completed Stage 2 manuscript. As you will see, both are positive and constructive, and based on my own reading the manuscript comes close to meeting the Stage 2 criteria. The reviews highlight a range of minor-to-moderate issues to address in revision, including presentation (and verification) of the results, increasing the depth of synthesis and precision of critical evaluation in the Discussion (including additional consideration of limitations), and justification of specific claims. The reviewers also note several parts that would benefit from presentational improvements. In revising, please ensure that the manuscript fully conforms to the the PCI RR TOP policy, particularly in terms of data accessibility.

Based on these reviews, I am happy to invite a revision and point-by-point response to the reviewers.

Reviewed by , 21 Jul 2022

Please see attached for my Stage 2 review. 

Best wishes,

Charlotte

Download the review

Reviewed by , 02 Aug 2022

User comments

No user comments yet