Mental accounting under the microscope

Chris Chambers

Recommendation

Share Post

Printable page

Mental accounting under the microscope

Chris Chambers based on reviews by Barnabas Szaszi and Féidhlim McGowan

A recommendation of:

STAGE 1

Revisiting mental accounting classic paradigms: Replication of Thaler (1999) and an extension examining impulsivity

Mengfei Li; Gilad Feldman https://osf.io/4ps8m/ version v2

Read report on server

Abstract

EN

AR

ES

FR

HI

JA

PT

RU

ZH-CN

Submission: posted 31 January 2022
Recommendation: posted 17 May 2022, validated 17 May 2022

Cite this recommendation as:
Chambers, C. (2022) Mental accounting under the microscope. Peer Community in Registered Reports, . https://rr.peercommunityin.org/PCIRegisteredReports/articles/rec?id=164

Recommendation

In recent years, the study of mental accounting – the thought processes by which people informally record, categorise, and evaluate the costs and benefits of their financial transactions – has been an active research area, drawing attention to a range of biases and distortions that deviate from optimal economic decision-making (Zhang & Sussman, 2018). Although the term “mental accounting” is a relatively recent construction (Thaler, 1999), it stems from a longer history of behavioural economic research on value functions, decision frames, risk-taking, and related concepts.

In the current study, Li and Feldman propose to replicate 17 influential mental accounting problems (or tasks) reviewed by Thaler (1999) in a large online sample. The authors also propose several extensions examining the effects of sunk costs and expenses framing.

The Stage 1 manuscript was evaluated over two rounds of in-depth review. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).

URL to the preregistered Stage 1 protocol: https://osf.io/d6cjk

Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.

List of eligible PCI RR-friendly journals:

References

1. Zhang, C. Y., & Sussman, A. B. (2018). Perspectives on mental accounting: An exploration of budgeting and investing. Financial Planning Review, 1, e1011. https://doi.org/10.1002/cfp2.1011

2. Thaler, R. H. (1999). Mental accounting matters. Journal of Behavioral Decision Making, 12, 183-206. https://doi.org/10.1002/(SICI)1099-0771(199909)12:3%3C183::AID-BDM318%3E3.0.CO;2-F

3. Li, M. & Feldman, G. (2022). Revisiting mental accounting classic paradigms: Replication of the problems reviewed in Thaler (1999), in principle acceptance of Version 2 by Peer Community in Registered Reports. https://osf.io/d6cjk

Conflict of interest:
The recommender in charge of the evaluation of the article and the reviewers declared that they have no conflict of interest (as defined in the code of conduct of PCI) with the authors or with the content of the article.

Reviews

Toggle reviews

Evaluation round #2

DOI or URL of the report: https://osf.io/4ps8m/

Version of the report: v2

Author's Reply, 16 May 2022

Download author's reply

Please see detailed review in attached file.

We believe that we were able to answer the questions and address the concerns without requiring further changes to the manuscript. Therefore, no changes have been made to the manuscript, and we did not update the preprint.

Decision by Chris Chambers, posted 16 May 2022

Thank you for your careful and thorough revision and response. One of the reviewers from Stage 1 was available to evaluate the revised manuscript within a short timeframe. As you will see, the reviewer is largely satisified, with just a few remaining clarifications to make in a minor revision. We should then be in a position to offer Stage 1 in-principle acceptance (IPA) without further in-depth review.

For the reviewer who was unable to assess the manuscript within 14 days, I have considered your revisions myself and found them sufficient to proceed. In the event that IPA is awarded, I will invite that reviewer back in due course to evaluate the Stage 2 manuscript.

Reviewed by Barnabas Szaszi, 09 May 2022

I would like again to thank the authors to take the time to review the manuscript based on the comments. In general, I believe the authors sufficiently addressed most of my concerns. Below I only focus on the comments where I feel that further changes would improve the quality and impact of the proposed study.

You suggested the following improved sentence to be included in the abstract:

“Out of the 17 mental accounting hypotheses, we found empirical support for X with effect sizes ranging from X.XX [X.XX, X.XX] to X.XX [X.XX, X.XX], and no empirical support for Y with effect sizes ranging from X.XX [X.XX, X.XX] to X.XX [X.XX, X.XX].”

Although I understand the reasoning behind the sentence, to me it is somewhat strange to dichotomize the results and the effect size ranges that way. Is it interesting what are the exact ranges for the different groups? I think rather the number of hypotheses with support and no support, and the general effect size range is interesting, but independently. However, I have no strong opinion on that.

You write the following sidenote response regarding how big a 0.23 effect size is.

“Sidenote: From Cohen (1988) to the more recent and social-psychology specific Lovakov and Agadullina (2021) a large effect for Cohen’s d is 0.65-0.8, a medium effect 0.36-0.5, and a weak effect 0.15-0.2. A Cohen’s d of 0.23 is considered a weak effect (35th percentile in the entire literature). The newly targeted 0.29/0.36 is considered a weak to medium effect.”

It does not concern the acceptability of the present paper, but I cannot stop myself from saying that I still disagree and leaning toward the effect size interpretation of https://journals.sagepub.com/doi/full/10.1177/2515245919847202, that is 0.29/0.36 is rather a medium to large effect size.

To me the last part of this sentence seems to be confusing:

“Our second goal was to examine several predictions made by Thaler regarding mental accounting behaviors that the review did not cover empirical tests for.“

You write that “ In a pre-registered study with an American online Amazon Mechanical Turk sample (N = 1000)”. Is that n=1000 the number of people starting the experiment OR participants providing a full response to all questions OR the target number after exclusions?

Again, thank you for the interesting submission!

Best regards,

Barnabas Szaszi

Evaluation round #1

DOI or URL of the report: https://osf.io/2g6a8/

Author's Reply, 27 Apr 2022

Download author's reply Download tracked changes file

Revised manuscript: https://osf.io/4ps8m/

All revised materials uploaded to: https://osf.io/v7fbj/ , updated manuscript under sub-directory "PCI-RR submission following R&R"

Decision by Chris Chambers, posted 24 Mar 2022

Two reviewers have now evaluated the Stage 1 manuscript, and at the outset I would like to thank them for providing such generously detailed and constructive assessments. As you will see, the reviewers are broadly positive about the prospects of the replication but also raise a lot of major concerns that will need to be resolved to meet the Stage 1 criteria. The majority of issues focus on the rationale and level of detail surrounding the predictions and analysis plans, methodological concerns surrounding bias control and sample quality, and overall coherence of the presentation.

Reviews of this quality represent the RR format operating at its best because they provide authors with the opportunity to clarify and correct major issues before it is too late. In this case, a significant amount of work lies ahead to achieve in-principle acceptance (and you may decide it is too much); however I would nevertheless like to offer you the opportunity to address the concerns in full.

A revised manuscript will be returned to the reviewers for further in-depth evaluation.