FILLON Adrien
- ERA chair in Science and Innovation Policy & Studies (SInnoPSis), university of cyprus, Nicosia, Cyprus
- Social sciences
- recommender
Recommendations: 4
Reviews: 3
Areas of expertise
I have a strong expertise in how to conduct a systematic review and meta-analysis. I have a good knowledge of R and Python for data-analysis. My areas of expertise are judgement and decision-making (and economics games); experimental philosophy (free will beliefs), creativity, especially the social aspects of creativity, nudges, conspiracy theories, and the relationship between science and policy-making.
Recommendations: 4
08 Nov 2024
STAGE 1
Relationship between perceived risk and compliance to infection control measures during the first year of a pandemic
The relationship between risk and compliance during the first year of the Covid-19 pandemic in Norway
Recommended by Adrien Fillon based on reviews by Erik Løhre, Gaëlle Marinthe, Lewend Mayiwar and 1 anonymous reviewerWhat relationship can be expected between the perception of risk and compliance with protective measures? The authors of the current study measured the perceived risk of COVID-19 and compliance with infection control in Norway during the first year of the pandemic. While the authors state that the perceived risk has a positive association with compliance, they also hypothesize that both measures at Tn will predict the other at Tn+1, indicating a dynamic and bi-directional relationship. Finding support (or not) for this hypothesis can be crucial for developing interventions that will encourage compliance with infection control measures. The analysis will be quantitative.
The authors already collected the data, and the risk of bias due to the accessibility of data was discussed extensively during the peer-reviewing process. In summary, the authors will set up an alpha at 0.01, perform a multiverse analysis and present all the results associated. They will analyse the model with various ways of handling outliers, and the analysis will be made by a colleague who did not have access to the data. The authors already provided a script to produce the multiverse analysis. The recommender and reviewers agreed that these procedures are sufficient to control for the level of bias due to the accessibility of data.
The Stage 1 manuscript was evaluated over three rounds of in-depth review. Based on detailed responses to reviewers’ and the recommender’s comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance.
The Stage 1 manuscript was evaluated over three rounds of in-depth review. Based on detailed responses to reviewers’ and the recommender’s comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance.
URL to the preregistered Stage 1 protocol: https://osf.io/epdn8
Level of bias control achieved: Level 1. At least some of the data/evidence that will be used to the answer the research question has been accessed and observed by the authors, the data analyst excepted, including key variables, but the authors certify that they have not yet performed ANY of their preregistered analyses, and in addition they have taken stringent steps to reduce the risk of bias.
List of eligible PCI RR-friendly journals:
List of eligible PCI RR-friendly journals:
References
Bjørkheim, S., Hystad, S., & Sætrevik, B. (2024). Relationship between perceived risk and compliance to infection control measures during the first year of a pandemic. In principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/epdn8
Mechanisms of secularization: Testing between the rationalization and existential insecurity theories
Understanding links between secularization, rationalisation and insecurity
Recommended by Adrien Fillon based on reviews by 1 anonymous reviewerWhat relationship can be expected between secularization, rationalization and insecurity? While some authors argue that rationalization reduces the willingness to belong to religious groups, others have suggested that insecurity increases this need to belong to religious groups.
In the current study, Lang and Chvaja (2024) adjudicated between these two possibilities using an economics game with 811 participants from two countries: US and Poland. The central question posed by the authors is whether cooperative insecurity increases the probability of joining a religious normative group. They tested the relationship between an environment (secure and insecure) and institution (which related to the norm context: religious and secular) on the probability of choosing the normative group in an experimental setting.
The authors included an adequate power analysis, alternatives for non-supported hypotheses, and filtering to ensure a high quality of data collection. They also undertook a pilot study to ensure the quality of the procedure and sensitivity of the analyses. There were only a few, minor, and well documented deviations from stage 1.
For the non-religious group, secularity increased the odds of joining the normative group when faced with insecurity. For the religious group, the results were mixed, mostly due to the unexpected high rate of participants joining the religious group in the secure environment. The researchers then pooled the regular and reversed scenarii and found support for the existential insecurity theory.
The authors concluded that both theories (the rationalization theory and the existential insecurity theory) can be at work, as the majority of the sample did not choose the religious normative group due to a potential rationalization, but they do slightly more when faced with (existential) insecurity.
The Stage 2 manuscript was evaluated over two rounds of review. Based on detailed responses to reviewers’ and the recommender’s comments, the recommender judged that the manuscript met the Stage 2 criteria and therefore awarded a positive recommendation.
URL to the preregistered Stage 1 protocol: https://osf.io/yzgek
Level of bias control achieved: Level 6. No part of the data or evidence that was used to answer the research question was generated until after IPA.
List of eligible PCI RR-friendly journals:
List of eligible PCI RR-friendly journals:
- Advances in Cognitive Psychology
- Collabra: Psychology
- International Review of Social Psychology
- Peer Community Journal
- PeerJ
- Royal Society Open Science
- Social Psychological Bulletin
- Studia Psychologica
- Swiss Psychology Open
References
1.Lang, M. & Chvaja, R. (2024). Mechanisms of secularization: Testing between the rationalization and existential insecurity theories [Stage 2]. Acceptance of Version 2 by Peer Community in Registered Reports. https://doi.org/10.31234/osf.io/gy7sj
21 Jun 2024
STAGE 1
Is it Worth the Hustle? A Multi-Country Replication of the Effort Moralization Effect and an Extension to Generational Differences in the Appreciation of Effort
Are people who exert more effort in a task seen as more moral?
Recommended by Adrien Fillon based on reviews by Jared Celniker, Ignazio Ziano and Michael InzlichtThis study seeks to understand cultural and age differences in the effort moralization effect, a phenomenon in which people who put more effort into a task are considered more moral, regardless of the quality or the morality associated with the task. This is shown in common phrases such as the “great resignation” or “quiet quitting”, which are mostly used against younger members of the population, in particular generation Z.
Tissot and Roth (2024) propose to conduct a replication of a study from Celniker et al. (2023) which found evidence for this effect, with new samples from Mexico and Germany to test potential cultural differences. They will also test the effect of age on the effort moralization effect. Therefore, the study will be a quantitative analysis.
The authors included an adequate power analysis, alternatives for non-supported hypotheses, and filtering to ensure a high quality of data collection. They already provided an R script and dummy data to ensure the quality of the analysis.
The authors included an adequate power analysis, alternatives for non-supported hypotheses, and filtering to ensure a high quality of data collection. They already provided an R script and dummy data to ensure the quality of the analysis.
The Stage 1 manuscript was evaluated over three rounds of in-depth review. Based on detailed responses to reviewers’ and the recommender’s comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance.
URL to the preregistered Stage 1 protocol: https://osf.io/tvgw2
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.
List of eligible PCI RR-friendly journals:
- Collabra: Psychology
- International Review of Social Psychology
- Meta-Psychology
- Peer Community Journal
- PeerJ
- Royal Society Open Science
- Social Psychological Bulletin
- Studia Psychologica
- Swiss Psychology Open
References
1. Celniker, J. B., Gregory, A., Koo, H. J., Piff, P. K., Ditto, P. H., & Shariff, A. F. (2023). The moralization of effort. Journal of Experimental Psychology: General, 152, 60–79. https://doi.org/10.1037/xge0001259
2. Tissot, T. T. & Roth, L. H. O. (2024). Is it Worth the Hustle? A Multi-Country Replication of the Effort Moralization Effect and an Extension to Generational Differences in the Appreciation of Effort. In principle acceptance of Version 4 by Peer Community in Registered Reports. https://osf.io/tvgw2
21 Apr 2024
STAGE 1
Mechanisms of secularization: Testing between three causal pathways
Understanding links between secularization, rationalisation and insecurity
Recommended by Adrien Fillon based on reviews by Chris Chambers and 1 anonymous reviewerWhat relationship can be expected between secularization, rationalisation and insecurity? While some authors argue that rationalisation reduces the willingness to belong to religious groups, others have suggested that insecurity increases this need to belong to religious groups.
In the current study, Lang and Chvaja (2024) will adjudicate between these two possibilities using an economics game in participants from two countries: US and Poland. The central question posed by the authors is whether cooperative insecurity increases the probability of joining a religious normative group. They will test the relationship between an environment (secure and insecure) and institution (which related to the norm context: religious and secular) on the probability of choosing the normative group in an experimental setting. Therefore, the study will be a quantitative analysis.
The authors included an adequate power analysis, alternatives for non-supported hypotheses, and filtering to ensure a high quality of data collection. They also undertook a pilot study to ensure the quality of the procedure and sensitivity of the analyses.
The Stage 1 manuscript was evaluated over one round of in-depth review. Based on detailed responses to reviewers’ and the recommender’s comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance.
URL to the preregistered Stage 1 protocol: https://osf.io/yzgek
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.
List of eligible PCI RR-friendly journals:
List of eligible PCI RR-friendly journals:
- Advances in Cognitive Psychology
- Collabra: Psychology
- International Review of Social Psychology
- Peer Community Journal
- PeerJ
- Royal Society Open Science
- Social Psychological Bulletin
- Studia Psychologica
- Swiss Psychology Open
References
1.Lang, M. & Chvaja, R. (2024). Mechanisms of secularization: Testing between the rationalization and existential insecurity theories. In principle acceptance of Version 2 by Peer Community in Registered Reports. https://osf.io/yzgek
Reviews: 3
27 Jun 2024
STAGE 1
Learning from comics versus non-comics material in education: Systematic review and meta-analysis
Comics in Education
Recommended by Veli-Matti Karhulahti based on reviews by Adrien Fillon, Benjamin Brummernhenrich, Solip Park and Pavol KačmárEspecially after the impactful experiments in modern comics (e.g. McCloud 1993), research interest in the medium increased with new practical developments (Kukkonen 2013). Some of these developments now manifest in educational settings where comics are used for various pedagogical purposes in diverse cultural contexts. To what degree comics are able to reach educational outcomes in comparison to other pedagogical tools remains largely unknown, however.
In the present registered report, Pagkratidou and colleagues (2024) respond to the research gap by investigating the effectiveness of educational comics materials. By means of systematic review and meta-analysis, the authors assess all empirical studies on educational comics to map out what their claimed benefits are, how the reported effectiveness differs between STEM and non-STEM groups, and what moderating effects complicate the phenomenon. With the help of large language models, all publication languages are included in analysis.
The research plan was reviewed over three rounds by four reviewers with diverse sets of expertise ranging from education and meta-analytic methodology to comics culture and design. After comprehensive revisions by the authors, the recommender considered the plan to meet high Stage 1 criteria and provided in-principle acceptance.
URL to the preregistered Stage 1 protocol: https://osf.io/vdr8c
In the present registered report, Pagkratidou and colleagues (2024) respond to the research gap by investigating the effectiveness of educational comics materials. By means of systematic review and meta-analysis, the authors assess all empirical studies on educational comics to map out what their claimed benefits are, how the reported effectiveness differs between STEM and non-STEM groups, and what moderating effects complicate the phenomenon. With the help of large language models, all publication languages are included in analysis.
The research plan was reviewed over three rounds by four reviewers with diverse sets of expertise ranging from education and meta-analytic methodology to comics culture and design. After comprehensive revisions by the authors, the recommender considered the plan to meet high Stage 1 criteria and provided in-principle acceptance.
URL to the preregistered Stage 1 protocol: https://osf.io/vdr8c
Level of bias control achieved: Level 3. At least some data/evidence that will be used to the answer the research question has been previously accessed by the authors (e.g. downloaded or otherwise received), but the authors certify that they have not yet observed ANY part of the data/evidence.
List of eligible PCI RR-friendly journals:
List of eligible PCI RR-friendly journals:
References
1. Kukkonen, K. (2013). Studying comics and graphic novels. John Wiley & Sons.
2. McCloud, S. (1993). Understanding comics: The invisible art. Tundra.
3. Pagkratidou, M., Cohn, N., Phylactou, P., Papadatou-Pastou, M., & Duffy, G. (2024). Learning from comics versus non-comics material in education: Systematic review and meta-analysis. In principle acceptance of Version 4 by Peer Community in Registered Reports. https://osf.io/vdr8c
11 Apr 2024
STAGE 1
Does retrieval practice protect memory against stress? A meta-analysis [Stage 1 Registered Report]
Can retrieval practice prevent the negative impact of acute stress on memory performance?
Recommended by Thomas Evans based on reviews by Chris Hartgerink (they/them) and Adrien FillonThere are a number of broad assumptions about memory which have penetrated societal understanding and mostly reflect supporting academic evidence e.g., that acute stress can compromise memory performance (Shields et al., 2017) and that practicing recalling critical information can help retain that knowledge (Moriera et al., 2019). The evidence base is less consistent when evaluating whether retrieval practice can protect against the negative effects of acute stress on memory, despite it being highly important for educators as to whether this specific strategy for supporting memorisation can be evidenced as especially effective under stressful conditions. A rigorous review of this mixed evidence base could provide the basis for developments in memory theory and research practice, with potential for direct educational applications.
Meta-analyses can play a critical role in furthering our understanding of complex cognitive mechanisms where the evidence base includes a wide range of methods, factors and effect size estimates. Furthermore, there is a lack of rigorous meta-analyses that prioritise open and reproducible processes (Topor et al., 2022) which help role-model good practice. In the current Registered Report, Mihaylova et al. (2024) have proposed a rigorous meta-analysis to systematically review and synthesise the evidence on the effects of retrieval practice for memory performance under acute stress. The work looks to be especially valuable for a) informing future research directions through a structured risk of bias evaluation, and b) generating theoretical developments through a range of confirmatory moderators (including stressor types, memory strategies, time of delay and task type). The findings of the planned analyses are expected to be of immediate interest to educational and occupational domains where memory recall is a priority.
The Stage 1 manuscript was evaluated over two rounds of in-depth review. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
URL to the preregistered Stage 1 protocol: https://osf.io/pkrzb
Level of bias control achieved: Level 3. At least some data/evidence that will be used to the answer the research question has been previously accessed by the authors (e.g. downloaded or otherwise received), but the authors certify that they have not yet observed ANY part of the data/evidence.
List of eligible PCI RR-friendly journals:
Level of bias control achieved: Level 3. At least some data/evidence that will be used to the answer the research question has been previously accessed by the authors (e.g. downloaded or otherwise received), but the authors certify that they have not yet observed ANY part of the data/evidence.
List of eligible PCI RR-friendly journals:
- Collabra: Psychology
- Cortex
- Journal of Cognition
- Peer Community Journal
- PeerJ
- Royal Society Open Science
- Studia Psychologica
- Swiss Psychology Open
References
1. Mihaylova, M., Kliegel, M, & Rothen, N. (2024). Does retrieval practice protect memory against stress? A meta-analysis. In principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/pkrzb
2. Moreira, B. F. T., Pinto, T. S. S., Starling, D. S. V., & Jaeger, A. (2019). Retrieval practice in classroom settings: A review of applied research. In Frontiers in Education (Vol. 4, p. 5). Frontiers Media SA. https://doi.org/10.3389/feduc.2019.00005
3. Shields, G. S., Sazma, M. A., McCullough, A. M., & Yonelinas, A. P. (2017). The effects of acute stress on episodic memory: A meta-analysis and integrative review. Psychological Bulletin, 143, 636–675. https://doi.org/10.1037/bul0000100
4. Topor, M. K., Pickering, J. S., Mendes, A. B., Bishop, D., Büttner, F., Elsherif, M. M., ... & Westwood, S. (2022). An integrative framework for planning and conducting Non-Intervention, Reproducible, and Open Systematic Reviews (NIRO-SR). Meta-Psychology. https://osf.io/preprints/metaarxiv/8gu5z
14 Nov 2023
STAGE 1
Scrolling to wisdom: the impact of social media news exposure on knowledge perception
Might we know less about current events than we think we do?
Recommended by Moin Syed based on reviews by Adrien Fillon, Erik Løhre and Moritz IngendahlWe are bombarded with news about current events from multiple sources: print media, digital media, friends, family, and more. At the same time, there is an imperative to “stay informed” and be knowledgeable of happenings both local and global. But how much knowledge do we actually gain from this bombardment of information? How informed are we really? It turns out that our perceptions of our knowledge tends to overstate our actual knowledge of a topic. This “illusion of knowledge” effect has been studied across a wide variety of contexts, but is especially relevant for understanding how people learn about and interact with politicized topics.
In the current study, Ruzzante et al. (2023) propose to further our understanding of the illusion of knowledge effect in the context of news exposure on social media. They will use an online pre-post experimental design that assesses participants’ perceived knowledge of a number of topics prior to the manipulation, which involves exposure to different social media news feeds, coming two weeks later. Central to the study, participants will be randomized to news stories that differ in their degree of self-involvement, that is how emotionally involved the topics are. Ruzzante et al. will test the hypothesis that more highly self-involved topics (e.g., abortion) will lead to a greater illusion of knowledge effect than less self-involved topics (e.g., feline immunodeficiency).
The Stage 1 manuscript was evaluated over two rounds of in-depth peer review, the first consisting of substantial comments from three scholars with relevant expertise, and the second consisting of a close review by the recommender. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and was therefore awarded in-principle acceptance (IPA).
URL to the preregistered Stage 1 protocol: https://osf.io/qa7tb
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.
List of eligible PCI RR-friendly journals:
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.
List of eligible PCI RR-friendly journals:
- Advances in Cognitive Psychology
- Collabra: Psychology
- Experimental Psychology
- F1000Research
- Journal of Cognition
- Peer Community Journal
- PeerJ
- Psychology of Consciousness: Theory, Research and Practice
- Royal Society Open Science
- Studia Psychologica
- Swiss Psychology Open
References
1. Ruzzante, F., Cevolani, G., & Panizza, F. (2023). Scrolling to wisdom: The impact of social media news exposure on knowledge perception. In principle acceptance of Version 5 by Peer Community in Registered Reports. https://osf.io/qa7tb