MCINTOSH Robert
- Human Cognitive Neuroscience, University of Edinburgh, Edinburgh, United Kingdom
- Life Sciences
- recommender
Recommendations: 4
Review: 1
Areas of expertise
Neuropsychology; Experimental Psychology; Perception & Action; Spatial Neglect
https://www.ed.ac.uk/profile/robert-mcintosh
Recommendations: 4
08 Sep 2023
STAGE 1
Evaluation of spatial learning and wayfinding in a complex maze using immersive virtual reality. A registered report
Evaluation of an immersive virtual reality wayfinding task
Recommended by Robert McIntosh based on reviews by Conor Thornberry, Gavin Buckingham and 1 anonymous reviewerThe Virtual Maze Task (VMT) is a digital desktop 2D spatial learning task that has been used for research into the effect of sleep and dreaming on memory consolidation (e.g. Wamsley et al, 2010). One limitation of this task has been low rates of reported dream incorporation. Eudave and colleagues (2023) have created an immersive virtual reality (iVR) version of the VMT, which they believe might be more likely to be incorporated into dreams. As an initial step in validating this task for research, they propose a within-subjects study to compare three measures of spatial learning between the 2D desktop and iVR versions. Based on a review of relevant literature, the prediction is that performance will be similar between the two task versions. The planned sample size (n = 62) is sufficient for a .9 power test of equivalence within effect size bounds of d = -.47 to .47. Additional independent variables (gender, perspective-taking ability) and dependent measures (self-reported cybersickness and sense of presence) will be recorded for exploratory analyses.
The study plan was refined across four rounds of review, with input from two external reviewers and the recommender, after which it was judged to satisfy the Stage 1 criteria for in-principle acceptance (IPA).†
URL to the preregistered Stage 1 protocol: https://osf.io/wba2v
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.
List of eligible PCI RR-friendly journals:
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.
List of eligible PCI RR-friendly journals:
- Advances in Cognitive Psychology
- Collabra: Psychology
- Cortex
- In&Vertebrates
- Journal of Cognition
- Peer Community Journal
- PeerJ
- Royal Society Open Science
- Studia Psychologica
- Swiss Psychology Open
References
Eudave, L., Martínez, M., Valencia, M., & Roth D. (2023). Evaluation of spatial learning and wayfinding in a complex maze using immersive virtual reality. A registered report. In principle acceptance of Version 5 by Peer Community in Registered Reports.
Wamsley, E. J., Tucker, M., Payne, J. D., Benavides, J. A., & Stickgold, R. (2010). Dreaming of a learning task is associated with enhanced sleep-dependent memory consolidation. Current Biology, 20, 850–855. https://doi.org/10.1016/j.cub.2010.03.027
† There is one minor change that the authors should make to the Methods section, which is sufficiently small that it can be incorporated at Stage 2: "if both tests reject the null hypothesis (observed data is less/greater than the lower/upper equivalence bounds), conditions are considered statistically equivalent" >> suggest changing "less/greater" to "greater/lesser" for correct correspondence with "lower/upper".
27 Jun 2023
STAGE 1
Functional MRI brain state occupancy in the presence of cerebral small vessel disease -- pre-registration for a replication analysis of the Hamburg City Health Study
Testing the replicability of dynamic functional connectivity correlates of cerebral small vessel disease in the Hamburg City Health Study
Recommended by Robert McIntosh based on reviews by Olivia Hamilton and 1 anonymous reviewerA recent study has reported that the extent of cerebral small vessel disease (cSVD) shows associations with dynamic functional connectivity measures obtained from resting state functional MRI scans (Schlemm et al, 2022). Specifically, when the functional scan was parsed into time spent in discrete brain states, the proportion of time spent in the two most-occupied states was negatively related to a structural indicator of cSVD (volume of white matter hyperintensities of presumed vascular origin). This measure of 'fractional occupancy' was also associated with cognitive impairment as indicated by longer time to complete part B of the Trail Making Test. These findings were based on the analysis of data from 988 participants in the Hamburg City Health Study (HCHS).
In the present Registered Report, Schlemm (2023) will test whether these associations can be replicated in an independent sample of participants from the HCHS, not included in the earlier analysis (projected N for new analysis ~1500). In addition to the two main hypothesis tests, an exploratory multiverse analysis will be reported, systematically varying some key parameters of the MRI processing pipeline to provide further information about the robustness of the outcome of the primary hypothesis test.
The Stage 1 plan was refined over two rounds of review by two relevant experts, with additional input from the recommender on the specification of the registered plan. Both reviewers are satisfied that the plan constitutes an appropriate approach to this question, and on the basis of their comments and his own evaluation, the recommender judged that the Stage 1 report meets the criteria for in-principle acceptance.
URL to the preregistered Stage 1 protocol: https://osf.io/9yhzc
Level of bias control achieved: Level 2. At least some data/evidence that will be used to answer the research question has been accessed and partially observed by the authors, but the authors certify that they have not yet observed the key variables within the data that will be used to answer the research question AND they have taken additional steps to maximise bias control and rigour.
List of eligible PCI RR-friendly journals:
Level of bias control achieved: Level 2. At least some data/evidence that will be used to answer the research question has been accessed and partially observed by the authors, but the authors certify that they have not yet observed the key variables within the data that will be used to answer the research question AND they have taken additional steps to maximise bias control and rigour.
List of eligible PCI RR-friendly journals:
- Brain and Neuroscience Advances
- Imaging Neuroscience
- In&Vertebrates
- NeuroImage: Reports
- Peer Community Journal
- PeerJ
- Royal Society Open Science
References
1. Schlemm, E., Frey, B. M., Mayer, C., Petersen, M., Fiehler, J., Hanning, U., Kühn, S., Twerenbold, R., Gallinat, J., Gerloff, C., Thomalla, G. & Cheng, B. (2022). Equalization of brain state occupancy accompanies cognitive impairment in cerebral small vessel disease. Biological Psychiatry, 92, 592-602. https://doi.org/10.1016/j.biopsych.2022.03.019
2. Schlemm, E. (2023). Functional MRI brain state occupancy in the presence of cerebral small vessel disease – pre-registration for a replication analysis of the Hamburg City Health Study. In principle acceptance of Version 1.5 by Peer Community in Registered Reports. https://osf.io/9yhzc
21 Oct 2022
STAGE 1
Replicating the facilitatory effects of transcranial random noise stimulation on motion processing: A registered report
Testing the facilitatory effect of high-frequency transcranial random noise stimulation through enhancement of global motion processing
Recommended by Robert McIntosh based on reviews by Sam Westwood and Filippo GhinHigh frequency transcranial random noise stimulation (hf-tRNS) is a relatively novel form of non-invasive brain stimulation, thought to enhance neural excitability and facilitate processing in targeted brain areas. The evidence for the efficacy of hf-tRNS is mixed, so a high-powered test of the proposed facilitatory effects would be of value to the field. This Registered Report will target the human middle temporal complex (hMT+), an area with a well-established critical role in global motion processing. The protocol is adapted from a study by Ghin and colleagues (2018) but focusing on a sub-set of the original experimental conditions and using a fully within-subjects design (n=42). Global motion processing will be operationalised in terms of the coherence threshold for identification of the dominant direction of random-dot motion. The experiment will test the predicted facilitation of contralateral motion processing (reduced coherence threshold) during hf-tRNS to the left hMT+. The specificity of this effect will be tested by comparison to a sham stimulation control condition and an active stimulation control condition (left forehead). By targeting a brain area with a well-established critical role in behaviour, this study will provide important information about the replicability and specificity of the facilitatory effects of hf-tRNS.
Following two rounds of in-depth review, the recommender judged that the manuscript met the Stage 1 criteria and awarded in-principle acceptance (IPA).
URL to the preregistered Stage 1 protocol: https://osf.io/bce7u
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.
List of eligible PCI RR-friendly journals:
URL to the preregistered Stage 1 protocol: https://osf.io/bce7u
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.
List of eligible PCI RR-friendly journals:
- Advances in Cognitive Psychology
- Brain and Neuroscience Advances
- Cortex
- F1000Research
- In&Vertebrates
- Journal for Reproducibility in Neuroscience
- NeuroImage: Reports
- Peer Community Journal
- PeerJ
- Royal Society Open Science
References
1. Ghin, F., Pavan, A., Contillo, A., & Mather, G. (2018). The effects of high-frequency transcranial random noise stimulation (hf-tRNS) on global motion processing: an equivalent noise approach. Brain Stimulation, 11, 1263–75.
2. Caroll, M. B., Edwards, G. & Baker, C. I. (2022). Replicating the facilitatory effects of transcranial random noise stimulation on motion processing: A registered report, in principle acceptance of Version 7 by Peer Community in Registered Reports. https://osf.io/bce7u
14 Feb 2022
STAGE 1
Minimal mindfulness of the world as an active control for a full mindfulness of mental states intervention: A Registered Report and Pilot study
Testing the metacognitive basis and benefits of mindfulness training
Recommended by Robert McIntosh based on reviews by Chris Noone and Julieta GalanteMindfulness is inherently metacognitive in that it requires monitoring of one’s own thoughts and attention in order to remain on task. Mindfulness practice is especially metacognitive when focused on internal mental states, rather than on the external world. This Registered Report will compare remote training in mindfulness of mental states with remote training in mindfulness of the world, and a wait list control, to test the idea that mindfulness of mental states has an additional metacognitive component, and that this has benefits for (self-reported) mental health. A comparison of participant expectancies between mindfulness conditions will be used to establish whether mindfulness of the world can be considered a true ‘active control’ condition. Additional comparisons will test whether this mindfulness control has benefits over the (inactive) waiting list condition. The study plan is informed by prior research, including pilot data presented in the Stage 1 report, and a sample of up to 300 participants will be tested.
The Stage 1 plan has been evaluated through two round of signed external review, and a further two rounds of minor revisions, with the recommender obtaining specialist advice on key points from a relevant external expert. The recommender has judged that the manuscript now meets all Stage 1 criteria, and has awarded In Principle Acceptance (IPA).
URL to the preregistered Stage 1 protocol: https://osf.io/tx54k
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.
List of eligible PCI RR-friendly journals:
- Advances in Cognitive Psychology
- F1000Research
- Journal of Cognition
- Peer Community Journal
- PeerJ
- Psychology of Consciousness: Theory, Research and Practice
- Royal Society Open Science
- Swiss Psychology Open
References
Lovell, M., & Dienes, Z. (2022). Minimal mindfulness of the world as an active control for a full mindfulness of mental states intervention: A Registered Report and Pilot study, in principle acceptance of version 4 by Peer Community in Registered Reports. https://osf.io/tx54k
Review: 1
06 Jun 2022
STAGE 1
Causal evidence for the role of the sensory visual cortex in visual short-term memory maintenance
Can the visual cortex maintain information in the short term?
Recommended by Zoltan Dienes based on reviews by Robert McIntosh, Evie Vergauwe and Vincent van de VenAccording to the sensory recruitment framework, the visual cortex is at least in part responsible for maintaining information about elementary visual features in visual short term memory. Could an early visual area, constantly taking in new information, really be responsible for holding information for up to a second? But conversely, could higher order regions, such as frontal regions, really hold subtle sensory distinctions? It must be done somewhere. Yet the existing evidence is conflicting. Phylactou et al. seek to address this question by applying transcranial magnetic stimulation (TMS) to disrupt early visual areas at intervals up to a second after stimulus presentation to determine the effect on visual short term memory performance. In this way they will causally influence the sensory cortex at relevant times while tightening up on possible confounds in earlier research.
The Stage 1 manuscript was evaluated over two rounds of in-depth review by three expert reviewers. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
URL to the preregistered Stage 1 protocol: https://osf.io/empdt
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.
List of eligible PCI RR-friendly journals:
- Advances in Cognitive Psychology
- F1000Research
- In&Vertebrates
- Peer Community Journal
- PeerJ
- Psychology of Consciousness: Theory, Research and Practice
- Royal Society Open Science
References
1. Phylactou, P., Shimi, A. & Konstantinou, N. (2022). Causal evidence for the role of the sensory visual cortex in visual short-term memory maintenance, in principle acceptance of Version 5 by Peer Community in Registered Reports. https://osf.io/empdt