Announcements
We are recruiting recommenders (editors) from all research fields!
Your feedback matters! If you have authored or reviewed a Registered Report at Peer Community in Registered Reports, then please take 5 minutes to leave anonymous feedback about your experience, and view community ratings.
279 records found
Latest recommendations
Id | Title * | Authors * | Abstract * | Picture | Thematic fields * | Recommender▼ | Reviewers | Submission date | |
---|---|---|---|---|---|---|---|---|---|
09 Sep 2024
STAGE 1
![]() The origin of symbolic numerical knowledge in early development – an fNIRS Registered ReportElizaveta Ivanova, Marc Joanisse, Daniel Ansari, Mojtaba Soltanlou https://osf.io/7vtdk?view_only=59385b6256b5492791f6882705c20424An fNIRS test of the neural correlates of the Cardinality Principle in typically-developing childrenRecommended by Robert McIntoshThe cardinality principle (CP) is a key concept in numerical cognition, which children typically acquire by the age of five. This is the understanding that each number in a counted sequence refers to a specific set of items, and that the final number represents the total size of the set. Here, Ivanova and colleagues (2024) propose an experiment to study the changes in neural activity that accompany the acquisition of this concept, focusing on activity within the parietal lobes as measured by functional near-infrared spectroscopy (fNIRS).
Typically-developing children aged from 2 years 9 months to 4 years 9 months will be assessed for their ability to give a specific number of balls from a pile: those who can give five or more correctly will be classified as CP-knowers, and those who can only give lower set sizes will be classified as subset-knowers. All children will then perform an auditory number word adaptation task while undergoing fNIRS. The adaptation task involves hearing the number word ‘two’ repeated, interspersed with deviant number words (‘four’ or ‘eight’) or a non-number word (‘rin’). The experimental hypotheses are that left parietal activations and bilateral parietal functional connectivity will be differentially greater for number than non-number deviants amongst CP-knowers than amongst subset-knowers. Each hypothesis will be tested by sequential Bayes factor analysis, with a minimum of 25 and a maximum of 46 participants per group, providing high sensitivity to detect a smallest effect size of d = .35. This study aims to provide insights into the neural underpinnings of the CP, informing theoretical models of symbolic knowledge acquisition.
The study plan was refined over four rounds of review, with input from two external reviewers, after which the recommender judged that the Stage 1 manuscript met the criteria for in-principle acceptance (IPA). URL to the preregistered Stage 1 protocol: https://osf.io/gzpk5
Level of bias control achieved: Level 4. At least some of the data/evidence that will be used to answer the research question already exists and is accessible in principle to the authors (e.g. residing in a public database or with a colleague) but the authors certify that they have not yet accessed any part of that data/evidence. List of eligible PCI RR-friendly Journals: References
Ivanova, E., Joanisse, M., Ansari, D., & Soltanlou, M. (2024). The origin of symbolic numerical knowledge in early development – an fNIRS Registered Report. In principle acceptance of Version 7 by Peer Community in Registered Reports. https://osf.io/gzpk5
| The origin of symbolic numerical knowledge in early development – an fNIRS Registered Report | Elizaveta Ivanova, Marc Joanisse, Daniel Ansari, Mojtaba Soltanlou | <p>The ability to understand that each number word in the count sequence refers to a specific set of items (e.g., ‘two’ means ‘two things’) is a milestone in cognitive development. When children reach this milestone, they are said to understand th... | Social sciences | Robert McIntosh | 2023-03-14 17:25:27 | View | ||
08 Sep 2023
STAGE 1
![]() Evaluation of spatial learning and wayfinding in a complex maze using immersive virtual reality. A registered reportEudave L., Martínez M., Valencia M., Roth D. https://osf.io/c2zvrEvaluation of an immersive virtual reality wayfinding taskRecommended by Robert McIntoshThe Virtual Maze Task (VMT) is a digital desktop 2D spatial learning task that has been used for research into the effect of sleep and dreaming on memory consolidation (e.g. Wamsley et al, 2010). One limitation of this task has been low rates of reported dream incorporation. Eudave and colleagues (2023) have created an immersive virtual reality (iVR) version of the VMT, which they believe might be more likely to be incorporated into dreams. As an initial step in validating this task for research, they propose a within-subjects study to compare three measures of spatial learning between the 2D desktop and iVR versions. Based on a review of relevant literature, the prediction is that performance will be similar between the two task versions. The planned sample size (n = 62) is sufficient for a .9 power test of equivalence within effect size bounds of d = -.47 to .47. Additional independent variables (gender, perspective-taking ability) and dependent measures (self-reported cybersickness and sense of presence) will be recorded for exploratory analyses.
The study plan was refined across four rounds of review, with input from two external reviewers and the recommender, after which it was judged to satisfy the Stage 1 criteria for in-principle acceptance (IPA).†
URL to the preregistered Stage 1 protocol: https://osf.io/wba2v
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA. List of eligible PCI RR-friendly journals:
References
Eudave, L., Martínez, M., Valencia, M., & Roth D. (2023). Evaluation of spatial learning and wayfinding in a complex maze using immersive virtual reality. A registered report. In principle acceptance of Version 5 by Peer Community in Registered Reports.
Wamsley, E. J., Tucker, M., Payne, J. D., Benavides, J. A., & Stickgold, R. (2010). Dreaming of a learning task is associated with enhanced sleep-dependent memory consolidation. Current Biology, 20, 850–855. https://doi.org/10.1016/j.cub.2010.03.027
† There is one minor change that the authors should make to the Methods section, which is sufficiently small that it can be incorporated at Stage 2: "if both tests reject the null hypothesis (observed data is less/greater than the lower/upper equivalence bounds), conditions are considered statistically equivalent" >> suggest changing "less/greater" to "greater/lesser" for correct correspondence with "lower/upper".
| Evaluation of spatial learning and wayfinding in a complex maze using immersive virtual reality. A registered report | Eudave L., Martínez M., Valencia M., Roth D. | <p style="text-align: justify;"><strong>Objectives</strong>: Mazes have traditionally been used as tools for evaluating spatial learning and navigational abilities in humans. They have been also utilized in sleep and dream research, as wayfinding ... | Life Sciences | Robert McIntosh | 2023-03-31 17:21:20 | View | ||
Functional MRI brain state occupancy in the presence of cerebral small vessel disease -- a pre-registered replication analysis of the Hamburg City Health StudyThies Ingwersen, Carola Mayer, Marvin Petersen, Benedikt M. Frey, Jens Fiehler, Uta Hanning, Simone Kühn, Jürgen Gallinat, Raphael Twerenbold, Christian Gerloff, Bastian Cheng, Götz Thomalla, Eckhard Schlemm, https://github.com/csi-hamburg/HCHS-brain-states-RR/blob/f9d00adbbcf9593d8d191bf5b93912141b80ab1b/manuscript/build/main.pdfReplicable dynamic functional connectivity and cognitive correlates of cerebral small vessel disease in the Hamburg City Health StudyRecommended by Robert McIntoshIn a previous analysis of data from 988 participants in the Hamburg City Health Study (HCHS), Schlemm and colleagues (2022) reported significant associations between the extent of cerebral small vessel disease (cSVD) and dynamic functional connectivity measures from resting state fMRI. Specifically, the volume of white matter hyperintensities of presumed vascular origin, a structural indicator of cSVD, was negatively related to the proportion of time (‘fractional occupancy’) spent in the two most occupied functional brain states. Reduced fractional occupancy was also associated with longer times to complete part B of the Trail Making Test.
In the present Registered Report, Ingwersen and colleagues (2023) successfully replicated these associations between structural, functional and cognitive measures in a sample of 1651 HCHS participants not included in the earlier study. An exploratory multiverse analysis found that the associations were generally robust to different brain parcellation and confound regression strategies. These replicable patterns reinforce the idea that cSVD may disrupt the brain’s ability to enter and maintain distinct functional modes, and that these changes in functional dynamics are predictive of cognitive impairment.
The Stage 2 manuscript was assessed over one round of in-depth review. The recommender judged that responses to reviewer comments were appropriate, and that the manuscript met the Stage 2 criteria for recommendation.
URL to the preregistered Stage 1 protocol: https://osf.io/9yhzc
Level of bias control achieved: Level 2. At least some data/evidence that was used to answer the research question had been accessed and partially observed by the authors prior to Stage 1 in-principle acceptance, but the authors certify that they had not yet observed the key variables within the data that were used to answer the research question AND they took additional steps to maximise bias control and rigour. List of eligible PCI RR-friendly journals:
References
1. Schlemm, E., Frey, B. M., Mayer, C., Petersen, M., Fiehler, J., Hanning, U., Kühn, S., Twerenbold, R., Gallinat, J., Gerloff, C., Thomalla, G. & Cheng, B. (2022). Equalization of brain state occupancy accompanies cognitive impairment in cerebral small vessel disease. Biological Psychiatry, 92, 592-602. https://doi.org/10.1016/j.biopsych.2022.03.019
2. Ingwersen, T., Mayer, C., Petersen, M., Frey, B. M., Fiehler, J., Hanning, U., Kühn, S., Gallinat, J., Twerenbold, R., Gerloff, C., Cheng, B., Thomalla, G. & Schlemm, E. (2023). Functional MRI brain state occupancy in the presence of cerebral small vessel disease -- a pre-registered replication analysis of the Hamburg City Health Study. Acceptance of Version 2.01 by Peer Community in Registered Reports. https://github.com/csi-hamburg/HCHS-brain-states-RR/blob/f9d00adbbcf9593d8d191bf5b93912141b80ab1b/manuscript/build/main.pdf
| Functional MRI brain state occupancy in the presence of cerebral small vessel disease -- a pre-registered replication analysis of the Hamburg City Health Study | Thies Ingwersen, Carola Mayer, Marvin Petersen, Benedikt M. Frey, Jens Fiehler, Uta Hanning, Simone Kühn, Jürgen Gallinat, Raphael Twerenbold, Christian Gerloff, Bastian Cheng, Götz Thomalla, Eckhard Schlemm, | <p><strong>Objective</strong>: To replicate recent findings on the association between the extent of cerebral small vessel disease (cSVD), functional brain network dedifferentiation, and cognitive impairment.</p> <p><strong>Methods:</strong> We a... | Life Sciences, Medical Sciences | Robert McIntosh | 2023-10-17 09:53:02 | View | ||
25 Jun 2024
STAGE 1
![]() Does ‘virtuality’ affect the role of prior expectations in perception and action? Comparing predictive grip and lifting forces in real and virtual environmentsDavid J. Harris, Tom Arthur, & Gavin Buckingham https://osf.io/q3ktsThe role of prior expectations for lifting objects in virtual realityRecommended by Robert McIntoshAs virtual reality environments become more common, it is important to understand our sensorimotor interactions with them. In real world settings, sensory information is supplemented by prior expectations from past experiences, aiding efficient action control. In VR, the relative role of expectations could decrease due to a lack of prior experience with the environment, or increase because sensory information is impoverished or ambiguous. Harris, Arthur and Buckingham (2024) propose to test these possibilities by comparing a real-world object lifting task and a VR version in which the same objects are lifted but visual feedback is substituted by a virtual view. The experiment uses the Size-Weight Illusion (SWI) and the Material Weight Illusion (MWI). In these paradigms, the visual appearance of the object induces expectations about weight that can affect the perception of weight during lifting, and the fingertip forces generated. The degree to which the visual appearance of objects induces differences in perceived weight, and in measured fingertip forces, will index the influence of prior expectations for these two paradigms. The analyses will test whether the influence of prior expectations is lower or higher in the VR set-up than in real-world lifting. The outcomes across tasks (SWI and MWI) and measures (perceived weight, fingertip forces) will broaden our understanding of the role of predictive sensorimotor control in novel virtual environments.
After three rounds of evaluation, with input from two external reviewers, the recommender judged that the Stage 1 manuscript met the criteria for in-principle acceptance (IPA).
URL to the preregistered Stage 1 protocol: https://osf.io/36jhb
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA. List of eligible PCI RR-friendly journals:
References 1. Harris, D. J., Arthur, T., & Buckingham, G. (2024). Does ‘virtuality’ affect the role of prior expectations in perception and action? Comparing predictive grip and lifting forces in real and virtual environments. In principle acceptance of Version 4 by Peer Community in Registered Reports. https://osf.io/36jhb
| Does ‘virtuality’ affect the role of prior expectations in perception and action? Comparing predictive grip and lifting forces in real and virtual environments | David J. Harris, Tom Arthur, & Gavin Buckingham | <p>Recent theories in cognitive science propose that prior expectations strongly influence how individuals perceive the world and control their actions. This influence is particularly relevant in novel sensory environments, such as virtual reality... | Life Sciences | Robert McIntosh | Ben van Buren | 2023-11-22 12:25:57 | View | |
The importance of conceptual knowledge when becoming familiar with faces during naturalistic viewingKira N. Noad and Timothy J. Andrews https://osf.io/thgrzA registered test of the role of contextual information in perceptual learning of facesRecommended by Robert McIntoshWhen we familiarise with new faces over repeated exposures, it is generally in situations that have meaning for us. Seeing a face more often tends to go along with learning more about the person, and their likely contexts and actions. In this Registered Report, Noad and Andrews (2024) tested whether meaningful context during exposure improves the consolidation of faces into long-term memory. Participants were shown video clips from the TV series Life on Mars, either in their original chronological sequence, which provides meaningful context, or in a scrambled sequence. It was expected that the original sequence would provide a better conceptual understanding, and this was confirmed by free recall and structured question tests. Face recognition memory was tested with images of the actor from the original clips (‘in show’) and the same actor from another show (‘out-of-show’), to test whether memory was modulated by the similarity of appearance to that at encoding. Face recognition was tested immediately after exposure and after four weeks, to allow time for consolidation. As expected, recognition memory was better for participants in the meaningful context condition, and for in-show faces. However, meaningful context did not lead to less forgetting of the faces at the follow up test, even for in-show faces, which did not support the original predictions. An exploratory analysis found that a metric of overlap between pairs of participants’ conceptual understanding was related to overlap in the set of faces they recognised. This relationship was stronger after four weeks, which suggests increased interaction of conceptual knowledge and face recognition after consolidation.
The Stage 2 manuscript was assessed over two rounds of review, and the recommender judged that the manuscript met the Stage 2 criteria for recommendation.
URL to the preregistered Stage 1 protocol: https://osf.io/8wp6f
Level of bias control achieved: Level 6. No part of the data or evidence that was used to answer the research question was generated until after IPA. List of eligible PCI RR-friendly journals:
References
1. Noad, K. & Andrews, T. J. (2024). The importance of conceptual knowledge when becoming familiar with faces during naturalistic viewing [Stage 2]. Acceptance of Version 4 by Peer Community in Registered Reports. https://osf.io/thgrz | The importance of conceptual knowledge when becoming familiar with faces during naturalistic viewing | Kira N. Noad and Timothy J. Andrews | <p>Although the ability to recognise familiar faces is a critical part of everyday life, the process by which a face becomes familiar in the real world is not fully understood. Previous research has focussed on the importance of perceptual experie... | Life Sciences, Social sciences | Robert McIntosh | 2024-01-17 16:00:17 | View | ||
One and only SNARC? Spatial-Numerical Associations are not fully flexible and depend on both relative and absolute magnitudeLilly Roth, John Caffier, Ulf-Dietrich Reips, Hans-Christoph Nuerk, Annika Tave Overlander, Krzysztof Cipora https://osf.io/ajqpkA Registered Report demonstration that the SNARC effect depends on absolute as well as relative number magnitudeRecommended by Robert McIntoshThe Spatial-Numerical Association of Response Codes (SNARC) effect refers to the fact that smaller numbers receive faster responses with the left hand, and larger numbers with the right hand (Dehaene et al., 1993). This robust finding implies that numbers are associated with space, being represented on a mental number line that progresses from left to right. The SNARC effect is held to depend on relative number magnitude, with the mental number line dynamically adjusting to the numerical range used in a given context. This characterisation is based on significant effects of relative number magnitude, with no significant influence of absolute number magnitude. However, a failure to reject the null hypothesis is not firm evidence for the absence of an effect. In this Registered Report, Roth and colleagues (2024) report two large-sample online experiments, with a Bayesian statistical approach to confirm—or refute—a role for absolute number magnitude in modulating the classic SNARC effect (smallest effect size of interest, d = 0.15).
Experiment 1 closely followed Dehaene’s (1993) original methods, and found strong evidence for an influence of relative magnitude, and moderate-to-strong evidence against an influence of absolute magnitude. Experiment 2 was designed to exclude some potential confounds in the original method, and this second experiment found strong evidence for both relative and absolute magnitude effects, of comparable effect sizes (in the range of d = .24 to .42). This registered study demonstrates that the SNARC effect is not ‘fully flexible’, in the sense of depending only on relative number magnitude; it is also shaped by absolute magnitude.
This Stage 2 manuscript was evaluated by the recommender and one external reviewer. Following appropriate minor revisions, the recommender judged that the manuscript met the Stage 2 criteria for recommendation.
URL to the preregistered Stage 1 protocol: https://osf.io/ae2c8
Level of bias control achieved: Level 6. No part of the data or evidence that was used to answer the research question was generated until after IPA. List of eligible PCI RR-friendly journals: References 1. Dehaene, S., Bossini, S., & Giraux, P. (1993). The mental representation of parity and number magnitude. Journal of Experimental Psychology: General, 122, 371–396. https://doi.org/10.1037/0096-3445.122.3.371
2. Roth, L., Caffier, J., Reips, U.-D., Nuerk, H.-C., Overlander, A. T. & Cipora, K. (2023). One and only SNARC? Spatial-Numerical Associations are not fully flexible and depend on both relative and absolute magnitude [Stage 2]. Acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/epnd4
| One and only SNARC? Spatial-Numerical Associations are not fully flexible and depend on both relative and absolute magnitude | Lilly Roth, John Caffier, Ulf-Dietrich Reips, Hans-Christoph Nuerk, Annika Tave Overlander, Krzysztof Cipora | <p>Numbers are associated with space, but it is unclear how flexible these associations are. We investigated whether the SNARC effect (Spatial-Numerical Association of Response Codes; Dehaene et al., 1993; i.e., faster responses to small/large num... | Life Sciences | Robert McIntosh | 2024-06-10 15:00:30 | View | ||
31 May 2024
STAGE 1
![]() Representativeness heuristic in intuitive predictions: Replication Registered Report of problems reviewed in Kahneman and Tversky (1973)Hong Ching (Bruce) Chan, Gilad Feldman https://osf.io/9cqp6The Representativeness Heuristic Revisited: Registered Replication Report of Kahneman and Tversky (1973)Recommended by Rima-Maria RahalRevisiting a true classic, this registered replication report addresses Kahneman and Tversky’s (1973) introduction of the representativeness heuristic. The heuristic refers to deviations of judgments from normative evaluations of the evidence when the stimulus fits to a prototype. For instance, when an individual is described by features stereotypically associated with a certain target group (e.g., a person who attends dance training several times a week and has a passion for singing and performing), likelihood judgments that the individual belongs to a target group (K-Pop artists) compared to a non-target group (e.g., accountants) are inflated.
The impact of the original research on the field is clearly immense and long-lasting. All the better that a systematic replication attempt is being undertaken in this registered report, which addresses studies 1 through 7 of Kahneman and Tversky’s classic 1973 paper. Chan and Feldman (2024) propose a well-powered online study, in which all studies from the original article are presented to participants within-subjects. The materials are carefully constructed and closely documented in the accompanying OSF project, where in-depth information on planned data analyses is supported with a simulated dataset. The Stage 1 manuscript was evaluated over three rounds of in-depth review. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA). URL to the preregistered Stage 1 protocol: https://osf.io/er2cq
Level of bias control achieved: Level 6. Data collection commenced during the later part of Stage 1 peer review; however, since no substantive changes to the design were made after this point, the risk of bias due to prior data observation remains zero and the manuscript therefore qualifies for Level 6.
List of eligible PCI RR-friendly journals:
References
1. Chan, H. C. & Feldman, G. (2024). Representativeness heuristic in intuitive predictions: Replication Registered Report of problems reviewed in Kahneman and Tversky (1973). In principle acceptance of Version 5 by Peer Community in Registered Reports. https://osf.io/er2cq 2. Kahneman, D., & Tversky, A. (1973). On the psychology of prediction. Psychological Review, 80(4), 237–251. https://doi.org/10.1037/h0034747
| Representativeness heuristic in intuitive predictions: Replication Registered Report of problems reviewed in Kahneman and Tversky (1973) | Hong Ching (Bruce) Chan, Gilad Feldman | <p>[IMPORTANT: Abstract, method, and results were written using a randomized dataset produced by Qualtrics to simulate what these sections will look like after data collection. These will be updated following the data collection. For the purpose o... | Social sciences | Rima-Maria Rahal | 2023-11-29 15:19:07 | View | ||
11 Apr 2024
STAGE 1
![]() Do pain and effort increase prosocial contributions?: Revisiting the Martyrdom Effect with a Replication and extensions Registered Report of Olivola and Shafir (2013)Yim Tung (Emanuel) Cheng, Gilad Feldman https://osf.io/7njh8More pain, more prosocial? Assessing the Martyrdom EffectRecommended by Rima-Maria RahalThe Martyrdom Effect is a behavioral tendency in which individuals exhibit greater generosity when their acts of giving entail effort or self-sacrifice (Olivola & Shafir, 2013). Giving at a personal cost, in this mindset, is associated with ascribing and inferring more meaning and value to charitable giving or other forms of generosity than in instances where no particular pain or effort is required to enact prosocial behavior. Arguably, the Martyrdom Effect’s ability to boost prosocial behavior therefore departs from other theories of behavior change postulating that easy options to act prosocially could boost contributions (e.g., default effects in charitable giving, see Altmann et al., 2019; Goswami & Urminsky, 2016). Because they introduce complexity to the debate about encouraging prosocial behavior, three studies from Olivola and Shafir (2013) are now being addressed in this Registered Report by Cheng and Feldman (2024).
Combining these three studies in a high-powered within-subjects replication attempt, transparently communicating necessary deviations from the original design and carefully outlining the analysis strategy, the current study will offer insights into the robustness of prior findings on the role of effort and pain in determining donations. The Stage 1 manuscript was evaluated by two reviewers and the recommender. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA). URL to the preregistered Stage 1 protocol: https://osf.io/aq89u
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.
List of eligible PCI RR-friendly journals:
References
1. Altmann, S., Falk, A., Heidhues, P., Jayaraman, R., & Teirlinck, M. (2019). Defaults and Donations: Evidence from a Field Experiment. The Review of Economics and Statistics, 101, 808-826. https://doi.org/10.1162/rest_a_00774
2. Cheng, Y. T. & Feldman, G. (2024). Do pain and effort increase prosocial contributions?: Revisiting the Martyrdom Effect with a Replication and extensions Registered Report of Olivola and Shafir (2013). In principle acceptance of Version 2 by Peer Community in Registered Reports. https://osf.io/aq89u
3. Goswami, I., & Urminsky, O. (2016). When should the Ask be a Nudge? The Effect of Default Amounts on Charitable Donations. Journal of Marketing Research, 53, 829-846. https://doi.org/10.1509/jmr.15.0001
4. Olivola, C. Y., & Shafir, E. (2013). The Martyrdom Effect: When Pain and Effort Increase Prosocial Contributions. Journal of Behavioral Decision Making, 26, 91-105. https://doi.org/10.1002/bdm.767
| Do pain and effort increase prosocial contributions?: Revisiting the Martyrdom Effect with a Replication and extensions Registered Report of Olivola and Shafir (2013) | Yim Tung (Emanuel) Cheng, Gilad Feldman | <p>[IMPORTANT: Abstract, method, and results were written using a randomized dataset produced by Qualtrics to simulate what these sections will look like after data collection. These will be updated following the data collection. For the purpose o... | Social sciences | Rima-Maria Rahal | Liesbeth Mann, Vanessa Clemens | 2023-11-30 12:32:25 | View | |
24 Sep 2024
STAGE 1
![]() Independent Comparative Evaluation of the Pupil Neon - A New Mobile Eye-trackerValentin Foucher, Alina Krug, Marian Sauter https://osf.io/jcu2t?view_only=2627595019be4f92abf0bf338c83ee68Assessing the Promise of Affordable, Mobile Eye-Tracking Devices: Evaluation of the Pupil NeonRecommended by Rima-Maria RahalStudying eye-gaze has long been employed as a central method for understanding attentional dynamics and cognitive processes in a variety of domains. The development of affordable, mobile eye-tracking devices, such as the Pupil Neon, promises new opportunities to extend this research beyond the contexts in which traditional eye-trackers have been available. But how good are such novel devices at detecting variables relevant for the study of eye movements and pupil dilations?
Foucher, Krug and Sauter (2024) propose an independent evaluation of the Pupil Neon eye-tracker using the Ehinger et al. (2019) test battery, comparing its performance with a traditional EyeLink 1000 Plus device. In an empirical study, participants will be asked to perform a wide variety of tasks while eye movements and pupil dilations are tracked using both devices. Results on the strengths and weaknesses, as well as potential use cases of the Pupil Neon will be informative for subsequent eye-tracking research.
The Stage 1 manuscript was evaluated over two rounds of in-depth review. Based on detailed responses to the recommender and reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA). URL to the preregistered Stage 1 protocol: https://osf.io/3kc5t
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.
List of eligible PCI RR-friendly journals:
References: 1. Ehinger, B. V., Groß, K., Ibs, I., and König, P. (2019). A New Comprehensive Eye-Tracking Test Battery Concurrently Evaluating the Pupil Labs Glasses and the Eyelink 1000. PeerJ, 7, e7086. https://doi.org/10.7717/peerj.7086 2. Foucher, V., Krug, A., and Sauter, M. (2024). Independent Comparative Evaluation of the Pupil Neon - A New Mobile Eye-tracker. In principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/3kc5t | Independent Comparative Evaluation of the Pupil Neon - A New Mobile Eye-tracker | Valentin Foucher, Alina Krug, Marian Sauter | <p>Due to the rapid adoption of (mobile) eye-tracking devices in both academic and consumer research, it becomes more important that the increasing number of datasets is based on reliable recordings. This study provides an independent evaluation o... | Engineering, Life Sciences, Social sciences | Rima-Maria Rahal | 2024-05-29 10:29:06 | View | ||
07 Dec 2023
STAGE 1
![]() Is conscious perception necessary to direct attention? A replication of Jiang et al. (2006)Yung-Jung Chen, Ryan B Scott, Zoltan Dienes https://osf.io/preprints/psyarxiv/jwgv3/Can sexually salient stimuli direct attention outside of conscious awareness?Recommended by Reshanne ReederAre attention and consciousness inherently intertwined or distinct aspects of cognition? One report (Jiang et al. 2006) presented clear results in evidence of the latter. In this earlier study, the authors used a continuous flash suppression (CFS) paradigm which presents a colorful pattern to the dominant eye and stimuli of interest to the non-dominant eye; the colorful pattern masks the relevant stimulus from awareness. On each trial, the authors presented a sexually stimulating image and a scrambled image on different sides of a computer screen during CFS. They found that, even though participants were not consciously aware of the images, intact images that matched participants' sexual orientation could still capture attention.
Despite these seemingly clear results, the authors of the current Stage 1 manuscript pointed out that CFS studies are often not replicated, and the paper by Jiang et al. (2006) is no exception. Therefore, Chen et al. (2023) seek to replicate this study using a Bayesian (rather than NHST) analytic approach. This method will allow the authors to determine the strength of evidence for their hypotheses.
In this Stage 1 manuscript, Chen et al. present an introduction that motivates the replication, and a pilot study that replicated the procedure of Jiang et al. (2006) conducted with 21 participants. This led to a well-motivated statistical sampling plan and some small design changes for the main experiment, such as adding a staircasing procedure to remove potential performance ceiling effects, and using less extreme wording for stimulus attractiveness ratings. A clear study design template is presented, detailing the different hypotheses that will be tested, and what different outcomes would indicate.
The Stage 1 submission was evaluated by the recommender and two expert reviewers. Following revisions, the recommender judged that the manuscript met the Stage 1 criteria and awarded in-principle acceptance (IPA).
URL to the preregistered Stage 1 protocol: https://osf.io/b2ncp
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.
List of eligible PCI RR-friendly journals:
References 1. Jiang, Y., Costello, P., Fang, F., Huang, M., & He, S. (2006). A gender-and sexual orientation-dependent spatial attentional effect of invisible images. Proceedings of the National Academy of Sciences, 103, 17048-17052. https://doi.org/10.1073/pnas.0605678103
2. Chen, Y.-J., Scott, R.B., & Dienes, Z. (2023). Is conscious perception necessary to direct attention? A replication of Jiang et al. (2006). In principle acceptance of Version 2 by Peer Community in Registered Reports. https://osf.io/b2ncp
| Is conscious perception necessary to direct attention? A replication of Jiang et al. (2006) | Yung-Jung Chen, Ryan B Scott, Zoltan Dienes | <p>The relationship between attention and consciousness has been debated for the past few decades. Observing attentional biases induced by visual stimuli below conscious threshold is one way of providing evidence for the independence of attention ... | Social sciences | Reshanne Reeder | 2023-10-11 22:02:33 | View |
FOLLOW US
MANAGING BOARD
Chris Chambers
Zoltan Dienes
Corina Logan
Benoit Pujol
Maanasa Raghavan
Emily S Sena
Yuki Yamada