Submit a report

Announcements

We are recruiting recommenders (editors) from all research fields!

Your feedback matters! If you have authored or reviewed a Registered Report at Peer Community in Registered Reports, then please take 5 minutes to leave anonymous feedback about your experience, and view community ratings.


 

Latest recommendationsrssmastodon

IdTitleAuthorsAbstract▼PictureThematic fieldsRecommenderReviewersSubmission date
25 Jun 2023
STAGE 1
toto

Cortical plasticity of the tactile mirror system in borderline personality disorder

Is borderline personality disorder linked to impairment of the tactile mirror system?

Recommended by ORCID_LOGO based on reviews by Zoltan Dienes and 2 anonymous reviewers
Borderline personality disorder (BPD) is a mental illness affecting ~1 in 100 people (Ellison et al., 2018), characterised by emotional dysregulation, impulsivity, a distorted sense of self, and a long-term pattern of unstable interpersonal relationships. Among this heterogenous range of symptoms is difficulty in the cognitive dimension of empathy, in particular understanding the perspectives of others, which in turn has been suggested to rely on the mirror neuron system, both in the motor and somatosensory domains. The integrity of the mirror system has therefore been a focus for understanding the possible causes or consequences of the disorder, with preliminary studies pointing to hypoactivity of neuronal areas associated with the mirror system in BPD (Mier et al., 2013).
 
In the current study, Zazio et al. (2023) will use crossmodal paired associative stimulation (cm-PAS) in which an image of a hand being touched is repeatedly paired with transcranial magnetic stimulation (TMS) of the primary somatosensory cortex (S1) to test the hypothesis that BPD is associated with a specific deficit in the tactile mirror system. In healthy controls, the close temporal coupling (20ms) between the visual depiction of tactile stimulation and TMS of S1 is expected boost tactile acuity and elevate the performance cost of incongruence in a task that manipulates visuo-tactile spatial congruity (VTSC) – effects that are thought to reflect the fidelity of the tactile mirror system.
 
In BPD patients, however, the authors make the crucial prediction that impairment of the tactile mirror system (if present) will lead to a reduced (or even non-existent) effect of cm-PAS on tactile acuity and VTSC task performance compared to healthy controls. To help ensure a severe test of this hypothesis, the design includes a variety of controls, including an attention check, control cm-PAS in which the inter-stimulus interval is increased to 100ms to break the close temporal coupling between visual stimulation and TMS, and a positive control to confirm that active cm-PAS (compared to control cm-PAS) produces the expected boost in tactile acuity in healthy controls.
 
The Stage 1 manuscript was evaluated over three rounds of in-depth review. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
 
URL to the preregistered Stage 1 protocol: https://osf.io/sqnwd
 
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.
 
List of eligible PCI RR-friendly journals:
 
References
 
1. Ellison, W. D., Rosenstein, L. K., Morgan, T. A., & Zimmerman, M. (2018). Community and clinical epidemiology of borderline personality disorder. Psychiatric Clinics, 41, 561-573. https://doi.org/10.1016/j.psc.2018.07.008

2. Mier, D., Lis, S., Esslinger, C., Sauer, C., Hagenhoff, M., Ulferts, J., Gallhofer, B. & Kirsch, P. (2013). Neuronal correlates of social cognition in borderline personality disorder. Social Cognitive and Affective Neuroscience, 8, 531-537. https://doi.org/10.1093/scan/nss028
 
2. Zazio, A., Guidali, G., Rossi, R., Bolognini, N. & Bortoletto, A. (2023). Cortical plasticity of the tactile mirror system in borderline personality disorder, in principle acceptance of Version 4 by Peer Community in Registered Reports. https://osf.io/sqnwd
Cortical plasticity of the tactile mirror system in borderline personality disorderAgnese Zazio, Giacomo Guidali, Roberta Rossi, Nadia Bolognini, Marta Bortoletto<p>People with borderline personality disorder (BPD) show alterations in empathic abilities, which may involve automatic simulation processes relying on mirror-like mechanisms in the somatosensory domain. In the tactile mirror system, the observat...Life Sciences, Social sciencesChris Chambers2023-01-05 21:50:15 View
19 Apr 2022
STAGE 1
toto

Is the past farther than the future? A registered replication and test of the time-expansion hypothesis based on the filling rate of duration

Could asymmetrical perceptions about the frequency of past and future events explain the Temporal Doppler Effect?

Recommended by ORCID_LOGO based on reviews by Chris Chambers and 2 anonymous reviewers
The Temporal Doppler Effect is a phenomenon where people subjectively perceive the past to be further away than the future even when both temporal distances are objectively the same from the present moment (Caruso et al., 2013). A common explanation for this phenomenon assumes that our perception of the past and future is based on spatial and temporal analogies (Matlock, Ramscar, & Boroditsky, 2005; Casanto & Boroditsky, 2008) and that the subjective discrepancy is due to people feeling that they are moving towards the future and away from the fast, thus underestimating the temporal distance of the former and overestimating the temporal distance of the latter (Caruso et al., 2013).
 
In the current study, Zhang et al. propose to replicate the Temporal Doppler Effect as tested by Caruso et al. (2013) in study 1 and to test an alternative explanation for the effect in study 2 based on the filled-duration illusion (Thomas & Brown, 1974). This alternative explanation assumes that the subjective discrepancy is based on the difference that the past and the future are filled with events that we can remember or imagine. Because the past has already happened, it is comprised of more events (those that were planned and those that were not), while the future still exists only of events that are currently planned. 
 
The Stage 1 manuscript was evaluated over three rounds of in-depth review. The main changes during the review process involved clarifications and adaptations of the way that the authors will measure the participants’ perception of how full of events the past and the future are, as the originally proposed way measuring this did not have sufficient theoretical or empirical justifications. The authors decided to address this by firstly, clarifying this issue in the stage 1 report so that the reader is aware of the potential shortcomings of this measure, and secondly, by testing a second group of participants with an alternative measure. Based on detailed responses to the reviewers’ comments and edits to the stage 1 report, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA). 
 
URL to the preregistered Stage 1 protocol: https://osf.io/d9ec3
 
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.
 
List of eligible PCI RR-friendly journals:
 
 
References
 
1. Caruso, E. M., Van Boven, L., Chin, M., & Ward, A. (2013). The temporal doppler effect: When the future feels closer than the past. Psychological Science, 24, 530-536. https://doi.org/10.1177/0956797612458804 
 
2. Casanto, D., & Boroditsky, L. (2008). Time in the mind: Using space to think about time. Cognition, 106, 579-593. https://doi.org/10.1016/j.cognition.2007.03.004
 
3. Matlock, T., Ramscar, M., & Boroditsky, L. (2005). One the experiential link between spatial and temporal language. Cognitive Science, 29, 655-664. https://doi.org/10.1207/s15516709cog0000_17 
 
4. Thomas, E. C., & Brown, I. (1974). Time perception and the filled-duration illusion. Perception & Psychophysics, 16, 449-458. https://doi.org/10.3758/BF03198571 
 
5. Zhang, Q., Masuda, Y., Ueda, K.,Toda, K., & Yamada, Y. (2022). Is the past farther than the future? A registered replication and test of the time-expansion hypothesis based on the filling rate of duration. Stage 1 Registered Report, in principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/d9ec3
Is the past farther than the future? A registered replication and test of the time-expansion hypothesis based on the filling rate of durationQinjing Zhang, Yoshitaka Masuda, Kohei Ueda, Kodai Toda, Yuki Yamada<p>People sometimes feel events to be psychologically closer while farther at other times. Caruso et al. (2013) reported the Temporal Doppler Effect (TDE) in which people feel that the past is farther than the future, despite an equivalent objecti...Social sciencesLjerka Ostojic2021-06-14 16:04:02 View
07 Oct 2022
STAGE 2
(Go to stage 1)
article picture

Is the past farther than the future? A registered replication and test of the time-expansion hypothesis based on the filling rate of duration

The Temporal Doppler Effect may not be a robust and culturally universal phenomenon

Recommended by ORCID_LOGO based on reviews by Chris Chambers and 1 anonymous reviewer
The Temporal Doppler Effect refers to the subjective perception that the past is further away than the future even when both temporal distances are objectively the same from the present moment (Caruso et al., 2013). In the current study, Zhang et al. ran a replication of this phenomenon and tested one possible explanation for it, namely that people overestimate the temporal distance of the past because the past is filled with more events than the future. This is because we can access information only about planned events for the future, but have access to both planned and unplanned events that happened in the past (filled-duration illusion; Thomas & Brown, 1974).
 
Over two studies, the authors found that the sampled participants reported feeling that the past was psychologically closer than the future, which is the opposite of what has previously been reported and termed the Temporal Doppler Effect (Caruso et al., 2013). In addition, the authors reported inconsistent results regarding the correlations between the psychological distance and different variables associated with the filling rate of duration. The authors discuss the differences between their own results and those by Caruso et al. (2013) in terms of methodological and contextual differences and highlight cultural aspects that may be critical to consider in future replications and overall testing of this phenomenon. As such, they highlight that, at the moment, the Temporal Doppler Effect should not be considered a robust and culturally universal phenomenon. 
 
The Stage 2 manuscript was evaluated by two reviewers who had also reviewed the stage 1 report. Following a revision by the authors, which consisted of adding the Data Availability statement, as well as a more precise summary of the results in various sections of the report, the recommender judged that the manuscript met the Stage 2 criteria and awarded a positive recommendation.
 
URL to the preregistered Stage 1 protocol: https://osf.io/d9ec3/
 
Level of bias control achieved: Level 6. No part of the data or evidence that was used to answer the research question existed prior to Stage 1 in-principle acceptance. 
 
List of eligible PCI RR-friendly journals:
 

 

References
 
1. Caruso, E. M., Van Boven, L., Chin, M., & Ward, A. (2013). The temporal doppler effect: When the future feels closer than the past. Psychological Science, 24, 530-536. https://doi.org/10.1177/0956797612458804 
 
2. Thomas, E. C., & Brown, I. (1974). Time perception and the filled-duration illusion. Perception & Psychophysics, 16, 449-458. https://doi.org/10.3758/BF03198571 
 
3. Zhang, Q., Masuda, Y., Ueda, K.,Toda, K., & Yamada, Y. (2022). Is the past farther than the future? A registered replication and test of the time-expansion hypothesis based on the filling rate of duration. Stage 2 Registered Report, acceptance of Version 2 by Peer Community in Registered Reports. https://psyarxiv.com/pb47n/ 
 
Is the past farther than the future? A registered replication and test of the time-expansion hypothesis based on the filling rate of durationQinjing Zhang, Yoshitaka Masuda, Kodai Toda, Kohei Ueda, Yuki Yamada<p>People feel some events to be psychologically closer, while others to be farther away. Caruso et al. (2013) reported the Temporal Doppler Effect (TDE), in which people feel that the past is farther than the future, despite an equivalent objecti...Social sciencesLjerka Ostojic2022-08-20 09:59:09 View
24 Oct 2022
STAGE 1
toto

Does childhood adversity alter opioid drug reward? A conceptual replication in outpatients before surgery

Is childhood adversity associated with a heightened response to opioids?

Recommended by ORCID_LOGO based on reviews by Zoltan Dienes, Yuki Yamada and 1 anonymous reviewer
A convergence of evidence suggests that early life adversity may cause dysfunction in opioid-sensitive reward systems. Childhood adversity is associated with opioid use, potentially by altering reward and motivation networks, and experimental models in animals have found that early life adversity increases and consolidates opioid seeking behaviours. Further, in a recent controlled experiment, Carlyle et al. (2021) found that opioid administration produced stronger positive responses, and weaker negative responses, in adults with a history of childhood abuse and neglect.
 
In the current study, Carlyle et al. seek to test the generalisability of these previous findings in a pre-operative clinical setting. Using partially observed data from an existing cohort study (N=155), the authors will test whether patients with greater experience of childhood trauma in turn exhibit a larger mood boost and express greater subjective pleasure following opioid administration. Although not a randomised experimental design, this study provides the opportunity to examine the relationship between opioid response and history of childhood adversity in a naturalistic setting, and thus has the potential to either support or cast doubt on the theory that adversity elevates risk of opioid addiction by altering sensitivity to subjectively pleasurable effects.
 
Following three rounds of in-depth review, the recommender judged that the manuscript met the Stage 1 criteria and awarded in-principle acceptance (IPA).
 
URL to the preregistered Stage 1 protocol: https://osf.io/7ymts
 
Level of bias control achieved: Level 2. At least some data/evidence that will be used to answer the research question has been accessed and partially observed by the authors, but the authors certify that they have not yet observed the key variables within the data that will be used to answer the research question AND they have taken additional steps to maximise bias control and rigour. 
 
List of eligible PCI RR-friendly journals:
 
References
 
1. Carlyle M., Broomby R., Simpson G., Hannon R., Fawaz L., Mollaahmetoglu O.M., Drain, J., Mostazir, M., & Morgan C. (2021). A randomised, double‐blind study investigating the relationship between early childhood trauma and the rewarding effects of morphine. Addiction Biology, 26(6):e13047.
 
2. Carlyle, M., Kvande, M., Leknes, S., Meier, I., Buen, K., Jensen, E. N., Ernst, G. & Eikemo, M. (2022). Does childhood adversity alter opioid drug reward? A conceptual replication in outpatients before surgery, in principle acceptance of Version 4 by Peer Community in Registered Reports. https://osf.io/7ymts
Does childhood adversity alter opioid drug reward? A conceptual replication in outpatients before surgeryMolly Carlyle*, Malin Kvande*, Siri Leknes, Isabell Meier, Kaja Buen, Eira Nordeng Jensen, Gernot Ernst, Marie Eikemo. *denotes equal contribution. <p>PCI-RR Snapshot only</p>Life Sciences, Medical Sciences, Social sciencesChris Chambers2022-03-15 10:07:29 View
15 Jan 2024
STAGE 1
toto

Neurophysiological correlates of plasticity induced by paired associative stimulation (PAS) targeting the motor cortex: a TMS-EEG registered report

Can TMS-evoked potentials act as biomarkers of long-term potentiation or long-term depression induced by paired associative stimulation?

Recommended by ORCID_LOGO based on reviews by Domenica Veniero, Lindsay Oberman and 1 anonymous reviewer
What are the neurophysiological correlates of paired associative stimulation (PAS) in inducing plastic changes in human motor cortex (M1)? Here, Arrigoni and colleagues (2024) will apply transcranial magnetic stimulation (TMS) to left M1 paired with electrical stimulation of the right median nerve at an ISI of 25 ms or 10 ms to induce long-term potentiation (LTP) or long-term depression (LTD), respectively. Arrigoni and colleagues (2024) will determine if these stimulation pairings effect cortical excitability using motor-evoked potentials (MEPs) and TMS-evoked potentials (TEPs). Specifically, they hypothesize PASLTP will increase the peak-to-peak amplitude of MEPs, whereas PASLTD will decrease the amplitude, replicating previous work. They will then extend these previous findings by examining TEPs. The authors anticipate modulation of the P30 and P60, which are TEPs thought to reflect local cortical excitability. They plan to account for the MEP reafference which may also mediate the P60 amplitude by stimulating at sub- and supra- motor threshold. Further, they hypothesize an increase of the N100, a marker of inhibitory processing mediated by GABA, by PASLTD. Finally, the authors will also examine the impact of cortical excitability over time to determine the duration of the PAS effects.   
 
This detailed examination of TEPs following PAS stimulation will determine which TEPs could be used as biomarkers with the induction of LTP and LTD through stimulation. The authors have built in an MEP replication for the PAS stimulation, supporting previous literature and acting as a positive control.  
 
The Stage 1 manuscript was evaluated by three expert reviewers across two rounds. Following in-depth review and responses from the authors, the recommender determined that Stage 1 criteria was met and awarded in-principle acceptance (IPA).
 
URL to the preregistered Stage 1 protocol: https://osf.io/detjc (under temporary private embargo)
 
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA. 
 
List of eligible PCI RR-friendly journals:
 

References
 
1. Arrigoni, E., Bolognini, N., Pisoni, A. & Guidali, G. (2024). Neurophysiological correlates of plasticity induced by paired associative stimulation (PAS) targeting the motor cortex: a TMS-EEG registered report. In principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/detjc
Neurophysiological correlates of plasticity induced by paired associative stimulation (PAS) targeting the motor cortex: a TMS-EEG registered reportEleonora Arrigoni, Nadia Bolognini, Alberto Pisoni, Giacomo Guidali<p>Paired associative stimulation (PAS) can induce long-term potentiation (LTP) and long-term depression (LTD) in the human motor system by applying transcranial magnetic stimulation (TMS) pulses on the primary motor cortex (M1) paired with electr...Life SciencesGrace Edwards2023-07-22 10:25:21 View
16 Sep 2022
STAGE 1
toto

Taking A Closer Look At The Bayesian Truth Serum: A Registered Report

Understanding the key ingredients of the Bayesian Truth Serum

Recommended by ORCID_LOGO based on reviews by 2 anonymous reviewers
The Bayesian Truth Serum, first introduced by Prelec (2004) rewards participants based on how surprisingly common their own answers are in relation to the actual distribution of answers. As such, it has been suggested as a possible incentive-compatible design for survey studies in different disciplines that rely on participants’ self-reports about their true preferences (Schoenegger, 2021). 
 
In this study, Schoenegger and Verheyen propose to replicate the results reported by Schoenegger (2021) and to directly investigate whether the effect elicited by the manipulations known as the Bayesian Truth Serum is distinct from its separate constituent parts. 
 
The Stage 1 manuscript was evaluated over one round of in-depth review. Based on detailed responses to the reviewers’ comments and edits to the stage 1 report, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
 
URL to the preregistered Stage 1 protocol: https://osf.io/dkvms
 
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.
 
List of eligible PCI RR-friendly journals:
 
 
References
 
1. Prelec, D. (2004). A Bayesian Truth Serum for Subjective Data. Science, 306(5695), 462-466. https://doi.org/10.1126/science.1102081
 
2. Schoenegger, P. (2021). Experimental Philosophy and the Incentivisation Challenge: a Proposed Application of the Bayesian Truth Serum. Review of Philosophy and Psychology https://doi.org/10.1007/s13164-021-00571-4 
 
3. Schoenegger, P., & Verheyen, S. (2022). Taking A Closer Look At The Bayesian Truth Serum: A Registered Report. Stage 1 Registered Report, in principle acceptance of Version 2 by Peer Community in Registered Reports. https://osf.io/dkvms 
Taking A Closer Look At The Bayesian Truth Serum: A Registered ReportPhilipp Schoenegger & Steven Verheyen<p>Over the past decades, psychology and its cognate disciplines have undergone substantial reform, ranging from advances in statistical methodology to significant changes in academic norms. One aspect of experimental design that has received comp...Social sciencesLjerka Ostojic2021-12-06 17:36:15 View
16 Sep 2022
STAGE 2
(Go to stage 1)
toto

Taking A Closer Look At The Bayesian Truth Serum: A Registered Report

Reassessing the use of the Bayesian Truth Serum as an incentive-compatible design for self-reports

Recommended by ORCID_LOGO based on reviews by Joël van der Weele
Different disciplines and research areas that rely on participants’ self-reports to accrue data on participants’ true preferences are faced with the question to what extent the former can be equated with the latter. Using monetary incentivisation for study participation may influence this relationship, and researchers, especially in economics, have been discussing how to develop and implement incentive-compatible research designs, i.e., those in which the incentivisation yields the best payoff for the participant if they report their true preferences (Hertwig & Ortmann, 2011; Baillon, 2017). The Bayesian Truth Serum, first introduced by Prelec (2004), according to which participants are rewarded based on how surprisingly common their own answers are relative to the actual distribution of answers, has been proposed as a possible incentive-compatible design for survey studies that rely on participants’ self-reports about their true preferences (Schoenegger, 2021).
 
In this study, Schoenegger and Verheyen (2022) ran a replication of the study by Schoenegger (2021) and assessed whether the effect elicited by the manipulations known as the Bayesian Truth Serum is distinct from its separate constituent parts. The authors report that the manipulation did not yield a significant difference compared to control conditions, which they interpret as a failure to replicate the original results. At the same time, the authors are careful in drawing conclusions as to the usefulness of the Bayesian Truth Serum for self-report studies using Likert-scale items in general, as they emphasise that smaller effect sizes may be of interest and that the results may differ when different items are used. 
 
The Stage 2 manuscript was evaluated by two reviewers, one of whom reviewed the first Stage 1 submission, and the other one of whom reviewed the manuscript specifically to assess statistical questions.
 
Following a careful revision by the authors, the recommender judged that the manuscript meets the Stage 2 criteria and awarded a positive recommendation.
 
URL to the preregistered Stage 1 protocol: https://osf.io/dkvms
 
Level of bias control achieved: Level 6. No part of the data or evidence that was used to answer the research question existed prior to Stage 1 in-principle acceptance. 
 
List of eligible PCI RR-friendly journals:
 
References
 
1. Baillon, A. (2017). Bayesian markets to elicit private information. Proceedings of the National Academy of Science, 114(30), 7985-7962. https://doi.org/10.1073/pnas.1703486114
 
2. Hertwig, R. & Ortmann (2001). Experimental practices in economics: a methodlogical challenge for psychologists? Behavioral and Brain Sciences, 24(3), 383-403. https://doi.org/10.1037/e683322011-032
 
3. Prelec, D. (2004). A Bayesian Truth Serum for Subjective Data. Science, 306(5695), 462-466. https://doi.org/10.1126/science.1102081
 
4. Schoenegger, P. (2021). Experimental Philosophy and the Incentivisation Challenge: a Proposed Application of the Bayesian Truth Serum. Review of Philosophy and Psychology https://doi.org/10.1007/s13164-021-00571-4 
 
5. Schoenegger, P., & Verheyen, S. (2022). Taking A Closer Look At The Bayesian Truth Serum: A Registered Report. Stage 2 Registered Report, in principle acceptance of Version 3 by Peer Community in Registered Reports. https://doi.org/10.31219/osf.io/9zvqj
Taking A Closer Look At The Bayesian Truth Serum: A Registered ReportPhilipp Schoenegger & Steven Verheyen<p>Over the past decade, psychology and its cognate disciplines have undergone substantial scientific reform, ranging from advances in statistical methodology to significant changes in academic norms. One aspect of experimental design that has rec...Social sciencesLjerka Ostojic2022-06-11 14:39:38 View
20 Jan 2023
STAGE 2
(Go to stage 1)
toto

No reliable effect of task-irrelevant cross-modal statistical regularities on distractor suppression

Failure to learn cross-modally to suppress distractors

Recommended by ORCID_LOGO based on reviews by Miguel Vadillo and 1 anonymous reviewer
There are two fundamental processes that the brain engages in: statistical learning and selection. Indeed, past work has shown these processes often come together: People can use a task-irrelevant stimulus to predict a target stimulus even in different modalities (crossmodal statistical learning), thereby enhancing the processing of the target stimulus (selection). Further, people can learn where a distractor will be in order to efficiently suppress it (selecting out), using task irrelevant stimuli in the same modality (within-modality statistical learning).
 
In two experiments Jagini and Sunny found that people did not learn to use a task-irrelevant stimulus from a different modality (cross modal statistical learning) to suppress a distractor (selecting out). They also found that people had little awareness of the relation between the predictor task-irrelevant stimulus and the location of the distractor. The results may reflect limits on what can be achieved unconsciously.
 
Following peer review, the recommender judged that the manuscript met the Stage 2 criteria and awarded a positive recommendation.
 
URL to the preregistered Stage 1 protocol: https://osf.io/qjbmg
 
Level of bias control achieved: Level 6. No part of the data or evidence that was used to answer the research question existed prior to Stage 1 in-principle acceptance.
 
List of eligible PCI RR-friendly journals:
 
 
References
 
1. Jagini, K. K. & Sunny, M. M. (2023). No reliable effect of task-irrelevant cross-modal statistical regularities on distractor suppression. Stage 2 Registered Report, acceptance of Version 4 by Peer Community in Registered Reports. https://doi.org/10.31234/osf.io/d8wes
No reliable effect of task-irrelevant cross-modal statistical regularities on distractor suppressionKishore Kumar Jagini, Meera Mary Sunny<p>Our sensory systems are known to extract and utilize statistical regularities in sensory inputs across space and time for efficient perceptual processing. Past research has shown that participants can utilize statistical regularities of target ...Humanities, Life Sciences, Social sciencesZoltan Dienes2022-11-21 15:30:30 View
16 Nov 2023
STAGE 1
toto

The effect of stimulus saliency on the modulation of pain-related ongoing neural oscillations: a Registered Report

Are there oscillatory markers of pain intensity?

Recommended by ORCID_LOGO based on reviews by Markus Ploner and Björn Horing
Rhythmic changes in pain can lead to corresponding modulations of EEG amplitudes in theta, alpha, and beta bands. But the question remains open as to whether these modulations are actually tracking pain, or maybe rather saliency or stimulus intensity. The question is of some importance because a marker of pain per se could be useful for tracking felt pain without a verbal response, and could be useful in investigating interventions for treating pain (such as suggestion).  Here, Leu et al. (2023) will address the question of whether modulations reflect saliency or else the intensity of pain, by using an oddball paradigm in which most trials are a pain stimulus of a certain intensity, and oddball trials will sometimes occur, at either a higher intensity or a lower intensity than the baseline ones. If the modulations reflect salience, the modulation at the frequency of the oddball will be similar for high and low intensity oddballs. However, if the modulations reflect pain intensity, the modulations for the low rather than high oddball condition will be lower.
 
The Stage 1 manuscript was evaluated over three rounds of in-depth peer review, the first two consisting of substantial comments from two scholars with relevant expertise, and the third consisting of a close review by the recommender. Based on detailed responses to the reviewers' comments, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).
 
URL to the preregistered Stage 1 protocol: https://osf.io/qbrf2
 
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.
 
List of eligible PCI RR-friendly journals:
 
 
References
 
1. Leu, C., Forest, S., Legrain, V., & Liberati, G. (2023). The effect of stimulus saliency on the modulation of pain-related ongoing neural oscillations: a Registered Report. In principle acceptance of Version 4 by Peer Community in Registered Reports. https://osf.io/qbrf2
The effect of stimulus saliency on the modulation of pain-related ongoing neural oscillations: a Registered ReportChiara Leu, Sébastien Forest, Valéry Legrain, Giulia Liberati<p>Ongoing oscillations have been shown to be modulated in different frequency bands following phasic, tonic as well as periodic thermonociceptive stimulation. Yet, it remains unclear whether these modulations are related to pain perception, salie...Life Sciences, Medical SciencesZoltan Dienes2023-09-06 15:15:19 View
14 Feb 2024
STAGE 1
toto

Detecting DIF in Forced-Choice Assessments: A Simulation Study Examining the Effect of Model Misspecification

Developing differential item functioning (DIF) testing methods for use in forced-choice assessments

Recommended by ORCID_LOGO based on reviews by Timo Gnambs and 2 anonymous reviewers
Traditional Likert-type items are commonly used but can elicit response bias. An alternative approach, the forced-choice question, required respondents to rank order all items. Forced-choice questions boast some advantages but required advanced item response theory analysis to generate scores which are comparable across individuals and to evaluate the properties of those scales. However, there has been limited discussion of how to test differential item functioning (DIF) in these scales. In a previous study, Lee et al. (2021) proposed a method for testing DIF.
 
Here, Plantz et al. (2024) explore the implications of incorrect specification of anchors in DIF detection for forced choice items. The study proposes to use a Monte Carlo simulation which manipulates sample size, equality of sample size across groups, effect size, percentage of differentially functioning items, analysis approach, anchor set size, and percent of DIF blocks in the anchor set. This study aims to answer research questions about the type I error and power of DIF detection strategies under a variety of circumstances, both evaluating whether the results from Lee et al. (2021) generalize to misspecified models and expanding to evaluate new research questions. Results of this study will provide practical implications for DIF testing with forced-choice questions. An important limitation of the study is that it does not explore non-uniform DIF, only uniform DIF. Additionally, as with all simulation studies not all results can only apply to conditions which are simulated and so rely on the realistic selection of simulation conditions. The authors have selected conditions to match reality in circumstances where data is available, but relied on previous simulations in cases when data is not available. 
 
This Stage 1 manuscript was evaluated over two rounds of review by two reviewers with expertise in psychometrics. An additional round of review was completed by the recommender only. Based on the merits of the original submission and responsiveness of the authors to requests from the reviewers, the recommender judged that the manuscript met the Stage 1 criteria and therefore awarded in-principle acceptance (IPA).​
 
URL to the preregistered Stage 1 protocol: https://osf.io/p8awx
 
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA.
 
List of eligible PCI RR-friendly journals:
 

References
 
1. Lee, P., Joo, S.-H. & Stark, S. (2021). Detecting DIF in multidimensional forced choice measures using the Thurstonian Item Response Theory Model. Organizational Research Methods, 24, 739–771. https://doi.org/10.1177/1094428120959822
 
2. Plantz, J. W.,  Brown, A., Wright, K. & Flake, J. K. (2024). Detecting DIF in Forced-Choice Assessments: A Simulation Study Examining the Effect of Model Misspecification. In principle acceptance of Version 3 by Peer Community in Registered Reports. https://osf.io/p8awx
Detecting DIF in Forced-Choice Assessments: A Simulation Study Examining the Effect of Model Misspecification Jake Plantz, Anna Brown, Keith Wright, Jessica K. Flake<p>On a forced-choice (FC) questionnaire, the respondent must rank two or more items instead of indicating how much they agree with each of them. Research demonstrates that this format can reduce response bias. However, the data are ipsative, resu...Social sciencesAmanda Montoya2023-09-06 22:43:32 View