Introduction to PCI, Registered Reports, and PCI Registered Reports
The Peer Community In (PCI) initiative is a non-profit, non-commercial platform that publishes the peer-reviews of preprints. The overarching aim of this researcher-run organisation is to create specific communities of researchers reviewing and recommending, for free, unpublished preprints in their field. PCI communities have so far been created across a wide range of sciences and are expanding rapidly. Once the submissions are accepted (or, in PCI terms, “recommended”) following peer review, the revised manuscript is posted at the preprint server where the preprint is hosted, and the peer reviews and recommendation of the preprint are posted at the PCI website. Authors then have the option to also publish the preprint in a traditional journal.
PCI Registered Reports (PCI RR) is a new community dedicated to receiving, reviewing, and recommending Registered Reports (RRs) across the full spectrum of STEM, medicine, the social sciences and humanities. RRs are a form of empirical article in which study proposals are peer reviewed and pre-accepted before research is undertaken. By deciding which articles are published based on the question and proposed methods, RRs offer a remedy for a range of research biases, including publication bias and reporting bias.
Peer review for a RR takes place over two stages (see How it works). At Stage 1, authors submit their research question(s), theory and hypotheses (where applicable), detailed methods and analysis plans, and any preliminary data as needed. Following detailed review and revision – according to specific criteria – proposals that are favourably assessed receive in-principle acceptance (IPA), which commits PCI RR to recommending the final article regardless of the outcomes, provided the authors adhere to their approved protocol and interpret the results in line with the evidence. Following IPA, authors then register their approved protocol in a recognised repository, either publicly or under a temporary embargo. Then, after completing the research, they (the authors) submit a Stage 2 manuscript that includes the approved protocol plus results and discussion, which may include clearly labelled post hoc analyses in addition to the preregistered outcomes. The reviewers from Stage 1 then return to assess the completed Stage 2 manuscript, focusing on compliance with protocol and whether the conclusions are justified by the evidence.
When a recommender decides to recommend a report, they (the recommender) write a recommendation. This recommendation is essentially a short article, similar to a News & Views piece, describing the context of the study and explaining why this research is particularly interesting. This recommendation and all of the editorial correspondence (reviews, recommender's decisions, authors’ replies) associated with the recommended report are published by PCI RR. The manuscript itself remains on the preprint server and is not separately published by PCI RR.
Following the completion of peer review, authors of RRs that are positively recommended have the option to publish their articles in the growing list of PCI RR-friendly journals that have committed to accepting PCI RR recommendations without further peer review. The complete set of Stage 1 and Stage 2 reviews solicited by PCI RR (signed or anonymous) and recommender decision letters are then published on the PCI RR website and assigned a DOI. Any Stage 2 RR that is published in a journal will contain a link to the reviews.
How it works
Submitting a report
Inclusiveness and Equity
PCI is attentive to equity and inclusion at all steps of the process of scientific article evaluation. PCI focuses on bringing more people who are traditionally underrepresented in academia among the authors submitting to PCI, and reviewers, recommenders, and managing board members working for PCI. Underrepresentation is linked with many factors including career stage, gender, and geography.
Specific recommendations are made to reviewers, recommenders, and managing board members to increase equity and inclusiveness in each of their tasks.
Tools to increase equity and inclusiveness:
- Possibility to submit articles anonymously
- Transparency in the evaluation of articles
- Managing Board members take into account underrepresentation in academia when appointing new recommenders
- Template messages to recommenders and reviewers include recommendations about equity and inclusiveness
- Possibility to review anonymously
PCI is signatory of the Joint Statement of Principles of the Coalition for Diversity and Inclusion in Scholarly Communication (C4DISC)
Education and Outreach
- PCI RR workshop: PDF and Google Slides. This is an interactive workshop that lasts for 1 hour. It has 4 interactive questions for small breakout groups who then come together and share with the large group, and 1 activity involving outlining your own registered report. Additionally, there are 6 slides of FAQs from Chambers at the end. It is CC-BY 4.0 so feel free to copy/share!
- PCI RR editor test: we made a public version of the test that our Recommenders (editors) have to pass before they can be assigned their first RR. Take the test to learn how registered reports and the PCI RR process works. It is CC-BY 4.0 so feel free to copy/share!
- Understanding Stage 1 recommendations: this is a brief slide-based tutorial that explains the different components of a Stage 1 recommendation, in PDF and Powerpoint format.
- Handy resources about RRs:
- Ten simple rules for writing a Registered Report
- Initial Evidence of Research Quality of Registered Reports Compared to the Traditional Publishing Model
- The past, present, and future of Registered Reports
- An Excess of Positive Results: Comparing the Standard Psychology Literature With Registered Reports
- Open science challenges, benefits and tips in early career and beyond
- A primer for choosing, designing and evaluating registered reports for qualitative methods
Promotion
Press releases and media coverage: Science, Addiction Research & Theory, Experimental Psychology, PeerJ, Royal Society Open Science, University of Sussex Blog
Talks:
- Chris Chambers: Munich (general RR intro with PCI RR at the end), Reading (PCI RR focused), Italian Reproducibility Network (slides, Youtube)
- Corina Logan: Reproducible Research Oxford (changing to an ethical publishing system)
- Zoltan Dienes Meta-Research Innovation Center at Stanford (METRICS), Stanford, 24 June
Workshops:
- Flávia Santos: European Neuroscience Conference by Doctoral Students
Social media:
- Mastodon: @pcirr@spore.social
PCI RR Registered Reports Funding Partnerships (RRFPs)
Apply for funding to conduct research on consciousness and have the scientific validity of your grant proposal be evaluated using PCI RR's peer review of your registered report!
How do RRFPs work? Regular RRs require authors to already have grant funding in place, but RRFPs take place earlier in the research cycle, before researchers have secured funding. Under our RRFP model, the funder and PCI RR will review a Stage 1 RR (or set of RRs) concurrently (or near concurrently), and if both PCI RR and the funder judge the proposal to be of sufficient quality then the funder will award funding at the same time as PCI RR awards in principle acceptance. This model has the advantage of compressing two phases of pre-study review (grant review and Stage 1 RR review) into a single review process, and it can also be integrated with ethics and regulatory review.