PCI Registered Reports

Announcements

We are recruiting recommenders (editors) from all research fields!

Your feedback matters! If you have authored or reviewed a Registered Report at Peer Community in Registered Reports, then please take 5 minutes to leave anonymous feedback about your experience, and view community ratings.

Back

349

Title

Convenience Samples and Measurement Equivalence in Replication Researchuse asterix (*) to get italics

Authors

Lindsay J. Alley, Jordan Axt, Jessica Kay FlakePlease use the format "First name initials family name" as in "Marie S. Curie, Niels H. D. Bohr, Albert Einstein, John R. R. Tolkien, Donna T. Strickland"

Year

2023

Picture

Abstract

<p>A great deal of research in psychology employs either university student or online crowdsourced convenience samples (Chandler & Shapiro, 2016; Strickland & Stoops, 2019) and there is evidence that these groups differ in meaningful ways (Behrend et al., 2011). This could result in the presence of unaccounted-for measurement differences across convenience sample sources, which may bias results when these groups are compared, or the resulting data are pooled. In this registered report, we used the openly available data from the Many Labs replication projects to test for measurement equivalence across different convenience sample sources. We examined 9 measures that showed acceptable baseline model fit and tested them for non-equivalence across convenience samples from different sources, including university participant pools, MTurk, and Project Implicit. We then examined whether replication results are robust to non-equivalence by fitting partial invariance models and sensitivity analyses of replication results. [Results and discussion summarized here.]</p>

Indicate the full web address (DOI or URL) giving public access to these data (if you have any problems with the deposit of your data, please contact contact@rr.peercommunityin.org).

You should fill this box only if you chose 'All or part of the results presented in this preprint are based on data'. URL must start with http:// or https://

Indicate the full web address (DOI or URL) giving public access to these scripts (if you have any problems with the deposit of your scripts, please contact contact@rr.peercommunityin.org).

You should fill this box only if you chose 'Scripts were used to obtain or analyze the results'. URL must start with http:// or https://

Indicate the full web address (DOI, SWHID or URL) giving public access to these codes (if you have any problems with the deposit of your codes, please contact contact@rr.peercommunityin.org).

You should fill this box only if you chose 'Codes have been used in this study'. URL must start with http:// or https://

Keywords

measurement, psychometrics, equivalence, invariance, metascience, replication

Methods that require specific expertise (optional)

NonePlease indicate the methods that may require specialised expertise during the peer review process (use a comma to separate various required expertises).

Thematic fields

Social sciences

Suggested reviewers - Suggest up to 10 reviewers (provide names and Email addresses). (Optional)

No need for them to be recommenders of PCI Registered Reports. Please do not suggest reviewers for whom there might be a conflict of interest. Reviewers are not allowed to review preprints written by close colleagues (with whom they have published in the last four years, with whom they have received joint funding in the last four years, or with whom they are currently writing a manuscript, or submitting a grant proposal), or by family members, friends, or anyone for whom bias might affect the nature of the review - see the code of conduct

Opposed reviewers - Suggest up to 5 people not to invite as reviewers. (Optional)

e.g. John Doe [john@doe.com]

Submission date

2022-11-29 18:37:54

Recommender

Corina Logan

Reviewers

or Register
Submit a report

Announcements

MANAGING BOARD

MEMBER OF

INDEXED BY