Online Survey Quality, PoliSciData.com Special Edition

About This Page

This page features political science articles examining the quality and reliability of online surveys, exploring issues like sample representativeness, response bias, and data validity. Understanding these challenges is crucial for researchers and practitioners as online surveys become an increasingly common tool for gathering public opinion and behavioral data.

Replication Data from Peer-Reviewed Studies

The Shape of and Solutions to the MTurk Quality CrisisRyan Kennedy, +5 more authors (2020) PSRM, more info.
R files: 1, Stata files: 4, images: 12, PDF files: 4, datasets: 40, text files: 1

Using Screeners to Measure Respondent Attention on Self-Administered Surveys: Which Items and How Many?*Christopher Warshaw, +3 more authors (2021) PSRM, more info.
R files: 3, Stata files: 1, text files: 1, datasets: 1

Recruiting Large Online Samples in the United States and India: Facebook, Mechanical Turk and QualtricsTaylor Boas, +2 more authors (2020) PSRM, more info.
R files: 16, text files: 9, datasets: 14, PDF files: 6, LaTeX files: 1, HTML files: 2

Generalizing from Survey Experiments Conducted on Mechanical Turk: A Replication Approach*Alexander Coppock (2019) PSRM, more info.
R files: 7, HTML files: 6, datasets: 4, text files: 1

No Harm in Checking: Using Factual Manipulation Checks to Assess Attentiveness in ExperimentsJohn V. Kane, +1 more author (2019) AJPS, more info.
Stata files: 2, PDF files: 1, datasets: 8, text files: 1

Separating the Shirkers from the Workers? Making Sure Respondents Pay Attention on Self-Administered SurveysAdam Berinsky, +2 more authors (2014) AJPS, more info.
Stata files: 3, datasets: 8, text files: 3

Testing Social Science Network Theories With Online Network Data: An Evaluation of External ValidityJames Bisbee, +1 more author (2017) APSR, more info.
R files: 8, Stata files: 6, PDF files: 16, datasets: 19, LaTeX files: 4, text files: 6

The Face of Internet Recruitment: Evaluating the Labor Markets of Online Crowdsourcing Platforms in ChinaXiaojun Li, +2 more authors (2018) RAP, more info.
R files: 1, datasets: 6, text files: 4

Sponsorship Effects in Online SurveysHolger Kern, +2 more authors (2022) POLBEH, more info.
R files: 6, text files: 1, datasets: 5

Racing the Clock: Using Response Time As a Proxy for Attentiveness on Self-Administered SurveysBlair Read, +2 more authors (2022) POLAN, more info.
archives: 1

A Text-As-Data Approach for Using Open-Ended Responses As Manipulation ChecksJeffrey Ziegler (2022) POLAN, more info.
R files: 3, other files: 1, PDF files: 17, images: 1, LaTeX files: 9, text files: 1

Crowdsourcing Reliable Local DataMirya Holman, +2 more authors (2020) POLAN, more info.
archives: 1

A Note on Dropping Experimental Subjects Who Fail a Manipulation CheckPeter M. Aronow, +2 more authors (2019) POLAN, more info.
archives: 1

Paying Attention to Inattentive Survey RespondentsR. Michael Alvarez, +3 more authors (2019) POLAN, more info.
R files: 2, datasets: 2, text files: 1

Also see Journal Data Archives | Author Replication Data

Watch & Learn


Does It Matter Who Sponsors a Poll?
A Marist Poll Academy case study (2:29)


Random Digit Dialing Vs. Registration Based Sampling
A Marist Poll Academy case study (2:30)


Quantitative Survey Design With Qualtrics for MTurk
From Professor Kramer (35:20)

MORE VIDEOS: See Video Channels for more political science videos!

LEARN HOW: Watch Lecture Videos for Essentials of Political Analysis, Video Tutorials for R, Stata, SPSS, and Excel