Surveys require attentive respondents. The article introduces "Screeners" as a tool to identify lack of attention but argues they have limitations.
Screeners are measures designed to detect survey respondents who aren't paying attention. They help reduce noisy data by flagging unreliable answers.
The study finds that relying on just one Screener question isn't ideal for ensuring data quality. Using multiple questions provides more reliable results and better captures inattentive respondents.
When survey respondents pass Screeners, their characteristics often reflect political interests or concerns—this affects how we interpret and generalize survey findings.
The recommendation is clear: Use multiple Screener items. This approach allows researchers to balance internal validity (excluding unreliable data) with external validity by reporting results conditionally on different attention levels.