FIND DATA: By Author | Journal | Sites   ANALYZE DATA: Help with R | SPSS | Stata | Excel   WHAT'S NEW? US Politics | Int'l Relations | Law & Courts
   FIND DATA: By Author | Journal | Sites   WHAT'S NEW? US Politics | IR | Law & Courts
If this link is broken, please report as broken. You can also submit updates (will be reviewed).
Small Studies, Big Effects: Publication Bias in Voter Mobilization Experiments
Insights from the Field
Publication bias
Voter mobilization
Effect size
Sample size
Experiments
Teaching and Learning
Pol. An.
1 PDF
Dataverse
Testing for Publication Bias in Political Science was authored by Alan S. Gerber, Donald P. Green and David Nickerson. It was published by Cambridge in Pol. An. in 2001.

If journals favor statistically significant results, the published literature can suffer from publication bias.

πŸ”Ž How the test works

Statistical significance depends on sample size: smaller samples must show larger observed effects to reach significance. That implies a clear empirical testβ€”if publications are biased against statistically insignificant findings, average reported effect sizes should shrink as sample sizes grow.

πŸ“š What evidence was examined

  • Published experimental studies on voter mobilization

πŸ“ˆ Key findings

  • Reported effect sizes decline as sample sizes increase.
  • This pattern is consistent with publication bias against statistically insignificant results.
  • The proposition that significance-driven selection produces larger effects in small samples was tested and confirmed in the experimental voter mobilization literature.

βš–οΈ Why it matters

The observed relationship between sample size and reported effect size indicates that the published literature on voter mobilization may overstate true effects when significance-driven selection operates. The described test offers a practical way to detect such bias in empirical literatures.

data
Find on Google Scholar
Find on JSTOR
Find on CUP
Political Analysis
Podcast host Ryan