FIND DATA: By Author | Journal | Sites   ANALYZE DATA: Help with R | SPSS | Stata | Excel   WHAT'S NEW? US Politics | Int'l Relations | Law & Courts
   FIND DATA: By Author | Journal | Sites   WHAT'S NEW? US Politics | IR | Law & Courts
If this link is broken, please report as broken. You can also submit updates (will be reviewed).
Choosing Between Average Effects and Observed-Value Estimates in Political Science Research
Insights from the Field
Limited Dependent Variable Models
Average Effect
Observed Value Approach
LDV Analysis
Methodology
AJPS
2 datasets
Dataverse
Behind the Curve: Clarifying the Best Approach to Calculating Predicted Probabilities and Marginal Effects from Limited Dependent Variable Models was authored by Michael J. Hanmer and Kerem Ozan Kalkan. It was published by Wiley in AJPS in 2013.

This article examines methods for calculating predicted probabilities and marginal effects from limited dependent variable models, a common approach in political science research. While coefficients often receive attention, this piece emphasizes that the most widely used method—calculating average effects across all observations—doesn't fully capture population-level insights.

Instead of focusing solely on average-case calculations, it argues for an observed-value approach to obtain better estimates of overall population impacts. This distinction matters significantly:

Key Insight:

Marginal effects and probabilities depend heavily on how they're calculated because these models are inherently nonlinear.

Two Approaches Compared:*

* Average Case Approach: Calculates the effect averaged across all observations in a sample, providing estimates for 'typical' cases but potentially obscuring population-level patterns.

* Observed-Value Approach: Fulfills the goal of estimating average effects by considering individual observed values within the model's estimation.

Why It Matters:

This paper contends that the average-case approach creates a weaker connection to the broader research objectives in political science compared to the observed-value method. The argument isn't just theoretical:

* Empirical Demonstration: A concrete example shows how these approaches can yield substantively different results.

* Simulation Evidence: Monte Carlo simulations further illustrate that average-case calculations may misrepresent population-level effects.

Conclusion:

Researchers should prioritize obtaining estimates of the average effect in the population rather than calculating effects for an 'average case'. This subtle distinction enhances understanding and improves the reliability of findings.

data
Find on Google Scholar
Find on JSTOR
Find on Wiley
American Journal of Political Science
Podcast host Ryan