FIND DATA: By Author | Journal | Sites   ANALYZE DATA: Help with R | SPSS | Stata | Excel   WHAT'S NEW? US Politics | Int'l Relations | Law & Courts
   FIND DATA: By Author | Journal | Sites   WHAT'S NEW? US Politics | IR | Law & Courts
If this link is broken, please report as broken. You can also submit updates (will be reviewed).
Better Policy Measurement: Log Odds-Ratio Scaling vs. Current Word Count Approaches
Insights from the Field
log odds ratio
political texts scaling
comparative manifesto project
policy dimension measurement
Methodology
LSQ
2 datasets
1 text files
1 PDF files
Dataverse
Scaling Policy Preferences from Coded Political Texts was authored by Will Lowe, Kenneth Benoit, Slava Mikhaylov and Michael Laver. It was published by Wiley in LSQ in 2011.

This article introduces an improved method for measuring policy preferences from political texts by using log odds-ratios instead of simple word frequencies.

## New Approach Proposed

The authors suggest a more theoretically grounded and linguistically sound alternative scaling technique based on the logarithm of odds-ratios. This approach offers several advantages over traditional methods:

* More accurate representation due to weighting schemes that account for semantic salience

* Better theoretical alignment with political science concepts

* Fewer statistical artifacts in constructed scales

## Comparison With Existing Methods

They directly contrast their proposed Logit Scale with the established methodology used by the Comparative Manifesto Project (CMP), highlighting key flaws in CMP's current approach:

* Over-reliance on word counts without accounting for contextual meaning and importance

* Potential to amplify measurement errors over time or across texts

* Inability to effectively capture nuanced policy shifts

## Validation Process

The proposed scale was rigorously tested through independent expert surveys, confirming its validity.

## Data Expansion Potential

Applying this new methodology to CMP's existing dataset demonstrates:

* Ability to identify more distinct and meaningful policy dimensions

* Measurability across additional years of data previously unavailable

## Call for Future Research

The authors conclude by advocating for the adoption of log odds-ratio scaling in political text analysis, suggesting it represents a significant advancement beyond current coding practices.

data
Find on Google Scholar
Find on JSTOR
Find on Wiley
Legislative Studies Quarterly
Podcast host Ryan