Scaling policy preferences from coded political texts

  title={Scaling policy preferences from coded political texts},
  author={Will Lowe and Kenneth Benoit and Slava J. Mikhaylov and Michael Laver},
  journal={Legislative Studies Quarterly},
Scholars estimating policy positions from political texts typically code words or sentences and then build left-right policy scales based on the relative frequencies of text units coded into different categories. Here we reexamine such scales and propose a theoretically and linguistically superior alternative based on the logarithm of odds-ratios. We contrast this scale with the current approach of the Comparative Manifesto Project (CMP), showing that our proposed logit scale avoids widely… Expand

Figures and Tables from this paper

Putting Text in Context: How to Estimate Better Left-Right Positions by Scaling Party Manifesto Data∗
Abstract Hand-coded party manifestos have formed the largest source of comparative, over-time data for estimating party policy positions and emphases, based on the fundamental assumption thatExpand
Judicial Positions on Political Reform Designing common policy scores from judicial text
What are the positions of highest courts towards political reforms? In order to answer this question scholarship on the US Supreme Court uses judicial votes but those are often not available inExpand
How to scale coded text units without bias: A response to Gemenis
Coding non-manifesto documents as if they were genuine policy platforms produced at election time clearly raises serious issues with error when these codings are used in the standard manner toExpand
Comparing public communication in democracies and autocracies: automated text analyses of speeches by heads of government
Renewed efforts at empirically distinguishing between different forms of political regimes leave out the cultural dimension. In this article, we demonstrate how modern computational tools can be usedExpand
A Dynamic State-Space Model of Coded Political Texts
A model that combines a dynamic perspective on actors' political positions with a probabilistic account of how these positions are translated into emphases of policy topics in political texts is presented, based on a model based on the Comparative Manifesto Project. Expand
A Pairwise Comparison Framework for Fast, Flexible, and Reliable Human Coding of Political Texts
A crowdsourced pairwise comparison framework for encoding political texts that combines the human ability to understand natural language with the ability of computers to aggregate data into reliable measures while ameliorating concerns about the biases and unreliability of non-expert human coders is developed. Expand
A textual Taylor rule: estimating central bank preferences combining topic and scaling methods
Abstract Scholars often use voting data to estimate central bankers’ policy preferences but consensus voting is commonplace. To get around this, we combine topic-based text analysis and scalingExpand
How to Scale Coded Text Units Without Bias : A response to AUTH
The core point made by AUTH is that a significant number of the documents coded by the Comparative Manifestos Project (CMP) are not party manifestos at all, as widely believed in the profession, butExpand
Political Text Scaling Meets Computational Semantics
An extensive quantitative analysis is conducted over a collection of speeches from the European Parliament in five different languages and from two different legislations to understand whether an approach that is aware of semantics would better capture known underlying political dimensions compared to a frequency-based scaling method. Expand
Human computation scaling for measuring meaningful latent traits in political texts∗
Political scientists are increasingly interested in measuring latent political concepts embedded in written or spoken records. After all, most important political behaviors and outcomes are encodedExpand


Extracting Policy Positions from Political Texts Using Words as Data
We present a new way of extracting policy positions from political texts that treats texts not as discourses to be understood and interpreted but rather, as data in the form of words. We compare thisExpand
Estimating policy positions using political texts: An evaluation of the Wordscores approach
This paper evaluates a recently developed method for extracting policy positions from political texts, known as Wordscores. This computerized content analysis technique is a potentially powerful toolExpand
Estimating policy positions from political texts
The analysis of policy-based party competition will not make serious progress beyond the constraints of (a) the unitary actor assumption and (b) a static approach to analyzing party competitionExpand
A Scaling Model for Estimating Time-Series Party Positions from Texts
A scaling algorithm called WORDFISH to estimate policy positions based on word frequencies in texts is proposed and it is found that words with strong political connotations are the best discriminators between parties. Expand
Estimating party policy positions: Comparing expert surveys and hand-coded content analysis
In this paper we compare estimates of the left-right positions of political parties derived from an expert survey recently completed by the authors with those derived by the Comparative ManifestosExpand
A Robust Transformation Procedure for Interpreting Political Text
This note addresses several shortcomings in the transformation procedure introduced in the original Wordscores program, and demonstrates that the original transformation distorts the metric on which content scores are placed. Expand
Understanding Wordscores
Wordscores is a widely used procedure for inferring policy positions, or scores, for new documents on the basis of scores for words derived from documents with known scores. It is computationallyExpand
Recovering a Basic Space from Elite Surveys: Evidence from Latin America
This paper uses elite survey data and scaling techniques to estimate the location of political actors (parties, chief executives, and legislators) in a common ideological space. The recoveredExpand
How to Analyze Political Attention with Minimal Assumptions and Costs
Previous methods of analyzing the substance of political attention have had to make several restrictive assumptions or been prohibitively costly when applied to large-scale political texts. Here, weExpand
Towards a New Methodology of Estimating Party Policy Positions
In the last twenty years, an international group of political scientists has coded nearly 2000 party manifestos with the help of one single coding scheme based on 56 categories which covers all mainExpand