Corpus ID: 18989877

Methodological Challenges in Estimating Tone: Application to News Coverage of the U.S. Economy

  title={Methodological Challenges in Estimating Tone: Application to News Coverage of the U.S. Economy},
  author={Pablo Barber{\'a} and Amber E. Boydstun and Suzanna Linn and Ryan McMahon and Jonathan Nagler},
Machine learning methods have made possible the classification of large corpora of text by measures such as topic, tone, and ideology. However, even when using dictionary-based methods that require few inputs by the analyst beyond the text itself, many decisions must be made before a measure of any kind is produced from the text. When coding media the analyst must decide on the universe of media sources to sample from, as well as the criteria for selecting articles for coding from within that… Expand

Figures and Tables from this paper

Four best practices for measuring news sentiment using ‘off-the-shelf’ dictionaries: a large-scale p-hacking experiment
Four best practices are summarized into four best practices: use a theory-informed sentiment dictionary; do not assume that the validity and reliability of the dictionary is ‘built-in’; check for the influence of content length and do not use multiple dictionaries to test the same statistical hypothesis. Expand
Studying Political Decision Making With Automatic Text Analysis
The confluence of increasing availability of large digital text collections, plentiful computational power, and methodological innovations has lead to many researchers adopting techniques of automatic text analysis for coding and analyzing textual data. Expand
Perspective Identification in Informal Text
A taxonomy for the most common community perspectives among Egyptians is developed and an iterative feedback-loop process to devise guidelines on how to successfully annotate a given online discussion forum post with different elements of a person's perspective is devised. Expand
A Cross-National Analysis of the Causes and Consequences of Economic News
Objective. Work on economic news argues that U.S. coverage focuses primarily on changes rather than levels of future economic conditions; it also both affects and reflects public economic sentiment.Expand
A Bad Workman Blames His Tweets The Consequences of Citizens ’ Uncivil Twitter Use when Interacting with Party Candidates
The recent emergence of microblogs has had a significant effect on the contemporary political landscape. The platform’s potential to enhance information availability and make interactive discussionsExpand
Does newspaper coverage influence or reflect public perceptions of the economy?
Citizens’ economic perceptions can shape their political and economic behavior, making the origins of those perceptions an important question. Research commonly posits that media coverage is aExpand
News-driven business cycles: a narrative approach
This paper analyses the effects of technology news on the US business cycle. The paper suggests a new frequency-based index about the technology news from a major news outlet for the period 1948Q1 toExpand
Negativity and Positivity Biases in Economic News Coverage: Traditional Versus Social Media
This work focuses on the tone of both newspaper and Twitter content following changes in the U.S. unemployment rate, from 2008 to 2014, and results strongly support the expectation that while thetone of newspaper content exhibits stronger reactions to negative information, the Tone of Twitter content reacts more strongly to positive economic shifts. Expand
Responding to Racial Resentment: How Racial Resentment Influences Legislative Behavior
Despite the growing body of scholarship urging congressional scholars to consider the racialization of Congress, little attention has been given to understanding how racial resentment impactsExpand


Text as Data: The Promise and Pitfalls of Automatic Content Analysis Methods for Political Texts
Politics and political conflict often occur in the written and spoken word. Scholars have long recognized this, but the massive costs of analyzing even moderately sized collections of texts haveExpand
Extracting Policy Positions from Political Texts Using Words as Data
We present a new way of extracting policy positions from political texts that treats texts not as discourses to be understood and interpreted but rather, as data in the form of words. We compare thisExpand
Affective News: The Automated Coding of Sentiment in Political Texts
The objective here is to outline and validate a new automated measurement instrument for sentiment analysis in political texts using a dictionary-based approach consisting of a simple word count of the frequency of keywords in a text from a predefined dictionary. Expand
Fightin' Words: Lexical Feature Selection and Evaluation for Identifying the Content of Political Conflict
A variety of techniques for selecting words that capture partisan, or other, differences in political speech and for evaluating the relative importance of those words are discussed and several new approaches based on Bayesian shrinkage and regularization are introduced. Expand
Computer‐Assisted Keyword and Document Set Discovery from Unstructured Text
A computer-assisted (as opposed to fully automated or human-only) statistical approach that suggests keywords from available text without needing structured data as inputs is developed, which leads to a widely applicable algorithm. Expand
When is a Liability not a Liability? Textual Analysis, Dictionaries, and 10-Ks
Previous research uses negative word counts to measure the tone of a text. We show that word lists developed for other disciplines misclassify common words in financial text. In a large sample of 10Expand
Determining Economic News Coverage
While much research has been devoted to how individuals respond to media messages and frames, we know much less about what motivates variations in the content and tone of media coverage. Given theExpand
RTextTools: A Supervised Learning Package for Text Classification
RTextTools was designed to make machine learning accessible by providing a start-to-finish product in less than 10 steps and can be used to train or cross-validate data. Expand
Computer-Assisted Topic Classification for Mixed-Methods Social Science Research
This system maintains high classification accuracy and provides accurate estimates of document proportions, while achieving reliability levels associated with human efforts, and it is estimated that it lowers the costs of classifying large numbers of complex documents by 80% or more. Expand
Consumer Sentiment, the Economy, and the News Media
The news media affects consumers' perceptions of the economy through three channels. First, the news media conveys the latest economic data and the opinions of professionals to consumers. Second,Expand