Media Bias, the Social Sciences, and NLP: Automating Frame Analyses to Identify Bias by Word Choice and Labeling

  title={Media Bias, the Social Sciences, and NLP: Automating Frame Analyses to Identify Bias by Word Choice and Labeling},
  author={Felix Hamborg},
Media bias can strongly impact the public perception of topics reported in the news. A difficult to detect, yet powerful form of slanted news coverage is called bias by word choice and labeling (WCL). WCL bias can occur, for example, when journalists refer to the same semantic concept by using different terms that frame the concept differently and consequently may lead to different assessments by readers, such as the terms “freedom fighters” and “terrorists,” or “gun rights” and “gun control… Expand

Figures and Topics from this paper

Argument from Old Man’s View: Assessing Social Bias in Argumentation
This paper trains word embedding models on portal-specific corpora and systematically evaluate their bias using WEAT, an existing metric to measure bias in word embeddings, and investigates causes of bias, suggesting that all tested debate corpora contain unbalanced and biased data. Expand
OpenFraming: We brought the ML; you bring the data. Interact with your data and discover its frames
A Web-based system for analyzing and classifying frames in text documents and a user-friendly pipeline for training novel classification models on user-provided corpora to make effective tools for automatic frame discovery and labeling widely accessible to researchers from a diverse array of disciplines. Expand
Measuring Alignment to Authoritarian State Media as Framing Bias
We introduce what is to the best of our knowledge a new task in natural language processing: measuring alignment to authoritarian state media. We operationalize alignment in terms of sociologicalExpand
Towards Target-Dependent Sentiment Classification in News Articles
Investigating characteristics of sentiment in news and contrasting them to popular TSC domains, it is found that sentiment in the news is expressed less explicitly, is more dependent on context and readership, and requires a greater degree of interpretation. Expand
NewsDeps: Visualizing the Origin of Information in News Articles
NewsDeps is presented, the first approach that analyzes and visualizes where information in news articles stems from and increases efficiency and transparency in news consumption by revealing which previously published articles are the primary sources of each given article. Expand
Newsalyze: Effective Communication of Person-Targeting Biases in News Articles
Media bias and its extreme form, fake news, can decisively affect public opinion. Especially when reporting on policy issues, slanted news coverage may strongly influence societal decisions, e.g., inExpand
Newsalyze: Enabling News Consumers to Understand Media Bias
Newsalyze is introduced, a bias-aware news reader focusing on a subtle, yet powerful form of media bias, named bias by word choice and labeling (WCL), which can alter the assessment of entities reported in the news. Expand


Automated Identification of Media Bias by Word Choice and Labeling in News Articles
An automated approach to identify bias by WCL is presented that employs models and manual analysis approaches from the social sciences and outperforming state-of-the-art methods, such as coreference resolution, which currently cannot resolve very broadly defined or abstract coreferences used by journalists. Expand
Illegal Aliens or Undocumented Immigrants? Towards the Automated Identification of Bias by Word Choice and Labeling
Newsalyze is proposed, a work-in-progress prototype that imitates a manual analysis concept for media bias established in the social sciences, which aims to find instances of bias by word choice and labeling in a set of news articles reporting on the same event. Expand
DEIM Forum 2018 C 1-3 Towards Bias Inducing Word Detection by Linguistic Cue Analysis in News Articles
Biased news still exists even though the balance, fairness and accuracy are important qualities in news reporting. The bias in news causes political and social bipolarization and what is worse, itExpand
Automated identification of media bias in news articles: an interdisciplinary literature review
It is suggested that suitable, automated methods from computer science, primarily in the realm of natural language processing, are already available for each of the discussed forms of media bias, opening multiple directions for promising further research in computer science in this area. Expand
Linguistic Models for Analyzing and Detecting Biased Language
The analysis of real instances of human edits designed to remove bias from Wikipedia articles uncovers two classes of bias: framing bias, such as praising or perspective-specific words, which is linked to the literature on subjectivity; and epistemological bias, related to whether propositions that are presupposed or entailed in the text are uncontroversially accepted as true. Expand
The POLUSA Dataset: 0.9M Political News Articles Balanced by Time and Outlet Popularity
POLUSA is presented, a dataset that represents the online media landscape as perceived by an average US news consumer and enables studying a variety of subjects, e.g., media effects and political partisanship, and allows to utilize data-intense deep learning methods. Expand
Learning to Flip the Bias of News Headlines
The paper in hand narrows down the general bias flipping task to focus on bias flipping for news article headlines, and applies an autoencoder incorporating information from an article’s content to learn how to automatically flip the bias. Expand
Enabling News Consumers to View and Understand Biased News Coverage: A Study on the Perception and Visualization of Media Bias
Using a multilevel model, it is found that perceived journalist bias is significantly related to perceived political extremeness and impartiality of the article. Expand
The impact of newspapers on consumer confidence: does spin bias exist?
It is sometimes argued that news reports in the media suffer from biased reporting. Mullainathan and Shleifer (2002, 2005) argue that there are two types of media bias. One bias, called ideology,Expand
Framing Bias: Media in the Distribution of Power
This article proposes integrating the insights generated by framing, priming, and agenda-setting research through a systematic effort to conceptualize and understand their larger implications forExpand