Automated Fact Checking in the News Room

@article{Miranda2019AutomatedFC,
  title={Automated Fact Checking in the News Room},
  author={Sebasti{\~a}o Miranda and David Nogueira and Afonso Mendes and Andreas Vlachos and Andrew Secker and Rebecca Garrett and Jeff Mitchell and Zita Marinho},
  journal={The World Wide Web Conference},
  year={2019}
}
Fact checking is an essential task in journalism; its importance has been highlighted due to recently increased concerns and efforts in combating misinformation. [...] Key Result We found that the predictions of our platform were correct 58% of the time, and 59% of the returned evidence was relevant.Expand
Automated Fact-Checking for Assisting Human Fact-Checkers
TLDR
The available intelligent technologies that can support the human expert in the different steps of her fact-checking endeavor are surveyed, including identifying claims worth fact- checking; detecting relevant previously fact-checked claims; retrieving relevant evidence to fact-check a claim; and actually verifying a claim. Expand
Assisting the Human Fact-Checkers: Detecting All Previously Fact-Checked Claims in a Document
TLDR
This work creates a new manually annotated dataset for the claim retrieval task, and proposes suitable evaluation measures and demonstrates the importance of modeling text similarity and stance, while also taking into account the veracity of the retrieved previously fact-checked claims. Expand
Generating Fact Checking Briefs
TLDR
This work investigates how to increase the accuracy and efficiency of fact checking by providing information about the claim before performing the check, in the form of natural language briefs, and develops QABriefer, a model that generates a set of questions conditioned on the claim, searches the web for evidence, and generates answers. Expand
FacTeR-Check: Semi-automated fact-checking through Semantic Similarity and Natural Language Inference
TLDR
The proposed FacTeR-Check architecture is a multilingual architecture for semi-automated fact-checking that can be used for either the general public but also useful for fact- checking organisations, and shows state-of-the-art performance on the individual benchmarks. Expand
That is a Known Lie: Detecting Previously Fact-Checked Claims
TLDR
Learning-to-rank experiments that demonstrate sizable improvements over state-of-the-art retrieval and textual similarity approaches are presented that are largely ignored by the research community so far. Expand
BRENDA: Browser Extension for Fake News Detection
TLDR
BRENDA is a browser extension which can be used to automate the entire process of credibility assessments of false claims and uses a tested deep neural network architecture to automatically identify fact check worthy claims and classifies as well as presents the result along with evidence to the user. Expand
Challenges and Opportunities for Journalistic Knowledge Platforms
TLDR
An overview of the main challenges and opportunities involved in JKPs which have been manually extracted from literature with the support of natural language processing and understanding techniques is presented. Expand
Modeling Factual Claims with Semantic Frames
TLDR
This work introduces 11 new manually crafted frames along with 9 existing FrameNet frames, all of which have been selected with fact-checking in mind, and releases the annotation tool, which can be used to understand how these frames are intended to work and to train machine learning models. Expand
ReVera Framework: A Framework for Fact Checking Traceability
TLDR
This work aims to propose a framework, where the development of methods can be done in a modular manner, creating workflows based on key steps that can be linked together to generate the input classification, using a proposed data traceability ontology. Expand
Human-in-the-loop Artificial Intelligence for Fighting Online Misinformation: Challenges and Opportunities
The rise of online misinformation is posing a threat to the functioning of democratic processes. The ability to algorithmically spread false information through online social networks together withExpand
...
1
2
...

References

SHOWING 1-10 OF 25 REFERENCES
Automated Fact Checking: Task Formulations, Methods and Future Directions
TLDR
This paper surveys automated fact checking research stemming from natural language processing and related disciplines, unifying the task formulations and methodologies across papers and authors, and highlights the use of evidence as an important distinguishing factor among them cutting across task formulation and methods. Expand
Understanding the Promise and Limits of Automated Fact-Checking
  • 2018
The last year has seen growing attention among journalists, policymakers, and technology companies to the problem of finding effective, large-scale responses to online misinformation. The furore overExpand
FEVER: a Large-scale Dataset for Fact Extraction and VERification
TLDR
This paper introduces a new publicly available dataset for verification against textual sources, FEVER, which consists of 185,445 claims generated by altering sentences extracted from Wikipedia and subsequently verified without knowledge of the sentence they were derived from. Expand
An Extensible Framework for Verification of Numerical Claims
TLDR
This paper presents an automated fact checking system demonstration which was developed in order to participate in the Fast and Furious Fact Check challenge and demonstrates the extensible nature of the system by evaluating it on relations used in previous work. Expand
The Quest to Automate Fact-Checking
The growing movement of political fact-checking plays an important role in increasing democratic accountability and improving political discourse [7, 3]. Politicians and media figures make claimsExpand
ClaimBuster: The First-ever End-to-end Fact-checking System
TLDR
In the U.S., the election year made fact-checking a part of household terminology and during the first presidential debate on September 26, 2016, NPR.org's live fact-checked website drew 7.4 million page views and delivered its biggest traffic day ever. Expand
UCL Machine Reading Group: Four Factor Framework For Fact Finding (HexaF)
TLDR
This system is a four stage model consisting of document retrieval, sentence retrieval, natural language inference and aggregation that achieved a FEVER score of 62.52% on the provisional test set (without additional human evaluation), and 65.41%" on the development set. Expand
Experimentation as a way of life: Okapi at TREC
The Okapi system has been used in a series of experiments on the TREC collections, investigating probabilistic models, relevance feedback and query expansion, and interaction issues. The TREC-6 adExpand
Rumor has it: Identifying Misinformation in Microblogs
TLDR
This paper addresses the problem of rumor detection in microblogs and explores the effectiveness of 3 categories of features: content- based, network-based, and microblog-specific memes for correctly identifying rumors, and believes that its dataset is the first large-scale dataset on rumor detection. Expand
Document Retrieval for Large Scale Content Analysis using Contextualized Dictionaries
TLDR
The procedure to retrieve subsets of relevant documents from large text collections for Content Analysis, e.g. in social sciences, is presented, which improves retrieval results for this purpose compared to alternative methods of key term extraction as well as neglecting co-occurrence data. Expand
...
1
2
3
...