Skip to search formSkip to main contentSkip to account menu
Pathologies of Neural Models Make Interpretations Difficult
TLDR
This work uses input reduction, which iteratively removes the least important word from the input, to expose pathological behaviors of neural models: the remaining words appear nonsensical to humans and are not the ones determined as important by interpretation methods.
View on ACL
Trick Me If You Can: Human-in-the-Loop Generation of Adversarial Examples for Question Answering
TLDR
This work proposes human- in-the-loop adversarial generation, where human authors are guided to break models through an interactive user interface, and applies this generation framework to a question answering task called Quizbowl, where trivia enthusiasts craft adversarial questions.
View on ACL
Quizbowl: The Case for Incremental Question Answering
TLDR
This work makes two key contributions to machine learning research through Quizbowl: collecting and curating a large factoid QA dataset and an accompanying gameplay dataset, and developing a computational approach to playing Quiz Bowl that involves determining both what to answer and when to answer.
View PDF on arXiv
Trick Me If You Can: Adversarial Writing of Trivia Challenge Questions
TLDR
An adversarial writing setting is developed, where humans interact with trained models and try to break them, which yields a challenge set, which despite being easy for trivia players to answer, systematically stumps automated question answering systems.
View on ACL
Mitigating Noisy Inputs for Question Answering
TLDR
This work investigates and mitigate the effects of noise from Automatic Speech Recognition systems on two factoid Question Answering (QA) tasks, and empirically shown to improve the accuracy of downstream neural QA systems.
View PDF on arXiv
Information Seeking in the Spirit of Learning: A Dataset for Conversational Curiosity
TLDR
A Wizard of Oz dialog task is designed that tests the hypothesis that engagement increases when users are presented with facts that relate to their existing knowledge, and shows that responses which incorporate a user's prior knowledge do increase engagement.
View on ACL
Introduction to NIPS 2017 Competition Track
Competitions have become a popular tool in the data science community to solve hard problems, assess the state of the art and spur new research directions. Companies like Kaggle and open source…
View via Publisher
Evaluation Examples are not Equally Informative: How should that change NLP Leaderboards?
TLDR
This work creates a Bayesian leaderboard model where latent subject skill and latent item difficulty predict correct responses and analyzes the ranking reliability of leaderboards to advocate a re-imagining.
View on ACL
Right Answer for the Wrong Reason: Discovery and Mitigation
TLDR
This work introduces a simple training technique that mitigates this problem while maintaining performance on regular examples on natural language processing tasks by removing as many words as possible from the input without changing the model prediction.
Human-Computer Question Answering: The Case for Quizbowl
TLDR
The setting: the game of quiz bowl is described, it is argued why it makes a suitable game for human-computer competition, and the logistics and preparation for the competition are described.
View via Publisher
...
...
By clicking accept or continuing to use the site, you agree to the terms outlined in our Privacy Policy, Terms of Service, and Dataset License