• Publications
  • Influence
Class-Based Construction of a Verb Lexicon
We present an approach to building a verb lexicon compatible with WordNet but with explicitly stated syntactic and semantic information, using Levin verb classes to systematically construct lexicalExpand
Overview of the TAC 2010 Knowledge Base Population Track
An overview of the task definition and annotation challenges associated with KBP2010 is provided and the evaluation results and lessons that are learned are discussed based on detailed analysis. Expand
Overview of DUC 2005
The focus of DUC 2005 was on developing new evaluation methods that take into account variation in content in human-authored summaries. Therefore, DUC 2005 had a single user-oriented,Expand
English Tasks: All-Words and Verb Lexical Sample
We describe our experience in preparing the lexicon and sense-tagged corpora used in the English all-words and lexical sample tasks of Senseval-2.
SemEval-2013 Task 7: The Joint Student Response Analysis and 8th Recognizing Textual Entailment Challenge
We present the results of the Joint Student Response Analysis and 8th Recognizing Textual Entailment Challenge, aiming to bring together researchers in educational NLP technology and textualExpand
Overview of the TREC 2007 Question Answering Track
The TREC 2005 Question Answering track contained three tasks: the main question answering task, the document ranking task, and the relationship task. The main task was the same as the single TRECExpand
DUC in context
This paper examines several major themes running through three evaluations: SUMMAC, NTCIR, and DUC, with a concentration on DUC. Expand
Overview of the TAC 2008 Update Summarization Task
While all of the 71 submitted runs were automatically scored with the ROUGE and BE metrics, NIST assessors manually evaluated only 57 of the submitted runs for readability, content, and overall responsiveness. Expand
Investigating Regular Sense Extensions Based on Intersective Levin Classes
This paper presents a refinement of Levin classes, intersective sets, which are a more fine-grained classification and have more coherent sets of syntactic frames and associated semantic components. Expand
An Assessment of the Accuracy of Automatic Evaluation in Summarization
An assessment of the automatic evaluations used for multi-document summarization of news, and recommendations about how any evaluation, manual or automatic, should be used to find statistically significant differences between summarization systems. Expand