Share This Author
Class-Based Construction of a Verb Lexicon
We present an approach to building a verb lexicon compatible with WordNet but with explicitly stated syntactic and semantic information, using Levin verb classes to systematically construct lexical…
Overview of the TAC 2010 Knowledge Base Population Track
An overview of the task definition and annotation challenges associated with KBP2010 is provided and the evaluation results and lessons that are learned are discussed based on detailed analysis.
Overview of DUC 2005
- H. Dang
- Materials Science
The focus of DUC 2005 was on developing new evaluation methods that take into account variation in content in human-authored summaries. Therefore, DUC 2005 had a single user-oriented,…
English Tasks: All-Words and Verb Lexical Sample
The experience in preparing the lexicon and sense-tagged corpora used in the English all-words and lexical sample tasks of Senseval-2 is described.
SemEval-2013 Task 7: The Joint Student Response Analysis and 8th Recognizing Textual Entailment Challenge
We present the results of the Joint Student Response Analysis and 8th Recognizing Textual Entailment Challenge, aiming to bring together researchers in educational NLP technology and textual…
DUC in context
Overview of the TREC 2007 Question Answering Track
The TREC 2005 Question Answering track contained three tasks: the main question answering task, the document ranking task, and the relationship task. The main task was the same as the single TREC…
Overview of the TAC 2008 Update Summarization Task
While all of the 71 submitted runs were automatically scored with the ROUGE and BE metrics, NIST assessors manually evaluated only 57 of the submitted runs for readability, content, and overall responsiveness.
Investigating Regular Sense Extensions based on Intersective Levin Classes
This paper presents a refinement of Levin classes, intersective sets, which are a more fine-grained classification and have more coherent sets of syntactic frames and associated semantic components.
An Assessment of the Accuracy of Automatic Evaluation in Summarization
- Karolina Owczarzak, John M. Conroy, H. Dang, A. Nenkova
- Computer ScienceEvalMetrics@NAACL-HLT
- 8 June 2012
An assessment of the automatic evaluations used for multi-document summarization of news, and recommendations about how any evaluation, manual or automatic, should be used to find statistically significant differences between summarization systems.