• Publications
  • Influence
A SICK cure for the evaluation of compositional distributional semantic models
TLDR
This work aims to help the research community working on compositional distributional semantic models (CDSMs) by providing SICK (Sentences Involving Compositional Knowldedge), a large size English benchmark tailored for them.
The Sixth PASCAL Recognizing Textual Entailment Challenge
TLDR
This paper presents the Sixth Recognizing Textual Entailment (RTE-6) challenge, as the traditional Main Task was replaced by a new task, similar to the RTE-5 Search Pilot, in which TextualEntailment is performed on a real corpus in the Update Summarization scenario.
SemEval-2014 Task 1: Evaluation of Compositional Distributional Semantic Models on Full Sentences through Semantic Relatedness and Textual Entailment
TLDR
This paper presents the task on the evaluation of Compositional Distributional Semantics Models on full sentences organized for the first time within SemEval2014, and attracted 21 teams, most of which participated in both subtasks.
Neural versus Phrase-Based Machine Translation Quality: a Case Study
TLDR
A detailed analysis of neural versus phrase-based SMT outputs is performed, leveraging high quality post-edits performed by professional translators on the IWSLT data and provides useful insights on what linguistic phenomena are best modeled by neural models.
Report on the 11th IWSLT evaluation campaign
TLDR
The paper overviews the 11th evaluation campaign organized by the IWSLT workshop, which offered multiple tracks on lecture transcription and translation based on the TED Talks corpus and included three automatic speech recognition tracks and five speech translation tracks.
Revising the Wordnet Domains Hierarchy: semantics, coverage and balancing
TLDR
This paper presents the WordNet Domains Hierarchy (WDH), a language-independent resource composed of 164, hierarchically organized, domain labels, and illustrates a new version of WDH addressing problems by an explicit and systematic reference to the Dewey Decimal Classification.
SemEval-2013 Task 7: The Joint Student Response Analysis and 8th Recognizing Textual Entailment Challenge
We present the results of the Joint Student Response Analysis and 8th Recognizing Textual Entailment Challenge, aiming to bring together researchers in educational NLP technology and textual
MuST-C: a Multilingual Speech Translation Corpus
TLDR
MuST-C is created, a multilingual speech translation corpus whose size and quality will facilitate the training of end-to-end systems for SLT from English into 8 languages and an empirical verification of its quality and SLT results computed with a state-of-the-art approach on each language direction.
Report on the 10th IWSLT evaluation campaign
TLDR
The paper overviews the tenth evaluation campaign organized by the IWSLT workshop, which offered multiple tracks on lecture transcription and translation based on the TED Talks corpus and evaluated the progresses against systems of the previous years.
The Seventh PASCAL Recognizing Textual Entailment Challenge
TLDR
This paper presents the Seventh Recognizing Textual Entailment (RTE-7) challenge, which replicated the exercise proposed in RTE-6, consisting of a Main Task, a Main subtask aimed at detecting novel information; and a KBP Validation Task, in which RTE systems had to validate the output of systems participating in the KBP Slot Filling Task.
...
1
2
3
4
5
...