Share This Author
Broad Coverage Multilingual Deep Sentence Generation with a Stochastic Multi-Level Realizer
This work proposes a multilingual deep stochastic sentence realizer that mirrors the state-of-the-art research in semantic parsing, and uses an SVM learning algorithm.
The First Multilingual Surface Realisation Shared Task (SR’18): Overview and Evaluation Results
- Simon Mille, A. Belz, Bernd Bohnet, Yvette Graham, Emily Pitler, Leo Wanner
- Computer Science
- 1 July 2018
A new multilingual surface realisation task organised as part of the ACL’18 Workshop on Multilingual Surface Realisation, with two tracks with different levels of complexity.
The 2020 Bilingual, Bi-Directional WebNLG+ Shared Task: Overview and Evaluation Results (WebNLG+ 2020)
The results of the generation and semantic parsing task for both English and Russian are presented and a brief description of the participating systems are provided.
AnCora-UPF: A Multi-Level Annotation of Spanish
This work presents a new corpus of Spanish annotated on four independent levels, morphology, surface-sy syntax, deep-syntax and semantics, as well as the methodology that allows for obtaining it with fewer cost while maintaining a high inter-annotator agreement.
Twenty Years of Confusion in Human Evaluation: NLG Needs Evaluation Sheets and Standardised Definitions
Due to a pervasive lack of clarity in reports and extreme diversity in approaches, human evaluation in NLG presents as extremely confused in 2020, and that the field is in urgent need of standard methods and terminology.
The Second Multilingual Surface Realisation Shared Task (SR’19): Overview and Evaluation Results
Evaluated systems were evaluated automatically, using a range of intrinsic metrics, and by human judges in terms of readability and meaning similarity, and the evaluation results are presented.
The Third Multilingual Surface Realisation Shared Task (SR’20): Overview and Evaluation Results
- Simon Mille, Anya Belz, Bernd Bohnet, Thiago Castro Ferreira, Yvette Graham, L. Wanner
- Computer ScienceMSR
Evaluation results from the Third Shared Task on Multilingual Surface Realisation (SR’20) are presented, along with descriptions of the SR’19 tracks, data and evaluation methods, as well as brief summaries of the participating systems.
Underspecified Universal Dependency Structures as Inputs for Multilingual Surface Realisation
The motivation for, and likely usefulness of, deriving NLG inputs from annotations in resources originally developed for Natural Language Understanding (NLU), and whether the resulting inputs supply enough information of the right kind for the final stage in the NLG process are examined.
The GEM Benchmark: Natural Language Generation, its Evaluation and Metrics
GEM, a living benchmark for natural language Generation (NLG), its Evaluation, and Metrics, is introduced and the description of the data for the 2021 shared task at the associated GEM Workshop is described.
Perspective-oriented generation of football match summaries: Old tasks, new challenges
The viability of the proposal has been evaluated for the generation of football match summaries of the First Spanish Football League and it is shown how content selection, discourse structuring, information structure determination, and lexicalization are driven by these criteria and how stage after stage a truly user perspective-tailed summary is generated.