Evaluating algorithms for the Generation of Referring Expressions using a balanced corpus

@inproceedings{Gatt2007EvaluatingAF,
  title={Evaluating algorithms for the Generation of Referring Expressions using a balanced corpus},
  author={Albert Gatt and I. V. D. Sluis and Kees van Deemter},
  booktitle={ENLG},
  year={2007}
}
Despite being the focus of intensive research, evaluation of algorithms that generate referring expressions is still in its infancy. We describe a corpus-based evaluation methodology, applied to a number of classic algorithms in this area. The methodology focuses on balance and semantic transparency to enable comparison of human and algorithmic output. Although the Incremental Algorithm emerges as the best match, we found that its dependency on manually-set parameters makes its performance… Expand
108 Citations
Evaluating Algorithms for the Generation of Referring Expressions: Going beyond Toy Domains.
  • 27
  • PDF
Attribute Selection for Referring Expression Generation: New Algorithms and Evaluation Methods
  • 30
  • PDF
Intrinsic vs. Extrinsic Evaluation Measures for Referring Expression Generation
  • 44
  • PDF
Combining symbolic and corpus-based approaches for the generation of successful referring expressions
  • 23
  • PDF
Generation of Referring Expressions: Assessing the Incremental Algorithm
  • 80
  • PDF
On The Feasibility of Open Domain Referring Expression Generation Using Large Scale Folksonomies
  • 7
  • Highly Influenced
  • PDF
Beyond DICE : measuring the quality of a referring expression
  • 7
  • PDF
Lessons from Computational Modelling of Reference Production in Mandarin and English
  • PDF
...
1
2
3
4
5
...

References

SHOWING 1-10 OF 34 REFERENCES
Building a Semantically Transparent Corpus for the Generation of Referring Expressions
  • 84
  • PDF
Generating Referring Expressions in Open Domains
  • 55
  • PDF
Algorithms for Generating Referring Expressions: Do They Do What People Do?
  • 75
  • PDF
Viewing Referring Expression Generation as Search
  • 23
  • PDF
Automatic Evaluation of Referring Expression Generation Using Corpora ∗
  • 47
  • PDF
Generating Referring Expressions that Involve Gradable Properties
  • 92
  • PDF
On identifying sets
  • 54
  • PDF
Generating Referring Expressions: Boolean Extensions of the Incremental Algorithm
  • 131
  • PDF
Cooking Up Referring Expressions
  • 242
  • PDF
...
1
2
3
4
...