Towards the evaluation of referring expression generation

Henriette Viethen, Robert Dale

Research output: Chapter in Book/Report/Conference proceedingConference proceeding contributionpeer-review

Abstract

The Natural Language Generation community is currently engaged in discussion as to whether and how to introduce one or several shared evaluation tasks, as are found in other fields of Natural Language Processing. As one of the most welldefined subtasks in NLG, the generation of referring expressions looks like a strong candidate for piloting such shared tasks. Based on our earlier evaluation of a number of existing algorithms for the generation of referring expressions, we explore in this paper some problems that arise in designing an evaluation task in this field, and try to identify general considerations that need to be met in evaluating generation subtasks.
Original languageEnglish
Title of host publicationProceedings of the 2006 Australasian language technology workshop 2006, November 30-December 1, 2006, Sancta Sophia College, Sydney
EditorsLawrence Cavedon, Ingrid Zukerman
Place of PublicationSydney
PublisherALTA
Pages115-122
Number of pages8
ISBN (Print)1741081467
Publication statusPublished - 2006
EventAustralasian Language Technology Association Workshop - Sydney
Duration: 30 Nov 20061 Dec 2006

Publication series

NameProceedings of the Australasian Language Technology Workshop
PublisherALTA
ISSN (Print)1834-7037

Workshop

WorkshopAustralasian Language Technology Association Workshop
CitySydney
Period30/11/061/12/06

Cite this