The Natural Language Generation community is currently engaged in discussion as to whether and how to introduce one or several shared evaluation tasks, as are found in other fields of Natural Language Processing. As one of the most welldefined subtasks in NLG, the generation of referring expressions looks like a strong candidate for piloting such shared tasks. Based on our earlier evaluation of a number of existing algorithms for the generation of referring expressions, we explore in this paper some problems that arise in designing an evaluation task in this field, and try to identify general considerations that need to be met in evaluating generation subtasks.
|Title of host publication||Proceedings of the 2006 Australasian language technology workshop 2006, November 30-December 1, 2006, Sancta Sophia College, Sydney|
|Editors||Lawrence Cavedon, Ingrid Zukerman|
|Place of Publication||Sydney|
|Number of pages||8|
|Publication status||Published - 2006|
|Event||Australasian Language Technology Association Workshop - Sydney|
Duration: 30 Nov 2006 → 1 Dec 2006
|Name||Proceedings of the Australasian Language Technology Workshop|
|Workshop||Australasian Language Technology Association Workshop|
|Period||30/11/06 → 1/12/06|
Viethen, H., & Dale, R. (2006). Towards the evaluation of referring expression generation. In L. Cavedon, & I. Zukerman (Eds.), Proceedings of the 2006 Australasian language technology workshop 2006, November 30-December 1, 2006, Sancta Sophia College, Sydney (pp. 115-122). (Proceedings of the Australasian Language Technology Workshop). Sydney: ALTA.