Evaluation in the context of natural language generation

C. Mellish, R. Dale

Research output: Contribution to journalArticle

31 Citations (Scopus)

Abstract

What role should evaluation play in the development of natural language generation (NLG) techniques and systems? In this paper we describe what is involved in natural language generation, and survey how evaluation has figured in work in this area to date. We comment on the issues raised by this existing work and on how the problems of NLG evaluation are different from the problems of evaluating work in natural language understanding. The paper is concluded by suggesting a way forward by looking more closely at the component problems that are addressed in natural language generation research; a particular text generation application is examined and the issues that are raised in assessing its performance on a variety of dimensions are looked at.

Original languageEnglish
Pages (from-to)349-373
Number of pages25
JournalComputer Speech and Language
Volume12
Issue number4
Publication statusPublished - Oct 1998

Fingerprint Dive into the research topics of 'Evaluation in the context of natural language generation'. Together they form a unique fingerprint.

  • Cite this