The first challenge on generating instructions in virtual environments

Alexander Koller*, Kristina Striegnitz, Donna Byron, Justine Cassell, Robert Dale, Johanna Moore, Jon Oberlander

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference proceeding contributionpeer-review

25 Citations (Scopus)


This paper describes the First Challenge on Generating Instructions in Virtual Environments (GIVE-1). GIVE is a shared task for generation systems which give real-time natural-language instructions to users in a virtual 3D world. These systems are evaluated by connecting users and NLG systems over the Internet. We describe the design and results of GIVE-1 as well as the participating NLG systems, and validate the experimental methodology by comparing the results collected over the Internet with results from a more traditional laboratory-based experiment.

Original languageEnglish
Title of host publicationEmpirical Methods in Natural Language Generation - Data-Oriented Methods and Empirical Evaluation
Place of PublicationBerlin; Heidelberg
PublisherSpringer, Springer Nature
Number of pages25
Volume5790 LNAI
ISBN (Print)3642155723, 9783642155727
Publication statusPublished - 2010
Event12th European Workshop on Natural Language Generation, ENLG 2009 - Athens, Greece
Duration: 30 Mar 20093 Apr 2009

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume5790 LNAI
ISSN (Print)03029743
ISSN (Electronic)16113349


Other12th European Workshop on Natural Language Generation, ENLG 2009


Dive into the research topics of 'The first challenge on generating instructions in virtual environments'. Together they form a unique fingerprint.

Cite this