The first challenge on generating instructions in virtual environments

Alexander Koller; Kristina Striegnitz; Donna Byron; Justine Cassell; Robert Dale; Johanna Moore; Jon Oberlander

doi:10.1007/978-3-642-15573-4_16

The first challenge on generating instructions in virtual environments

Alexander Koller^*, Kristina Striegnitz, Donna Byron, Justine Cassell, Robert Dale, Johanna Moore, Jon Oberlander

^*Corresponding author for this work

School of Computing

Research output: Chapter in Book/Report/Conference proceeding › Conference proceeding contribution › peer-review

25 Citations (Scopus)

Abstract

This paper describes the First Challenge on Generating Instructions in Virtual Environments (GIVE-1). GIVE is a shared task for generation systems which give real-time natural-language instructions to users in a virtual 3D world. These systems are evaluated by connecting users and NLG systems over the Internet. We describe the design and results of GIVE-1 as well as the participating NLG systems, and validate the experimental methodology by comparing the results collected over the Internet with results from a more traditional laboratory-based experiment.

Original language	English
Title of host publication	Empirical Methods in Natural Language Generation - Data-Oriented Methods and Empirical Evaluation
Place of Publication	Berlin; Heidelberg
Publisher	Springer, Springer Nature
Pages	328-352
Number of pages	25
Volume	5790 LNAI
ISBN (Print)	3642155723, 9783642155727
DOIs	https://doi.org/10.1007/978-3-642-15573-4_16
Publication status	Published - 2010
Event	12th European Workshop on Natural Language Generation, ENLG 2009 - Athens, Greece Duration: 30 Mar 2009 → 3 Apr 2009

Publication series

Name	Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume	5790 LNAI
ISSN (Print)	03029743
ISSN (Electronic)	16113349

Other

Other	12th European Workshop on Natural Language Generation, ENLG 2009
Country/Territory	Greece
City	Athens
Period	30/03/09 → 3/04/09

Access to Document

10.1007/978-3-642-15573-4_16

Cite this

Koller, A., Striegnitz, K., Byron, D., Cassell, J., Dale, R., Moore, J., & Oberlander, J. (2010). The first challenge on generating instructions in virtual environments. In Empirical Methods in Natural Language Generation - Data-Oriented Methods and Empirical Evaluation (Vol. 5790 LNAI, pp. 328-352). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 5790 LNAI). Springer, Springer Nature. https://doi.org/10.1007/978-3-642-15573-4_16

Koller, Alexander ; Striegnitz, Kristina ; Byron, Donna et al. / The first challenge on generating instructions in virtual environments. Empirical Methods in Natural Language Generation - Data-Oriented Methods and Empirical Evaluation. Vol. 5790 LNAI Berlin; Heidelberg : Springer, Springer Nature, 2010. pp. 328-352 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).

@inproceedings{6255e63be437456496fc0165fb53ffd7,

title = "The first challenge on generating instructions in virtual environments",

abstract = "This paper describes the First Challenge on Generating Instructions in Virtual Environments (GIVE-1). GIVE is a shared task for generation systems which give real-time natural-language instructions to users in a virtual 3D world. These systems are evaluated by connecting users and NLG systems over the Internet. We describe the design and results of GIVE-1 as well as the participating NLG systems, and validate the experimental methodology by comparing the results collected over the Internet with results from a more traditional laboratory-based experiment.",

author = "Alexander Koller and Kristina Striegnitz and Donna Byron and Justine Cassell and Robert Dale and Johanna Moore and Jon Oberlander",

year = "2010",

doi = "10.1007/978-3-642-15573-4_16",

language = "English",

isbn = "3642155723",

volume = "5790 LNAI",

series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

publisher = "Springer, Springer Nature",

pages = "328--352",

booktitle = "Empirical Methods in Natural Language Generation - Data-Oriented Methods and Empirical Evaluation",

address = "United States",

note = "12th European Workshop on Natural Language Generation, ENLG 2009 ; Conference date: 30-03-2009 Through 03-04-2009",

}

Koller, A, Striegnitz, K, Byron, D, Cassell, J, Dale, R, Moore, J & Oberlander, J 2010, The first challenge on generating instructions in virtual environments. in Empirical Methods in Natural Language Generation - Data-Oriented Methods and Empirical Evaluation. vol. 5790 LNAI, Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 5790 LNAI, Springer, Springer Nature, Berlin; Heidelberg, pp. 328-352, 12th European Workshop on Natural Language Generation, ENLG 2009, Athens, Greece, 30/03/09. https://doi.org/10.1007/978-3-642-15573-4_16

The first challenge on generating instructions in virtual environments. / Koller, Alexander; Striegnitz, Kristina; Byron, Donna et al.
Empirical Methods in Natural Language Generation - Data-Oriented Methods and Empirical Evaluation. Vol. 5790 LNAI Berlin; Heidelberg: Springer, Springer Nature, 2010. p. 328-352 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 5790 LNAI).

Research output: Chapter in Book/Report/Conference proceeding › Conference proceeding contribution › peer-review

TY - GEN

T1 - The first challenge on generating instructions in virtual environments

AU - Koller, Alexander

AU - Striegnitz, Kristina

AU - Byron, Donna

AU - Cassell, Justine

AU - Dale, Robert

AU - Moore, Johanna

AU - Oberlander, Jon

PY - 2010

Y1 - 2010

N2 - This paper describes the First Challenge on Generating Instructions in Virtual Environments (GIVE-1). GIVE is a shared task for generation systems which give real-time natural-language instructions to users in a virtual 3D world. These systems are evaluated by connecting users and NLG systems over the Internet. We describe the design and results of GIVE-1 as well as the participating NLG systems, and validate the experimental methodology by comparing the results collected over the Internet with results from a more traditional laboratory-based experiment.

AB - This paper describes the First Challenge on Generating Instructions in Virtual Environments (GIVE-1). GIVE is a shared task for generation systems which give real-time natural-language instructions to users in a virtual 3D world. These systems are evaluated by connecting users and NLG systems over the Internet. We describe the design and results of GIVE-1 as well as the participating NLG systems, and validate the experimental methodology by comparing the results collected over the Internet with results from a more traditional laboratory-based experiment.

UR - http://www.scopus.com/inward/record.url?scp=77956324955&partnerID=8YFLogxK

U2 - 10.1007/978-3-642-15573-4_16

DO - 10.1007/978-3-642-15573-4_16

M3 - Conference proceeding contribution

AN - SCOPUS:77956324955

SN - 3642155723

SN - 9783642155727

VL - 5790 LNAI

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 328

EP - 352

BT - Empirical Methods in Natural Language Generation - Data-Oriented Methods and Empirical Evaluation

PB - Springer, Springer Nature

CY - Berlin; Heidelberg

T2 - 12th European Workshop on Natural Language Generation, ENLG 2009

Y2 - 30 March 2009 through 3 April 2009

ER -

Koller A, Striegnitz K, Byron D, Cassell J, Dale R, Moore J et al. The first challenge on generating instructions in virtual environments. In Empirical Methods in Natural Language Generation - Data-Oriented Methods and Empirical Evaluation. Vol. 5790 LNAI. Berlin; Heidelberg: Springer, Springer Nature. 2010. p. 328-352. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). doi: 10.1007/978-3-642-15573-4_16

The first challenge on generating instructions in virtual environments

Abstract

Publication series

Other

Access to Document

Other files and links

Fingerprint

Cite this