A wizard or a fool? Initial Assessment of a Wizard of Oz agent supporting collaborative virtual environments

James Simpson; Michael Richardson; Deborah Richards

doi:10.1145/3527188.3563930

A wizard or a fool? Initial Assessment of a Wizard of Oz agent supporting collaborative virtual environments

James Simpson, Michael Richardson, Deborah Richards

Research output: Chapter in Book/Report/Conference proceeding › Conference proceeding contribution › peer-review

Abstract

A popular technique for evaluating envisioned AI agents without committing significant engineering resources to implement such an agent is the Wizard of Oz (WoZ) methodology. Thus far, many of the WoZ studies concerned with the design of conversational agents have been standalone systems for individual participants to interact with. The aim of this work was to determine whether a WoZ conversational agent could be embedded within an existing team-based collaborative virtual environment. In doing so, we uncovered a number of potential challenges in designing such a system which may be valuable for those implementing such a system in the future.

Original language	English
Title of host publication	HAI 2022
Subtitle of host publication	Proceedings of the 10th Conference on Human-Agent Interaction
Place of Publication	New York, NY
Publisher	Association for Computing Machinery
Pages	299-301
Number of pages	3
ISBN (Electronic)	9781450393232
DOIs	https://doi.org/10.1145/3527188.3563930
Publication status	Published - Dec 2022
Event	International Conference on Human-Agent Interaction (10th : 2022) - Christchurch, New Zealand Duration: 5 Dec 2022 → 8 Dec 2022

Conference

Conference	International Conference on Human-Agent Interaction (10th : 2022)
Abbreviated title	HAI ’22
Country/Territory	New Zealand
City	Christchurch
Period	5/12/22 → 8/12/22

Keywords

conversational agent
pilot study
virtual environment
Wizard of Oz

Access to Document

10.1145/3527188.3563930

Cite this

@inproceedings{c3979dbcda0243aeb66eb9b1d3629286,

title = "A wizard or a fool? Initial Assessment of a Wizard of Oz agent supporting collaborative virtual environments",

abstract = "A popular technique for evaluating envisioned AI agents without committing significant engineering resources to implement such an agent is the Wizard of Oz (WoZ) methodology. Thus far, many of the WoZ studies concerned with the design of conversational agents have been standalone systems for individual participants to interact with. The aim of this work was to determine whether a WoZ conversational agent could be embedded within an existing team-based collaborative virtual environment. In doing so, we uncovered a number of potential challenges in designing such a system which may be valuable for those implementing such a system in the future.",

keywords = "conversational agent, pilot study, virtual environment, Wizard of Oz",

author = "James Simpson and Michael Richardson and Deborah Richards",

year = "2022",

month = dec,

doi = "10.1145/3527188.3563930",

language = "English",

pages = "299--301",

booktitle = "HAI 2022",

publisher = "Association for Computing Machinery",

note = "International Conference on Human-Agent Interaction (10th : 2022), HAI {\textquoteright}22 ; Conference date: 05-12-2022 Through 08-12-2022",

}

Simpson, J , Richardson, M & Richards, D 2022, A wizard or a fool? Initial Assessment of a Wizard of Oz agent supporting collaborative virtual environments. in HAI 2022: Proceedings of the 10th Conference on Human-Agent Interaction. Association for Computing Machinery, New York, NY, pp. 299-301, International Conference on Human-Agent Interaction (10th : 2022), Christchurch, New Zealand, 5/12/22. https://doi.org/10.1145/3527188.3563930

A wizard or a fool? Initial Assessment of a Wizard of Oz agent supporting collaborative virtual environments. / Simpson, James ; Richardson, Michael ; Richards, Deborah.

HAI 2022: Proceedings of the 10th Conference on Human-Agent Interaction. New York, NY : Association for Computing Machinery, 2022. p. 299-301.

Research output: Chapter in Book/Report/Conference proceeding › Conference proceeding contribution › peer-review

TY - GEN

T1 - A wizard or a fool? Initial Assessment of a Wizard of Oz agent supporting collaborative virtual environments

AU - Simpson, James

AU - Richardson, Michael

AU - Richards, Deborah

PY - 2022/12

Y1 - 2022/12

N2 - A popular technique for evaluating envisioned AI agents without committing significant engineering resources to implement such an agent is the Wizard of Oz (WoZ) methodology. Thus far, many of the WoZ studies concerned with the design of conversational agents have been standalone systems for individual participants to interact with. The aim of this work was to determine whether a WoZ conversational agent could be embedded within an existing team-based collaborative virtual environment. In doing so, we uncovered a number of potential challenges in designing such a system which may be valuable for those implementing such a system in the future.

AB - A popular technique for evaluating envisioned AI agents without committing significant engineering resources to implement such an agent is the Wizard of Oz (WoZ) methodology. Thus far, many of the WoZ studies concerned with the design of conversational agents have been standalone systems for individual participants to interact with. The aim of this work was to determine whether a WoZ conversational agent could be embedded within an existing team-based collaborative virtual environment. In doing so, we uncovered a number of potential challenges in designing such a system which may be valuable for those implementing such a system in the future.

KW - conversational agent

KW - pilot study

KW - virtual environment

KW - Wizard of Oz

UR - http://www.scopus.com/inward/record.url?scp=85144617747&partnerID=8YFLogxK

U2 - 10.1145/3527188.3563930

DO - 10.1145/3527188.3563930

M3 - Conference proceeding contribution

AN - SCOPUS:85144617747

SP - 299

EP - 301

BT - HAI 2022

PB - Association for Computing Machinery

CY - New York, NY

T2 - International Conference on Human-Agent Interaction (10th : 2022)

Y2 - 5 December 2022 through 8 December 2022

ER -

A wizard or a fool? Initial Assessment of a Wizard of Oz agent supporting collaborative virtual environments

Abstract

Conference

Keywords

Access to Document

Other files and links

Fingerprint

Cite this