What are we measuring anyway? A literature survey of questionnaires used in studies reported in the Intelligent Virtual Agent conferences

Siska Fitrianie, Merijn Bruijnes, Deborah Richards, Amal Abdulrahman, Willem-Paul Brinkman

Research output: Chapter in Book/Report/Conference proceedingConference proceeding contributionpeer-review

3 Citations (Scopus)

Abstract

Research into artificial social agents aims at constructing these agents and at establishing an empirically grounded understanding of them, their interaction with humans, and howthey can ultimately deliver certain outcomes in areas such as health, entertainment, and education. Key for establishing such understanding is the community's ability to describe and replicate their observations on how users perceive and interact with their agents. In this paper, we address this ability by examining questionnaires and their constructs used in empirical studies reported in the intelligent virtual agent conference proceedings from 2013 to 2018. The literature survey shows the identification of 189 constructs used in 89 questionnaires thatwere reported across 81 papers.We found unexpectedly little repeated use of questionnaires as the vast majority of questionnaires (more than 76%) were only reported in a single paper. We expect that this finding will motivate joint effort by the IVA community towards creating a unified measurement instrument.

Original languageEnglish
Title of host publicationIVA '19 Proceedings of the 19th ACM International Conference on Intelligent Virtual Agents
Place of PublicationNew York, NY, USA
PublisherAssociation for Computing Machinery (ACM)
Pages159-161
Number of pages3
ISBN (Electronic)9781450366724
DOIs
Publication statusPublished - 1 Jul 2019
Event19th ACM International Conference on Intelligent Virtual Agents, IVA 2019 - Paris, France
Duration: 2 Jul 20195 Jul 2019

Publication series

NameIVA 2019 - Proceedings of the 19th ACM International Conference on Intelligent Virtual Agents

Conference

Conference19th ACM International Conference on Intelligent Virtual Agents, IVA 2019
CountryFrance
CityParis
Period2/07/195/07/19

Keywords

  • artificial social agent
  • evaluation instrument
  • measurement construct
  • questionnaire
  • user study

Fingerprint Dive into the research topics of 'What are we measuring anyway? A literature survey of questionnaires used in studies reported in the Intelligent Virtual Agent conferences'. Together they form a unique fingerprint.

Cite this