The 19 unifying questionnaire constructs of artificial social agents: an IVA community analysis

Siska Fitrianie, Merijn Bruijnes, Deborah Richards, Andrea Bönsch, Willem-Paul Brinkman

Research output: Chapter in Book/Report/Conference proceedingConference proceeding contributionpeer-review

23 Citations (Scopus)

Abstract

In this paper, we report on the multi-year Intelligent Virtual Agents (IVA) community effort, involving more than 80 researchers worldwide, researching the IVA community interests and practises in evaluating human interaction with an artificial social agent (ASA). The effort is driven by previous IVA workshops and plenary IVA discussions related to the methodological crisis on the evaluation of ASAs. A previous literature review showed a continuous practise of creating new questionnaires instead of reusing validated questionnaires. We address this issue by examining questionnaire measurement constructs used in empirical studies between 2013 to 2018 published in the IVA conference. We identified 189 constructs used in 89 questionnaires that are reported across 81 studies. Although these constructs have different names, they often measure the same thing. In this paper, we, therefore, present a unifying set of 19 constructs that captures more than 80% of the 189 constructs initially identified. We established this set in two steps. First, 49 researchers classified the constructs in broad theoretically based categories. Next, 23 researchers grouped the constructs in each category on their similarity. The resulting 19 groups form a unifying set of constructs, which will be the basis for the future questionnaire instrument of human-ASA interaction.

Original languageEnglish
Title of host publicationProceedings of the 20th ACM International Conference on Intelligent Virtual Agents, IVA 2020
Place of PublicationNew York, NY
PublisherAssociation for Computing Machinery, Inc
Pages1-8
Number of pages8
ISBN (Print)9781450375863
DOIs
Publication statusPublished - Oct 2020
Event20th ACM International Conference on Intelligent Virtual Agents, IVA 2020 - Virtual, Online, United Kingdom
Duration: 20 Oct 202022 Oct 2020

Publication series

NameProceedings of the 20th ACM International Conference on Intelligent Virtual Agents, IVA 2020

Conference

Conference20th ACM International Conference on Intelligent Virtual Agents, IVA 2020
Country/TerritoryUnited Kingdom
CityVirtual, Online
Period20/10/2022/10/20

Keywords

  • Artificial social agent
  • evaluation instrument
  • user study
  • questionnaire
  • measurement construct

Fingerprint

Dive into the research topics of 'The 19 unifying questionnaire constructs of artificial social agents: an IVA community analysis'. Together they form a unique fingerprint.

Cite this