Towards accommodating gender differences in speech-gesture based multimodal interfaces design

Jing Liu, Manolya Kavakli

Research output: Chapter in Book/Report/Conference proceedingConference proceeding contributionpeer-review

Abstract

Gender as an user related factor is rarely taken into account when users interact withMultimodal Interface Systems (MMIS), there are individual differences in their behavior. Therefore, gender, age, culture and other individual differences might be influential factors in the design of MMIS. This paper presents an empirical study aimed at addressing basic gender differences in the use of speech and hand gestures for the design of MMIS. The methodology used in this paper is the video analysis to identify the gender differences in the descriptions of two objects using speech and hand gestures. Our initial findings confirm that gender differences exist in the description of the objects using speech and hand gestures, which might have implications for the design of MMIS. The differences originate from cognitive processing as well as the order and structure of speech and hand gestures. We found that males and females use different cognitive modes when they describe the same objects. While male participants spend a greater proportion of time in verbal communication using speech than in tactile communication using gestures to describe the objects, females use gestures more frequently compared to males. On average, the time interval between the onsets of gesture strokes and the related key words are shorter for females than for males, which can affect the integration of speech and hand gestures in MMIS. Thus our findings suggest that the performance of MMIS depends not only on the task being performed, but also the gender of the users.
Original languageEnglish
Title of host publicationICITA 2013
Subtitle of host publicationthe 8th International Conference on Information Technology and Applications
Place of PublicationSydney
PublisherAcademic Alliance International
Pages38-43
Number of pages6
ISBN (Print)9780980326758
Publication statusPublished - 2013
EventInternational Conference on Information Technology and Applications (8th : 2013) - Sydney
Duration: 1 Jul 20134 Jul 2013

Conference

ConferenceInternational Conference on Information Technology and Applications (8th : 2013)
CitySydney
Period1/07/134/07/13

Keywords

  • Gender differences
  • multimodal interface
  • speech and hand gestures
  • cognitive aspect
  • time interval

Fingerprint

Dive into the research topics of 'Towards accommodating gender differences in speech-gesture based multimodal interfaces design'. Together they form a unique fingerprint.

Cite this