A survey of speech-hand gesture recognition for the development of multimodal interfaces in computer games

Jing Liu*, Manolya Kavakli

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference proceeding contributionpeer-review

28 Citations (Scopus)

Abstract

Hand gestures and speech constitute one of the most important modalities in human-to-human communication. The investigation of this phenomenon has been the focus of research about multimodal interfaces for speech and hand gesture recognition in human computer interaction(HCI). Computer games, as one of the most popular application areas of HCI, are likely to make use of this technology. Integration of speech and gesture in computer games make game play more enjoyable. This article does not intend to cover exhaustively all the issues related to multimodal interface creation in computer games. We primarily discuss some of the key issues related to multimodal interfaces for speech and hand gesture recognition and present a survey of current approaches to overcome the problems faced in this area.

Original languageEnglish
Title of host publication2010 IEEE International Conference on Multimedia and Expo, ICME 2010
Place of PublicationPiscataway, NJ
PublisherInstitute of Electrical and Electronics Engineers (IEEE)
Pages1564-1569
Number of pages6
ISBN (Print)9781424474912
DOIs
Publication statusPublished - 2010
Event2010 IEEE International Conference on Multimedia and Expo, ICME 2010 - Singapore, Singapore
Duration: 19 Jul 201023 Jul 2010

Other

Other2010 IEEE International Conference on Multimedia and Expo, ICME 2010
Country/TerritorySingapore
CitySingapore
Period19/07/1023/07/10

Keywords

  • speech
  • hand gestures
  • multimodal interfaces
  • computer games

Fingerprint

Dive into the research topics of 'A survey of speech-hand gesture recognition for the development of multimodal interfaces in computer games'. Together they form a unique fingerprint.

Cite this