AirContour

building contour-based model for in-air writing gesture recognition

Yafeng Yin, Lei Xie, Tao Gu, Yijia Lu, Sanglu Lu

Research output: Contribution to journalArticle

2 Citations (Scopus)

Abstract

Recognizing in-Air hand gestures will benefit a wide range of applications such as sign-language recognition, remote control with hand gestures, and "writing" in the air as a new way of text input. This article presents AirContour, which focuses on in-Air writing gesture recognition with a wrist-worn device. We propose a novel contour-based gesture model that converts human gestures to contours in 3D space and then recognizes the contours as characters. Different from 2D contours, the 3D contours may have the problems such as contour distortion caused by different viewing angles, contour difference caused by different writing directions, and the contour distribution across different planes. To address the above problem, we introduce Principal Component Analysis (PCA) to detect the principal/writing plane in 3D space, and then tune the projected 2D contour in the principal plane through reversing, rotating, and normalizing operations, to make the 2D contour in right orientation and normalized size under a uniform view. After that, we propose both an online approach, AC-Vec, and an offline approach, AC-CNN, for character recognition. The experimental results show that AC-Vec achieves an accuracy of 91.6% and AC-CNN achieves an accuracy of 94.3% for gesture/character recognition, both outperforming the existing approaches.

Original languageEnglish
Article number44
Number of pages25
JournalACM Transactions on Sensor Networks (TOSN)
Volume15
Issue number4
DOIs
Publication statusPublished - Oct 2019
Externally publishedYes

Keywords

  • AirContour
  • Contour-based gesture model
  • Gesture recognition
  • In-Air writing
  • Principal component analysis (PCA)

Fingerprint Dive into the research topics of 'AirContour: building contour-based model for in-air writing gesture recognition'. Together they form a unique fingerprint.

Cite this