Structured streaming skeleton - A new feature for online human gesture recognition

Xin Zhao*, Xue Li, Chaoyi Pang, Quan Z. Sheng, Sen Wang, Mao Ye

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

26 Citations (Scopus)


Online human gesture recognition has a wide range of applications in computer vision, especially in humancomputer interaction applications. The recent introduction of cost-effective depth cameras brings a new trend of research on body-movement gesture recognition. However, there are two major challenges: (i) how to continuously detect gestures from unsegmented streams, and (ii) how to differentiate different styles of the same gesture from other types of gestures. In this article, we solve these two problems with a new effective and efficient feature extractionmethod-Structured Streaming Skeleton (SSS)-which uses a dynamicmatching approach to construct a feature vector for each frame. Our comprehensive experiments on MSRC-12 Kinect Gesture, Huawei/3DLife-2013, and MSR-Action3D datasets have demonstrated superior performances than the state-of-the-art approaches. We also demonstrate model selection based on the proposed SSS feature, where the classifier of squared loss regression with l2,1 norm regularization is a recommended classifier for best performance.

Original languageEnglish
Article number22
Pages (from-to)1-18
Number of pages18
JournalACM Transactions on Multimedia Computing, Communications and Applications
Issue number1
Publication statusPublished - Sept 2014
Externally publishedYes


  • Depth camera
  • Feature extraction
  • Gesture recognition


Dive into the research topics of 'Structured streaming skeleton - A new feature for online human gesture recognition'. Together they form a unique fingerprint.

Cite this