Real time gesture recognition and processing to control television set by hand beacon

Khizir Mahmud*

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference proceeding contributionpeer-review


The goal of this research is to develop a system for real time gesture recognition and classify the sign and send to TV. A continuous stream of hand signs images is recorded and has to be processed immediately. The camera that records these signs provides pictures in real-time conditions to a PC that has to classify the signs. Such systems should offer the possibility to command computers just using hand signs. To simplify the task the research tried to find a robust solution for recognizing signs correctly as well as make the computation faster and interface with television to supersede the remote controller. The system function is divided into four major parts. Firstly, from the hand gesture some features have been extracted. To calculate height and area of the gesture, centroid and distance of that centroid from the origin are the extracted feature. Secondly, an input array is formed using these features and converted it into formatted feature matrix. For this the decimal input matrix has been converted into binary matrix by using a ranging method. The test image is collected from the camera of the computer in real time environment. Then, this binary matrix is used as the input of a feed-forward back-propagation neural network and tries to find the decimal output from it and convert it into binary. Finally, that corresponding character of channel is sent through serial port to the television via web cam.

Original languageEnglish
Title of host publicationGHTCE 2013
Subtitle of host publication2013 IEEE Global High Tech Congress on Electronics
Place of PublicationPiscataway, NJ
PublisherInstitute of Electrical and Electronics Engineers (IEEE)
Number of pages5
ISBN (Electronic)9781479932092
Publication statusPublished - 2013
Externally publishedYes
Event2013 IEEE Global High Tech Congress on Electronics, GHTCE 2013 - Shenzhen, China
Duration: 17 Nov 201319 Nov 2013


Other2013 IEEE Global High Tech Congress on Electronics, GHTCE 2013


  • hand gesture
  • image processing
  • RGB
  • television set

Fingerprint Dive into the research topics of 'Real time gesture recognition and processing to control television set by hand beacon'. Together they form a unique fingerprint.

Cite this