FinDroidHR: smartwatch gesture input with optical heartrate monitor

Yu Zhang, Tao Gu, Chu Luo, Vassilis Kostakos, Aruna Seneviratne

Research output: Contribution to journalArticlepeer-review


We present FinDroidHR, a novel gesture input technique for off-the-shelf smartwatches. Our technique is designed to detect 10 hand gestures on the hand wearing a smartwatch. The technique is enabled by analysing features of the Photoplethysmography (PPG) signal that optical heart-rate sensors capture. In a study with 20 participants, we show that FinDroidHR achieves 90.55% accuracy and 90.73% recall. Our work is the first study to explore the feasibility of using optical sensors on the off-the-shelf wearable devices to recognise gestures. Without requiring bespoke hardware, FinDroidHR can be readily used on existing smartwatches.
Original languageEnglish
Article number56
Number of pages42
JournalACM Proceedings on Interactive, Mobile, Wearable and Ubiquitous Technologies
Issue number1
Publication statusPublished - Mar 2018
Externally publishedYes


  • Wearable Computing
  • Gesture Interaction
  • Machine Learning
  • Mobile Sensors


Dive into the research topics of 'FinDroidHR: smartwatch gesture input with optical heartrate monitor'. Together they form a unique fingerprint.

Cite this