Robust multi-object tracking using deep learning framework

Shuchao Pang, Anan Du, Zhezhou Yu

Research output: Contribution to journalArticlepeer-review

2 Citations (Scopus)


Object appearance representation is crucial to any visual tracker. In order to improve the appearance representation, we propose a deep compact and high-level appearance representation applied to a multi-object tracking algorithm, which is called Deep Multi-object Tracking. In this paper, we adopt the deep learning framework to offline obtain generic image features with auxiliary natural images and online fine-tune our Deep Multi-object Tracking system to adapt to appearance changes of the moving objects. Besides, we have fully considered the temporal information denoting the dynamic duration time of each object. Based on the temporal information and particle filter, our Deep Multi-object Tracking algorithm can effectively generate an online learning and updating model to form a discriminative appearance scheme to achieve successful multi-object tracking. Experiments show that the proposed Deep Multi-object Tracking performs well both indoor and outdoor, where the objects undergo large pose, scale, occlusion, and illumination variations in complex scenes including abnormal ones.
Original languageEnglish
Pages (from-to)516-527
Number of pages12
JournalJournal of Optical Technology (A Translation of Opticheskii Zhurnal)
Issue number8
Publication statusPublished - 1 Aug 2015
Externally publishedYes


  • Pattern recognition
  • neural networks
  • target tracking
  • Multiframe image processing
  • Vision processor architecture


Dive into the research topics of 'Robust multi-object tracking using deep learning framework'. Together they form a unique fingerprint.

Cite this