Multi-modal fusion for flasher detection in a mobile video chat application

Lei Tian, Rahat Rafiq, Shaosong Li, David Chu, Richard Han, Qin Lv, Shivakant Mishra

Research output: Chapter in Book/Report/Conference proceedingConference proceeding contributionpeer-review

1 Citation (Scopus)

Abstract

This paper investigates the development of accurate and efficient classifiers to identify misbehaving users (i.e., "flashers") in a mobile video chat application. Our analysis is based on video session data collected from a mobile client that we built that connects to a popular random video chat service. We show that prior imagebased classifiers designed for identifying normal and misbehaving users in online video chat systems perform poorly on mobile video chat data. We present an enhanced image-based classifier that improves classification performance on mobile data. More importantly, we demonstrate that incorporating multi-modal mobile sensor data from accelerometer and the camera state (front/back) along with audio can significantly improve the overall image-based classification accuracy. Our work also shows that leveraging multiple image-based predictions within a session (i.e., temporal modality) has the potential to further improve the classification performance. Finally, we show that the cost of classification in terms of running time can be significantly reduced by employing a multilevel cascaded classifier in which high-complexity features and further image-based predictions are not generated unless needed.

Original languageEnglish
Title of host publicationMobiQuitous 2014 - 11th International Conference on Mobile and Ubiquitous Systems: Computing, Networking and Services
Subtitle of host publicationComputing, Networking and Services
Place of PublicationGent, Belgium
PublisherICST (Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering)
Pages267-276
Number of pages10
ISBN (Electronic)9781631900396
DOIs
Publication statusPublished - 2014
Externally publishedYes
Event11th International Conference on Mobile and Ubiquitous Systems: Computing, Networking and Services, MobiQuitous 2014 - London, United Kingdom
Duration: 2 Dec 20145 Dec 2014

Publication series

NameMobiQuitous 2014 - 11th International Conference on Mobile and Ubiquitous Systems: Computing, Networking and Services

Other

Other11th International Conference on Mobile and Ubiquitous Systems: Computing, Networking and Services, MobiQuitous 2014
CountryUnited Kingdom
CityLondon
Period2/12/145/12/14

Fingerprint Dive into the research topics of 'Multi-modal fusion for flasher detection in a mobile video chat application'. Together they form a unique fingerprint.

Cite this