Smart sampling: a novel unsupervised boosting approach for outlier detection

Mahsa Salehi, Xuyun Zhang, James C. Bezdek, Christopher Leckie

Research output: Chapter in Book/Report/Conference proceedingConference proceeding contributionpeer-review

8 Citations (Scopus)

Abstract

While various ensemble algorithms have been proposed for supervised ensembles or clustering ensembles, there are few ensemble based approaches for outlier detection. The main challenge in this context is the lack of knowledge about the accuracy of the outlier detectors. Hence, none of the proposed approaches focused on sequential boosting techniques. In this paper for the first time we propose a novel boosting algorithm for outlier detection called BSS, where we sequentially improve the accuracy of each ensemble detector in an unsupervised manner. We discuss the effectiveness of our approach in terms of bias-variance trade-off. Furthermore, an extended version of BSS (called DBSS) is proposed to introduce a novel source of diversity in outlier ensemble modeling. DBSS is used to analyze the effect of changing the input parameter of BSS on its detection accuracy. Our experimental results on both synthetic and real data sets demonstrate that our approaches outperform the two state-of-the-art outlier ensemble algorithms and benefit from bias reduction. In addition, our BSS approach is robust with respect to the changing input parameter. Since each detector in our proposed BSS/DBSS is only a subset of the whole dataset, our both techniques are well suited to application environments with limited memory processors (e.g., wireless sensor networks).
Original languageEnglish
Title of host publicationAI 2016: Advances in Artificial Intelligence
Subtitle of host publication29th Australasian Joint Conference Hobart, TAS, Australia, December 5–8, 2016 Proceedings
EditorsByeong Ho Kang, Quan Bai
Place of PublicationCham, Switzerland
PublisherSpringer, Springer Nature
Pages469-481
Number of pages13
ISBN (Electronic)9783319501277
ISBN (Print)9783319501260
DOIs
Publication statusPublished - 2016
Externally publishedYes
Event29th Australasian Joint Conference on Artificial Intelligence, AI 2016 - Hobart, Australia
Duration: 5 Dec 20168 Dec 2016

Publication series

NameLecture Notes in Artificial Intelligence
Volume9992
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349
NameSubseries of Lecture Notes in Computer Science

Other

Other29th Australasian Joint Conference on Artificial Intelligence, AI 2016
CountryAustralia
CityHobart
Period5/12/168/12/16

Keywords

  • Ensemble analysis
  • Outlier detection
  • Smart sampling
  • Unsupervised boosting

Fingerprint Dive into the research topics of 'Smart sampling: a novel unsupervised boosting approach for outlier detection'. Together they form a unique fingerprint.

Cite this