SODE

Self-Adaptive One-Dependence Estimators for classification

Jia Wu*, Shirui Pan, Xingquan Zhu, Peng Zhang, Chengqi Zhang

*Corresponding author for this work

Research output: Contribution to journalArticle

31 Citations (Scopus)

Abstract

SuperParent-One-Dependence Estimators (SPODEs) represent a family of semi-naive Bayesian classifiers which relax the attribute independence assumption of Naive Bayes (NB) to allow each attribute to depend on a common single attribute (superparent). SPODEs can effectively handle data with attribute dependency but still inherent NB's key advantages such as computational efficiency and robustness for high dimensional data. In reality, determining an optimal superparent for SPODEs is difficult. One common approach is to use weighted combinations of multiple SPODEs, each having a different superparent with a properly assigned weight value (i.e., a weight value is assigned to each attribute). In this paper, we propose a self-adaptive SPODEs, namely SODE, which uses immunity theory in artificial immune systems to automatically and self-adaptively select the weight for each single SPODE. SODE does not need to know the importance of individual SPODE nor the relevance among SPODEs, and can flexibly and efficiently search optimal weight values for each SPODE during the learning process. Extensive experiments and comparisons on 56 benchmark data sets, and validations on image and text classification, demonstrate that SODE outperforms state-of-the-art weighted SPODE algorithms and is suitable for a wide range of learning tasks. Results also confirm that SODE provides an appropriate balance between runtime efficiency and accuracy.

Original languageEnglish
Pages (from-to)358-377
Number of pages20
JournalPattern Recognition
Volume51
DOIs
Publication statusPublished - 1 Mar 2016
Externally publishedYes

Keywords

  • Artificial immune systems
  • Attribute weighting
  • Classification
  • Evolutionary machine learning
  • Naive Bayes
  • Self-adaptive

Fingerprint Dive into the research topics of 'SODE: Self-Adaptive One-Dependence Estimators for classification'. Together they form a unique fingerprint.

  • Cite this