Self-adaptive attribute weighting for Naive Bayes classification

Jia Wu, Shirui Pan, Xingquan Zhu, Zhihua Cai, Peng Zhang, Chengqi Zhang

Research output: Contribution to journalArticle

48 Citations (Scopus)

Abstract

Naive Bayes (NB) is a popular machine learning tool for classification, due to its simplicity, high computational efficiency, and good classification accuracy, especially for high dimensional data such as texts. In reality, the pronounced advantage of NB is often challenged by the strong conditional independence assumption between attributes, which may deteriorate the classification performance. Accordingly, numerous efforts have been made to improve NB, by using approaches such as structure extension, attribute selection, attribute weighting, instance weighting, local learning and so on. In this paper, we propose a new Artificial Immune System (AIS) based self-adaptive attribute weighting method for Naive Bayes classification. The proposed method, namely AISWNB, uses immunity theory in Artificial Immune Systems to search optimal attribute weight values, where self-adjusted weight values will alleviate the conditional independence assumption and help calculate the conditional probability in an accurate way. One noticeable advantage of AISWNB is that the unique immune system based evolutionary computation process, including initialization, clone, section, and mutation, ensures that AISWNB can adjust itself to the data without explicit specification of functional or distributional forms of the underlying model. As a result, AISWNB can obtain good attribute weight values during the learning process. Experiments and comparisons on 36 machine learning benchmark data sets and six image classification data sets demonstrate that AISWNB significantly outperforms its peers in classification accuracy, class probability estimation, and class ranking performance.
Original languageEnglish
Pages (from-to)1487-1502
Number of pages16
JournalExpert Systems With Applications
Volume42
Issue number3
DOIs
Publication statusPublished - 15 Feb 2015
Externally publishedYes

    Fingerprint

Keywords

  • Naive Bayes
  • self-adaptive
  • attribute weighting
  • Artificial immune system
  • evolutionary computing
  • Evolutionary computing
  • Artificial Immune Systems
  • Naive Bayes Self-adaptive
  • Attribute weighting

Cite this