Multi-view multi-label learning with sparse feature selection for image annotation

Yongshan Zhang, Jia Wu*, Zhihua Cai*, Philip S. Yu

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

121 Citations (Scopus)

Abstract

In image analysis, image samples are always represented by multiple view features and associated with multiple class labels for better interpretation. However, multiple view data may include noisy, irrelevant and redundant features, while multiple class labels can be noisy and incomplete. Due to the special data characteristic, it is hard to perform feature selection on multi-view multi-label data. To address these challenges, in this paper, we propose a novel multi-view multi-label sparse feature selection (MSFS) method, which exploits both view relations and label correlations to select discriminative features for further learning. Specifically, the multi-labeled information is decomposed into a reduced latent label representation to capture higher level concepts and correlations among multiple labels. Multiple local geometric structures are constructed to exploit visual similarities and relations for different views. By taking full advantage of the latent label representation and multiple local geometric structures, the sparse regression model with an l2,1 -norm and an Frobenius norm (F-norm) penalty terms is utilized to perform hierarchical feature selection, where the F-norm penalty performs high-level (i.e., view-wise) feature selection to preserve the informative views and the l2,1 -norm penalty conducts low-level (i.e., row-wise) feature selection to remove noisy features. To solve the proposed formulation, we also devise a simple yet efficient iterative algorithm. Experiments and comparisons on real-world image datasets demonstrate the effectiveness and potential of MSFS.

Original languageEnglish
Pages (from-to)2844-2857
Number of pages14
JournalIEEE Transactions on Multimedia
Volume22
Issue number11
DOIs
Publication statusPublished - Nov 2020

Keywords

  • Feature selection
  • image annotation
  • multi-label learning
  • multi-view learning
  • sparse learning

Fingerprint

Dive into the research topics of 'Multi-view multi-label learning with sparse feature selection for image annotation'. Together they form a unique fingerprint.

Cite this