Pattern mining for a two-stage information filtering system

Xujuan Zhou, Yuefeng Li, Peter Bruza, Yue Xu, Raymond Y. K. Lau

Research output: Chapter in Book/Report/Conference proceedingConference proceeding contributionpeer-review

1 Citation (Scopus)

Abstract

As information available over computer networks is growing exponentially, searching for useful information becomes increasingly more difficult. Accordingly, developing an effective information filtering mechanism is becoming very important to alleviate the problem of information overload. Information filtering systems often employ user profiles to represent users' information needs so as to determine the relevance of documents from an incoming data stream. This paper presents a novel two-stage information filtering model which combines the merits of term-based and pattern-based approaches to effectively filter sheer volume of information. In particular, the first filtering stage is supported by a novel rough analysis model which efficiently removes a large number of irrelevant documents, thereby addressing the overload problem. The second filtering stage is empowered by a semantically rich pattern taxonomy mining model which effectively fetches incoming documents according to the specific information needs of a user, thereby addressing the mismatch problem. The experimental results based on the RCV1 corpus show that the proposed two-stage filtering model significantly outperforms both the term-based and pattern-based information filtering models.
Original languageEnglish
Title of host publicationAdvances in knwledge discovery and data mining
Subtitle of host publication15th Pacific-Asia Conference, PAKDD 2011, Shenzhen, China, May 24-27, 2011, Proceedings, Part I
EditorsJoshua Zhexue Huang, Longbing Cao, Jaideep Srivastava
Place of PublicationBerlin Heidelberg
PublisherSpringer, Springer Nature
Pages363-374
Number of pages12
ISBN (Print)9783642208409
DOIs
Publication statusPublished - 2011
Externally publishedYes
EventPacific-Asia Conference on Knowledge Discovery and Data Mining (15th : 2011) - Shenzhen, China
Duration: 24 May 201127 May 2011

Publication series

NameLecture notes in computer science
PublisherSpringer
Volume6634
ISSN (Print)0302-9743

Conference

ConferencePacific-Asia Conference on Knowledge Discovery and Data Mining (15th : 2011)
CityShenzhen, China
Period24/05/1127/05/11

Keywords

  • information filtering
  • pattern mining
  • threshold
  • user profile

Fingerprint Dive into the research topics of 'Pattern mining for a two-stage information filtering system'. Together they form a unique fingerprint.

Cite this