Two-stage model for information filtering

Xujuan Zhou, Yuefeng Li, Peter Bruza, Yue Xu, Raymond Y. K. Lau

Research output: Chapter in Book/Report/Conference proceedingConference proceeding contributionpeer-review

2 Citations (Scopus)

Abstract

This thesis presents a novel two-stage model that integrates the theories and techniques from the fields of information retrieval/filtering (IR/IF) and the fields of machine learning and data mining to provide more precise document filtering and retrieval. The first stage is topic filtering. The topic filtering stage is intended to minimize information mismatch by filtering out the most likely irrelevant information based on term-based profiles. Thus, only a relatively small amount of potentially highly relevant documents remain for document ranking. The second stage of the presented method uses pattern mining approach. The objective of the second stage is to solve the problem of information overload. The most likely relevant documents were assigned higher ranks by exploiting patterns in the pattern taxonomy. The second stage is precision oriented. Since relatively small amount of documents are involved at this stage, computational cost is markedly reduced, at the same time, with significant improved results. The new two-stage information filtering model has been evaluated by extensive experiments. The tests were based on well-known IR bench-marking processes, using the latest version of the Reuters dataset, namely Reuters Corpus Volume 1 (RCV1). The performance of the new model was compared with both of the term-based and data miningbased IF models. The results show that more effective and efficient information access has been achieved by combining the strength of information filtering and data mining method.
Original languageEnglish
Title of host publicationWI-IAT 2008
Subtitle of host publicationIEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology : proceedings
Place of PublicationPiscataway, NJ
PublisherInstitute of Electrical and Electronics Engineers (IEEE)
Pages685-689
Number of pages5
ISBN (Print)9780769534961
DOIs
Publication statusPublished - 2008
Externally publishedYes
EventIEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology - Sydney, NSW
Duration: 9 Dec 200812 Dec 2008

Conference

ConferenceIEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology
CitySydney, NSW
Period9/12/0812/12/08

Fingerprint Dive into the research topics of 'Two-stage model for information filtering'. Together they form a unique fingerprint.

Cite this