Semantic documents relatedness using concept graph representation

Yuan Ni, Qiong Kai Xu, Feng Cao, Yosi Mass, Dafna Sheinwald, Hui Jia Zhu, Shao Sheng Cao

Research output: Chapter in Book/Report/Conference proceedingConference proceeding contributionpeer-review

51 Citations (Scopus)

Abstract

We deal with the problem of document representation for the task of measuring semantic relatedness between documents. A document is represented as a compact concept graph where nodes represent concepts extracted from the document through references to entities in a knowledge base such as DBpedia. Edges represent the semantic and structural relationships among the concepts. Several methods are presented to measure the strength of those relationships. Concepts are weighted through the concept graph using closeness centrality measure which reflects their relevance to the aspects of the document. A novel similarity measure between two concept graphs is presented. The similarity measure first represents concepts as continuous vectors by means of neural networks. Second, the continuous vectors are used to accumulate pairwise similarity between pairs of concepts while considering their assigned weights. We evaluate our method on a standard benchmark for document similarity. Our method outperforms state-of-the-art methods including ESA (Explicit Semantic Annotation) while our concept graphs are much smaller than the concept vectors generated by ESA. Moreover, we show that by combining our concept graph with ESA, we obtain an even further improvement.

Original languageEnglish
Title of host publicationWSDM '16
Subtitle of host publicationproceedings of the Ninth ACM International Conference on Web Search and Data Mining
Place of PublicationNew York
PublisherAssociation for Computing Machinery, Inc
Pages635-644
Number of pages10
ISBN (Electronic)9781450337168
DOIs
Publication statusPublished - 2016
Externally publishedYes
Event9th ACM International Conference on Web Search and Data Mining, WSDM 2016 - San Francisco, United States
Duration: 22 Feb 201625 Feb 2016

Conference

Conference9th ACM International Conference on Web Search and Data Mining, WSDM 2016
Country/TerritoryUnited States
CitySan Francisco
Period22/02/1625/02/16

Keywords

  • Document Representation
  • Document Semantic Similarity
  • DBpedia
  • Graph Model
  • Neural Network

Fingerprint

Dive into the research topics of 'Semantic documents relatedness using concept graph representation'. Together they form a unique fingerprint.

Cite this