Bootstrapped multi-level distant supervision for relation extraction

Ying He, Zhixu Li*, Guanfeng Liu, Fangfei Cao, Zhigang Chen, Ke Wang, Jie Ma

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference proceeding contributionpeer-review

2 Citations (Scopus)


Distant supervised relation extraction has been widely used to identify new relation facts from free text. However, relying on a single-node categorization model to identify relation facts for thousands of relations simultaneously inevitably accompanies with serious false categorization problem. Also to the best of our knowledge, no previous efforts has yet considered to update the categorization model with the new identified relation facts, which wastes the chance to further improsve the extraction precision and recall. In this paper, we novelly propose a multi-level distant supervision model for relation extraction, which divides the original categorization task into a number of sub-tasks in multiple levels of a constructed tree-like categorization structure. With the tree-like structure, an unlabelled relation instance would be categorized step by step along a path from the root node to a leaf node. Beyond that, we propose to do bootstrapped distant supervision to update the distant supervision model with new learned relation facts iteratively to further improve the extraction precision and recall. Experimental results conducted on two real datasets prove that our approach outperforms state-of-the-art approaches by reaching more than 10% better extraction quality.

Original languageEnglish
Title of host publicationWeb Information Systems Engineering – WISE 2018
Subtitle of host publication19th International Conference, 2018, Proceedings
EditorsHakim Hacid, Wojciech Cellary, Hua Wang, Hye-Young Paik, Rui Zhou
Place of PublicationSwitzerland
PublisherSpringer-VDI-Verlag GmbH & Co. KG
Number of pages16
ISBN (Electronic)9783030029227
ISBN (Print)9783030029210
Publication statusPublished - 1 Jan 2018
Event19th International Conference on Web Information Systems Engineering, WISE 2018 - Dubai, United Arab Emirates
Duration: 12 Nov 201815 Nov 2018

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume11233 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349


Conference19th International Conference on Web Information Systems Engineering, WISE 2018
Country/TerritoryUnited Arab Emirates


  • Distant supervision
  • Information extraction
  • Relation extraction


Dive into the research topics of 'Bootstrapped multi-level distant supervision for relation extraction'. Together they form a unique fingerprint.

Cite this