Hyperbolic geometry is not necessary: lightweight Euclidean-based models for low-dimensional knowledge graph embeddings

Kai Wang*, Yu Liu, Dan Lin, Quan Z. Sheng

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingChapterpeer-review

11 Citations (Scopus)
318 Downloads (Pure)

Abstract

Recent knowledge graph embedding (KGE) models based on hyperbolic geometry have shown great potential in a low-dimensional embedding space. However, the necessity of hyperbolic space in KGE is still questionable, because the calculation based on hyperbolic geometry is much more complicated than Euclidean operations. In this paper, based on the state-of-the-art hyperbolic-based model RotH, we develop two lightweight Euclideanbased models, called RotL and Rot2L. The RotL model simplifies the hyperbolic operations while keeping the flexible normalization effect. Utilizing a novel two-layer stacked transformation and based on RotL, the Rot2L model obtains an improved representation capability, yet costs fewer parameters and calculations than RotH. The experiments on link prediction show that Rot2L achieves the stateof-the-art performance on two widely-used datasets in low-dimensional knowledge graph embeddings. Furthermore, RotL achieves similar performance as RotH but only requires half of the training time.

Original languageEnglish
Title of host publicationFindings of the Association for Computational Linguistics, Findings of ACL: EMNLP 2021
EditorsMarie-Francine Moens, Xuanjing Huang, Lucia Specia, Scott Wen-tau Yih
Place of PublicationStroudsburg, PA
PublisherAssociation for Computational Linguistics (ACL)
Pages464-474
Number of pages11
ISBN (Electronic)9781955917100
DOIs
Publication statusPublished - 2021

Bibliographical note

Copyright the Publisher 2021. Version archived for private and non-commercial use with the permission of the author/s and according to publisher conditions. For further rights please contact the publisher.

Fingerprint

Dive into the research topics of 'Hyperbolic geometry is not necessary: lightweight Euclidean-based models for low-dimensional knowledge graph embeddings'. Together they form a unique fingerprint.

Cite this