Skip to main navigation Skip to search Skip to main content

Adaptive and reinforcement-guided Contrastive Hypergraph Distillation

Rongwei Xu, Zitai Qiu, Pengfei Ding, Yan Wang, Jia Wu, Amin Beheshti, Guanfeng Liu*

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceeding › Conference proceeding contribution › peer-review

6 Downloads (Pure)

Abstract

Hypergraph-based distillation methods have been proposed to mitigate the high computational cost of Hypergraph Neural Networks (HGNNs) in modeling high-order relationships. However, most existing methods use static and uniform distillation strategies for all nodes and hyperedges, ignoring their individual characteristics. In addition, they neglect the student model's capability to independently extract useful internal features. As a result, they are not effective in transferring higher-order structural knowledge from the teacher. To overcome these limitations, we propose ARCHER, an Adaptive and Reinforcement-Guided Contrastive HypER graph Distillation framework that enables a lightweight MLP student model to outperform its HGNN teacher model. First, we design an adaptive strategy that leverages node- and hyperedge-level confidence to mediate error guidance from the teacher model. Second, we introduce a contrastive learning module that guides the student to learn from both the teacher's outputs and its own internal representations, producing more expressive embeddings. Finally, we propose a multi-armed bandit-based reinforcement learning module that dynamically balances multiple loss objectives during training. Experiments on six benchmark datasets demonstrate that our method outperforms existing hypergraph distillation methods.

Original languageEnglish
Title of host publicationWSDM '26
Subtitle of host publicationproceedings of the Nineteenth ACM International Conference on Web Search and Data Mining
Place of PublicationNew York, US
PublisherAssociation for Computing Machinery
Pages778-787
Number of pages10
ISBN (Electronic)9798400722929
DOIs
Publication statusPublished - 2026
Event19th ACM International Conference on Web Search and Data Mining, WSDM 2026 - Boise, United States
Duration: 22 Feb 2026 → 26 Feb 2026

Conference

Conference19th ACM International Conference on Web Search and Data Mining, WSDM 2026
Country/TerritoryUnited States
CityBoise
Period22/02/26 → 26/02/26

Bibliographical note

Copyright the Author(s) 2026. Version archived for private and non-commercial use with the permission of the author/s and according to publisher conditions. For further rights please contact the publisher.

Keywords

  • Hypergraph
  • Knowledge Distillation
  • Contrastive Learning

Fingerprint

Dive into the research topics of 'Adaptive and reinforcement-guided Contrastive Hypergraph Distillation'. Together they form a unique fingerprint.

Cite this