Abstract
Large Language Models (LLMs) need to be in accordance with human values—being helpful, harmless, and honest (HHH)—is important for safe deployment. Existing works use Supervised Fine-Tuning (SFT) and Mixture-of-Experts (MoE) to align LLMs. However, these works face challenges in multi-objective settings, such as SFT leading to interference between conflicting objectives, while MoEs suffer from miscalibrated routing. We term this failure mode Axis Collapse, marked by (1) disjoint feature spaces causing catastrophic forgetting, and (2) unreliable inference from misrouted experts. To resolve this, we propose AlignX, a two-stage framework. Stage 1 uses prompt-injected fine-tuning to extract axis-specific task features, mitigating catastrophic forgetting. Stage 2 deploys a MoCaE module that calibrates expert routing using fractal and natural geometry, improving inference reliability. AlignX achieves significant gains on Alpaca (Helpfulness), BeaverTails (Harmlessness), and TruthfulQA (Honesty), with +171.5% win rate, +110.1% in truthfulness-informativeness, and 4.3% fewer safety violations. It also reduces latency and memory usage by over 35% compared to prior MoEs. Results across four LLMs validate its generalizability. Code and data are available at: https://github.com/gskgautam/AlignX.
| Original language | English |
|---|---|
| Title of host publication | Proceedings of the 19th Conference of the European Chapter of the Association for Computational Linguistics |
| Subtitle of host publication | Volume 1: Long Papers |
| Editors | Vera Demberg, Kentaro Inui, Lluis Marquez Villodre |
| Place of Publication | Kerrville, TX |
| Publisher | Association for Computational Linguistics (ACL) |
| Pages | 2561-2572 |
| Number of pages | 12 |
| ISBN (Electronic) | 9798891763807 |
| DOIs | |
| Publication status | Published - 2026 |
| Event | 19th Conference of the European Chapter of the Association for Computational Linguistics, EACL 2026 - Rabat, Morocco Duration: 24 Mar 2026 → 29 Mar 2026 |
Conference
| Conference | 19th Conference of the European Chapter of the Association for Computational Linguistics, EACL 2026 |
|---|---|
| Country/Territory | Morocco |
| City | Rabat |
| Period | 24/03/26 → 29/03/26 |
Fingerprint
Dive into the research topics of 'When the model said ‘No Comment’, we knew helpfulness was dead, honesty was alive, and safety was terrified'. Together they form a unique fingerprint.Cite this
- APA
- Author
- BIBTEX
- Harvard
- Standard
- RIS
- Vancouver