Can large language models enhance predictions of disease progression? Investigating through disease network link prediction

Haohui Lu, Usman Naseem

Research output: Chapter in Book/Report/Conference proceedingConference proceeding contributionpeer-review

Abstract

Large Language Models (LLMs) have made significant strides in various tasks, yet their effectiveness in predicting disease progression remains relatively unexplored. To fill this gap, we use LLMs and employ advanced graph prompting and Retrieval-Augmented Generation (RAG) to predict disease comorbidity within disease networks. Specifically, we introduce a disease Comorbidity prediction model using LLM, named ComLLM, which leverages domain knowledge to enhance the prediction performance. Based on the comprehensive experimental results, ComLLM consistently outperforms conventional models, such as Graph Neural Networks, achieving average area under the curve (AUC) improvements of 10.70% and 6.07% over the best baseline models in two distinct disease networks. ComLLM is evaluated across multiple settings for disease progression prediction, employing various prompting strategies, including zero-shot, few-shot, Chain-of-Thought, graph prompting and RAG. Our results show that graph prompting and RAG enhance LLM performance in disease progression prediction tasks. ComLLM exhibits superior predictive capabilities and serves as a proof-of-concept for LLM-based systems in disease progression prediction, highlighting its potential for broad applications in healthcare.

Original languageEnglish
Title of host publicationEMNLP 2024
Subtitle of host publication2024 Conference on Empirical Methods in Natural Language Processing: proceedings of the conference
EditorsYaser Al-Onaizan, Mohit Bansal, Yun-Nung Chen
Place of PublicationKerrville, TX
PublisherAssociation for Computational Linguistics (ACL)
Pages17703-17715
Number of pages13
ISBN (Electronic)9798891761643
Publication statusPublished - 2024
Event2024 Conference on Empirical Methods in Natural Language Processing - Miami, United States
Duration: 12 Nov 202416 Nov 2024

Conference

Conference2024 Conference on Empirical Methods in Natural Language Processing
Abbreviated title EMNLP 2024
Country/TerritoryUnited States
CityMiami
Period12/11/2416/11/24

Cite this