Incorporating medical knowledge to transformer-based language models for medical dialogue generation

Usman Naseem, Ajay Bandi, Shaina Raza, Junaid Rashid, Bharathi Raja Chakravarthi

Research output: Chapter in Book/Report/Conference proceedingConference proceeding contributionpeer-review

12 Citations (Scopus)

Abstract

Medical dialogue systems have the potential to assist doctors in expanding access to medical care, improving the quality of patient experiences, and lowering medical expenses. The computational methods are still in their early stages and are not ready for widespread application despite their great potential. Existing transformer-based language models have shown promising results but lack domain-specific knowledge. However, to diagnose like doctors, an automatic medical diagnosis necessitates more stringent requirements for the rationality of the dialogue in the context of relevant knowledge. In this study, we propose a new method that addresses the challenges of medical dialogue generation by incorporating medical knowledge into transformer-based language models. We present a method that leverages an external medical knowledge graph and injects triples as domain knowledge into the utterances. Automatic and human evaluation on a publicly available dataset demonstrates that incorporating medical knowledge outperforms several state-of-the-art baseline methods.

Original languageEnglish
Title of host publicationProceedings of the 21st Workshop on Biomedical Language Processing
Place of PublicationStroudsburg
PublisherAssociation for Computational Linguistics
Pages110-115
Number of pages6
ISBN (Electronic)9781955917278
DOIs
Publication statusPublished - 2022
Externally publishedYes
Event21st Workshop on Biomedical Language Processing, BioNLP 2022 at the Association for Computational Linguistics Conference, ACL 2022 - Dublin, Ireland
Duration: 26 May 202226 May 2022

Conference

Conference21st Workshop on Biomedical Language Processing, BioNLP 2022 at the Association for Computational Linguistics Conference, ACL 2022
Country/TerritoryIreland
CityDublin
Period26/05/2226/05/22

Fingerprint

Dive into the research topics of 'Incorporating medical knowledge to transformer-based language models for medical dialogue generation'. Together they form a unique fingerprint.

Cite this