Multi-scale hybrid embedding transformer for atrophic gastritis recognition

Shanzhi Jiang, Yankun Cao, Subhas Chandra Mukhopadhyay, Xiang Min, Wentao Li, Chaoyang Lv, Zhen Li*, Xiaoyun Yang*, Zhi Liu*

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference proceeding contributionpeer-review

Abstract

Atrophic gastritis is a chronic gastric disease that can be identified through gastroscope observation. Automatically identifying atrophic gastritis and its location through endoscopic images can effectively reduce the burden on doctors. However, the similarity of adjacent areas and the less obvious nature of lesions pose significant challenges to existing diagnostic methods. In this paper, we propose a novel method called Multi-scale Hybrid Embedding Transformer (MHET). MHET can capture multi-scale features from images to address this issue, achieving more accurate recognition of atrophic gastritis. Furthermore, we utilize generative adversarial networks (GANs) to synthesize endoscopic images, thereby resolving the problem of data imbalance. We have collected an atrophic gastritis dataset and conducted model training, as well as related experiments. The results indicate that our method achieves high performance on multiple evaluation metrics and its effectiveness is validated through ablation studies.

Original languageEnglish
Title of host publicationProceedings: 2024 17th International Congress on Image and Signal Processing, BioMedical Engineering and Informatics
Subtitle of host publicationCISP-BMEI 2024
EditorsQingli Li, Yan Wang, Lipo Wang
Place of PublicationShanghai
PublisherInstitute of Electrical and Electronics Engineers (IEEE)
Number of pages6
ISBN (Electronic)9798331507398
DOIs
Publication statusPublished - 2024
Event17th International Congress on Image and Signal Processing, BioMedical Engineering and Informatics, CISP-BMEI 2024 - Shanghai, China
Duration: 26 Oct 202428 Oct 2024

Conference

Conference17th International Congress on Image and Signal Processing, BioMedical Engineering and Informatics, CISP-BMEI 2024
Country/TerritoryChina
CityShanghai
Period26/10/2428/10/24

Keywords

  • Atrophic Gastritis
  • Endoscopic Images
  • Multi-scale Features
  • Transformer

Fingerprint

Dive into the research topics of 'Multi-scale hybrid embedding transformer for atrophic gastritis recognition'. Together they form a unique fingerprint.

Cite this