Skip to main navigation Skip to search Skip to main content

Innovate Spatial-Temporal Attention Network (STAN) for accurate 3D mice pose estimation with a single monocular RGB camera

Liyun Gong, Miao Yu, Gautam Siddharth Kashyap, Sheldon McCall, Mamatha Thota, Saeid Pourroostaei Ardakani

Research output: Chapter in Book/Report/Conference proceeding › Conference proceeding contribution › peer-review

Abstract

Precise 3D pose estimation of mice holds crucial importance across various scientific domains. In this research, we introduce an innovative model named the Spatial-Temporal Attention Network (STAN), specifically designed for accurate 3D pose estimation of mice using a single monocular camera. The STAN model leverages a sequence of extracted 2D skeletons to predict the 3D pose of a mouse. Through the incorporation of spatial and temporal attention modules, our STAN methodology adeptly captures intricate spatial and temporal relationships among key points, thereby enabling a comprehensive representation of the dynamic movements inherent in a mouse's behavior for precise 3D pose estimation. To assess the effectiveness of our proposed method, extensive experimental evaluations were undertaken. The results show the superior performance of the STAN model when compared to other state-of-the-art approaches within the realm of 3D mouse pose estimation.

Original languageEnglish
Title of host publication32nd European Signal Processing Conference (EUSIPCO 2024)
Subtitle of host publicationproceedings
Place of PublicationOnline
PublisherEuropean Association for Signal Processing (EURASIP)
Pages616-620
Number of pages5
ISBN (Electronic)9789464593617
ISBN (Print)9798331519773
DOIs
Publication statusPublished - 2024
Externally publishedYes
Event32nd European Signal Processing Conference, EUSIPCO 2024 - Lyon, France
Duration: 26 Aug 2024 → 30 Aug 2024

Publication series

Name
ISSN (Print)2219-5491
ISSN (Electronic)2076-1465

Conference

Conference32nd European Signal Processing Conference, EUSIPCO 2024
Country/TerritoryFrance
CityLyon
Period26/08/24 → 30/08/24

Keywords

  • mice 3D pose estimation
  • deep learning
  • temporal/spatial information
  • multi-head attention
  • transformer
  • computer vision

Fingerprint

Dive into the research topics of 'Innovate Spatial-Temporal Attention Network (STAN) for accurate 3D mice pose estimation with a single monocular RGB camera'. Together they form a unique fingerprint.

Cite this