Investigating effortful speech perception using fNIRS and pupillometry measures

Xin Zhou*, Emily Burg, Alan Kan, Ruth Y. Litovsky

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

6 Citations (Scopus)
41 Downloads (Pure)

Abstract

The current study examined the neural mechanisms for mental effort and its correlation to speech perception using functional near-infrared spectroscopy (fNIRS) in listeners with normal hearing (NH). Data were collected while participants listened and responded to unprocessed and degraded sentences, where words were presented in grammatically correct or shuffled order. Effortful listening and task difficulty due to stimulus manipulations was confirmed using a subjective questionnaire and a well-established objective measure of mental effort – pupillometry. fNIRS measures focused on cortical responses in two a priori regions of interest, the left auditory cortex (AC) and lateral frontal cortex (LFC), which are closely related to auditory speech perception and listening effort, respectively. We examined the relations between the two objective measures and behavioral measures of speech perception (task performance) and task difficulty. 

Results: demonstrated that changes in pupil dilation were positively correlated with the self-reported task difficulty levels and negatively correlated with the task performance scores. A significant and negative correlation between the two behavioral measures was also found. That is, as perceived task demands increased and task performance scores decreased, pupils dilated more. fNIRS measures (cerebral oxygenation) in the left AC and LFC were both negatively correlated with the self-reported task difficulty levels and positively correlated with task performance scores. These results suggest that pupillometry measures can indicate task demands and listening effort; whereas, fNIRS measures using a similar paradigm seem to reflect speech processing, but not effort.

Original languageEnglish
Article number100052
Pages (from-to)1-14
Number of pages14
JournalCurrent Research in Neurobiology
Volume3
DOIs
Publication statusPublished - 2022

Bibliographical note

Copyright the Author(s) 2022. Version archived for private and non-commercial use with the permission of the author/s and according to publisher conditions. For further rights please contact the publisher.

Keywords

  • Functional near-infrared spectroscopy
  • Left lateral frontal cortex
  • Left auditory cortex
  • Pupillometry
  • Mental effort

Fingerprint

Dive into the research topics of 'Investigating effortful speech perception using fNIRS and pupillometry measures'. Together they form a unique fingerprint.

Cite this