Multimodal measurement of cognitive load during subtitle processing: same-language subtitles for foreign-language viewers

Jan Kruger, Stephen Doherty, Wendy Fox, Peter De Lissa

    Research output: Chapter in Book/Report/Conference proceedingChapterpeer-review

    33 Citations (Scopus)

    Abstract

    This chapter presents the findings of a multimodal study that combines a suite of methods, namely, eye tracking, electroencephalography, and self-reported psychometrics, to investigate the impact of language and layout on cognitive load in the absence and presence of conventional same-language subtitles and integrated titles (a transcript of the spoken language presented dynamically in line with the film presentation) in an English fiction film viewed by L2 speakers of English. Findings show similar levels of immersion for conventional same-language subtitles and integrated titles, whereas the latter appears to facilitate deeper processing of subtitle contents resulting in reductions in perceived complexity.
    Original languageEnglish
    Title of host publicationInnovation and expansion in translation process research
    EditorsIsabel Lacruz , Riitta Jääskeläinen
    Place of PublicationAmsterdam
    PublisherJohn Benjamins Publishing Company
    Chapter12
    Pages267-294
    Number of pages28
    ISBN (Electronic)9789027264756
    ISBN (Print) 9789027231956
    DOIs
    Publication statusPublished - 2018

    Publication series

    NameAmerican Translators Association scholarly monograph series
    VolumeXVIII
    ISSN (Print)0890-4111

    Keywords

    • cognitive load
    • electroencephalography (EEG)
    • dnamic text
    • eye tracking
    • multimodality
    • integrated titles
    • reading index
    • split attention
    • subtitles
    • transportation
    • working memory

    Fingerprint

    Dive into the research topics of 'Multimodal measurement of cognitive load during subtitle processing: same-language subtitles for foreign-language viewers'. Together they form a unique fingerprint.

    Cite this