Subtitles and eye tracking: reading and performance

Jan Louis Kruger, Faans Steyn

Research output: Contribution to journalArticleResearchpeer-review

Abstract

This article presents an experimental study to investigate whether subtitle reading has a positive impact on academic performance. In the absence of reliable indexes of reading behavior in dynamic texts, the article first formulates and validates an index to measure the reading of text, such as subtitles on film. Eye-tracking measures (fixations and saccades) are expressed as functions of the number of standard words and word length and provide a reliable index of reading behavior of subtitles over extended audiovisual texts. By providing a robust index of reading over dynamic texts, this article lays the foundation for future studies combining behavioral measures and performance measures in fields such as media psychology, educational psychology, multimedia design, and audiovisual translation. The article then utilizes this index to correlate the degree to which subtitles are read and the performance of students who were exposed to the subtitles in a comprehension test. It is found that a significant positive correlation is obtained between comprehension and subtitle reading for the sample, providing some evidence in favor of using subtitles in reading instruction and language learning. The study, which was conducted in the context of English subtitles on academic lectures delivered in English, further seems to indicate that the number of words and the number of lines do not play as big a role in the processing of subtitles as previously thought but that attention distribution across different redundant sources of information results in the partial processing of subtitles.

LanguageEnglish
Pages105-120
Number of pages16
JournalReading Research Quarterly
Volume49
Issue number1
DOIs
Publication statusPublished - 2014

Fingerprint

Reading
reading behavior
performance
comprehension
educational psychology
reading instruction
Educational Psychology
source of information
multimedia
Multimedia
Saccades
Language
Learning
language
Students
Psychology
learning
evidence
student

Cite this

@article{2a257d4e41184bd781da00eb2e44fa68,
title = "Subtitles and eye tracking: reading and performance",
abstract = "This article presents an experimental study to investigate whether subtitle reading has a positive impact on academic performance. In the absence of reliable indexes of reading behavior in dynamic texts, the article first formulates and validates an index to measure the reading of text, such as subtitles on film. Eye-tracking measures (fixations and saccades) are expressed as functions of the number of standard words and word length and provide a reliable index of reading behavior of subtitles over extended audiovisual texts. By providing a robust index of reading over dynamic texts, this article lays the foundation for future studies combining behavioral measures and performance measures in fields such as media psychology, educational psychology, multimedia design, and audiovisual translation. The article then utilizes this index to correlate the degree to which subtitles are read and the performance of students who were exposed to the subtitles in a comprehension test. It is found that a significant positive correlation is obtained between comprehension and subtitle reading for the sample, providing some evidence in favor of using subtitles in reading instruction and language learning. The study, which was conducted in the context of English subtitles on academic lectures delivered in English, further seems to indicate that the number of words and the number of lines do not play as big a role in the processing of subtitles as previously thought but that attention distribution across different redundant sources of information results in the partial processing of subtitles.",
author = "Kruger, {Jan Louis} and Faans Steyn",
year = "2014",
doi = "10.1002/rrq.59",
language = "English",
volume = "49",
pages = "105--120",
journal = "Reading Research Quarterly",
issn = "0034-0553",
publisher = "INT READING ASSN",
number = "1",

}

Subtitles and eye tracking : reading and performance. / Kruger, Jan Louis; Steyn, Faans.

In: Reading Research Quarterly, Vol. 49, No. 1, 2014, p. 105-120.

Research output: Contribution to journalArticleResearchpeer-review

TY - JOUR

T1 - Subtitles and eye tracking

T2 - Reading Research Quarterly

AU - Kruger, Jan Louis

AU - Steyn, Faans

PY - 2014

Y1 - 2014

N2 - This article presents an experimental study to investigate whether subtitle reading has a positive impact on academic performance. In the absence of reliable indexes of reading behavior in dynamic texts, the article first formulates and validates an index to measure the reading of text, such as subtitles on film. Eye-tracking measures (fixations and saccades) are expressed as functions of the number of standard words and word length and provide a reliable index of reading behavior of subtitles over extended audiovisual texts. By providing a robust index of reading over dynamic texts, this article lays the foundation for future studies combining behavioral measures and performance measures in fields such as media psychology, educational psychology, multimedia design, and audiovisual translation. The article then utilizes this index to correlate the degree to which subtitles are read and the performance of students who were exposed to the subtitles in a comprehension test. It is found that a significant positive correlation is obtained between comprehension and subtitle reading for the sample, providing some evidence in favor of using subtitles in reading instruction and language learning. The study, which was conducted in the context of English subtitles on academic lectures delivered in English, further seems to indicate that the number of words and the number of lines do not play as big a role in the processing of subtitles as previously thought but that attention distribution across different redundant sources of information results in the partial processing of subtitles.

AB - This article presents an experimental study to investigate whether subtitle reading has a positive impact on academic performance. In the absence of reliable indexes of reading behavior in dynamic texts, the article first formulates and validates an index to measure the reading of text, such as subtitles on film. Eye-tracking measures (fixations and saccades) are expressed as functions of the number of standard words and word length and provide a reliable index of reading behavior of subtitles over extended audiovisual texts. By providing a robust index of reading over dynamic texts, this article lays the foundation for future studies combining behavioral measures and performance measures in fields such as media psychology, educational psychology, multimedia design, and audiovisual translation. The article then utilizes this index to correlate the degree to which subtitles are read and the performance of students who were exposed to the subtitles in a comprehension test. It is found that a significant positive correlation is obtained between comprehension and subtitle reading for the sample, providing some evidence in favor of using subtitles in reading instruction and language learning. The study, which was conducted in the context of English subtitles on academic lectures delivered in English, further seems to indicate that the number of words and the number of lines do not play as big a role in the processing of subtitles as previously thought but that attention distribution across different redundant sources of information results in the partial processing of subtitles.

UR - http://www.scopus.com/inward/record.url?scp=84900853903&partnerID=8YFLogxK

U2 - 10.1002/rrq.59

DO - 10.1002/rrq.59

M3 - Article

VL - 49

SP - 105

EP - 120

JO - Reading Research Quarterly

JF - Reading Research Quarterly

SN - 0034-0553

IS - 1

ER -