TY - JOUR
T1 - Using Eye Movements to Study the Reading of Subtitles in Video
AU - Liao, Sixin
AU - Yu, Lili
AU - Reichle, Erik
AU - Kruger, Jan-Louis
PY - 2020/11/11
Y1 - 2020/11/11
N2 - This article reports the first eye-movement experiment to examine how the presence versus absence of concurrent video content and presentation speed affect the reading of subtitles. Results indicated that participants adapted their visual routines to examine video content while simultaneously prioritizing the reading of subtitles, especially when the latter was displayed only briefly. Although decisions about when and where to move the eyes largely remained under local (cognitive) control, this control was also modulated by global task demands, suggesting an integration of local and global eye-movement control. The theoretical and pedagogical implications of these findings are discussed, and we also briefly describe a new theoretical framework for understanding all forms of multimodal reading, including the reading of subtitles in video.
AB - This article reports the first eye-movement experiment to examine how the presence versus absence of concurrent video content and presentation speed affect the reading of subtitles. Results indicated that participants adapted their visual routines to examine video content while simultaneously prioritizing the reading of subtitles, especially when the latter was displayed only briefly. Although decisions about when and where to move the eyes largely remained under local (cognitive) control, this control was also modulated by global task demands, suggesting an integration of local and global eye-movement control. The theoretical and pedagogical implications of these findings are discussed, and we also briefly describe a new theoretical framework for understanding all forms of multimodal reading, including the reading of subtitles in video.
UR - http://www.scopus.com/inward/record.url?scp=85096088857&partnerID=8YFLogxK
U2 - 10.1080/10888438.2020.1823986
DO - 10.1080/10888438.2020.1823986
M3 - Article
JO - Scientific Studies of Reading
JF - Scientific Studies of Reading
SN - 1088-8438
ER -