The impact of audio on the reading of intralingual versus interlingual subtitles: Evidence from eye movements.
This study investigated how semantically relevant auditory information might affect the reading of subtitles, and if such effects might be modulated by the concurrent video content. Thirty-four native Chinese speakers with English as their second language watched video with English subtitles in six...
| Publicado en: | Applied Psycholinguistics Vol. 43; no. 1; pp. 237 - 270 |
|---|---|
| Autores principales: | , , , |
| Formato: | pictorial research tables/charts Journal Article |
| Publicado: |
Cambridge University Press
Jan2022
|
| Acceso en línea: | Ver este registro en EBSCOhost |
| fields | @attributes: recordID: 1 pdfLink: plink: https://search.ebscohost.com/login.aspx?direct=true&db=ccm&AN=154343690&site=ehost-live header: @attributes: shortDbName: ccm uiTerm: 154343690 longDbName: CINAHL Complete uiTag: AN controlInfo: bkinfo: dissinfo: jinfo: jid: 01427164 7XE jtl: Applied Psycholinguistics issn: 01427164 maglogo: N pubinfo: dt: Jan2022 vid: 43 iid: 1 pid: 15979 pub: Cambridge University Press artinfo: ui: 154343690 154343690 154343690 10.1017/S0142716421000527 154343690 ppf: 237 ppct: 33 formats: tig: atl: The impact of audio on the reading of intralingual versus interlingual subtitles: Evidence from eye movements. aug: au: Liao, Sixin Yu, Lili Kruger, Jan-Louis Reichle, Erik D. affil: Department of Linguistics, Macquarie University, Sydney, NSW, Australia sug: subj: Audiovisuals Reading Multilingualism Videorecording Eye Movements Evaluation Human Chinese Persons English as a Second Language English Language Patient Attitudes Language Processing Methods Visual Perception ab: This study investigated how semantically relevant auditory information might affect the reading of subtitles, and if such effects might be modulated by the concurrent video content. Thirty-four native Chinese speakers with English as their second language watched video with English subtitles in six conditions defined by manipulating the nature of the audio (Chinese/L1 audio vs. English/L2 audio vs. no audio) and the presence versus absence of video content. Global eye-movement analyses showed that participants tended to rely less on subtitles with Chinese or English audio than without audio, and the effects of audio were more pronounced in the presence of video presentation. Lexical processing of subtitles was not modulated by the audio. However, Chinese audio, which presumably obviated the need to read the subtitles, resulted in more superficial post-lexical processing of the subtitles relative to either the English or no audio. On the contrary, English audio accentuated post-lexical processing of the subtitles compared with Chinese audio or no audio, indicating that participants might use English audio to support subtitle reading (or vice versa) and thus engaged in deeper processing of the subtitles. These findings suggest that, in multimodal reading situations, eye movements are not only controlled by processing difficulties associated with properties of words (e.g., their frequency and length) but also guided by metacognitive strategies involved in monitoring comprehension and its online modulation by different information sources. pubtype: Academic Journal doctype: pictorial research tables/charts Journal Article ougenre: Article language: English refInfo: holdings: @attributes: islocal: N |
|---|