Multimodal information density is highest in question beginnings, and early entropy is associated with fewer but longer visual signals.
When engaged in spoken conversation, speakers convey meaning using both speech and visual signals, such as facial expressions and manual gestures. An important question is how information is distributed in utterances during face-to-face interaction when information from visual signals is also presen...
| Publicado en: | Discourse Processes Vol. 62; no. 2; pp. 69 - 89 |
|---|---|
| Autores principales: | , |
| Formato: | Artículo |
| Publicado: |
Taylor & Francis Ltd
Jan/Feb2025
|
| Materias: | |
| Acceso en línea: | Ver este registro en EBSCOhost |
| fields | @attributes: recordID: 1 pdfLink: plink: https://search.ebscohost.com/login.aspx?direct=true&db=hlh&AN=183540895&site=ehost-live header: @attributes: shortDbName: hlh uiTerm: 183540895 longDbName: Humanities International Complete uiTag: AN controlInfo: bkinfo: jinfo: jid: 0163853X 7LQ jtl: Discourse Processes issn: 0163853X maglogo: N pubinfo: dt: Jan/Feb2025 vid: 62 iid: 2 pid: 377 pub: Taylor & Francis Ltd artinfo: ui: 183540895 10.1080/0163853X.2024.2413314 ppf: 69 ppct: 20 formats: tig: atl: Multimodal information density is highest in question beginnings, and early entropy is associated with fewer but longer visual signals. aug: au: Trujillo, James P. Holler, Judith affil: Donders Institute for Brain, Cognition and Behaviour, Radboud University Nijmegen, Nijmegen, The Netherlands Max Planck Institute for Psycholinguistics, Nijmegen, The Netherlands su: Speech Dutch language Parallel processing Entropy Gesture sug: subj: Speech Dutch language Parallel processing Entropy Gesture ab: When engaged in spoken conversation, speakers convey meaning using both speech and visual signals, such as facial expressions and manual gestures. An important question is how information is distributed in utterances during face-to-face interaction when information from visual signals is also present. In a corpus of casual Dutch face-to-face conversations, we focus on spoken questions in particular because they occur frequently, thus constituting core building blocks of conversation. We quantified information density (i.e. lexical entropy and surprisal) and the number and relative duration of facial and manual signals. We tested whether lexical information density or the number of visual signals differed between the first and last halves of questions, as well as whether the number of visual signals occurring in the less-predictable portion of a question was associated with the lexical information density of the same portion of the question in a systematic manner. We found that information density, as well as number of visual signals, were higher in the first half of questions, and specifically lexical entropy was associated with fewer, but longer visual signals. The multimodal front-loading of questions and the complementary distribution of visual signals and high entropy words in Dutch casual face-to-face conversations may have implications for the parallel processes of utterance comprehension and response planning during turn-taking. pubtype: Academic Journal doctype: Article src: R language: English refInfo: copyright: @attributes: flag: Y dt: @attributes: year: 2025 holdings: @attributes: islocal: N |
|---|