Generating Multimodal References.
This article presents a new computational model for the generation of multimodal referring expressions (REs), based on observations in human communication. The algorithm is an extension of the graph-based algorithm proposed by Krahmer, van Erk, and Verleg (2003) and makes use of a so-called Flashlig...
| Publicado en: | Discourse Processes Vol. 44; no. 3; pp. 145 - 175 |
|---|---|
| Autores principales: | , |
| Formato: | Artículo |
| Publicado: |
Taylor & Francis Ltd
Nov2007
|
| Materias: | |
| Acceso en línea: | Ver este registro en EBSCOhost |
| fields | @attributes: recordID: 1 pdfLink: plink: https://search.ebscohost.com/login.aspx?direct=true&db=hlh&AN=28548685&site=ehost-live header: @attributes: shortDbName: hlh uiTerm: 28548685 longDbName: Humanities International Complete uiTag: AN controlInfo: bkinfo: jinfo: jid: 0163853X 7LQ jtl: Discourse Processes issn: 0163853X maglogo: N pubinfo: dt: Nov2007 vid: 44 iid: 3 pid: 377 pub: Taylor & Francis Ltd artinfo: ui: 28548685 10.1080/01638530701600755 ppf: 145 ppct: 30 formats: tig: atl: Generating Multimodal References. aug: au: Van der Sluis, Ielka Krahmer, Emiel affil: Department of Computing Science, University of Aberdeen, Scotland Department of Communication and Information Sciences, Tilburg University, The Netherlands su: Communication Algorithms Pointing (Gesture) Gesture Nonverbal communication Language & languages sug: subj: Communication Algorithms Pointing (Gesture) Gesture Nonverbal communication Language & languages ab: This article presents a new computational model for the generation of multimodal referring expressions (REs), based on observations in human communication. The algorithm is an extension of the graph-based algorithm proposed by Krahmer, van Erk, and Verleg (2003) and makes use of a so-called Flashlight Model for pointing. The Flashlight Model accounts for various types of pointing gestures of different precisions. Based on a notion of effort, the algorithm produces REs combining language and pointing gestures. The algorithm is evaluated using two production experiments with which spontaneous data is gathered on controlled input. The output of the algorithm coincides to a large extent with the utterances of the participants. However, an important difference is that the participants tend to produce overspecified REs, whereas the algorithm generates minimal ones. This article briefly discusses ways to generate overspecified multimodal references. pubtype: Academic Journal doctype: Article src: R language: English refInfo: copyright: @attributes: flag: Y dt: @attributes: year: 2007 holdings: @attributes: islocal: N |
|---|