The JESTKOD database: an affective multimodal database of dyadic interactions.
In human-to-human communication, gesture and speech co-exist in time with a tight synchrony, and gestures are often utilized to complement or to emphasize speech. In human-computer interaction systems, natural, affective and believable use of gestures would be a valuable key component in adopting an...
| Publicado en: | Language Resources & Evaluation Vol. 51; no. 3; pp. 857 - 873 |
|---|---|
| Autores principales: | , , , , , |
| Formato: | Artículo |
| Publicado: |
Springer Nature
Sep2017
|
| Materias: | |
| Acceso en línea: | Ver este registro en EBSCOhost |
| fields | @attributes: recordID: 1 pdfLink: plink: https://search.ebscohost.com/login.aspx?direct=true&db=hlh&AN=124484773&site=ehost-live header: @attributes: shortDbName: hlh uiTerm: 124484773 longDbName: Humanities International Complete uiTag: AN controlInfo: bkinfo: jinfo: jid: 1574020X 179V jtl: Language Resources & Evaluation issn: 1574020X maglogo: N pubinfo: dt: Sep2017 vid: 51 iid: 3 pid: 237 pub: Springer Nature artinfo: ui: 124484773 10.1007/s10579-016-9377-0 ppf: 857 ppct: 16 formats: fmt: @attributes: type: P size: 1.2MB tig: atl: The JESTKOD database: an affective multimodal database of dyadic interactions. aug: au: Bozkurt, Elif Khaki, Hossein Keçeci, Sinan Türker, B. Yemez, Yücel Erzin, Engin affil: Multimedia, Vision and Graphics Laboratory, College of Engineering , Koç University , Istanbul Turkey su: Corpora Dyadic communication Gesture Speech Human-computer interaction Data sug: subj: Corpora Dyadic communication Gesture Speech Human-computer interaction Data keyword: Affective state tracking Dyadic interaction ab: In human-to-human communication, gesture and speech co-exist in time with a tight synchrony, and gestures are often utilized to complement or to emphasize speech. In human-computer interaction systems, natural, affective and believable use of gestures would be a valuable key component in adopting and emphasizing human-centered aspects. However, natural and affective multimodal data, for studying computational models of gesture and speech, is limited. In this study, we introduce the JESTKOD database, which consists of speech and full-body motion capture data recordings in dyadic interaction setting under agreement and disagreement scenarios. Participants of the dyadic interactions are native Turkish speakers and recordings of each participant are rated in dimensional affect space. We present our multimodal data collection and annotation process, as well as our preliminary experimental studies on agreement/disagreement classification of dyadic interactions using body gesture and speech data. The JESTKOD database provides a valuable asset to investigate gesture and speech towards designing more natural and affective human-computer interaction systems. pubtype: Academic Journal doctype: Article src: R language: English refInfo: copyright: @attributes: flag: Y custom: Language Resources & Evaluation is a copyright of Springer, 2017. All Rights Reserved. item: Language Resources & Evaluation holder: Springer Nature dt: @attributes: year: 2017 holdings: @attributes: islocal: N |
|---|