Understanding conversational interaction in multiparty conversations: the EVA Corpus.
This paper focuses on gaining new knowledge through observation, qualitative analytics, and cross-modal fusion of rich multi-layered conversational features expressed during multiparty discourse. The outlined research stems from the theory that speech and co-speech gestures originate from the same r...
| Publicado en: | Language Resources & Evaluation Vol. 57; no. 2; pp. 641 - 672 |
|---|---|
| Autores principales: | , , , |
| Formato: | Artículo |
| Publicado: |
Springer Nature
Jun2023
|
| Materias: | |
| Acceso en línea: | Ver este registro en EBSCOhost |
| fields | @attributes: recordID: 1 pdfLink: plink: https://search.ebscohost.com/login.aspx?direct=true&db=hlh&AN=163826592&site=ehost-live header: @attributes: shortDbName: hlh uiTerm: 163826592 longDbName: Humanities International Complete uiTag: AN controlInfo: bkinfo: jinfo: jid: 1574020X 179V jtl: Language Resources & Evaluation issn: 1574020X maglogo: N pubinfo: dt: Jun2023 vid: 57 iid: 2 pid: 237 pub: Springer Nature artinfo: ui: 163826592 10.1007/s10579-022-09627-y ppf: 641 ppct: 31 formats: fmt: – @attributes: type: T – @attributes: type: P size: 2.1MB tig: atl: Understanding conversational interaction in multiparty conversations: the EVA Corpus. aug: au: Mlakar, Izidor Verdonik, Darinka Majhenič, Simona Rojc, Matej affil: Faculty of Electrical Engineering and Computer Science, University of Maribor, Maribor, Slovenia su: Natural languages Discourse markers Corpora Speech Manufacturing processes sug: subj: Natural languages Discourse markers Corpora Speech Manufacturing processes keyword: Conversational intelligence Corpora and language resources Multimodal corpus Pragmatics Speech corpus ab: This paper focuses on gaining new knowledge through observation, qualitative analytics, and cross-modal fusion of rich multi-layered conversational features expressed during multiparty discourse. The outlined research stems from the theory that speech and co-speech gestures originate from the same representation; however, the representation is not solely limited to the speech production process. Thus, the nature of how information is conveyed by synchronously fusing speech and gestures must be investigated in detail. Therefore, this paper introduces an integrated annotation scheme and methodology which opens the opportunity to study verbal (i.e., speech) and non-verbal (i.e., visual cues with a communicative intent) components independently, however, still interconnected over a common timeline. To analyse this interaction between linguistic, paralinguistic, and non-verbal components in multiparty discourse and to help improve natural language generation in embodied conversational agents, a high-quality multimodal corpus, consisting of several annotation layers spanning syntax, POS, dialogue acts, discourse markers, sentiment, emotions, non-verbal behaviour, and gesture units was built and is represented in detail. It is the first of its kind for the Slovenian language. Moreover, detailed case studies show the tendency of metadiscourse to coincide with non-verbal behaviour of non-propositional origin. The case analysis further highlights how the newly created conversational model and the corresponding information-rich consistent corpus can be exploited to deepen the understanding of multiparty discourse. pubtype: Academic Journal doctype: Article src: R language: English refInfo: copyright: @attributes: flag: Y custom: Language Resources & Evaluation is a copyright of Springer, 2023. All Rights Reserved. item: Language Resources & Evaluation holder: Springer Nature dt: @attributes: year: 2023 holdings: @attributes: islocal: N |
|---|