Prosody Dominates Over Semantics in Emotion Word Processing: Evidence From Cross-Channel and Cross-Modal Stroop Effects.
Purpose: Emotional speech communication involves multisensory integration of linguistic (e.g., semantic content) and paralinguistic (e.g., prosody and facial expressions) messages. Previous studies on linguistic versus paralinguistic salience effects in emotional speech processing have produced inco...
| Publicado en: | Journal of Speech, Language & Hearing Research Vol. 63; no. 3; pp. 896 - 913 |
|---|---|
| Autores principales: | , , |
| Formato: | Artículo |
| Publicado: |
American Speech-Language-Hearing Association
Mar2020
|
| Materias: | |
| Acceso en línea: | Ver este registro en EBSCOhost |
| fields | @attributes: recordID: 1 pdfLink: plink: https://search.ebscohost.com/login.aspx?direct=true&db=ssf&AN=142412816&site=ehost-live header: @attributes: shortDbName: ssf uiTerm: 142412816 longDbName: Social Sciences Full Text (H.W. Wilson) uiTag: AN controlInfo: bkinfo: jinfo: jid: 10924388 1SM jtl: Journal of Speech, Language & Hearing Research issn: 10924388 maglogo: N pubinfo: dt: Mar2020 vid: 63 iid: 3 pid: 42 pub: American Speech-Language-Hearing Association artinfo: ui: 142412816 10.1044/2020_JSLHR-19-00258 ppf: 896 ppct: 17 formats: fmt: @attributes: type: P size: 1.3MB tig: atl: Prosody Dominates Over Semantics in Emotion Word Processing: Evidence From Cross-Channel and Cross-Modal Stroop Effects. aug: au: Yi Lin Hongwei Ding Yang Zhang affil: Speech-Language-Hearing Center, School of Foreign Languages, Shanghai Jiao Tong University, China Department of Speech-Language-Hearing Science & Center for Neurobehavioral Development, University of Minnesota, Minneapolis su: Emotions Facial expression Semantics Auditory perception Chi-squared test Confidence intervals Psychology of movement Reaction time Research funding Scale analysis (Psychology) Physiological aspects of speech Statistics Visual perception Data analysis Phonological awareness Data analysis software Descriptive statistics sug: subj: Emotions Facial expression Semantics Auditory perception Chi-squared test Confidence intervals Psychology of movement Reaction time Research funding Scale analysis (Psychology) Physiological aspects of speech Statistics Visual perception Data analysis Phonological awareness Data analysis software Descriptive statistics ab: Purpose: Emotional speech communication involves multisensory integration of linguistic (e.g., semantic content) and paralinguistic (e.g., prosody and facial expressions) messages. Previous studies on linguistic versus paralinguistic salience effects in emotional speech processing have produced inconsistent findings. In this study, we investigated the relative perceptual saliency of emotion cues in crosschannel auditory alone task (i.e., semantics-prosody Stroop task) and cross-modal audiovisual task (i.e., semantics- prosody-face Stroop task). Method: Thirty normal Chinese adults participated in two Stroop experiments with spoken emotion adjectives in Mandarin Chinese. Experiment 1 manipulated auditory pairing of emotional prosody (happy or sad) and lexical semantic content in congruent and incongruent conditions. Experiment 2 extended the protocol to cross-modal integration by introducing visual facial expression during auditory stimulus presentation. Participants were asked to judge emotional information for each test trial according to the instruction of selective attention. Results: Accuracy and reaction time data indicated that, despite an increase in cognitive demand and task complexity in Experiment 2, prosody was consistently more salient than semantic content for emotion word processing and did not take precedence over facial expression. While congruent stimuli enhanced performance in both experiments, the facilitatory effect was smaller in Experiment 2. Conclusion: Together, the results demonstrate the salient role of paralinguistic prosodic cues in emotion word processing and congruence facilitation effect in multisensory integration. Our study contributes tonal language data on how linguistic and paralinguistic messages converge in multisensory speech processing and lays a foundation for further exploring the brain mechanisms of crosschannel/ modal emotion integration with potential clinical applications. pubtype: Academic Journal doctype: Article src: R language: English refInfo: copyright: @attributes: flag: N holdings: @attributes: islocal: N |
|---|