Gaze Patterns and Audiovisual Speech Enhancement.
Purpose: In this study, the authors sought to quantify the relationships between speech intelligibility (perception) and gaze patterns under different auditory-visual conditions. Method: Eleven subjects listened to low-context sentences spoken by a single talker while viewing the face of one or more...
| Published in: | Journal of Speech, Language & Hearing Research Vol. 56; no. 2; pp. 471 - 481 |
|---|---|
| Main Authors: | , , , , |
| Format: | Article |
| Published: |
American Speech-Language-Hearing Association
Apr2013
|
| Subjects: | |
| Online Access: | View this record in EBSCOhost |
| fields | @attributes: recordID: 1 pdfLink: plink: https://search.ebscohost.com/login.aspx?direct=true&db=ssf&AN=90494488&site=ehost-live header: @attributes: shortDbName: ssf uiTerm: 90494488 longDbName: Social Sciences Full Text (H.W. Wilson) uiTag: AN controlInfo: bkinfo: jinfo: jid: 10924388 1SM jtl: Journal of Speech, Language & Hearing Research issn: 10924388 maglogo: N pubinfo: dt: Apr2013 vid: 56 iid: 2 pid: 42 pub: American Speech-Language-Hearing Association artinfo: ui: 90494488 10.1044/1092-4388(2012/10-0288) ppf: 471 ppct: 10 formats: fmt: @attributes: type: P size: 8.2MB tig: atl: Gaze Patterns and Audiovisual Speech Enhancement. aug: au: Yi, Astrid Wong, Willy Eizenman, Moshe Smith, Anne Forrest, Karen affil: University of Toronto, Ontario, Canada su: Analysis of variance Distraction Audiovisual materials Experimental design Eye movements Fisher exact test Noise Speech perception Intelligibility of speech Statistical hypothesis testing T-test (Statistics) Video recording Visual perception Descriptive statistics sug: subj: Analysis of variance Distraction Audiovisual materials Experimental design Eye movements Fisher exact test Noise Speech perception Intelligibility of speech Statistical hypothesis testing T-test (Statistics) Video recording Visual perception Descriptive statistics keyword: speech intelligibility speech perception visual scanning speech intelligibility speech perception visual scanning ab: Purpose: In this study, the authors sought to quantify the relationships between speech intelligibility (perception) and gaze patterns under different auditory-visual conditions. Method: Eleven subjects listened to low-context sentences spoken by a single talker while viewing the face of one or more talkers on a computer display. Subjects either maintained their gaze at a specific distance (0°, 2.5°, 5°, 10°, and 15°) from the center of the talker's mouth (CTM) or moved their eyes freely on the computer display. Eye movements were monitored with an eye-tracking system, and speech intelligibility was evaluated by the mean percentage of correctly perceived words. Results: With a single talker and a fixed point of gaze, speech intelligibility was similar for all fixations within 10° of the CTM. With visual cues from two talker faces and a speech signal from one of the talkers, speech intelligibility was similar to that of a single talker for fixations within 2.5° of the CTM. With natural viewing of a single talker, gaze strategy changed with speech- signal-to-noise ratio (SNR). For low speech-SNR, a strategy that brought the point of gaze directly to within 2.5° of the CTM was used in approximately 80% of trials, whereas in high speech-SNR it was used in only approximately 50% of trials. Conclusions: With natural viewing of a single talker and high speech-SNR, subjects can shift their gaze between points on the talker's face without compromising speech intelligibility. With low-speech SNR, subjects change their gaze patterns to fixate primarily on points that are in close proximity to the talker's mouth. The latter strategy is essential to optimize speech intelligibility in situations where there are simultaneous visual cues from multiple talkers (i.e., when some of the visual cues are distracters). pubtype: Academic Journal doctype: Article src: R language: English refInfo: copyright: @attributes: flag: N holdings: @attributes: islocal: N |
|---|