MagTrack: A Wearable Tongue Motion Tracking System for Silent Speech Interfaces.
Purpose: Current electromagnetic tongue tracking devices are not amenable for daily use and thus not suitable for silent speech interface and other applications. We have recently developed MagTrack, a novel wearable electromagnetic articulograph tongue tracking device. This study aimed to validate M...
| Published in: | Journal of Speech, Language & Hearing Research Vol. 66; pp. 3206 - 3222 |
|---|---|
| Main Authors: | , , , , , , |
| Format: | Article |
| Published: |
American Speech-Language-Hearing Association
2023 Supplement
|
| Subjects: | |
| Online Access: | View this record in EBSCOhost |
| fields | @attributes: recordID: 1 pdfLink: plink: https://search.ebscohost.com/login.aspx?direct=true&db=ssf&AN=171330559&site=ehost-live header: @attributes: shortDbName: ssf uiTerm: 171330559 longDbName: Social Sciences Full Text (H.W. Wilson) uiTag: AN controlInfo: bkinfo: jinfo: jid: 10924388 1SM jtl: Journal of Speech, Language & Hearing Research issn: 10924388 maglogo: N pubinfo: dt: 2023 Supplement vid: 66 pid: 42 pub: American Speech-Language-Hearing Association artinfo: ui: 171330559 10.1044/2023_JSLHR-22-00319 ppf: 3206 ppct: 16 formats: fmt: @attributes: type: P size: 17.9MB tig: atl: MagTrack: A Wearable Tongue Motion Tracking System for Silent Speech Interfaces. aug: au: Beiming Cao Ravi, Shravan Sebkhi, Nordine Bhavsar, Arpan Inan, Omer T. Wen Xu Jun Wang affil: Department of Electrical and Computer Engineering, The University of Texas at Austin. Department of Speech, Language, and Hearing Sciences, The University of Texas at Austin. Department of Computer Science, The University of Texas at Austin. School of Electrical and Computer Engineering, Georgia Institute of Technology, Atlanta. Division of Computer Science, Texas Woman’s University, Denton. Department of Neurology, The University of Texas at Austin. su: Phonetics Tongue physiology Speech perception Vowels One-way analysis of variance Wearable technology Biofeedback training Electromagnetism T-test (Statistics) Commercial product evaluation Research funding Descriptive statistics Statistical hypothesis testing New product development Data analysis software sug: subj: Phonetics Commodity Contracts Dealing Commodity Contracts Brokerage Marketing Consulting Services Tongue physiology Speech perception Vowels One-way analysis of variance Wearable technology Biofeedback training Electromagnetism T-test (Statistics) Commercial product evaluation Research funding Descriptive statistics Statistical hypothesis testing New product development Data analysis software ab: Purpose: Current electromagnetic tongue tracking devices are not amenable for daily use and thus not suitable for silent speech interface and other applications. We have recently developed MagTrack, a novel wearable electromagnetic articulograph tongue tracking device. This study aimed to validate MagTrack for potential silent speech interface applications. Method: We conducted two experiments: (a) classification of eight isolated vowels in consonant–vowel–consonant form and (b) continuous silent speech recognition. In these experiments, we used data from healthy adult speakers collected with MagTrack. The performance of vowel classification was measured by accuracies. The continuous silent speech recognition was measured by phoneme error rates. The performance was then compared with results using data collected with commercial electromagnetic articulograph in a prior study. Results: The isolated vowel classification using MagTrack achieved an average accuracy of 89.74% when leveraging all MagTrack signals (x, y, z coordinates; orientation; and magnetic signals), which outperformed the accuracy using commercial electromagnetic articulograph data (only y, z coordinates) in our previous study. The continuous speech recognition from two subjects using MagTrack achieved phoneme error rates of 73.92% and 66.73%, respectively. The commercial electromagnetic articulograph achieved 64.53% from the same subject (66.73% using MagTrack data). Conclusions: MagTrack showed comparable results with the commercial electromagnetic articulograph when using the same localized information. Adding raw magnetic signals would improve the performance of MagTrack. Our preliminary testing demonstrated the potential for silent speech interface as a lightweight wearable device. This work also lays the foundation to support Mag- Track’s potential for other applications including visual feedback–based speech therapy and second language learning. pubtype: Academic Journal doctype: Article src: R language: English refInfo: copyright: @attributes: flag: N holdings: @attributes: islocal: N |
|---|