Eye gaze controlled adaptive virtual keyboard for users with SSMI.
BACKGROUND: Users with Severe Speech and Motor Impairment (SSMI) often use a communication chart through their eye gaze or limited hand movement and care takers interpret their communication intent. There is already significant research conducted to automate this communication through electronic mea...
| Published in: | Technology & Disability Vol. 33; no. 4; pp. 319 - 339 |
|---|---|
| Main Authors: | , , , , |
| Format: | algorithm equations & formulas research tables/charts Journal Article |
| Published: |
Sage Publications Inc.
2021
|
| Online Access: | View this record in EBSCOhost |
| fields | @attributes: recordID: 1 pdfLink: plink: https://search.ebscohost.com/login.aspx?direct=true&db=ccm&AN=156136102&site=ehost-live header: @attributes: shortDbName: ccm uiTerm: 156136102 longDbName: CINAHL Complete uiTag: AN controlInfo: bkinfo: dissinfo: jinfo: jid: 10554181 3QS jtl: Technology & Disability issn: 10554181 maglogo: N pubinfo: dt: 2021 vid: 33 iid: 4 pid: 344 pub: Sage Publications Inc. place: Thousand Oaks, California artinfo: ui: 156136102 156136102 156136102 10.3233/TAD-200292 156136102 ppf: 319 ppct: 20 formats: fmt: – @attributes: type: T – @attributes: type: P tig: atl: Eye gaze controlled adaptive virtual keyboard for users with SSMI. aug: au: DV, Jeevithashree Jain, Puneet Mukhopadhyay, Abhishek Saluja, Kamal Preet Singh Biswas, Pradipta affil: Indian Institute of Science, Bangalore, India sug: subj: Eye Movement Measurements English Language Keyboards User-Computer Interface Automation Speech Disorders Motor Skills Disorders Persons with Disabilities Human Assistive Technology Algorithms Genetics Pilot Studies Comfort ab: BACKGROUND: Users with Severe Speech and Motor Impairment (SSMI) often use a communication chart through their eye gaze or limited hand movement and care takers interpret their communication intent. There is already significant research conducted to automate this communication through electronic means. Developing electronic user interface and interaction techniques for users with SSMI poses significant challenges as research on their ocular parameters found that such users suffer from Nystagmus and Strabismus limiting number of elements in a computer screen. This paper presents an optimized eye gaze controlled virtual keyboard for English language with an adaptive dwell time feature for users with SSMI. OBJECTIVE: Present an optimized eye gaze controlled English virtual keyboard that follows both static and dynamic adaptation process. The virtual keyboard can automatically adapt to reduce eye gaze movement distance and dwell time for selection and help users with SSMI type better without any intervention of an assistant. METHODS: Before designing the virtual keyboard, we undertook a pilot study to optimize screen region which would be most comfortable for SSMI users to operate. We then proposed an optimized two-level English virtual keyboard layout through Genetic algorithm using static adaptation process; followed by dynamic adaptation process which tracks users' interaction and reduces dwell time based on a Markov model-based algorithm. Further, we integrated the virtual keyboard for a web-based interactive dashboard that visualizes real-time Covid data. RESULTS: Using our proposed virtual keyboard layout for English language, the average task completion time for users with SSMI was 39.44 seconds in adaptive condition and 29.52 seconds in non-adaptive condition. Overall typing speed was 16.9 lpm (letters per minute) for able-bodied users and 6.6 lpm for users with SSMI without using any word completion or prediction features. A case study with an elderly participant with SSMI found a typing speed of 2.70 wpm (words per minute) and 14.88 lpm (letters per minute) after 6 months of practice. CONCLUSIONS: With the proposed layout for English virtual keyboard, the adaptive system increased typing speed statistically significantly for able bodied users than a non-adaptive version while for 6 users with SSMI, task completion time reduced by 8.8% in adaptive version than nonadaptive one. Additionally, the proposed layout was successfully integrated to a web-based interactive visualization dashboard thereby making it accessible for users with SSMI. pubtype: Academic Journal doctype: algorithm equations & formulas research tables/charts Journal Article ougenre: Article language: English refInfo: holdings: @attributes: islocal: N |
|---|