Deep learning-based eye sign communication system for people with speech impairments.
Objective: People with motor difficulties and speech impairments often struggle to communicate their needs and views. Augmentative and Alternative Communication (AAC) offers solutions through gestures, body language, or specialized equipment. However, eye gaze and eye signs remain the sole communica...
| Publicado en: | Disability & Rehabilitation: Assistive Technology Vol. 20; no. 8; pp. 2782 - 2804 |
|---|---|
| Autores principales: | , , , |
| Formato: | computer program equations & formulas pictorial research tables/charts Journal Article |
| Publicado: |
Taylor & Francis Ltd
Nov2025
|
| Acceso en línea: | Ver este registro en EBSCOhost |
| fields | @attributes: recordID: 1 pdfLink: plink: https://search.ebscohost.com/login.aspx?direct=true&db=ccm&AN=189411302&site=ehost-live header: @attributes: shortDbName: ccm uiTerm: 189411302 longDbName: CINAHL Complete uiTag: AN controlInfo: bkinfo: dissinfo: jinfo: jid: 17483107 1X04 jtl: Disability & Rehabilitation: Assistive Technology issn: 17483107 maglogo: Y pubinfo: dt: Nov2025 vid: 20 iid: 8 pid: 377 pub: Taylor & Francis Ltd place: Philadelphia, Pennsylvania artinfo: ui: 189411302 186742659 189411302 189411302 10.1080/17483107.2025.2532698 189411302 ppf: 2782 ppct: 22 formats: fmt: – @attributes: type: T – @attributes: type: P tig: atl: Deep learning-based eye sign communication system for people with speech impairments. aug: au: Megalingam, Rajesh Kannan Kuttankulangara Manoharan, Sakthiprasad Riju, Gokul Vadivel, Shree Rajesh Raagul affil: Humanitarian Technology (HuT) Labs, Department of Electronics and Communication Engineering, Amrita Vishwa Vidyapeetham, Amritapuri, India sug: subj: Deep Learning Alternative and Augmentative Communication Methods Rehabilitation, Speech and Language User-Computer Interface Eye Movements Human Adolescence Word Lists Body Language Adult Middle Age Aged Descriptive Statistics Data Analysis Software Comparative Studies Male Female Adolescent: 13-18 years Adult: 19-44 years Middle Aged: 45-64 years Aged: 65+ years Male Female ab: Objective: People with motor difficulties and speech impairments often struggle to communicate their needs and views. Augmentative and Alternative Communication (AAC) offers solutions through gestures, body language, or specialized equipment. However, eye gaze and eye signs remain the sole communication method for some individuals. While existing eye-gaze devices leverage deep learning, their pre-calibration techniques can be unreliable and susceptible to lighting conditions. On the other hand, the research into eye sign-based communication is at a very novice stage. Methods: In this research, we propose an eye sign-based communication system that operates on deep learning principles and accepts eye sign patterns from speech-impaired or paraplegic individuals via a standard webcam. The system converts the eye signs into alphabets, words, or sentences and displays the resulting text visually on the screen. In addition, it provides a vocal prompt for the user and the caretaker. It functions effectively in various lighting conditions without requiring calibration and integrates a text prediction function for user convenience. Impact Experiments conducted with participants aged between 18 and 35 years yielded average accuracy rates of 98%, 99%, and 99% for alphabet, word, and sentence formation, respectively. These results demonstrate the system's robustness and potential to significantly benefit individuals with speech impairments. Implications for rehabilitation: Enhanced communication abilities: The deep learning-based eye sign communication system offers a reliable and efficient alternative communication method for individuals with speech impairments, enabling them to convey their thoughts and needs independently. Improved quality of life: By facilitating effective interaction with caregivers, family, and society, this system promotes social inclusion and reduces isolation for individuals with speech and physical disabilities. Customizable and adaptable solution: The system's ability to adapt to the unique needs of users ensures its effectiveness across various rehabilitation settings, accommodating users with different levels of motor and cognitive capabilities. Support for therapists and caregivers: Rehabilitation professionals can use the system to better understand the needs and preferences of patients, leading to more personalized and effective care plans. Scalability for broader applications: Beyond individual use, the system has the potential to be implemented in hospitals, rehabilitation centers, and home-care environments, supporting a wide range of speech-impaired individuals. Encourages Independence: By providing a direct communication channel, the system empowers users to express themselves without constant reliance on caregivers, fostering self-confidence and independence in daily life. pubtype: Academic Journal doctype: computer program equations & formulas pictorial research tables/charts Journal Article ougenre: Article language: English refInfo: holdings: @attributes: islocal: N |
|---|