A Kinect-Based Sign Language Hand Gesture Recognition System for Hearing- and Speech-Impaired: A Pilot Study of Pakistani Sign Language.
Sign language provides hearing and speech impaired individuals with an interface to communicate with other members of the society. Unfortunately, sign language is not understood by most of the common people. For this, a gadget based on image processing and pattern recognition can provide with a vita...
| Publicado en: | Assistive Technology Vol. 27; no. 1; pp. 34 - 44 |
|---|---|
| Autores principales: | , |
| Formato: | pictorial research tables/charts Journal Article |
| Publicado: |
Taylor & Francis Ltd
Spring2015
|
| Acceso en línea: | Ver este registro en EBSCOhost |
| fields | @attributes: recordID: 1 pdfLink: plink: https://search.ebscohost.com/login.aspx?direct=true&db=ccm&AN=103778539&site=ehost-live header: @attributes: shortDbName: ccm uiTerm: 103778539 longDbName: CINAHL Complete uiTag: AN controlInfo: bkinfo: dissinfo: jinfo: jid: 10400435 YVP jtl: Assistive Technology issn: 10400435 maglogo: Y pubinfo: dt: Spring2015 vid: 27 iid: 1 pid: 377 pub: Taylor & Francis Ltd place: Philadelphia, Pennsylvania artinfo: ui: 103778539 101715423 10.1080/10400435.2014.952845 NLM26132224 103778539 ppf: 34 ppct: 10 formats: fmt: @attributes: type: P tig: atl: A Kinect-Based Sign Language Hand Gesture Recognition System for Hearing- and Speech-Impaired: A Pilot Study of Pakistani Sign Language. aug: au: Halim, Zahid Abbas, Ghulam affil: Faculty of Computer Science and Engineering, Ghulam Ishaq Khan Institute of Engineering Sciences and Technology, Topi, Pakistan sug: subj: Video Games Utilization Sign Language Utilization Hearing Disorders Speech Disorders Alternative and Augmentative Communication Equipment and Supplies Virtual Reality Utilization Human Pakistan Pilot Studies Equipment Design Algorithms User-Computer Interface Software Male Female Young Adult Adult Hand Physiology Joints Physiology Body Weights and Measures Shopping Communication Methods Consumer Attitudes Descriptive Statistics Adult: 19-44 years Male Female ab: Sign language provides hearing and speech impaired individuals with an interface to communicate with other members of the society. Unfortunately, sign language is not understood by most of the common people. For this, a gadget based on image processing and pattern recognition can provide with a vital aid for detecting and translating sign language into a vocal language. This work presents a system for detecting and understanding the sign language gestures by a custom built software tool and later translating the gesture into a vocal language. For the purpose of recognizing a particular gesture, the system employs a Dynamic Time Warping (DTW) algorithm and an off-the-shelf software tool is employed for vocal language generation. Microsoft®Kinect is the primary tool used to capture video stream of a user. The proposed method is capable of successfully detecting gestures stored in the dictionary with an accuracy of 91%. The proposed system has the ability to define and add custom made gestures. Based on an experiment in which 10 individuals with impairments used the system to communicate with 5 people with no disability, 87% agreed that the system was useful. pubtype: Academic Journal doctype: pictorial research tables/charts Journal Article ougenre: Article language: English refInfo: holdings: @attributes: islocal: N |
|---|