Webcam controlled robotic arm for persons with SSMI.
BACKGROUND: People with severe speech and motor impairment (SSMI) often uses a technique called eye pointing to communicate with outside world. One of their parents, caretakers or teachers hold a printed board in front of them and by analyzing their eye gaze manually, their intentions are interprete...
| Publicado en: | Technology & Disability Vol. 32; no. 3; pp. 179 - 198 |
|---|---|
| Autores principales: | , , , , , |
| Formato: | equations & formulas pictorial research tables/charts Journal Article |
| Publicado: |
Sage Publications Inc.
2020
|
| Acceso en línea: | Ver este registro en EBSCOhost |
| fields | @attributes: recordID: 1 pdfLink: plink: https://search.ebscohost.com/login.aspx?direct=true&db=ccm&AN=145428204&site=ehost-live header: @attributes: shortDbName: ccm uiTerm: 145428204 longDbName: CINAHL Complete uiTag: AN controlInfo: bkinfo: dissinfo: jinfo: jid: 10554181 3QS jtl: Technology & Disability issn: 10554181 maglogo: N pubinfo: dt: 2020 vid: 32 iid: 3 pid: 344 pub: Sage Publications Inc. place: Thousand Oaks, California artinfo: ui: 145428204 145428204 147565306 145428204 10.3233/TAD-200264 145428204 ppf: 179 ppct: 19 formats: fmt: – @attributes: type: T – @attributes: type: P tig: atl: Webcam controlled robotic arm for persons with SSMI. aug: au: Sharma, Vinay Krishna Murthy, L.R.D. Singh Saluja, KamalPreet Mollyn, Vimal Sharma, Gourav Biswas, Pradipta affil: Indian Institute of Science, Bangalore, India sug: subj: Robotics Equipment and Supplies Arm Physiology Speech Disorders Motor Skills Disorders Persons with Disabilities Eye Movements Task Performance and Analysis Human Funding Source Audiovisuals Augmented Reality Textiles Graphics Prosthesis Design User-Computer Interface Movement Wearable Sensors Assistive Technology Devices India Students Quadriplegia Clinical Assessment Tools Male Female Adolescence Child Young Adult Descriptive Statistics Algorithms Two-Way Analysis of Variance One-Way Analysis of Variance Computer Hardware Software Reaching Kinematics Adolescent: 13-18 years Child: 6-12 years Male Female ab: BACKGROUND: People with severe speech and motor impairment (SSMI) often uses a technique called eye pointing to communicate with outside world. One of their parents, caretakers or teachers hold a printed board in front of them and by analyzing their eye gaze manually, their intentions are interpreted. This technique is often error prone and time consuming and depends on a single caretaker. OBJECTIVE: We aimed to automate the eye tracking process electronically by using commercially available tablet, computer or laptop and without requiring any dedicated hardware for eye gaze tracking. The eye gaze tracker is used to develop a video see through based AR (augmented reality) display that controls a robotic device with eye gaze and deployed for a fabric printing task. METHODS: We undertook a user centred design process and separately evaluated the web cam based gaze tracker and the video see through based human robot interaction involving users with SSMI. We also reported a user study on manipulating a robotic arm with webcam based eye gaze tracker. RESULTS: Using our bespoke eye gaze controlled interface, able bodied users can select one of nine regions of screen at a median of less than 2 secs and users with SSMI can do so at a median of 4 secs. Using the eye gaze controlled human-robot AR display, users with SSMI could undertake representative pick and drop task at an average duration less than 15 secs and reach a randomly designated target within 60 secs using a COTS eye tracker and at an average time of 2 mins using the webcam based eye gaze tracker. CONCLUSION: The proposed system allows users with SSMI to manipulate physical objects without any dedicated eye gaze tracker. The novelty of the system is in terms of non-invasiveness as earlier work mostly used glass based wearable trackers or head/face tracking but no other earlier work reported use of webcam based eye tracking for controlling robotic arm by users with SSMI. pubtype: Academic Journal doctype: equations & formulas pictorial research tables/charts Journal Article ougenre: Article language: English refInfo: holdings: @attributes: islocal: N |
|---|