Human-computer multimodal interface to internet navigation.
Propose and develop new multimodal interfaces that allow people with motor impairments to control mass use applications in a natural way through gestures and voice. A multimodal interaction interface was developed for using Google Chrome, Gmail and Facebook applications through gestural and verbal c...
| Publicado en: | Disability & Rehabilitation: Assistive Technology Vol. 16; no. 8; pp. 807 - 821 |
|---|---|
| Autores principales: | , , , |
| Formato: | research tables/charts Journal Article |
| Publicado: |
Taylor & Francis Ltd
Nov2021
|
| Acceso en línea: | Ver este registro en EBSCOhost |
| fields | @attributes: recordID: 1 pdfLink: plink: https://search.ebscohost.com/login.aspx?direct=true&db=ccm&AN=152491115&site=ehost-live header: @attributes: shortDbName: ccm uiTerm: 152491115 longDbName: CINAHL Complete uiTag: AN controlInfo: bkinfo: dissinfo: jinfo: jid: 17483107 1X04 jtl: Disability & Rehabilitation: Assistive Technology issn: 17483107 maglogo: Y pubinfo: dt: Nov2021 vid: 16 iid: 8 pid: 377 pub: Taylor & Francis Ltd place: Philadelphia, Pennsylvania artinfo: ui: 152491115 145550526 152491115 152491115 10.1080/17483107.2020.1799440 152491115 ppf: 807 ppct: 14 formats: fmt: – @attributes: type: T – @attributes: type: P tig: atl: Human-computer multimodal interface to internet navigation. aug: au: Mosquera-DeLaCruz, Jose H. Loaiza-Correa, Humberto Nope-Rodríguez, Sandra E. Restrepo-Girón, Andrés D. affil: School of Electrical and Electronic Engineering, Universidad del Valle, Cali, Colombia sug: subj: Internet User-Computer Interface Motor Skills Disorders Voice Nonverbal Communication Human Web Search Engines Social Media Adult Descriptive Statistics Information Technology Graphical User Interface Digital Imaging Voice Recognition Systems Adult: 19-44 years ab: Propose and develop new multimodal interfaces that allow people with motor impairments to control mass use applications in a natural way through gestures and voice. A multimodal interaction interface was developed for using Google Chrome, Gmail and Facebook applications through gestural and verbal commands. The interface activates mouse and keyboard commands from the processing of voice signals and videos of the user's head movement. The interface does not disable traditional keyboard and mouse functions; moreover, it only requires a webcam and a microphone, which are usually built into portable computers. The tests were performed on three groups of people: young adults, older adults and people with motor impairments. The verbal interaction was tested on a total of 189 voice commands with an average performance of 75.7% and a total of 105 dictations. The dictations had an average of 13 words; the system had a performance of 81.1%. Moreover, the gestural interaction activated 126 commands without errors using a drop-down menu; a click was activated 84 times with a success rate of 70.2%. The motor impairments group especially valued the option of using Google Chrome, Gmail and Facebook without physically manipulating a mouse and keyboard. This group showed a greater preference for verbal control than for gestural control. An adaptation period is required for the adults group to acquire greater skill in using the interface. The young adults group preferred the types of interactions they are accustomed to due to their familiarity with Information and Communication Technologies (ICT); they considered the interface fun. Computers and their applications were conceived with unnatural interaction mechanisms, such as the keyboard and mouse, which prevent their use by people with psychophysiological limitations or digital literacy. For this reason, the need arises to design new natural interfaces commanded by gestures and voice. It is necessary to develop low-cost interfaces that can control mass-use applications such as Google Chrome, Facebook and Gmail, which do not require additional hardware using webcams and microphones, which are usually integrated into laptops. The development of these multimodal interfaces improves the quality of life of people with motor impairments, allowing them to have access to Information and Communication Technologies (ICT). pubtype: Academic Journal doctype: research tables/charts Journal Article ougenre: Article language: English refInfo: holdings: @attributes: islocal: N |
|---|