Switching between touch and voice: factors influencing modality selection in multimodal systems.
Users frequently encounter multimodal systems and make decisions regarding the most suitable modality for a given task. This study examines users' modality selection in multimodal systems, focusing on the features and menu structures of available modalities. Modality selection tasks that considered...
| Publicado en: | Ergonomics Vol. 69; no. 6; pp. 1007 - 1021 |
|---|---|
| Autor principal: | |
| Formato: | pictorial research tables/charts Journal Article |
| Publicado: |
Taylor & Francis Ltd
Jun2026
|
| Acceso en línea: | Ver este registro en EBSCOhost |
| fields | @attributes: recordID: 1 pdfLink: plink: https://search.ebscohost.com/login.aspx?direct=true&db=ccm&AN=193835289&site=ehost-live header: @attributes: shortDbName: ccm uiTerm: 193835289 longDbName: CINAHL Complete uiTag: AN controlInfo: bkinfo: dissinfo: jinfo: jid: 00140139 ERO jtl: Ergonomics issn: 00140139 maglogo: Y pubinfo: dt: Jun2026 vid: 69 iid: 6 pid: 377 pub: Taylor & Francis Ltd place: Philadelphia, Pennsylvania artinfo: ui: 193835289 185065184 193835289 193835289 10.1080/00140139.2025.2499200 193835289 ppf: 1007 ppct: 14 formats: tig: atl: Switching between touch and voice: factors influencing modality selection in multimodal systems. aug: au: Cha, Min Chul affil: Division of Media Communication, Hankuk University of Foreign Studies, Seoul, Republic of Korea sug: subj: Touch User-Computer Interface Voice Perception Task Performance and Analysis Human Funding Source Logistic Regression Voice Recognition Systems Decision Making Male Female Adult Descriptive Statistics Questionnaires Analysis of Variance Data Analysis Software Post Hoc Analysis Adult: 19-44 years Male Female ab: Users frequently encounter multimodal systems and make decisions regarding the most suitable modality for a given task. This study examines users' modality selection in multimodal systems, focusing on the features and menu structures of available modalities. Modality selection tasks that considered the number of touches, syllables per touch (S/T), and menu structure were presented to participants. Binomial logistic regression analysis revealed that S/T and menu structure significantly predicted modality selection. The voice modality was predominantly chosen when S/T ranged from 2 to 3 in non-hierarchical tasks and 4 to 5 in hierarchical tasks. In contrast, the number of touches did not significantly predict modality selection. Additionally, modality features and menu structure significantly influenced interaction effort, including both physical and mental dimensions. This study identified modality switching points by evaluating the interaction effort associated with voice and touch modalities. Practitioner Summary: This study identifies key factors – syllables per touch and menu structure – affecting touch and voice modality preferences in multimodal systems. Hierarchical tasks significantly influence the switching point. The findings provide a framework for designing adaptive interfaces that enhance usability and reduce interaction effort. pubtype: Academic Journal doctype: pictorial research tables/charts Journal Article ougenre: Article language: English refInfo: holdings: @attributes: islocal: N |
|---|