The effect of the modality principle to support learning with virtual reality: An eye‐tracking and electrodermal activity study.
Background: Virtual reality (VR) is considered a promising approach to support learning. An instructional design is essential to optimize cognitive processes. Studies show that VR has unique instructional and pedagogical requirements. Objectives: To evaluate the effectiveness and applicability of th...
| Publicado en: | Journal of Computer Assisted Learning Vol. 39; no. 2; pp. 547 - 558 |
|---|---|
| Autores principales: | , |
| Formato: | pictorial research tables/charts Journal Article |
| Publicado: |
Wiley-Blackwell
Apr2023
|
| Acceso en línea: | Ver este registro en EBSCOhost |
| fields | @attributes: recordID: 1 pdfLink: plink: https://search.ebscohost.com/login.aspx?direct=true&db=ccm&AN=162203185&site=ehost-live header: @attributes: shortDbName: ccm uiTerm: 162203185 longDbName: CINAHL Complete uiTag: AN controlInfo: bkinfo: dissinfo: jinfo: jid: 02664909 6M1 jtl: Journal of Computer Assisted Learning issn: 02664909 maglogo: Y pubinfo: dt: Apr2023 vid: 39 iid: 2 pid: 480 pub: Wiley-Blackwell place: Malden, Massachusetts artinfo: ui: 162203185 160416602 162203185 162203185 10.1111/jcal.12763 162203185 ppf: 547 ppct: 11 formats: tig: atl: The effect of the modality principle to support learning with virtual reality: An eye‐tracking and electrodermal activity study. aug: au: Liberman, Liat Dubovi, Ilana affil: Nursing Department, The Stanley Steyer School of Health Professions, Sackler Faculty of Medicine, Tel Aviv University, Tel Aviv, Israel sug: subj: Virtual Reality Learning Methods Multimedia Educational Technology Eye Movements Skin Physiology Support, Psychosocial Human Prospective Studies Experimental Studies Student Experiences Student Knowledge Students, Nursing Israel Israel Systematic Random Sample Female Male Young Adult Adult Pretest-Posttest Design Descriptive Statistics Unpaired T-Tests Mann-Whitney U Test Kruskal-Wallis Test Post Hoc Analysis Funding Source Adult: 19-44 years Female Male ab: Background: Virtual reality (VR) is considered a promising approach to support learning. An instructional design is essential to optimize cognitive processes. Studies show that VR has unique instructional and pedagogical requirements. Objectives: To evaluate the effectiveness and applicability of the modality principle, which was previously validated in 2D classic multimedia, for learning with VR. The modality principle states that multimedia information presented as spoken narration is superior to on‐screen text. Methods: A prospective experimental study with two compared conditions of instruction: VR‐based learning guided by on‐screen text (n = 34) versus spoken narration (n = 28). Students' cognitive learning experiences were captured by eye‐tracking and electrodermal activity (EDA). In addition, students' knowledge was evaluated using a pre–post knowledge test. Results and Conclusions: Overall, there was no significant difference in knowledge retention between the participants who learned with on‐screen text compared to spoken narration. However, results from the eye‐tracking analysis showed that students who learned with the on‐screen text devoted longer visual attention toward important learning activity areas of interest, suggesting a better ability to discern between relevant and irrelevant information. Conversely, students who learned with the spoken narration expressed significantly more EDA peak responses, proposing a higher cognitive load. Implications: This study outlines that while learning with VR was effective, the modality principle might not apply to learning with VR. Moreover, the analysis of the learning process suggests even an inverse effect, favouring the provision of instructional scaffolds as on‐screen text. Future research should evaluate this effect on long‐term knowledge retention. Lay Description: What is already known about this topic?: VR can increase learners' engagement and impact their cognitive processing.VR has different instructional requirements than classic multimedia learning material.The modality principle states that audio‐visual is superior to visual‐only information. What this paper adds?: This study evaluated the impact of the modality design principle to scaffolded learning with VR.In terms of achievements learning with textual and audio instruction was comparable.Eye‐tracking analysis showed that learning with on‐screen text was characterized by longer visual attention to the important learning objects.Learning with the auditory narration was associated with a higher cognitive load as measured by EDA and more performance errors.In both study conditions, students tended to focus more on the less important information in the learning activity. Implications of the study's findings for practitioners: VR‐based simulations are effective to support learning and knowledge gaining.The modality principle is not fully applicable to support learning in VR‐based learning environments.Instructional design should take into consideration that novices often notice the non‐salient information in VR. pubtype: Academic Journal doctype: pictorial research tables/charts Journal Article ougenre: Article language: English refInfo: holdings: @attributes: islocal: N |
|---|