Systematically Reviewing the Rigour of Immersive Virtual Reality Research in STEM Education: A Deep Dive Into Threats to Internal Validity.
Background: There have been many initiatives focused on implementing IVR in the classroom to either replace or supplement conventional instruction. The efficacy of these initiatives is often informed by IVR media comparison studies that examine the learning outcomes of students who learn academic co...
| Publicado en: | Journal of Computer Assisted Learning Vol. 42; no. 1; pp. 1 - 32 |
|---|---|
| Autores principales: | , , , , , , , , , |
| Formato: | research systematic review tables/charts Journal Article |
| Publicado: |
Wiley-Blackwell
Feb2026
|
| Acceso en línea: | Ver este registro en EBSCOhost |
| fields | @attributes: recordID: 1 pdfLink: plink: https://search.ebscohost.com/login.aspx?direct=true&db=ccm&AN=191181617&site=ehost-live header: @attributes: shortDbName: ccm uiTerm: 191181617 longDbName: CINAHL Complete uiTag: AN controlInfo: bkinfo: dissinfo: jinfo: jid: 02664909 6M1 jtl: Journal of Computer Assisted Learning issn: 02664909 maglogo: Y pubinfo: dt: Feb2026 vid: 42 iid: 1 pid: 480 pub: Wiley-Blackwell place: Malden, Massachusetts artinfo: ui: 191181617 191181617 191181617 10.1002/jcal.70165 191181617 ppf: 1 ppct: 31 formats: tig: atl: Systematically Reviewing the Rigour of Immersive Virtual Reality Research in STEM Education: A Deep Dive Into Threats to Internal Validity. aug: au: Martella, Amédee Marchand Lawson, Alyssa P. Martella, Ronald C. LaBonte, Kristen Zhao, Fangzheng Delgado, Cynthia Y. Munns, Mitchell E. LeRoy, Ashleigh Wells Gluck, Justin A. Mayer, Richard E. affil: University of Georgia, Athens Georgia,, USA sug: subj: Virtual Reality Education Educational Measurement Human Systematic Review ERIC Database PubMed Psycinfo Descriptive Statistics Power Analysis One-Way Analysis of Variance Analysis of Covariance Study Design Reproducibility of Results Bias (Research) Sample Size Learning Computer Simulation Validation Studies Funding Source Internal Validity ab: Background: There have been many initiatives focused on implementing IVR in the classroom to either replace or supplement conventional instruction. The efficacy of these initiatives is often informed by IVR media comparison studies that examine the learning outcomes of students who learn academic content in IVR versus conventional media. However, the current methodological rigour of research on the use of IVR for learning in STEM education has not yet been established to ensure recommendations concerning its use in education are rooted in rigorous research studies. Objective: The present review aimed to fill this gap in the literature by evaluating published journal articles, conference proceedings, and dissertations (between the years 2013 and 2023) related to IVR comparison studies in STEM education. Method: The 44 articles were evaluated with respect to 13 internal validity controls (i.e., research design, justified sample size, group equivalence, attrition equivalence, operational definitions provided, matched dosage, matched timeframe, matched content, implementation fidelity, practice equivalence with dependent measures [DMs], equivalent DMs, interrater agreement for DM scoring and technical adequacy of DMs). Results: Results indicated there were no articles that explicitly met all 13 internal validity controls; the average number of control issues was 5.36. When articles were not penalised for missing information, 21 articles adhered to all internal validity controls. As can be seen when comparing these findings, the lack of methodological information was a glaring problem. Conclusion: These findings indicate that there are both methodological problems and reporting problems in IVR media comparison research that need to be addressed to advance future IVR research. Recommendations for productively moving forward are discussed. Lay Summary: Internal validity is necessary to establish for methodically rigorous research studies but has not been assessed in IVR literature.Controlling for and/or acknowledging threats to internal validity can aid in the interpretation of results.Most articles evaluated were missing critical information about internal validity.IVR research in STEM education has many areas of strengths but also many areas in need of improvement to advance knowledge on the effective use of IVR in education. Practitioner Notes: What is already known about this topic ○IVR is being investigated as a learning tool in STEM courses.○The literature on the use of IVR for learning outcomes in STEM courses is mixed.○The methodological rigour of this research has not been yet established.What this paper adds ○Studies on the learning impacts of IVR in STEM courses were evaluated with respect to 13 internal validity controls.○This research identified that a high percentage of articles did not meet the internal validity controls.○Many studies demonstrated a lack of methodological information contained within the manuscript.Implications for practice and/or policy ○Studies on the impact of IVR on STEM learning need to take into account internal validity controls to ensure the literature base is strong.○More transparency is necessary in publishing research to ensure that researchers are not violating internal validity controls. pubtype: Academic Journal doctype: research systematic review tables/charts Journal Article ougenre: Article language: English refInfo: holdings: @attributes: islocal: N |
|---|