Challenges and opportunities of multimodal data in human learning: The computer science students' perspective.

Multimodal data have the potential to explore emerging learning practices that extend human cognitive capacities. A critical issue stretching in many multimodal learning analytics (MLA) systems and studies is the current focus aimed at supporting researchers to model learner behaviours, rather than...

Full description

Bibliographic Details
Published in:Journal of Computer Assisted Learning Vol. 37; no. 4; pp. 1030 - 1048
Main Authors: Mangaroska, Katerina, Martinez‐Maldonado, Roberto, Vesin, Boban, Gašević, Dragan
Format: pictorial research tables/charts Journal Article
Published: Wiley-Blackwell Aug2021
Online Access:View this record in EBSCOhost
fields @attributes:
  recordID: 1
pdfLink:
plink: https://search.ebscohost.com/login.aspx?direct=true&db=ccm&AN=151329630&site=ehost-live
header:
  @attributes:
    shortDbName: ccm
    uiTerm: 151329630
    longDbName: CINAHL Complete
    uiTag: AN
  controlInfo:
    bkinfo:
    dissinfo:
    jinfo:
      jid:
        02664909
        6M1
      jtl: Journal of Computer Assisted Learning
      issn: 02664909
      maglogo: Y
    pubinfo:
      dt: Aug2021
      vid: 37
      iid: 4
      pid: 480
      pub: Wiley-Blackwell
      place: Malden, Massachusetts
    artinfo:
      ui:
        151329630
        148999736
        151329630
        151329630
        10.1111/jcal.12542
        151329630
      ppf: 1030
      ppct: 18
      formats:
      tig:
        atl: Challenges and opportunities of multimodal data in human learning: The computer science students' perspective.
      aug:
        au:
          Mangaroska, Katerina
          Martinez‐Maldonado, Roberto
          Vesin, Boban
          Gašević, Dragan
        affil: Department of Computer Science, Faculty of Information Technology and Electrical Engineering, Norwegian University of Science and Technology, Trondheim, Norway
      sug:
        subj:
          Learning
          Computers and Computerization Education
          Student Attitudes Evaluation
          Funding Source
          Norway
          Human
          Female
          Male
          Adult
          Qualitative Studies
          Wearable Sensors
          Interviews
          Thematic Analysis
          Educational Technology
          Adult: 19-44 years
          Female
          Male
      ab: Multimodal data have the potential to explore emerging learning practices that extend human cognitive capacities. A critical issue stretching in many multimodal learning analytics (MLA) systems and studies is the current focus aimed at supporting researchers to model learner behaviours, rather than directly supporting learners. Moreover, many MLA systems are designed and deployed without learners' involvement. We argue that in order to create MLA interfaces that directly support learning, we need to gain an expanded understanding of how multimodal data can support learners' authentic needs. We present a qualitative study in which 40 computer science students were tracked in an authentic learning activity using wearable and static sensors. Our findings outline learners' curated representations about multimodal data and the non‐technical challenges in using these data in their learning practice. The paper discusses 10 dimensions that can serve as guidelines for researchers and designers to create effective and ethically aware student‐facing MLA innovations. Lay Description: What is already known about this topic: Many MLA systems are designed without learners' involvement.Understanding of how multimodal data can support learners' authentic needs is needed.MLA have the potential to enable the automated generation of models to provide real‐time feedback. What this paper adds: Understanding how learners perceive multimodal data and the learning context.The findings outline the soft challenges in using multimodal data in the learning practice.Ten dimensions were identified to serve as guidelines for researchers and designers.The paper reports learners' perspectives describing new, intriguing, and under‐developed ideas about potential uses of multimodal data in educational context.The discussion on the need for human‐centred design approaches for educational technologies has been presented. Implications for practice and/or policy: Relevant pointers for what is appropriate and ethically necessary when designing learning technologies.Change in perspective among educators, on how they address progress and engagement in learning.
      pubtype: Academic Journal
      doctype:
        pictorial
        research
        tables/charts
        Journal Article
      ougenre: Article
    language: English
    refInfo:
    holdings:
      @attributes:
        islocal: N