Measurement and identification of mental workload during simulated computer tasks with multimodal methods and machine learning.

This study attempted to multimodally measure mental workload and validate indicators for estimating mental workload. A simulated computer work composed of mental arithmetic tasks with different levels of difficulty was designed and used in the experiment to measure physiological signals (heart rate,...

Descripción completa

Detalles Bibliográficos
Publicado en:Ergonomics Vol. 63; no. 7; pp. 896 - 909
Autores principales: Ding, Yi, Cao, Yaqin, Duffy, Vincent G., Wang, Yi, Zhang, Xuefeng
Formato: equations & formulas pictorial research tables/charts Journal Article
Publicado: Taylor & Francis Ltd Jul2020
Acceso en línea:Ver este registro en EBSCOhost
fields @attributes:
  recordID: 1
pdfLink:
plink: https://search.ebscohost.com/login.aspx?direct=true&db=ccm&AN=144636834&site=ehost-live
header:
  @attributes:
    shortDbName: ccm
    uiTerm: 144636834
    longDbName: CINAHL Complete
    uiTag: AN
  controlInfo:
    bkinfo:
    dissinfo:
    jinfo:
      jid:
        00140139
        ERO
      jtl: Ergonomics
      issn: 00140139
      maglogo: Y
    pubinfo:
      dt: Jul2020
      vid: 63
      iid: 7
      pid: 377
      pub: Taylor & Francis Ltd
      place: Philadelphia, Pennsylvania
    artinfo:
      ui:
        144636834
        144636834
        145596842
        144636834
        10.1080/00140139.2020.1759699
        144636834
      ppf: 896
      ppct: 13
      formats:
      tig:
        atl: Measurement and identification of mental workload during simulated computer tasks with multimodal methods and machine learning.
      aug:
        au:
          Ding, Yi
          Cao, Yaqin
          Duffy, Vincent G.
          Wang, Yi
          Zhang, Xuefeng
        affil: School of Management Engineering, Anhui Polytechnic University, Wuhu, P. R. China
      sug:
        subj:
          Task Performance and Analysis
          Machine Learning
          Workload Measurement
          Mental Health
          Ergonomics
          Human
          Heart Rate Evaluation
          Heart Rate Variability Diagnosis
          Respiration Evaluation
          Electromyography
          Scales
          Validity
          Psychophysiology
      ab: This study attempted to multimodally measure mental workload and validate indicators for estimating mental workload. A simulated computer work composed of mental arithmetic tasks with different levels of difficulty was designed and used in the experiment to measure physiological signals (heart rate, heart rate variability, electromyography, electrodermal activity, and respiration), subjective ratings of mental workload (the NASA Task Load Index), and task performance. The indices from electrodermal activity and respiration had a significant increment as task difficulty increased. There were no significant differences between the average heart rate and the low-frequency/high-frequency ratio among tasks. The classification of mental workload using combined indices as inputs showed that classification models combining physiological signals and task performance can reach satisfying accuracy at 96.4% and an accuracy of 78.3% when only using physiological indices as inputs. The present study also showed that ECG and EDA signals have good discriminating power for mental workload detection. Practitioner summary: The methods used in this study could be applied to office workers, and the findings provide preliminary support and theoretical exploration for follow-up early mental workload detection systems, whose implementation in the real world could beneficially impact worker health and company efficiency. Abbreviations: NASA-TLX: the national aeronautics and space administration-task load index; ECG: electrocardiographic; EDA: electrodermal activity; EEG: electroencephalogram; LDA: linear discriminant analysis; SVM: support vector machine; KNN: k-nearest neighbor; ANNs: artificial neural networks; EMG: electromyography; PPG: photoplethysmography; SD: standard deviation; BMI: body mass index; DSSQ: dundee stress state questionnaire; ANOVA: analysis of variance; SC: skin conductance; RMS: root mean square; AVHR: the average heart rate; HR: heart rate; LF/HF: the ratio between the low frequencies band and the high frequency band; PSD: power spectral density; MF: median frequency; HRV: heart rate variability; BPNN: backpropagation neural network
      pubtype: Academic Journal
      doctype:
        equations & formulas
        pictorial
        research
        tables/charts
        Journal Article
      ougenre: Article
    language: English
    refInfo:
    holdings:
      @attributes:
        islocal: N