Validation of the Raw National Aeronautics and Space Administration Task Load Index (NASA-TLX) Questionnaire to Assess Perceived Workload in Patient Monitoring Tasks: Pooled Analysis Study Using Mixed Models.

Background: Patient monitoring is indispensable in any operating room to follow the patient's current health state based on measured physiological parameters. Reducing workload helps to free cognitive resources and thus influences human performance, which ultimately improves the quality of care. Amo...

Full description

Bibliographic Details
Published in:Journal of Medical Internet Research Vol. 22; no. 9
Main Authors: Said, Sadiq, Gozdzik, Malgorzata, Roche, Tadzio Raoul, Braun, Julia, Rössler, Julian, Kaserer, Alexander, Spahn, Donat R, Nöthiger, Christoph B, Tscholl, David Werner
Format: research tables/charts Journal Article
Published: JMIR Publications Inc. Sep2020
Online Access:View this record in EBSCOhost
fields @attributes:
  recordID: 1
pdfLink:
plink: https://search.ebscohost.com/login.aspx?direct=true&db=ccm&AN=146245800&site=ehost-live
header:
  @attributes:
    shortDbName: ccm
    uiTerm: 146245800
    longDbName: CINAHL Complete
    uiTag: AN
  controlInfo:
    bkinfo:
    dissinfo:
    jinfo:
      jid:
        14394456
        DNC
      jtl: Journal of Medical Internet Research
      issn: 14394456
      maglogo: N
    pubinfo:
      dt: Sep2020
      vid: 22
      iid: 9
      pid: 21567
      pub: JMIR Publications Inc.
      place: Toronto, Ontario
    artinfo:
      ui:
        146245800
        146245800
        NLM32780712
        146245800
        10.2196/19472
        NLM32780712
        146245800
      ppct: 1
      formats:
      tig:
        atl: Validation of the Raw National Aeronautics and Space Administration Task Load Index (NASA-TLX) Questionnaire to Assess Perceived Workload in Patient Monitoring Tasks: Pooled Analysis Study Using Mixed Models.
      aug:
        au:
          Said, Sadiq
          Gozdzik, Malgorzata
          Roche, Tadzio Raoul
          Braun, Julia
          Rössler, Julian
          Kaserer, Alexander
          Spahn, Donat R
          Nöthiger, Christoph B
          Tscholl, David Werner
        affil: Department of Anesthesiology, University Hospital Zurich, Zurich, Switzerland
      sug:
        subj:
          Workload
          Task Performance and Analysis
          Monitoring, Physiologic Standards
          Female
          Prospective Studies
          Human
          Switzerland
          Male
          Workload Standards
          Validation Studies
          Comparative Studies
          Evaluation Research
          Multicenter Studies
          Questionnaires
          Female
          Male
      ab: Background: Patient monitoring is indispensable in any operating room to follow the patient's current health state based on measured physiological parameters. Reducing workload helps to free cognitive resources and thus influences human performance, which ultimately improves the quality of care. Among the many methods available to assess perceived workload, the National Aeronautics and Space Administration Task Load Index (NASA-TLX) provides the most widely accepted tool. However, only few studies have investigated the validity of the NASA-TLX in the health care sector.Objective: This study aimed to validate a modified version of the raw NASA-TLX in patient monitoring tasks by investigating its correspondence with expected lower and higher workload situations and its robustness against nonworkload-related covariates. This defines criterion validity.Methods: In this pooled analysis, we evaluated raw NASA-TLX scores collected after performing patient monitoring tasks in four different investigator-initiated, computer-based, prospective, multicenter studies. All of them were conducted in three hospitals with a high standard of care in central Europe. In these already published studies, we compared conventional patient monitoring with two newly developed situation awareness-oriented monitoring technologies called Visual Patient and Visual Clot. The participants were resident and staff anesthesia and intensive care physicians, and nurse anesthetists with completed specialization qualification. We analyzed the raw NASA-TLX scores by fitting mixed linear regression models and univariate models with different covariates.Results: We assessed a total of 1160 raw NASA-TLX questionnaires after performing specific patient monitoring tasks. Good test performance and higher self-rated diagnostic confidence correlated significantly with lower raw NASA-TLX scores and the subscores (all P<.001). Staff physicians rated significantly lower workload scores than residents (P=.001), whereas nurse anesthetists did not show any difference in the same comparison (P=.83). Standardized distraction resulted in higher rated total raw NASA-TLX scores (P<.001) and subscores. There was no gender difference regarding perceived workload (P=.26). The new visualization technologies Visual Patient and Visual Clot resulted in significantly lower total raw NASA-TLX scores and all subscores, including high self-rated performance, when compared with conventional monitoring (all P<.001).Conclusions: This study validated a modified raw NASA-TLX questionnaire for patient monitoring tasks. The scores obtained correctly represented the assumed influences of the examined covariates on the perceived workload. We reported high criterion validity. The NASA-TLX questionnaire appears to be a reliable tool for measuring subjective workload. Further research should focus on its applicability in a clinical setting.
      pubtype: Academic Journal
      doctype:
        research
        tables/charts
        Journal Article
      ougenre: Article
    language: English
    refInfo:
    holdings:
      @attributes:
        islocal: N