Optimizing Adaptive Notifications in Mobile Health Interventions Systems: Reinforcement Learning from a Data-driven Behavioral Simulator.

Mobile health (mHealth) intervention systems can employ adaptive strategies to interact with users. Instead of designing such complex strategies manually, reinforcement learning (RL) can be used to adaptively optimize intervention strategies concerning the user's context. In this paper, we focus on...

Descripción completa

Detalles Bibliográficos
Publicado en:Journal of Medical Systems Vol. 45; no. 12; pp. 1 - 9
Autores principales: Wang, Shihan, Zhang, Chao, Kröse, Ben, van Hoof, Herke
Formato: research tables/charts Journal Article
Publicado: Springer Nature Dec2021
Acceso en línea:Ver este registro en EBSCOhost
fields @attributes:
  recordID: 1
pdfLink:
plink: https://search.ebscohost.com/login.aspx?direct=true&db=ccm&AN=153929240&site=ehost-live
header:
  @attributes:
    shortDbName: ccm
    uiTerm: 153929240
    longDbName: CINAHL Complete
    uiTag: AN
  controlInfo:
    bkinfo:
    dissinfo:
    jinfo:
      jid:
        01485598
        4N0
      jtl: Journal of Medical Systems
      issn: 01485598
      maglogo: N
    pubinfo:
      dt: Dec2021
      vid: 45
      iid: 12
      pid: 237
      pub: Springer Nature
      place: New York, New York
    artinfo:
      ui:
        153929240
        153929240
        153929240
        10.1007/s10916-021-01773-0
        153929240
      ppf: 1
      ppct: 8
      formats:
        fmt:
          @attributes:
            type: P
      tig:
        atl: Optimizing Adaptive Notifications in Mobile Health Interventions Systems: Reinforcement Learning from a Data-driven Behavioral Simulator.
      aug:
        au:
          Wang, Shihan
          Zhang, Chao
          Kröse, Ben
          van Hoof, Herke
        affil: Informatics Institute, University of Amsterdam, Amsterdam, Netherlands
      sug:
        subj:
          Telehealth
          Reinforcement (Psychology)
          Reminder Systems
          Computer Simulation
          Human
          Algorithms
          Funding Source
          Neural Networks (Computer)
      ab: Mobile health (mHealth) intervention systems can employ adaptive strategies to interact with users. Instead of designing such complex strategies manually, reinforcement learning (RL) can be used to adaptively optimize intervention strategies concerning the user's context. In this paper, we focus on the issue of overwhelming interactions when learning a good adaptive strategy for the user in RL-based mHealth intervention agents. We present a data-driven approach integrating psychological insights and knowledge of historical data. It allows RL agents to optimize the strategy of delivering context-aware notifications from empirical data when counterfactual information (user responses when receiving notifications) is missing. Our approach also considers a constraint on the frequency of notifications, which reduces the interaction burden for users. We evaluated our approach in several simulation scenarios using real large-scale running data. The results indicate that our RL agent can deliver notifications in a manner that realizes a higher behavioral impact than context-blind strategies.
      pubtype: Academic Journal
      doctype:
        research
        tables/charts
        Journal Article
      ougenre: Article
    language: English
    refInfo:
    holdings:
      @attributes:
        islocal: N