Modeling incentive salience in Pavlovian learning more parsimoniously using a multiple attribute model.

We present a multi-attribute incentive salience (MAIS) model as a computational account of incentive salience in model-based Pavlovian learning. A model of incentive salience as a joint function of reward value and physiological state has been previously proposed by Zhang et al. (2009). In that mode...

Full description

Bibliographic Details
Published in:Cognitive, Affective & Behavioral Neuroscience Vol. 22; no. 2; pp. 244 - 258
Main Authors: Smith, Benjamin J., Read, Stephen J.
Format: equations & formulas research tables/charts Journal Article
Published: Springer Nature Apr2022
Online Access:View this record in EBSCOhost
fields @attributes:
  recordID: 1
pdfLink:
plink: https://search.ebscohost.com/login.aspx?direct=true&db=ccm&AN=156124882&site=ehost-live
header:
  @attributes:
    shortDbName: ccm
    uiTerm: 156124882
    longDbName: CINAHL Complete
    uiTag: AN
  controlInfo:
    bkinfo:
    dissinfo:
    jinfo:
      jid:
        15307026
        NA4
      jtl: Cognitive, Affective & Behavioral Neuroscience
      issn: 15307026
      maglogo: N
    pubinfo:
      dt: Apr2022
      vid: 22
      iid: 2
      pid: 237
      pub: Springer Nature
      place: New York, New York
    artinfo:
      ui:
        156124882
        153137616
        156124882
        156124882
        10.3758/s13415-021-00953-2
        156124882
      ppf: 244
      ppct: 14
      formats:
        fmt:
          – @attributes:
              type: T
          – @attributes:
              type: P
      tig:
        atl: Modeling incentive salience in Pavlovian learning more parsimoniously using a multiple attribute model.
      aug:
        au:
          Smith, Benjamin J.
          Read, Stephen J.
        affil: University of Oregon, Eugene, OR, USA
      sug:
        subj:
          Learning Methods
          Algorithms
          Reinforcement (Psychology)
          Animal Studies
          Animals
          Rats
          Models, Theoretical
          Bioinformatics
          Decision Making
          Funding Source
          Systems Analysis
      ab: We present a multi-attribute incentive salience (MAIS) model as a computational account of incentive salience in model-based Pavlovian learning. A model of incentive salience as a joint function of reward value and physiological state has been previously proposed by Zhang et al. (2009). In that model, the function takes additive or multiplicative forms depending on whether a preference shifts from positive to negative or vice versa. We demonstrate that arbitrarily varying this function is unnecessary to explain observed data. A multiplicative function is sufficient if one takes into account empirical data suggesting the incentive salience function for an incentive is comprised of multiple physiological signals. We compare our model to the previously proposed model on two datasets. We find the MAIS model predicts the outcomes equally well, fits empirical data describing multiple sensory representations of a single stimulus, better approximates the dual-structure appetitive-aversive nature of the reward system, is compatible with existing knowledge about incentive salience in Pavlovian learning, and better describes revaluation in Pavlovian learning. This model addresses a call (Dayan & Berridge, 2014) for algorithmic and computational models of model-based Pavlovian learning that consistently and fully explain empirical observations. Because a multi-attribute model is relevant even for simple Pavlovian associations, it should be useful in a wide variety of decision-making contexts, including agent modeling and addiction research.
      pubtype: Academic Journal
      doctype:
        equations & formulas
        research
        tables/charts
        Journal Article
      ougenre: Article
    language: English
    refInfo:
    holdings:
      @attributes:
        islocal: N