Why do valence asymmetries emerge in value learning? A reinforcement learning account.
The Value Learning Task (VLT; e.g., Raymond & O'Brien, 2009) is widely used to investigate how acquired value impacts how we perceive and process stimuli. The task consists of a series of trials in which participants attempt to maximize accumulated winnings as they make choices from a pair of presen...
| Publicado en: | Cognitive, Affective & Behavioral Neuroscience Vol. 23; no. 3; pp. 543 - 557 |
|---|---|
| Autores principales: | , , , , |
| Formato: | Journal Article |
| Publicado: |
Springer Nature
Jun2023
|
| Acceso en línea: | Ver este registro en EBSCOhost |
| fields | @attributes: recordID: 1 pdfLink: plink: https://search.ebscohost.com/login.aspx?direct=true&db=ccm&AN=169327299&site=ehost-live header: @attributes: shortDbName: ccm uiTerm: 169327299 longDbName: CINAHL Complete uiTag: AN controlInfo: bkinfo: dissinfo: jinfo: jid: 15307026 NA4 jtl: Cognitive, Affective & Behavioral Neuroscience issn: 15307026 maglogo: N pubinfo: dt: Jun2023 vid: 23 iid: 3 pid: 237 pub: Springer Nature place: New York, New York artinfo: ui: 169327299 161032001 10.3758/s13415-022-01050-8 169327299 ppf: 543 ppct: 14 formats: fmt: – @attributes: type: T – @attributes: type: P tig: atl: Why do valence asymmetries emerge in value learning? A reinforcement learning account. aug: au: Hao, Chenxu Cabrera-Haro, Lilian E. Lin, Ziyong Reuter-Lorenz, Patricia A. Lewis, Richard L. affil: Department of Psychology, University of Michigan, Ann Arbor, MI, USA sug: ab: The Value Learning Task (VLT; e.g., Raymond & O'Brien, 2009) is widely used to investigate how acquired value impacts how we perceive and process stimuli. The task consists of a series of trials in which participants attempt to maximize accumulated winnings as they make choices from a pair of presented images associated with probabilistic win, loss, or no-change outcomes. The probabilities and outcomes are initially unknown to the participant and thus the task involves decision making and learning under uncertainty. Despite the symmetric outcome structure for win and loss pairs, people learn win associations better than loss associations (Lin, Cabrera-Haro, & Reuter-Lorenz, 2020). This learning asymmetry could lead to differences when the stimuli are probed in subsequent tasks, compromising inferences about how acquired value affects downstream processing. We investigate the nature of the asymmetry using a standard error-driven reinforcement learning model with a softmax choice rule. Despite having no special role for valence, the model yields the learning asymmetry observed in human behavior, whether the model parameters are set to maximize empirical fit, or task payoff. The asymmetry arises from an interaction between a neutral initial value estimate and a choice policy that exploits while exploring, leading to more poorly discriminated value estimates for loss stimuli. We also show how differences in estimated individual learning rates help to explain individual differences in the observed win-loss asymmetries, and how the final value estimates produced by the model provide a simple account of a post-learning explicit value categorization task. pubtype: Academic Journal doctype: Journal Article ougenre: Article language: English refInfo: holdings: @attributes: islocal: N |
|---|