Meta-control of the exploration-exploitation dilemma emerges from probabilistic inference over a hierarchy of time scales.
Cognitive control is typically understood as a set of mechanisms that enable humans to reach goals that require integrating the consequences of actions over longer time scales. Importantly, using routine behaviour or making choices beneficial only at short time scales would prevent one from attainin...
| Publicado en: | Cognitive, Affective & Behavioral Neuroscience Vol. 21; no. 3; pp. 509 - 534 |
|---|---|
| Autores principales: | , , |
| Formato: | Journal Article |
| Publicado: |
Springer Nature
Jun2021
|
| Acceso en línea: | Ver este registro en EBSCOhost |
| fields | @attributes: recordID: 1 pdfLink: plink: https://search.ebscohost.com/login.aspx?direct=true&db=ccm&AN=150935706&site=ehost-live header: @attributes: shortDbName: ccm uiTerm: 150935706 longDbName: CINAHL Complete uiTag: AN controlInfo: bkinfo: dissinfo: jinfo: jid: 15307026 NA4 jtl: Cognitive, Affective & Behavioral Neuroscience issn: 15307026 maglogo: N pubinfo: dt: Jun2021 vid: 21 iid: 3 pid: 237 pub: Springer Nature place: New York, New York artinfo: ui: 150935706 147817773 10.3758/s13415-020-00837-x 150935706 ppf: 509 ppct: 25 formats: fmt: – @attributes: type: T – @attributes: type: P tig: atl: Meta-control of the exploration-exploitation dilemma emerges from probabilistic inference over a hierarchy of time scales. aug: au: Marković, Dimitrije Goschke, Thomas Kiebel, Stefan J. affil: Chair of Neuroimaging, Faculty of Psychology, Technische Universität Dresden, 01062, Dresden, Germany sug: ab: Cognitive control is typically understood as a set of mechanisms that enable humans to reach goals that require integrating the consequences of actions over longer time scales. Importantly, using routine behaviour or making choices beneficial only at short time scales would prevent one from attaining these goals. During the past two decades, researchers have proposed various computational cognitive models that successfully account for behaviour related to cognitive control in a wide range of laboratory tasks. As humans operate in a dynamic and uncertain environment, making elaborate plans and integrating experience over multiple time scales is computationally expensive. Importantly, it remains poorly understood how uncertain consequences at different time scales are integrated into adaptive decisions. Here, we pursue the idea that cognitive control can be cast as active inference over a hierarchy of time scales, where inference, i.e., planning, at higher levels of the hierarchy controls inference at lower levels. We introduce the novel concept of meta-control states, which link higher-level beliefs with lower-level policy inference. Specifically, we conceptualize cognitive control as inference over these meta-control states, where solutions to cognitive control dilemmas emerge through surprisal minimisation at different hierarchy levels. We illustrate this concept using the exploration-exploitation dilemma based on a variant of a restless multi-armed bandit task. We demonstrate that beliefs about contexts and meta-control states at a higher level dynamically modulate the balance of exploration and exploitation at the lower level of a single action. Finally, we discuss the generalisation of this meta-control concept to other control dilemmas. pubtype: Academic Journal doctype: Journal Article ougenre: Article language: English refInfo: holdings: @attributes: islocal: N |
|---|