Value signals guide abstraction during learning

被引:16
作者
Cortese, Aurelio [1 ,2 ]
Yamamoto, Asuka [1 ,3 ]
Hashemzadeh, Maryam [4 ]
Sepulveda, Pradyumna [2 ]
Kawato, Mitsuo [1 ,5 ]
De Martino, Benedetto [2 ]
机构
[1] ATR Inst Int, Computat Neurosci Labs, Kyoto, Japan
[2] UCL, Inst Cognit Neurosci, London, England
[3] Nara Inst Sci & Technol, Sch Informat Sci, Nara, Japan
[4] Univ Alberta, Dept Comp Sci, Edmonton, AB, Canada
[5] RIKEN, Ctr Artificial Intelligence Project, Kyoto, Japan
基金
英国惠康基金;
关键词
DECODED FMRI NEUROFEEDBACK; ORBITOFRONTAL CORTEX; CONCEPTUAL KNOWLEDGE; COGNITIVE MAP; MECHANISMS; ATTENTION; REPRESENTATIONS; ARCHITECTURE; HIPPOCAMPUS; INTEGRATION;
D O I
10.7554/eLife.68943
中图分类号
Q [生物科学];
学科分类号
07 ; 0710 ; 09 ;
摘要
The human brain excels at constructing and using abstractions, such as rules, or concepts. Here, in two fMRI experiments, we demonstrate a mechanism of abstraction built upon the valuation of sensory features. Human volunteers learned novel association rules based on simple visual features. Reinforcement-learning algorithms revealed that, with learning, high-value abstract representations increasingly guided participant behaviour, resulting in better choices and higher subjective confidence. We also found that the brain area computing value signals - the ventromedial prefrontal cortex - prioritised and selected latent task elements during abstraction, both locally and through its connection to the visual cortex. Such a coding scheme predicts a causal role for valuation. Hence, in a second experiment, we used multivoxel neural reinforcement to test for the causality of feature valuation in the sensory cortex, as a mechanism of abstraction. Tagging the neural representation of a task feature with rewards evoked abstraction-based decisions. Together, these findings provide a novel interpretation of value as a goal-dependent, key factor in forging abstract representations.
引用
收藏
页数:27
相关论文
共 88 条
[1]   Neural Mechanisms of Credit Assignment in a Multicue Environment [J].
Akaishi, Rei ;
Kolling, Nils ;
Brown, Joshua W. ;
Rushworth, Matthew .
JOURNAL OF NEUROSCIENCE, 2016, 36 (04) :1096-1112
[2]   FUNCTIONAL ARCHITECTURE OF BASAL GANGLIA CIRCUITS - NEURAL SUBSTRATES OF PARALLEL PROCESSING [J].
ALEXANDER, GE ;
CRUTCHER, MD .
TRENDS IN NEUROSCIENCES, 1990, 13 (07) :266-271
[3]   Value-driven attentional capture [J].
Anderson, Brian A. ;
Laurent, Patryk A. ;
Yantis, Steven .
PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2011, 108 (25) :10367-10371
[4]   Mechanisms of Hierarchical Reinforcement Learning in Cortico-Striatal Circuits 2: Evidence from fMRI [J].
Badre, David ;
Frank, Michael J. .
CEREBRAL CORTEX, 2012, 22 (03) :527-536
[5]   Value-guided remapping of sensory cortex by lateral orbitofrontal cortex [J].
Banerjee, Abhishek ;
Parente, Giuseppe ;
Teutsch, Jasper ;
Lewis, Christopher ;
Voigt, Fabian F. ;
Helmchen, Fritjof .
NATURE, 2020, 585 (7824) :245-+
[6]   Direct Recordings from Human Anterior Insula Reveal its Leading Role within the Error-Monitoring Network [J].
Bastin, Julien ;
Deman, Pierre ;
David, Olivier ;
Gueguen, Maelle ;
Benis, Damien ;
Minotti, Lorella ;
Hoffman, Dominique ;
Combrisson, Etienne ;
Kujala, Jan ;
Perrone-Bertolotti, Marcela ;
Kahane, Philippe ;
Lachaux, Jean-Philippe ;
Jerbi, Karim .
CEREBRAL CORTEX, 2017, 27 (02) :1545-1557
[7]  
Bellman R.E., 1957, DYNAMIC PROGRAMMING
[8]   The Representation of Abstract Task Rules in the Human Prefrontal Cortex [J].
Bengtsson, Sara L. ;
Haynes, John-Dylan ;
Sakai, Katsuyuki ;
Buckley, Mark J. ;
Passingham, Richard E. .
CEREBRAL CORTEX, 2009, 19 (08) :1929-1936
[9]   Ventromedial prefrontal cortex supports affective future simulation by integrating distributed knowledge [J].
Benoit, Roland G. ;
Szpunar, Karl K. ;
Schacter, Daniel L. .
PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2014, 111 (46) :16550-16555
[10]   The Geometry of Abstraction in the Hippocampus and Prefrontal Cortex [J].
Bernardi, Silvia ;
Benna, Marcus K. ;
Rigotti, Mattia ;
Munuera, Jerome ;
Fusi, Stefano ;
Salzman, C. Daniel .
CELL, 2020, 183 (04) :954-+