Cortical recruitment determines learning dynamics and strategy

被引:10
作者
Ceballo, Sebastian [1 ]
Bourg, Jacques [1 ]
Kempf, Alexandre [1 ]
Piwkowska, Zuzanna [1 ,3 ]
Daret, Aurelie [1 ]
Pinson, Pierre [1 ]
Deneux, Thomas [1 ]
Rumpel, Simon [2 ]
Bathellier, Brice [1 ]
机构
[1] Univ Paris Sud, Paris Saclay Inst Neurosci NeuroPSI, Dept Integrat & Computat Neurosci ICN, UMR9197 CNRS, Bldg 32-33,1 Av Terrasse, F-91190 Gif Sur Yvette, France
[2] Johannes Gutenberg Univ Mainz, Univ Med Ctr, Focus Program Translat Neurosci, Inst Physiol, D-55099 Mainz, Germany
[3] Inst Pasteur, Dynam Neuronal Imaging Unit, F-75015 Paris, France
基金
欧洲研究理事会;
关键词
TIMING-DEPENDENT PLASTICITY; PRIMARY AUDITORY-CORTEX; NEURON; ATTENTION; DISCRIMINATION; CATEGORIZATION; REPRESENTATION; POPULATIONS; ASYMMETRIES; PERCEPTION;
D O I
10.1038/s41467-019-09450-0
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
Salience is a broad and widely used concept in neuroscience whose neuronal correlates, however, remain elusive. In behavioral conditioning, salience is used to explain various effects, such as stimulus overshadowing, and refers to how fast and strongly a stimulus can be associated with a conditioned event. Here, we identify sounds of equal intensity and perceptual detectability, which due to their spectro-temporal content recruit different levels of population activity in mouse auditory cortex. When using these sounds as cues in a Go/NoGo discrimination task, the degree of cortical recruitment matches the salience parameter of a reinforcement learning model used to analyze learning speed. We test an essential prediction of this model by training mice to discriminate light-sculpted optogenetic activity patterns in auditory cortex, and verify that cortical recruitment causally determines association or overshadowing of the stimulus components. This demonstrates that cortical recruitment underlies major aspects of stimulus salience during reinforcement learning.
引用
收藏
页数:12
相关论文
共 67 条
  • [1] Cooperative nonlinearities in auditory cortical neurons
    Atencio, Craig A.
    Sharpee, Tatyana O.
    Schreiner, Christoph E.
    [J]. NEURON, 2008, 58 (06) : 956 - 966
  • [2] A multiplicative reinforcement learning model capturing learning dynamics and interindividual variability in mice
    Bathellier, Brice
    Tee, Sui Poh
    Hrovat, Christina
    Rumpel, Simon
    [J]. PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2013, 110 (49) : 19950 - 19955
  • [3] Discrete Neocortical Dynamics Predict Behavioral Categorization of Sounds
    Bathellier, Brice
    Ushakova, Lyubov
    Rumpel, Simon
    [J]. NEURON, 2012, 76 (02) : 435 - 449
  • [4] THEORY FOR THE DEVELOPMENT OF NEURON SELECTIVITY - ORIENTATION SPECIFICITY AND BINOCULAR INTERACTION IN VISUAL-CORTEX
    BIENENSTOCK, EL
    COOPER, LN
    MUNRO, PW
    [J]. JOURNAL OF NEUROSCIENCE, 1982, 2 (01) : 32 - 48
  • [5] A componential view of configural cues in generalization and discrimination in Pavlovian conditioning
    Brandon, SE
    Vogel, EH
    Wagner, AR
    [J]. BEHAVIOURAL BRAIN RESEARCH, 2000, 110 (1-2) : 67 - 72
  • [6] Synchronous Oscillatory Neural Ensembles for Rules in the Prefrontal Cortex
    Buschman, Timothy J.
    Denovellis, Eric L.
    Diogo, Cinira
    Bullock, Daniel
    Miller, Earl K.
    [J]. NEURON, 2012, 76 (04) : 838 - 846
  • [7] Conditional modulation of spike-timing-dependent plasticity for olfactory learning
    Cassenaer, Stijn
    Laurent, Gilles
    [J]. NATURE, 2012, 482 (7383) : 47 - U62
  • [8] Neuron-type-specific signals for reward and punishment in the ventral tegmental area
    Cohen, Jeremiah Y.
    Haesler, Sebastian
    Vong, Linh
    Lowell, Bradford B.
    Uchida, Naoshige
    [J]. NATURE, 2012, 482 (7383) : 85 - U109
  • [9] Reward, motivation, and reinforcement learning
    Dayan, P
    Balleine, BW
    [J]. NEURON, 2002, 36 (02) : 285 - 298
  • [10] Dayan P., 2001, Theoretical Neuroscience: Computational and Mathematical Modeling of Neural Systems