Covert skill learning in a cortical-basal ganglia circuit

被引:79
作者
Charlesworth, Jonathan D. [1 ,2 ]
Warren, Timothy L. [1 ,2 ]
Brainard, Michael S. [1 ,2 ]
机构
[1] Univ Calif San Francisco, WM Keck Ctr Integrat Neurosci, Dept Physiol, San Francisco, CA 94143 USA
[2] Univ Calif San Francisco, Neurosci Grad Program, San Francisco, CA 94143 USA
基金
美国国家卫生研究院; 美国国家科学基金会;
关键词
FOREBRAIN CIRCUIT; BIRDSONG; MODEL; VARIABILITY; PERFORMANCE; MECHANISMS; REWARD; SIGNAL; SONG;
D O I
10.1038/nature11078
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
We learn complex skills such as speech and dance through a gradual process of trial and error. Cortical-basal ganglia circuits have an important yet unresolved function in this trial-and-error skill learning(1); influential 'actor-critic' models propose that basal ganglia circuits generate a variety of behaviours during training and learn to implement the successful behaviours in their repertoire(2,3). Here we show that the anterior forebrain pathway (AFP), a cortical-basal ganglia circuit(4), contributes to skill learning even when it does not contribute to such 'exploratory' variation in behavioural performance during training. Blocking the output of the AFP while training Bengalese finches to modify their songs prevented the gradual improvement that normally occurs in this complex skill during training. However, unblocking the output of the AFP after training caused an immediate transition from naive performance to excellent performance, indicating that the AFP covertly gained the ability to implement learned skill performance without contributing to skill practice. In contrast, inactivating the output nucleus of the AFP during training completely prevented learning, indicating that learning requires activity within the AFP during training. Our results suggest a revised model of skill learning: basal ganglia circuits can monitor the consequences of behavioural variation produced by other brain regions and then direct those brain regions to implement more successful behaviours. The ability of the AFP to identify successful performances generated by other brain regions indicates that basal ganglia circuits receive a detailed efference copy of premotor activity in those regions. The capacity of the AFP to implement successful performances that were initially produced by other brain regions indicates precise functional connections between basal ganglia circuits and the motor regions that directly control performance.
引用
收藏
页码:251 / +
页数:6
相关论文
共 28 条
[1]   A basal ganglia-forebrain circuit in the songbird biases motor output to avoid vocal errors [J].
Andalman, Aaron S. ;
Fee, Michale S. .
PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2009, 106 (30) :12518-12523
[2]   Separate neural substrates for skill learning and performance in the ventral and dorsal striatum [J].
Atallah, Hisham E. ;
Lopez-Paniagua, Dan ;
Rudy, Jerry W. ;
O'Reilly, Randall C. .
NATURE NEUROSCIENCE, 2007, 10 (01) :126-131
[3]   Still at the choice-point - Action selection and initiation in instrumental conditioning [J].
Balleine, Bernard W. ;
Ostlund, Sean B. .
REWARD AND DECISION MAKING IN CORTICOBASAL GANGLIA NETWORKS, 2007, 1104 :147-171
[4]   Learning the microstructure of successful behavior [J].
Charlesworth, Jonathan D. ;
Tumer, Evren C. ;
Warren, Timothy L. ;
Brainard, Michael S. .
NATURE NEUROSCIENCE, 2011, 14 (03) :373-380
[5]   Corollary discharge across the animal kingdom [J].
Crapse, Trinity B. ;
Sommer, Marc A. .
NATURE REVIEWS NEUROSCIENCE, 2008, 9 (08) :587-600
[6]  
Doya Kenji, 2000, P469
[7]   A HYPOTHESIS FOR BASAL GANGLIA-DEPENDENT REINFORCEMENT LEARNING IN THE SONGBIRD [J].
Fee, M. S. ;
Goldberg, J. H. .
NEUROSCIENCE, 2011, 198 :152-170
[8]   Model of birdsong learning based on gradient estimation by dynamic perturbation of neural conductances [J].
Fiete, Ila R. ;
Fee, Michale S. ;
Seung, H. Sebastian .
JOURNAL OF NEUROPHYSIOLOGY, 2007, 98 (04) :2038-2057
[9]   Computational models of motivated action selection in corticostriatal circuits [J].
Frank, Michael J. .
CURRENT OPINION IN NEUROBIOLOGY, 2011, 21 (03) :381-386
[10]   A cortical motor nucleus drives the basal ganglia-recipient thalamus in singing birds [J].
Goldberg, Jesse H. ;
Fee, Michale S. .
NATURE NEUROSCIENCE, 2012, 15 (04) :620-627