Adaptive Regulation of Motor Variability

被引:54
作者
Dhawale, Ashesh K. [1 ,2 ]
Miyamoto, Yohsuke R. [2 ,3 ]
Smith, Maurice A. [2 ,3 ]
Olveczky, Bence P. [1 ,2 ]
机构
[1] Harvard Univ, Dept Organism & Evolutionary Biol, Cambridge, MA 02138 USA
[2] Harvard Univ, Ctr Brain Sci, Cambridge, MA 02138 USA
[3] Harvard Univ, John A Paulson Sch Engn & Appl Sci, Cambridge, MA 02138 USA
关键词
PREFRONTAL CORTEX; BASAL GANGLIA; BEHAVIORAL VARIABILITY; INDIVIDUAL-DIFFERENCES; SOCIAL-CONTEXT; EXPLORATION; NOISE; EXPLOITATION; MODULATION; PLASTICITY;
D O I
10.1016/j.cub.2019.08.052
中图分类号
Q5 [生物化学]; Q7 [分子生物学];
学科分类号
071010 ; 081704 ;
摘要
Trial-to-trial movement variability can both drive motor learning and interfere with expert performance, suggesting benefits of regulating it in context-specific ways. Here we address whether and how the brain regulates motor variability as a function of performance by training rats to execute ballistic forelimb movements for reward. Behavioral datasets comprisingmillions of trials revealed thatmotor variability is regulated by two distinct processes. A fast process modulates variability as a function of recent trial outcomes, increasing it when performance is poor and vice versa. A slower process tunes the gain of the fast process based on the uncertainty in the task's reward landscape. Simulations demonstrated that this regulation strategy optimizes reward accumulation over a wide range of time horizons, while also promoting learning. Our results uncover a sophisticated algorithm implemented by the brain to adaptively regulate motor variability to improve task performance.
引用
收藏
页码:3551 / +
页数:19
相关论文
共 61 条
[1]   The Basal Ganglia Is Necessary for Learning Spectral, but Not Temporal, Features of Birdsong [J].
Ali, Farhan ;
Otchy, Timothy M. ;
Pehlevan, Cengiz ;
Fantana, Antoniu L. ;
Burak, Yoram ;
Oelveczky, Bence P. .
NEURON, 2013, 80 (02) :494-506
[2]  
[Anonymous], 2009, CAUSALITY
[3]   An integrative theory of locus coeruleus-norepinephrine function: Adaptive gain and optimal performance [J].
Aston-Jones, G ;
Cohen, JD .
ANNUAL REVIEW OF NEUROSCIENCE, 2005, 28 :403-450
[4]   Rostrolateral Prefrontal Cortex and Individual Differences in Uncertainty-Driven Exploration [J].
Badre, David ;
Doll, Bradley B. ;
Long, Nicole M. ;
Frank, Michael J. .
NEURON, 2012, 73 (03) :595-607
[5]   Prefrontal cortex and decision making in a mixed-strategy game [J].
Barraclough, DJ ;
Conroy, ML ;
Lee, D .
NATURE NEUROSCIENCE, 2004, 7 (04) :404-410
[6]   Learning the value of information in an uncertain world [J].
Behrens, Timothy E. J. ;
Woolrich, Mark W. ;
Walton, Mark E. ;
Rushworth, Matthew F. S. .
NATURE NEUROSCIENCE, 2007, 10 (09) :1214-1221
[7]   Dopamine neuron systems in the brain:: an update [J].
Bjorklund, Anders ;
Dunnett, Stephen B. .
TRENDS IN NEUROSCIENCES, 2007, 30 (05) :194-202
[8]   VARIABILITY OF RESPONDING AS A MEASURE OF THE EFFECT OF FRUSTRATION [J].
BOROCZI, G ;
NAKAMURA, CY .
JOURNAL OF ABNORMAL AND SOCIAL PSYCHOLOGY, 1964, 68 (03) :342-345
[9]   What songbirds teach us about learning [J].
Brainard, MS ;
Doupe, AJ .
NATURE, 2002, 417 (6886) :351-358
[10]   Should I stay or should I go? How the human brain manages the trade-off between exploitation and exploration [J].
Cohen, Jonathan D. ;
McClure, Samuel M. ;
Yu, Angela J. .
PHILOSOPHICAL TRANSACTIONS OF THE ROYAL SOCIETY B-BIOLOGICAL SCIENCES, 2007, 362 (1481) :933-942