Learning from Sensory and Reward Prediction Errors during Motor Adaptation

被引:310
作者
Izawa, Jun [1 ,2 ]
Shadmehr, Reza [1 ]
机构
[1] Johns Hopkins Sch Med, Dept Biomed Engn, Baltimore, MD USA
[2] Univ Electrocommun, Dept Human Media Syst, Tokyo, Japan
基金
美国国家卫生研究院;
关键词
SIGNAL-DEPENDENT NOISE; BASAL GANGLIA; INTERNAL-MODELS; MOVEMENT VARIABILITY; HUNTINGTONS-DISEASE; PARKINSONS-DISEASE; NEURAL MECHANISMS; DECISION-MAKING; CEREBELLUM; MEMORY;
D O I
10.1371/journal.pcbi.1002012
中图分类号
Q5 [生物化学];
学科分类号
071010 ; 081704 ;
摘要
Voluntary motor commands produce two kinds of consequences. Initially, a sensory consequence is observed in terms of activity in our primary sensory organs ( e. g., vision, proprioception). Subsequently, the brain evaluates the sensory feedback and produces a subjective measure of utility or usefulness of the motor commands ( e. g., reward). As a result, comparisons between predicted and observed consequences of motor commands produce two forms of prediction error. How do these errors contribute to changes in motor commands? Here, we considered a reach adaptation protocol and found that when high quality sensory feedback was available, adaptation of motor commands was driven almost exclusively by sensory prediction errors. This form of learning had a distinct signature: as motor commands adapted, the subjects altered their predictions regarding sensory consequences of motor commands, and generalized this learning broadly to neighboring motor commands. In contrast, as the quality of the sensory feedback degraded, adaptation of motor commands became more dependent on reward prediction errors. Reward prediction errors produced comparable changes in the motor commands, but produced no change in the predicted sensory consequences of motor commands, and generalized only locally. Because we found that there was a within subject correlation between generalization patterns and sensory remapping, it is plausible that during adaptation an individual's relative reliance on sensory vs. reward prediction errors could be inferred. We suggest that while motor commands change because of sensory and reward prediction errors, only sensory prediction errors produce a change in the neural system that predicts sensory consequences of motor commands.
引用
收藏
页数:11
相关论文
共 51 条
  • [1] Agostino R, 1996, J NEUROL SCI, V139, P218
  • [2] Baddeley RJ, 2003, J NEUROSCI, V23, P3066
  • [3] Activity of striatal neurons reflects dynamic encoding and recoding of procedural memories
    Barnes, TD
    Kubota, Y
    Hu, D
    Jin, DZZ
    Graybiel, AM
    [J]. NATURE, 2005, 437 (7062) : 1158 - 1161
  • [4] Keeping perception accurate
    Bedford, FL
    [J]. TRENDS IN COGNITIVE SCIENCES, 1999, 3 (01) : 4 - 11
  • [5] Estimating the sources of motor errors for adaptation and generalization
    Berniker, Max
    Kording, Konrad
    [J]. NATURE NEUROSCIENCE, 2008, 11 (12) : 1454 - 1461
  • [6] The statistical determinants of adaptation rate in human reaching
    Burge, Johannes
    Ernst, Marc O.
    Banks, Martin S.
    [J]. JOURNAL OF VISION, 2008, 8 (04):
  • [7] A central source of movement variability
    Churchland, Mark M.
    Afshar, Afsheen
    Shenoy, Krishna V.
    [J]. NEURON, 2006, 52 (06) : 1085 - 1096
  • [8] Size of Error Affects Cerebellar Contributions to Motor Learning
    Criscimagna-Hemminger, Sarah E.
    Bastian, Amy J.
    Shadmehr, Reza
    [J]. JOURNAL OF NEUROPHYSIOLOGY, 2010, 103 (04) : 2275 - 2284
  • [9] MOTIVATIONAL CONTROL OF GOAL-DIRECTED ACTION
    DICKINSON, A
    BALLEINE, B
    [J]. ANIMAL LEARNING & BEHAVIOR, 1994, 22 (01): : 1 - 18
  • [10] Complementary roles of basal ganglia and cerebellum in learning and motor control
    Doya, K
    [J]. CURRENT OPINION IN NEUROBIOLOGY, 2000, 10 (06) : 732 - 739