Task-relevant and task-irrelevant variability causally shape error-based motor learning

被引:14
作者
Dal'Bello, Lucas Rebelo [1 ]
Izawa, Jun [2 ]
机构
[1] Univ Tsukuba, Sch Integrat & Global Majors, 3A201 Dai San Area,Tennodai 1-1-1, Tsukuba, Ibaraki 3058573, Japan
[2] Univ Tsukuba, Fac Engn Informat & Syst, Tennodai 1-1-1, Tsukuba, Ibaraki 3058573, Japan
关键词
Motor learning; Computational model; Exploration; Redundancy; Error-based learning; Motor variability; CROSS-VALIDATION; EXPLORATION; COORDINATION; ADAPTATION; REQUIRES; FEEDBACK;
D O I
10.1016/j.neunet.2021.07.015
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Recent studies of motor learning show dissociable roles of reward- and sensory-prediction errors in updating motor commands by using typical adaptation paradigms where force or visual perturbations are imposed on hand movements. Such classic adaptation paradigms ignore a problem of redundancy inherently embedded in the motor pathways where the central nervous system has to find a unique solution in the high-dimensional motor command space. Computationally, a possible way of solving such a redundancy problem is exploring and updating motor commands based on the learned knowledge of the structures of both the motor pathways and the tasks. However, the effects of task-irrelevant motor command exploration in structure learning and its effects on reward-based and error-based learning have yet to be examined. Here, we used a redundant motor task where participants manipulated a cursor on a monitor screen with their hand gesture movements and then analyzed single-trial motor learning by fitting models consisting of reward-based and error-based learning contributions. We found that the error-based learning rate positively correlated with both task-relevant and task-irrelevant variability, likely reflecting the effect of motor exploration in structure learning. Further modeling results show that the effects of both task-relevant and task-irrelevant variability are simultaneous, and not mediated by one another. In contrast, the reward-based learning rate correlated with neither task-relevant nor task-irrelevant variability. Thus, although not having a direct influence on the task outcome, exploration in the task-irrelevant space late in training has a significant effect on the learning of a task structure used for error-based learning. This suggests that motor exploration, in both task-relevant and task-irrelevant spaces, has an essential role in error-based motor learning in a redundant motor mechanism. (C) 2021 The Author(s). Published by Elsevier Ltd.
引用
收藏
页码:583 / 596
页数:14
相关论文
共 52 条
[1]   Sensitivity derivatives for flexible sensorimotor learning [J].
Abdelghani, M. N. ;
Lillicrap, T. P. ;
Tweed, D. B. .
NEURAL COMPUTATION, 2008, 20 (08) :2085-2111
[2]   An introduction to MCMC for machine learning [J].
Andrieu, C ;
de Freitas, N ;
Doucet, A ;
Jordan, MI .
MACHINE LEARNING, 2003, 50 (1-2) :5-43
[3]   Differences in Adaptation Rates after Virtual Surgeries Provide Direct Evidence for Modularity [J].
Berger, Denise J. ;
Gentner, Reinhard ;
Edmunds, Timothy ;
Pai, Dinesh K. ;
d'Avella, Andrea .
JOURNAL OF NEUROSCIENCE, 2013, 33 (30) :12384-12394
[4]  
Bernshtein N. A., 1967, The co-ordination and regulation of movements
[5]   The neural origin of muscle synergies [J].
Bizzi, Emilio ;
Cheung, Vincent C. K. .
FRONTIERS IN COMPUTATIONAL NEUROSCIENCE, 2013, 7 :1-6
[6]   Structure learning in action [J].
Braun, Daniel A. ;
Mehring, Carsten ;
Wolpert, Daniel M. .
BEHAVIOURAL BRAIN RESEARCH, 2010, 206 (02) :157-165
[7]   Plasticity of muscle synergies through fractionation and merging during development and training of human runners [J].
Cheung, Vincent C. K. ;
Cheung, Ben M. F. ;
Zhang, Janet H. ;
Chan, Zoe Y. S. ;
Ha, Sophia C. W. ;
Chen, Chao-Ying ;
Cheung, Roy T. H. .
NATURE COMMUNICATIONS, 2020, 11 (01)
[8]   The Role of Variability in Motor Learning [J].
Dhawale, Ashesh K. ;
Smith, Maurice A. ;
Olveczky, Bence P. .
ANNUAL REVIEW OF NEUROSCIENCE, VOL 40, 2017, 40 :479-498
[9]   Volitional control of neural activity: implications for brain-computer interfaces [J].
Fetz, Eberhard E. .
JOURNAL OF PHYSIOLOGY-LONDON, 2007, 579 (03) :571-579
[10]  
Gabry Jonah, 2024, CRAN