Task-relevant and task-irrelevant variability causally shape error-based motor learning

被引:14
作者
Dal'Bello, Lucas Rebelo [1 ]
Izawa, Jun [2 ]
机构
[1] Univ Tsukuba, Sch Integrat & Global Majors, 3A201 Dai San Area,Tennodai 1-1-1, Tsukuba, Ibaraki 3058573, Japan
[2] Univ Tsukuba, Fac Engn Informat & Syst, Tennodai 1-1-1, Tsukuba, Ibaraki 3058573, Japan
关键词
Motor learning; Computational model; Exploration; Redundancy; Error-based learning; Motor variability; CROSS-VALIDATION; EXPLORATION; COORDINATION; ADAPTATION; REQUIRES; FEEDBACK;
D O I
10.1016/j.neunet.2021.07.015
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Recent studies of motor learning show dissociable roles of reward- and sensory-prediction errors in updating motor commands by using typical adaptation paradigms where force or visual perturbations are imposed on hand movements. Such classic adaptation paradigms ignore a problem of redundancy inherently embedded in the motor pathways where the central nervous system has to find a unique solution in the high-dimensional motor command space. Computationally, a possible way of solving such a redundancy problem is exploring and updating motor commands based on the learned knowledge of the structures of both the motor pathways and the tasks. However, the effects of task-irrelevant motor command exploration in structure learning and its effects on reward-based and error-based learning have yet to be examined. Here, we used a redundant motor task where participants manipulated a cursor on a monitor screen with their hand gesture movements and then analyzed single-trial motor learning by fitting models consisting of reward-based and error-based learning contributions. We found that the error-based learning rate positively correlated with both task-relevant and task-irrelevant variability, likely reflecting the effect of motor exploration in structure learning. Further modeling results show that the effects of both task-relevant and task-irrelevant variability are simultaneous, and not mediated by one another. In contrast, the reward-based learning rate correlated with neither task-relevant nor task-irrelevant variability. Thus, although not having a direct influence on the task outcome, exploration in the task-irrelevant space late in training has a significant effect on the learning of a task structure used for error-based learning. This suggests that motor exploration, in both task-relevant and task-irrelevant spaces, has an essential role in error-based motor learning in a redundant motor mechanism. (C) 2021 The Author(s). Published by Elsevier Ltd.
引用
收藏
页码:583 / 596
页数:14
相关论文
共 52 条
[21]   Task Errors Drive Memories That Improve Sensorimotor Adaptation [J].
Leow, Li-Ann ;
Marinovic, Welber ;
de Rugy, Aymar ;
Carroll, Timothy J. .
JOURNAL OF NEUROSCIENCE, 2020, 40 (15) :3075-3088
[22]   Contributions of online visual feedback to the learning and generalization of novel finger coordination patterns [J].
Liu, Xiaolin ;
Scheidt, Robert A. .
JOURNAL OF NEUROPHYSIOLOGY, 2008, 99 (05) :2546-2557
[23]   Principles of Neurorehabilitation After Stroke Based on Motor Learning and Brain Plasticity Mechanisms [J].
Maier, Martina ;
Rubio Ballester, Belen ;
Verschure, Paul F. M. J. .
FRONTIERS IN SYSTEMS NEUROSCIENCE, 2019, 13
[24]  
Mardia K.V., 2000, Directional Statistics
[25]   Dynamic coordination of body parts during prism adaptation [J].
Martin, TA ;
Norris, SA ;
Greger, BE ;
Thach, WT .
JOURNAL OF NEUROPHYSIOLOGY, 2002, 88 (04) :1685-1694
[26]  
McElreath R, 2016, TEXT STAT SCI, pXI
[27]   A Tutorial in Bayesian Potential Outcomes Mediation Analysis [J].
Miocevic, Milica ;
Gonzalez, Oscar ;
Valente, Matthew J. ;
MacKinnon, David P. .
STRUCTURAL EQUATION MODELING-A MULTIDISCIPLINARY JOURNAL, 2018, 25 (01) :121-136
[28]   Motor Learning: Changes in the Structure of Variability in a Redundant Task [J].
Mueller, Hermann ;
Sternad, Dagmar .
PROGRESS IN MOTOR CONTROL: A MULTIDISCIPLINARY PERSPECTIVE, 2009, 629 :439-456
[29]   Plasticity during stroke recovery: from synapse to behaviour [J].
Murphy, Timothy H. ;
Corbett, Dale .
NATURE REVIEWS NEUROSCIENCE, 2009, 10 (12) :861-872
[30]   Vocal experimentation in the juvenile songbird requires a basal ganglia circuit [J].
Ölveczky, BP ;
Andalman, AS ;
Fee, MS .
PLOS BIOLOGY, 2005, 3 (05) :902-909