Dynamics systems vs. optimal control - a unifying view

被引:182
作者
Schaal, Stefan [1 ,2 ]
Mohajerian, Peyman [1 ]
Ijspeert, Auke [1 ,3 ]
机构
[1] Univ So Calif, Los Angeles, CA 90089 USA
[2] ATR Computat Neuroscience Lab, Kyoto 61902, Japan
[3] Ecole Polytech Fed Lausanne, Sch Comp & Commun Sci, CH-1015 Lausanne, Switzerland
来源
COMPUTATIONAL NEUROSCIENCE: THEORETICAL INSIGHTS INTO BRAIN FUNCTION | 2007年 / 165卷
基金
美国国家航空航天局; 美国国家科学基金会; 日本科学技术振兴机构;
关键词
discrete movement; rhythmic movement; movement primitives; dynamic systems; optimization; computational motor control;
D O I
10.1016/S0079-6123(06)65027-9
中图分类号
Q [生物科学];
学科分类号
07 ; 0710 ; 09 ;
摘要
In the past, computational motor control has been approached from at least two major frameworks: the dynamic systems approach and the viewpoint of optimal control. The dynamic system approach emphasizes motor control as a process of self-organization between an animal and its environment. Nonlinear differential equations that can model entrainment and synchronization behavior are among the most favorable tools of dynamic systems modelers. In contrast, optimal control approaches view motor control as the evolutionary or development result of a nervous system that tries to optimize rather general organizational principles, e.g., energy consumption or accurate task achievement. Optimal control theory is usually employed to develop appropriate theories. Interestingly, there is rather little interaction between dynamic systems and optimal control modelers as the two approaches follow rather different philosophies and are often viewed as diametrically opposing. In this paper, we develop a computational approach to motor control that offers a unifying modeling framework for both dynamic systems and optimal control approaches. In discussions of several behavioral experiments and some theoretical and robotics studies, we demonstrate how our computational ideas allow both the representation of self-organizing processes and the optimization of movement based on reward criteria. Our modeling framework is rather simple and general, and opens opportunities to revisit many previous modeling results from this novel unifying view.
引用
收藏
页码:425 / 445
页数:21
相关论文
共 81 条
  • [1] HUMAN ARM TRAJECTORY FORMATION
    ABEND, W
    BIZZI, E
    MORASSO, P
    [J]. BRAIN, 1982, 105 (JUN) : 331 - 348
  • [2] ABOAF EW, 1989, P IEEE INT C ROB AUT, P331
  • [3] ADAMOVICH SV, 1994, EXP BRAIN RES, V99, P325
  • [4] [Anonymous], 1986, INTRO ROBOTICS
  • [5] [Anonymous], 2019, Nonlinear Dynamics and Chaos: With Applications to Physics, Biology, Chemistry, and Engineering
  • [6] Atkeson CG, 1997, ARTIF INTELL REV, V11, P11, DOI 10.1023/A:1006559212014
  • [7] Barto AG, 2003, DISCRETE EVENT DYN S, V13, P343
  • [8] Bellman R., 1957, DYNAMIC PROGRAMMING
  • [9] Bertsekas D. P., 1996, Neuro Dynamic Programming, V1st
  • [10] Bishop CM., 1995, Neural networks for pattern recognition