Online Inverse Optimal Control for Time-Varying Cost Weights

被引:0
作者
Cao, Sheng [1 ]
Luo, Zhiwei [1 ]
Quan, Changqin [1 ]
机构
[1] Kobe Univ, Grad Sch Syst Informat, 1-1 Rokkodai Cho,Nada Ku, Kobe 6578501, Japan
关键词
inverse optimal control; online calculation; time-varying cost weights; robust to noises;
D O I
10.3390/biomimetics9020084
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
Inverse optimal control is a method for recovering the cost function used in an optimal control problem in expert demonstrations. Most studies on inverse optimal control have focused on building the unknown cost function through the linear combination of given features with unknown cost weights, which are generally considered to be constant. However, in many real-world applications, the cost weights may vary over time. In this study, we propose an adaptive online inverse optimal control approach based on a neural-network approximation to address the challenge of recovering time-varying cost weights. We conduct a well-posedness analysis of the problem and suggest a condition for the adaptive goal, under which the weights of the neural network generated to achieve this adaptive goal are unique to the corresponding inverse optimal control problem. Furthermore, we propose an updating law for the weights of the neural network to ensure the stability of the convergence of the solutions. Finally, simulation results for an example linear system are presented to demonstrate the effectiveness of the proposed strategy. The proposed method is applicable to a wide range of problems requiring real-time inverse optimal control calculations.
引用
收藏
页数:18
相关论文
共 28 条
  • [1] From inverse optimal control to inverse reinforcement learning: A historical review
    Ab Azar, Nematollah
    Shahmansoorian, Aref
    Davoudi, Mohsen
    [J]. ANNUAL REVIEWS IN CONTROL, 2020, 50 : 119 - 138
  • [2] Abbeel P., 2004, INT C MACHINE LEARNI
  • [3] Athans M., 2007, OPTIMAL CONTROL INTR
  • [4] Evidence for Composite Cost Functions in Arm Movement Planning: An Inverse Optimal Control Approach
    Berret, Bastien
    Chiovetto, Enrico
    Nori, Francesco
    Pozzo, Thierry
    [J]. PLOS COMPUTATIONAL BIOLOGY, 2011, 7 (10)
  • [5] Boyd S., 1994, Linear matrix inequalities in system and control theory, DOI DOI 10.1137/1.9781611970777
  • [6] Cao S., 2024, IEEE/CAA J. Autom. Sin, V11, P1
  • [7] Inverse Optimization: Theory and Applications
    Chan, Timothy C. Y.
    Mahmood, Rafid
    Zhu, Ian Yihang
    [J]. OPERATIONS RESEARCH, 2025, 73 (02) : 1046 - 1074
  • [8] Adaptive learning of human motor behaviors: An evolving inverse optimal control approach
    El-Hussieny, Haitham
    Abouelsoud, A. A.
    Assal, Samy F. M.
    Megahed, Said M.
    [J]. ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2016, 50 : 115 - 124
  • [9] Inverse optimality in robust stabilization
    Freeman, RA
    Kokotovic, PV
    [J]. SIAM JOURNAL ON CONTROL AND OPTIMIZATION, 1996, 34 (04) : 1365 - 1391
  • [10] Control of Mammalian Locomotion by Somatosensory Feedback
    Frigon, Alain
    Akay, Turgay
    Prilutsky, Boris I.
    [J]. COMPREHENSIVE PHYSIOLOGY, 2022, 12 (01) : 2877 - 2947