Learning Stable Models for Prediction and Control

被引:11
|
作者
Mamakoukas, Giorgos [1 ,2 ]
Abraham, Ian [1 ,3 ]
Murphey, Todd D. [1 ]
机构
[1] Northwestern Univ, Dept Mech Engn, Evanston, IL 60208 USA
[2] Machine Learning & Controls Mot, Boston, MA USA
[3] Yale Univ, Mech Engn, New Haven, CT USA
基金
美国国家科学基金会;
关键词
Stability analysis; Nonlinear dynamical systems; Numerical stability; Mathematical models; Analytical models; Robots; Predictive models; Control Lyapunov functions; data-driven control; Koopman operator; stability; KOOPMAN OPERATOR; SPECTRAL PROPERTIES; STABILITY; SYSTEMS; IDENTIFICATION; ROBOT; DECOMPOSITION; BOUNDS;
D O I
10.1109/TRO.2022.3228130
中图分类号
TP24 [机器人技术];
学科分类号
080202 ; 1405 ;
摘要
In this article, we demonstrate the benefits of imposing stability on data-driven Koopman operators. The data-driven identification of stable Koopman operators (DISKO) is implemented using an algorithm [1] that computes the nearest stable matrix solution to a least-squares reconstruction error. As a first result, we derive a formula that describes the prediction error of Koopman representations for an arbitrary number of time steps, and which shows that stability constraints can improve the predictive accuracy over long horizons. As a second result, we determine formal conditions on basis functions of Koopman operators needed to satisfy the stability properties of an underlying nonlinear system. As a third result, we derive formal conditions for constructing Lyapunov functions for nonlinear systems out of stable data-driven Koopman operators, which we use to verify stabilizing control from data. Finally, we demonstrate the benefits of DISKO in prediction and control with simulations using a pendulum and a quadrotor and experiments with a pusher-slider system. The paper is complemented with a video: https://sites.google.com/view/learning-stable-koopman.
引用
收藏
页码:2255 / 2275
页数:21
相关论文
共 50 条
  • [1] Koopman operator dynamical models: Learning, analysis and control
    Bevanda, Petar
    Sosnowski, Stefan
    Hirche, Sandra
    ANNUAL REVIEWS IN CONTROL, 2021, 52 : 197 - 212
  • [2] Graph Neural Network and Koopman Models for Learning Networked Dynamics: A Comparative Study on Power Grid Transients Prediction
    Nandanoori, Sai Pushpak
    Guan, Sheng
    Kundu, Soumya
    Pal, Seemita
    Agarwal, Khushbu
    Wu, Yinghui
    Choudhury, Sutanay
    IEEE ACCESS, 2022, 10 : 32337 - 32349
  • [3] EVOLVER: Online Learning and Prediction of Disturbances for Robot Control
    Jia, Jindou
    Zhang, Wenyu
    Guo, Kexin
    Wang, Jianliang
    Yu, Xiang
    Shi, Yang
    Guo, Lei
    IEEE TRANSACTIONS ON ROBOTICS, 2024, 40 : 382 - 402
  • [4] Learning Control Affine Neural NARX Models for Internal Model Control Design
    Xie, Jing
    Bonassi, Fabio
    Scattolini, Riccardo
    IEEE TRANSACTIONS ON AUTOMATION SCIENCE AND ENGINEERING, 2024, : 8137 - 8149
  • [5] Learning Stable Gaussian Process State Space Models
    Umlauft, Jonas
    Lederer, Armin
    Hirche, Sandra
    2017 AMERICAN CONTROL CONFERENCE (ACC), 2017, : 1499 - 1504
  • [6] Stabilizing reinforcement learning control: A modular framework for optimizing over all stable behavior
    Lawrence, Nathan P.
    Loewen, Philip D.
    Wang, Shuyuan
    Forbes, Michael G.
    Gopaluni, R. Bhushan
    AUTOMATICA, 2024, 164
  • [7] Learning Parametric Koopman Decompositions for Prediction and Control
    Guo, Yue
    Korda, Milan
    Kevrekidis, Ioannis G.
    Li, Qianxiao
    SIAM JOURNAL ON APPLIED DYNAMICAL SYSTEMS, 2025, 24 (01): : 744 - 781
  • [8] Optimal Construction of Koopman Eigenfunctions for Prediction and Control
    Korda, Milan
    Mezic, Igor
    IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2020, 65 (12) : 5114 - 5129
  • [9] Learning stochastically stable Gaussian process state-space models
    Umlauft, Jonas
    Hirche, Sandra
    IFAC JOURNAL OF SYSTEMS AND CONTROL, 2020, 12
  • [10] Provably Stable Learning Control of Linear Dynamics With Multiplicative Noise
    Coppens, Peter
    Patrinos, Panagiotis
    IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2024, 69 (08) : 5049 - 5064