Online Constraint Tightening in Stochastic Model Predictive Control: A Regression Approach

被引:0
|
作者
Capone, Alexandre [1 ]
Brudigam, Tim [2 ]
Hirche, Sandra [3 ]
机构
[1] Carnegie Mellon Univ, Robot Inst, Pittsburgh, PA 15213 USA
[2] Tech Univ Munich, Chair Automat Control Engn, D-80333 Munich, Germany
[3] Tech Univ Munich, Sch Computat Informat & Technol, D-80333 Munich, Germany
基金
欧洲研究理事会;
关键词
Stochastic processes; Uncertainty; Symbols; Optimal control; Costs; Computational modeling; Closed loop systems; Autonomous systems; data-driven control; Gaussian processes (GPs); machine learning; online learning; optimal control; reinforcement learning; statistical learning; stochastic processes; uncertain systems; CONVERGENCE; STABILITY; ROBUST; RATES;
D O I
10.1109/TAC.2024.3433988
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Solving chance-constrained stochastic optimal control problems is a significant challenge in control. This is because no analytical solutions exist for up to a handful of special cases. A common and computationally efficient approach for tackling chance-constrained stochastic optimal control problems consists of a deterministic reformulation, where hard constraints with an additional constraint-tightening parameter are imposed on a nominal prediction that ignores stochastic disturbances. However, in such approaches, the choice of constraint-tightening parameter remains challenging, and guarantees can mostly be obtained assuming that the process noise distribution is known a priori. Moreover, the chance constraints are often not tightly satisfied, leading to unnecessarily high costs. This work proposes a data-driven approach for learning the constraint-tightening parameters online during control. To this end, we reformulate the choice of constraint-tightening parameter for the closed loop as a binary regression problem. We then leverage a highly expressive Gaussian process, model for binary regression to approximate the smallest constraint-tightening parameters that satisfy the chance constraints. By tuning the algorithm parameters appropriately, we show that the resulting constraint-tightening parameters satisfy the chance constraints up to an arbitrarily small margin with high probability. Our approach yields constraint-tightening parameters that tightly satisfy the chance constraints in numerical experiments, resulting in a lower average cost than three other state-of-the-art approaches.
引用
收藏
页码:736 / 750
页数:15
相关论文
共 50 条
  • [21] Robust nonlinear model predictive control for automatic train operation based on constraint tightening strategy
    Jia, Chao
    Xu, Hongze
    Wang, Longsheng
    ASIAN JOURNAL OF CONTROL, 2022, 24 (01) : 83 - 97
  • [22] An Online Learning Approach to Model Predictive Control
    Wagener, Nolan
    Cheng, Ching-An
    Sacks, Jacob
    Boots, Byron
    ROBOTICS: SCIENCE AND SYSTEMS XV, 2019,
  • [23] A Robust Model Predictive Control with Constraints Tightening Approach for Train Trajectory Tracking Control
    Wang, Long-Sheng
    Xu, Hong-Ze
    INTERNATIONAL CONFERENCE ON CONTROL ENGINEERING AND AUTOMATION (ICCEA 2014), 2014, : 429 - 435
  • [24] Stochastic Model Predictive Control: Controlling the Average Number of Constraint Violations
    Korda, Milan
    Gondhalekar, Ravi
    Oldewurtel, Frauke
    Jones, Colin N.
    2012 IEEE 51ST ANNUAL CONFERENCE ON DECISION AND CONTROL (CDC), 2012, : 4529 - 4536
  • [25] Wind turbine control with constraint handling: a model predictive control approach
    Henriksen, L. C.
    Hansen, M. H.
    Poulsen, N. K.
    IET CONTROL THEORY AND APPLICATIONS, 2012, 6 (11): : 1722 - 1734
  • [26] Nonquadratic stochastic model predictive control: A tractable approach
    Korda, Milan
    Cigler, Jiri
    AUTOMATICA, 2012, 48 (09) : 2352 - 2358
  • [27] Online learning stochastic model predictive control of linear uncertain systems
    Li, Fei
    Li, Huiping
    Li, Shaoyuan
    He, Yuyao
    INTERNATIONAL JOURNAL OF ROBUST AND NONLINEAR CONTROL, 2022, 32 (17) : 9275 - 9293
  • [28] ROBUST OUTPUT FEEDBACK MODEL PREDICTIVE CONTROL: A STOCHASTIC APPROACH
    Mohammadkhani, Mohammadali
    Bayat, Farhad
    Jalali, Ali Akbar
    ASIAN JOURNAL OF CONTROL, 2017, 19 (06) : 2085 - 2096
  • [29] Adaptively Constrained Stochastic Model Predictive Control for Closed-Loop Constraint Satisfaction
    Oldewurtel, Frauke
    Sturzenegger, David
    Esfahani, Peyman Mohajerin
    Andersson, Goeran
    Morari, Manfred
    Lygeros, John
    2013 AMERICAN CONTROL CONFERENCE (ACC), 2013, : 4674 - 4681
  • [30] Constraints Tightening Approach Towards Model Predictive Control Based Rendezvous and Docking with Uncooperative Targets
    Iskender, O. B.
    Ling, K., V
    Dubanchet, V
    2018 EUROPEAN CONTROL CONFERENCE (ECC), 2018, : 381 - 386