Online Constraint Tightening in Stochastic Model Predictive Control: A Regression Approach

被引:0
|
作者
Capone, Alexandre [1 ]
Brudigam, Tim [2 ]
Hirche, Sandra [3 ]
机构
[1] Carnegie Mellon Univ, Robot Inst, Pittsburgh, PA 15213 USA
[2] Tech Univ Munich, Chair Automat Control Engn, D-80333 Munich, Germany
[3] Tech Univ Munich, Sch Computat Informat & Technol, D-80333 Munich, Germany
基金
欧洲研究理事会;
关键词
Stochastic processes; Uncertainty; Symbols; Optimal control; Costs; Computational modeling; Closed loop systems; Autonomous systems; data-driven control; Gaussian processes (GPs); machine learning; online learning; optimal control; reinforcement learning; statistical learning; stochastic processes; uncertain systems; CONVERGENCE; STABILITY; ROBUST; RATES;
D O I
10.1109/TAC.2024.3433988
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Solving chance-constrained stochastic optimal control problems is a significant challenge in control. This is because no analytical solutions exist for up to a handful of special cases. A common and computationally efficient approach for tackling chance-constrained stochastic optimal control problems consists of a deterministic reformulation, where hard constraints with an additional constraint-tightening parameter are imposed on a nominal prediction that ignores stochastic disturbances. However, in such approaches, the choice of constraint-tightening parameter remains challenging, and guarantees can mostly be obtained assuming that the process noise distribution is known a priori. Moreover, the chance constraints are often not tightly satisfied, leading to unnecessarily high costs. This work proposes a data-driven approach for learning the constraint-tightening parameters online during control. To this end, we reformulate the choice of constraint-tightening parameter for the closed loop as a binary regression problem. We then leverage a highly expressive Gaussian process, model for binary regression to approximate the smallest constraint-tightening parameters that satisfy the chance constraints. By tuning the algorithm parameters appropriately, we show that the resulting constraint-tightening parameters satisfy the chance constraints up to an arbitrarily small margin with high probability. Our approach yields constraint-tightening parameters that tightly satisfy the chance constraints in numerical experiments, resulting in a lower average cost than three other state-of-the-art approaches.
引用
收藏
页码:736 / 750
页数:15
相关论文
共 50 条
  • [1] Constraint-Tightening and Stability in Stochastic Model Predictive Control
    Lorenzen, Matthias
    Dabbene, Fabrizio
    Tempo, Roberto
    Allgoewer, Frank
    IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2017, 62 (07) : 3165 - 3177
  • [2] A Constraint-Tightening Approach to Nonlinear Model Predictive Control with Chance Constraints for Stochastic Systems
    Santos, Tito L. M.
    Bonzanini, Angelo D.
    Heirung, Tor Aksel N.
    Mesbah, Ali
    2019 AMERICAN CONTROL CONFERENCE (ACC), 2019, : 1641 - 1647
  • [3] A Constraint-Tightening Approach to Nonlinear Stochastic Model Predictive Control under General Bounded Disturbances
    Schlueter, Henning
    Allgoewer, Frank
    IFAC PAPERSONLINE, 2020, 53 (02): : 7130 - 7135
  • [4] A novel constraint tightening approach for nonlinear robust model predictive control
    Koehler, Johannes
    Mueller, Matthias A.
    Allgoewer, Frank
    2018 ANNUAL AMERICAN CONTROL CONFERENCE (ACC), 2018, : 728 - 734
  • [5] Robust stable model predictive control with constraint tightening
    Richards, Arthur
    How, Jonathan
    2006 AMERICAN CONTROL CONFERENCE, VOLS 1-12, 2006, 1-12 : 1557 - +
  • [6] Tube-based Stochastic Nonlinear Model Predictive Control: A Comparative Study on Constraint Tightening
    Bonzanini, Angelo D.
    Santos, Tito L. M.
    Mesbah, Ali
    IFAC PAPERSONLINE, 2019, 52 (01): : 598 - 603
  • [7] Stochastic Data-Driven Predictive Control: Regularization, Estimation, and Constraint Tightening
    Yin, Mingzhou
    Iannelli, Andrea
    Smith, Roy S.
    IFAC PAPERSONLINE, 2024, 58 (15): : 79 - 84
  • [8] Stochastic Model Predictive Control with adaptive constraint tightening for non-conservative chance constraints satisfaction
    Munoz-Carpintero, Diego
    Hu, Guoqiang
    Spanos, Costas J.
    AUTOMATICA, 2018, 96 : 32 - 39
  • [9] An adaptive constraint tightening approach to linear model predictive control based on approximation algorithms for optimization
    Necoara, Ion
    Ferranti, Laura
    Keviczky, Tamas
    OPTIMAL CONTROL APPLICATIONS & METHODS, 2015, 36 (05): : 648 - 666
  • [10] Linear model predictive control based on approximate optimal control inputs and constraint tightening
    Necoara, Ion
    Nedelcu, Valentin
    Keviczky, Tamas
    Minh Dang Doan
    de Schutter, Bart
    2013 IEEE 52ND ANNUAL CONFERENCE ON DECISION AND CONTROL (CDC), 2013, : 7728 - 7733