Fixed-Time Stable Gradient Flows: Applications to Continuous-Time Optimization

被引:66
作者
Garg, Kunal [1 ]
Panagou, Dimitra [1 ]
机构
[1] Univ Michigan, Dept Aerosp Engn, Ann Arbor, MI 48109 USA
关键词
Optimization; Convergence; Linear programming; Convex functions; Stability analysis; Heuristic algorithms; Newton method; Finite and fixed-time stability; nonlinear systems; optimization; FINITE-TIME; DYNAMICS; STABILITY; SYSTEMS;
D O I
10.1109/TAC.2020.3001436
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Continuous-time optimization is currently an active field of research in optimization theory; prior work in this area has yielded useful insights and elegant methods for proving stability and convergence properties of the continuous-time optimization algorithms. This article proposes novel gradient-flow schemes that yield convergence to the optimal point of a convex optimization problem within a fixed time from any given initial condition for unconstrained optimization, constrained optimization, and min-max problems. It is shown that the solution of the modified gradient-flow dynamics exists and is unique under certain regularity conditions on the objective function, while fixed-time convergence to the optimal point is shown via Lyapunov-based analysis. The application of the modified gradient flow to unconstrained optimization problems is studied under the assumption of gradient dominance, a relaxation of strong convexity. Then, a modified Newton's method is presented that exhibits fixed-time convergence under some mild conditions on the objective function. Building upon this method, a novel technique for solving convex optimization problems with linear equality constraints that yields convergence to the optimal point in fixed time is developed. Finally, the general min-max problem is considered, and a modified saddle-point dynamics to obtain the optimal solution in fixed time is developed.
引用
收藏
页码:2002 / 2015
页数:14
相关论文
共 41 条
  • [1] Agarwal R. P., 1993, UNIQUENESS NONUNIQUE, V6
  • [2] Beck A., 2014, MOS-SIAM Series on Optimization, V19
  • [3] Benzi M, 2005, ACTA NUMER, V14, P1, DOI 10.1017/S0962492904000212
  • [4] Finite-time stability of continuous autonomous systems
    Bhat, SP
    Bernstein, DS
    [J]. SIAM JOURNAL ON CONTROL AND OPTIMIZATION, 2000, 38 (03) : 751 - 766
  • [5] Quartic formulation of standard quadratic optimization problems
    Bomze, IM
    Palagi, L
    [J]. JOURNAL OF GLOBAL OPTIMIZATION, 2005, 32 (02) : 181 - 205
  • [6] Boyd L., 2004, Convex Optimization, DOI DOI 10.1017/CBO9780511804441
  • [7] SOME EFFECTIVE METHODS FOR UNCONSTRAINED OPTIMIZATION BASED ON THE SOLUTION OF SYSTEMS OF ORDINARY DIFFERENTIAL-EQUATIONS
    BROWN, AA
    BARTHOLOMEWBIGGS, MC
    [J]. JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS, 1989, 62 (02) : 211 - 224
  • [8] Chen F, 2018, IEEE DECIS CONTR P, P4072, DOI 10.1109/CDC.2018.8619081
  • [9] The Role of Convexity in Saddle-Point Dynamics: Lyapunov Function and Robustness
    Cherukuri, Ashish
    Mallada, Enrique
    Low, Steven
    Cortes, Jorge
    [J]. IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2018, 63 (08) : 2449 - 2464
  • [10] SADDLE-POINT DYNAMICS: CONDITIONS FOR ASYMPTOTIC STABILITY OF SADDLE POINTS
    Cherukuri, Ashish
    Gharesifard, Bahman
    Cortes, Jorge
    [J]. SIAM JOURNAL ON CONTROL AND OPTIMIZATION, 2017, 55 (01) : 486 - 511