Conservative Parametric Optimality and the Ridge Method for Tame Min-Max Problems

被引:1
|
作者
Pauwels, Edouard [1 ]
机构
[1] Univ Toulouse, CNRS, Inst Univ France IUF, IRIT, Toulouse, France
关键词
Min-max problems; Ridge algorithm; Parametric optimality; Conservative gradients; Definable sets; O-minimal structures; Clarke subdifferential; First order methods; NONCONVEX;
D O I
10.1007/s11228-023-00682-3
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
We study the ridge method for min-max problems, and investigate its convergence without any convexity, differentiability or qualification assumption. The central issue is to determine whether the "parametric optimality formula" provides a conservative gradient, a notion of generalized derivative well suited for optimization. The answer to this question is positive in a semi-algebraic, and more generally definable, context. As a consequence, the ridge method applied to definable objectives is proved to have a minimizing behavior and to converge to a set of equilibria which satisfy an optimality condition. Definability is key to our proof: we show that for a more general class of nonsmooth functions, conservativity of the parametric optimality formula may fail, resulting in an absurd behavior of the ridge method.
引用
收藏
页数:24
相关论文
共 13 条
  • [1] Solving Continuous Min-Max Problems by an Iterative Entropic Regularization Method
    R. L. Sheu
    J. Y. Lin
    Journal of Optimization Theory and Applications, 2004, 121 : 597 - 612
  • [2] Online learning for min-max discrete problems
    Bampis, Evripidis
    Christou, Dimitris
    Escoffier, Bruno
    NGuyen, Kim Thang
    THEORETICAL COMPUTER SCIENCE, 2022, 930 : 209 - 217
  • [3] Solving continuous min-max problems by an iterative entropic regularization method
    Sheu, RL
    Lin, JY
    JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS, 2004, 121 (03) : 597 - 612
  • [4] Novel Min-Max Reformulations of Linear Inverse Problems
    Sheriff, Mohammed Rayyan
    Chatterjee, Debasish
    JOURNAL OF MACHINE LEARNING RESEARCH, 2022, 23 : 1 - 46
  • [5] Approximations for minimum and min-max vehicle routing problems
    Arkin, EM
    Hassin, R
    Levin, A
    JOURNAL OF ALGORITHMS-COGNITION INFORMATICS AND LOGIC, 2006, 59 (01): : 1 - 18
  • [6] First-order algorithms for generalized semi-infinite min-max problems
    Polak, E
    Qi, LQ
    Sun, DF
    COMPUTATIONAL OPTIMIZATION AND APPLICATIONS, 1999, 13 (1-3) : 137 - 161
  • [7] Alternating Gradient Descent Ascent for Nonconvex Min-Max Problems in Robust Learning and GANs
    Lu, Songtao
    Singh, Rahul
    Chen, Xiangyi
    Chen, Yongxin
    Hong, Mingyi
    CONFERENCE RECORD OF THE 2019 FIFTY-THIRD ASILOMAR CONFERENCE ON SIGNALS, SYSTEMS & COMPUTERS, 2019, : 680 - 684
  • [8] Sum-of-squares relaxations for polynomial min-max problems over simple sets
    Bach, Francis
    MATHEMATICAL PROGRAMMING, 2025, 209 (1-2) : 475 - 501
  • [9] First-Order Algorithms for Generalized Semi-Infinite Min-Max Problems
    Elijah Polak
    Liqun Qi
    Defeng Sun
    Computational Optimization and Applications, 1999, 13 : 137 - 161
  • [10] A decentralized adaptive method with consensus step for non-convex non-concave min-max optimization problems
    Li, Meiwen
    Long, Xinyue
    Liu, Muhua
    Guo, Jing
    Zhao, Xuhui
    Wang, Lin
    Wu, Qingtao
    EXPERT SYSTEMS WITH APPLICATIONS, 2025, 276