CONVERGENCE ANALYSIS OF THE PROXIMAL GRADIENT METHOD IN THE PRESENCE OF THE KURDYKA-LOJASIEWICZ PROPERTY WITHOUT GLOBAL LIPSCHITZ ASSUMPTIONS

被引:3
|
作者
Jia, Xiaoxi [1 ]
Kanzow, Christian [1 ]
Mehlitz, Patrick [2 ]
机构
[1] Univ Wurzburg, Inst Math, D-97074 Wurzburg, Germany
[2] Univ Duisburg Essen, Fac Math, D-45127 Essen, Germany
关键词
non-Lipschitzian optimization; nonsmooth optimization; proximal gradient method; Kurdyka-Lojasiewicz property; rate-of-convergence; MONOTONE-OPERATORS; 1ST-ORDER METHODS; DESCENT METHODS; NONCONVEX; ALGORITHM; MINIMIZATION; NONSMOOTH; OPTIMIZATION; CONTINUITY; SIGNALS;
D O I
10.1137/23M1548293
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
We consider a composite optimization problem where the sum of a continuously differentiable and a merely lower semicontinuous function has to be minimized. The proximal gradient algorithm is the classical method for solving such a problem numerically. The corresponding global convergence and local rate-of-convergence theory typically assumes, besides some technical conditions, that the smooth function has a globally Lipschitz continuous gradient and that the objective function satisfies the Kurdyka-Lojasiewicz property. Though this global Lipschitz assumption is satisfied in several applications where the objective function is, e.g., quadratic, this requirement is very restrictive in the nonquadratic case. Some recent contributions therefore try to overcome this global Lipschitz condition by replacing it with a local one, but, to the best of our knowledge, they still require some extra condition in order to obtain the desired global and rate-of-convergence results. The aim of this paper is to show that the local Lipschitz assumption together with the Kurdyka-Lojasiewicz property is sufficient to recover these convergence results.
引用
收藏
页码:3038 / 3056
页数:19
相关论文
共 17 条
  • [1] Multi-block Nonconvex Nonsmooth Proximal ADMM: Convergence and Rates Under Kurdyka-Lojasiewicz Property
    Yashtini, Maryam
    JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS, 2021, 190 (03) : 966 - 998
  • [2] A Telescopic Bregmanian Proximal Gradient Method Without the Global Lipschitz Continuity Assumption
    Reem, Daniel
    Reich, Simeon
    De Pierro, Alvaro
    JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS, 2019, 182 (03) : 851 - 884
  • [3] A Telescopic Bregmanian Proximal Gradient Method Without the Global Lipschitz Continuity Assumption
    Daniel Reem
    Simeon Reich
    Alvaro De Pierro
    Journal of Optimization Theory and Applications, 2019, 182 : 851 - 884
  • [4] Convergence rates analysis of a multiobjective proximal gradient method
    Tanabe, Hiroki
    Fukuda, Ellen H.
    Yamashita, Nobuo
    OPTIMIZATION LETTERS, 2023, 17 (02) : 333 - 350
  • [5] On the convergence analysis of a proximal gradient method for multiobjective optimization
    Zhao, Xiaopeng
    Ghosh, Debdas
    Qin, Xiaolong
    Tammer, Christiane
    Yao, Jen-Chih
    TOP, 2025, 33 (01) : 102 - 132
  • [6] Proximal gradient method for convex multiobjective optimization problems without Lipschitz continuous gradients
    Zhao, Xiaopeng
    Raushan, Ravi
    Ghosh, Debdas
    Yao, Jen-Chih
    Qi, Min
    COMPUTATIONAL OPTIMIZATION AND APPLICATIONS, 2025, : 27 - 66
  • [7] Proximal Gradient Algorithms Under Local Lipschitz Gradient Continuity A Convergence and Robustness Analysis of PANOC
    De Marchi, Alberto
    Themelis, Andreas
    JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS, 2022, 194 (03) : 771 - 794
  • [8] Convergence rates analysis of a multiobjective proximal gradient method
    Hiroki Tanabe
    Ellen H. Fukuda
    Nobuo Yamashita
    Optimization Letters, 2023, 17 : 333 - 350
  • [9] Global convergence of a cautious projection BFGS algorithm for nonconvex problems without gradient Lipschitz continuity
    Yuan, Gonglin
    Zhao, Xiong
    Yu, Jiajia
    ACTA MATHEMATICA SCIENTIA, 2024, 44 (05) : 1735 - 1746
  • [10] A New Modified Three-Term Conjugate Gradient Method with Sufficient Descent Property and Its Global Convergence
    Baluch, Bakhtawar
    Salleh, Zabidin
    Alhawarat, Ahmad
    Roslan, U. A. M.
    JOURNAL OF MATHEMATICS, 2017, 2017