An alternating structure-adapted Bregman proximal gradient descent algorithm for constrained nonconvex nonsmooth optimization problems and its inertial variant

被引:2
|
作者
Gao, Xue [1 ]
Cai, Xingju [2 ]
Wang, Xiangfeng [3 ]
Han, Deren [4 ]
机构
[1] Hebei Univ Technol, Inst Math, Tianjin 300401, Peoples R China
[2] Nanjing Normal Univ, Sch Math Sci, Jiangsu Key Lab NSLSCS, Nanjing 210023, Peoples R China
[3] East China Normal Univ, Sch Comp Sci & Technol, Shanghai 200026, Peoples R China
[4] Beihang Univ, Sch Math Sci, LMIB, Beijing 100191, Peoples R China
基金
中国国家自然科学基金;
关键词
Proximal gradient decent; Bregman distance; Inertial; Kurdyka-Lojasiewicz property; Nonconvex nonsmooth optimization; 1ST-ORDER METHODS; LINEARIZED MINIMIZATION; CONVERGENCE; CONTINUITY; CONVEXITY;
D O I
10.1007/s10898-023-01300-0
中图分类号
C93 [管理学]; O22 [运筹学];
学科分类号
070105 ; 12 ; 1201 ; 1202 ; 120202 ;
摘要
We consider the nonconvex nonsmooth minimization problem over abstract sets, whose objective function is the sum of a proper lower semicontinuous biconvex function of the entire variables and two smooth nonconvex functions of their private variables. Fully exploiting the problem structure, we propose an alternating structure-adapted Bregman proximal (ASABP for short) gradient descent algorithm, where the geometry of the abstract set and the function is captured by employing generalized Bregman function. Under the assumption that the underlying function satisfies the Kurdyka-Lojasiewicz property, we prove that each bounded sequence generated by ASABP globally converges to a critical point. We then adopt an inertial strategy to accelerate the ASABP algorithm (IASABP), and utilize a backtracking line search scheme to find "suitable" step sizes, making the algorithm efficient and robust. The global O(1/K) sublinear convergence rate measured by Bregman distance is also established. Furthermore, to illustrate the potential of ASABP and its inertial version (IASABP), we apply them to solving the Poisson linear inverse problem, and the results are promising.
引用
收藏
页码:277 / 300
页数:24
相关论文
共 50 条
  • [1] An alternating structure-adapted Bregman proximal gradient descent algorithm for constrained nonconvex nonsmooth optimization problems and its inertial variant
    Xue Gao
    Xingju Cai
    Xiangfeng Wang
    Deren Han
    Journal of Global Optimization, 2023, 87 : 277 - 300
  • [2] ALTERNATING STRUCTURE-ADAPTED PROXIMAL GRADIENT DESCENT FOR NONCONVEX NONSMOOTH BLOCK-REGULARIZED PROBLEMS
    Nikolova, Mila
    Tan, Pauline
    SIAM JOURNAL ON OPTIMIZATION, 2019, 29 (03) : 2053 - 2078
  • [3] STOCHASTIC ALTERNATING STRUCTURE-ADAPTED PROXIMAL GRADIENT DESCENT METHOD WITH VARIANCE REDUCTION FOR NONCONVEX NONSMOOTH OPTIMIZATION
    Jia, Zehui
    Zhang, Wenxing
    Cai, Xingju
    Han, Deren
    MATHEMATICS OF COMPUTATION, 2024, 93 (348) : 1677 - 1714
  • [4] A Bregman proximal subgradient algorithm for nonconvex and nonsmooth fractional optimization problems
    Long, Xian Jun
    Wang, Xiao Ting
    Li, Gao Xi
    Li, Geng Hua
    APPLIED NUMERICAL MATHEMATICS, 2024, 202 : 209 - 221
  • [5] A stochastic two-step inertial Bregman proximal alternating linearized minimization algorithm for nonconvex and nonsmooth problems
    Guo, Chenzheng
    Zhao, Jing
    Dong, Qiao-Li
    arXiv, 2023,
  • [6] A stochastic two-step inertial Bregman proximal alternating linearized minimization algorithm for nonconvex and nonsmooth problems
    Guo, Chenzheng
    Zhao, Jing
    Dong, Qiao-Li
    NUMERICAL ALGORITHMS, 2024, 97 (01) : 51 - 100
  • [7] Bregman Proximal Gradient Algorithm With Extrapolation for a Class of Nonconvex Nonsmooth Minimization Problems
    Zhang, Xiaoya
    Barrio, Roberto
    Angeles Martinez, M.
    Jiang, Hao
    Cheng, Lizhi
    IEEE ACCESS, 2019, 7 : 126515 - 126529
  • [8] Bregman proximal gradient algorithm with extrapolation for a class of nonconvex nonsmooth minimization problems
    Department of Mathematics, National University of Defense Technology, Changsha, Hunan
    410073, China
    不详
    不详
    410073, China
    arXiv,
  • [9] Two-step inertial Bregman alternating minimization algorithm for nonconvex and nonsmooth problems
    Jing Zhao
    Qiao-Li Dong
    Michael Th. Rassias
    Fenghui Wang
    Journal of Global Optimization, 2022, 84 : 941 - 966
  • [10] Two-step inertial Bregman alternating minimization algorithm for nonconvex and nonsmooth problems
    Zhao, Jing
    Dong, Qiao-Li
    Rassias, Michael Th
    Wang, Fenghui
    JOURNAL OF GLOBAL OPTIMIZATION, 2022, 84 (04) : 941 - 966