Proximal gradient method for nonconvex and nonsmooth optimization on Hadamard manifolds

被引:2
|
作者
Feng, Shuailing [1 ]
Huang, Wen [2 ]
Song, Lele [1 ]
Ying, Shihui [1 ]
Zeng, Tieyong [3 ]
机构
[1] Shanghai Univ, Sch Sci, Dept Math, Shanghai 200444, Peoples R China
[2] Xiamen Univ, Sch Math Sci, Xiamen 361005, Peoples R China
[3] Chinese Univ Hong Kong, Dept Math, Shatin, Hong Kong, Peoples R China
基金
中国国家自然科学基金;
关键词
Proximal gradient method; Hadamard manifolds; Manifold optimization; Convergence analysis; ALTERNATING MINIMIZATION; POINT METHOD; CONVERGENCE; ALGORITHMS;
D O I
10.1007/s11590-021-01822-0
中图分类号
C93 [管理学]; O22 [运筹学];
学科分类号
070105 ; 12 ; 1201 ; 1202 ; 120202 ;
摘要
In this paper, we address the minimizing problem of the nonconvex and nonsmooth functions on Hadamard manifolds, and develop an improved proximal gradient method. First, by utilizing the geometric structure of non-positive curvature manifolds, we propose a monotone proximal gradient algorithm with fixed step size on Hadamard manifolds. Then, a convergence theorem of the proposed method has been established under the reasonable definition of proximal gradient mapping on manifolds. If the function further satisfies the Riemannian Kurdyka-Lojasiewicz (KL) property with an exponent, the local convergence rate is given. Finally, numerical experiments on a special Hadamard manifold, named symmetric positive definite matrix manifold, show the advantages of the proposed method.
引用
收藏
页码:2277 / 2297
页数:21
相关论文
共 50 条
  • [1] Proximal gradient method for nonconvex and nonsmooth optimization on Hadamard manifolds
    Shuailing Feng
    Wen Huang
    Lele Song
    Shihui Ying
    Tieyong Zeng
    Optimization Letters, 2022, 16 : 2277 - 2297
  • [2] General inertial proximal gradient method for a class of nonconvex nonsmooth optimization problems
    Wu, Zhongming
    Li, Min
    COMPUTATIONAL OPTIMIZATION AND APPLICATIONS, 2019, 73 (01) : 129 - 158
  • [3] PROXIMAL GRADIENT METHOD FOR NONSMOOTH OPTIMIZATION OVER THE STIEFEL MANIFOLD
    Chen, Shixiang
    Ma, Shiqian
    So, Anthony Man-Cho
    Zhang, Tong
    SIAM JOURNAL ON OPTIMIZATION, 2020, 30 (01) : 210 - 239
  • [4] A Nonconvex Proximal Bundle Method for Nonsmooth Constrained Optimization
    Shen, Jie
    Guo, Fang-Fang
    Xu, Na
    COMPLEXITY, 2024, 2024
  • [5] Proximal point method for a special class of nonconvex functions on Hadamard manifolds
    Bento, G. C.
    Ferreira, O. P.
    Oliveira, P. R.
    OPTIMIZATION, 2015, 64 (02) : 289 - 319
  • [6] STOCHASTIC ALTERNATING STRUCTURE-ADAPTED PROXIMAL GRADIENT DESCENT METHOD WITH VARIANCE REDUCTION FOR NONCONVEX NONSMOOTH OPTIMIZATION
    Jia, Zehui
    Zhang, Wenxing
    Cai, Xingju
    Han, Deren
    MATHEMATICS OF COMPUTATION, 2024, 93 (348) : 1677 - 1714
  • [7] An inexact regularized proximal Newton method for nonconvex and nonsmooth optimization
    Liu, Ruyu
    Pan, Shaohua
    Wu, Yuqia
    Yang, Xiaoqi
    COMPUTATIONAL OPTIMIZATION AND APPLICATIONS, 2024, 88 (02) : 603 - 641
  • [8] A Bregman Proximal Stochastic Gradient Method with Extrapolation for Nonconvex Nonsmooth Problems
    Wang, Qingsong
    Liu, Zehui
    Cui, Chunfeng
    Han, Deren
    THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 14, 2024, : 15580 - 15588
  • [9] Some accelerated alternating proximal gradient algorithms for a class of nonconvex nonsmooth problems
    Yang, Xin
    Xu, Lingling
    JOURNAL OF GLOBAL OPTIMIZATION, 2023, 87 (2-4) : 939 - 964
  • [10] An inexact proximal gradient algorithm with extrapolation for a class of nonconvex nonsmooth optimization problems
    Jia, Zehui
    Wu, Zhongming
    Dong, Xiaomei
    JOURNAL OF INEQUALITIES AND APPLICATIONS, 2019, 2019 (1)