A Multi-step Inertial Forward-Backward Splitting Method for Non-convex Optimization

被引:0
|
作者
Liang, Jingwei [1 ]
Fadili, Jalal M. [1 ]
Peyre, Gabriel [2 ]
机构
[1] Normandie Univ, ENSICAEN, CNRS, GREYC, Caen, France
[2] CNRS, DMA, ENS Paris, Paris, France
来源
ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 29 (NIPS 2016) | 2016年 / 29卷
基金
欧洲研究理事会;
关键词
PROXIMAL METHOD; ALGORITHM; CONVERGENCE;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We propose a multi-step inertial Forward-Backward splitting algorithm for minimizing the sum of two non-necessarily convex functions, one of which is proper lower semi-continuous while the other is differentiable with a Lipschitz continuous gradient. We first prove global convergence of the algorithm with the help of the Kurdyka-Lojasiewicz property. Then, when the non-smooth part is also partly smooth relative to a smooth submanifold, we establish finite identification of the latter and provide sharp local linear convergence analysis. The proposed method is illustrated on several problems arising from statistics and machine learning.
引用
收藏
页数:9
相关论文
共 50 条
  • [1] A Forward-Backward Algorithm With Different Inertial Terms for Structured Non-Convex Minimization Problems
    Laszlo, Szilard Csaba
    JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS, 2023, 198 (01) : 387 - 427
  • [2] AN INERTIAL FORWARD-BACKWARD SPLITTING METHOD FOR APPROXIMATING SOLUTIONS OF CERTAIN OPTIMIZATION PROBLEMS
    Abass, H. A.
    Aremu, K. O.
    Jolaoso, L. O.
    Mewomo, O. T.
    JOURNAL OF NONLINEAR FUNCTIONAL ANALYSIS, 2020,
  • [3] Outer reflected forward-backward splitting algorithm with inertial extrapolation step
    Shehu, Yekini
    Jolaoso, Lateef O.
    Okeke, C. C.
    Xu, Renqi
    OPTIMIZATION, 2024,
  • [4] A modified inertial projected forward-backward algorithm for convex optimization problems
    Kankam, Kunrada
    Inkrong, Papatsara
    Cholamjiak, Prasit
    RENDICONTI DEL CIRCOLO MATEMATICO DI PALERMO, 2025, 74 (01)
  • [5] An Inertial Parallel and Asynchronous Forward-Backward Iteration for Distributed Convex Optimization
    Stathopoulos, Giorgos
    Jones, Colin N.
    JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS, 2019, 182 (03) : 1088 - 1119
  • [6] The Modified Viscosity Approximation Method with Inertial Technique and Forward-Backward Algorithm for Convex Optimization Model
    Hanjing, Adisak
    Bussaban, Limpapat
    Suantai, Suthep
    MATHEMATICS, 2022, 10 (07)
  • [7] A Primal-Dual Forward-Backward Splitting Algorithm for Distributed Convex Optimization
    Li, Huaqing
    Su, Enbing
    Wang, Chengbo
    Liu, Jiawei
    Zheng, Zuqing
    Wang, Zheng
    Xia, Dawen
    IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTATIONAL INTELLIGENCE, 2023, 7 (01): : 278 - 284
  • [8] Inertial forward-backward splitting method in Banach spaces with application to compressed sensing
    Cholamjiak, Prasit
    Shehu, Yekini
    APPLICATIONS OF MATHEMATICS, 2019, 64 (04) : 409 - 435
  • [9] An inertial forward-backward splitting method for solving inclusion problems in Hilbert spaces
    Cholamjiak, Watcharaporn
    Cholamjiak, Prasit
    Suantai, Suthep
    JOURNAL OF FIXED POINT THEORY AND APPLICATIONS, 2018, 20 (01) : 1 - 17
  • [10] Inertial forward-backward splitting method in Banach spaces with application to compressed sensing
    Prasit Cholamjiak
    Yekini Shehu
    Applications of Mathematics, 2019, 64 : 409 - 435