A proximal subgradient algorithm with extrapolation for structured nonconvex nonsmooth problems

被引:5
作者
Pham, Tan Nhat [1 ,3 ]
Dao, Minh N. N. [2 ]
Shah, Rakibuzzaman [3 ]
Sultanova, Nargiz [1 ]
Li, Guoyin [4 ]
Islam, Syed [3 ]
机构
[1] Federat Univ Australia, Ctr Smart Analyt, Ballarat, Vic 3353, Australia
[2] RMIT Univ, Sch Sci, Melbourne, Vic 3000, Australia
[3] Federat Univ Australia, Ctr New Energy Transit Res, Ballarat, Vic 3353, Australia
[4] Univ New South Wales, Dept Appl Math, Sydney, NSW 2052, Australia
基金
澳大利亚研究理事会;
关键词
Composite optimization problem; Difference of convex; Distributed energy resources; Extrapolation; Optimal power flow; Proximal subgradient algorithm; OPTIMAL POWER-FLOW; DC ALGORITHMS; CONVERGENCE; OPTIMIZATION; DIFFERENCE;
D O I
10.1007/s11075-023-01554-5
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
In this paper, we consider a class of structured nonconvex nonsmooth optimization problems, in which the objective function is formed by the sum of a possibly nonsmooth nonconvex function and a differentiable function with Lipschitz continuous gradient, subtracted by a weakly convex function. This general framework allows us to tackle problems involving nonconvex loss functions and problems with specific nonconvex constraints, and it has many applications such as signal recovery, compressed sensing, and optimal power flow distribution. We develop a proximal subgradient algorithm with extrapolation for solving these problems with guaranteed subsequential convergence to a stationary point. The convergence of the whole sequence generated by our algorithm is also established under the widely used Kurdyka-Lojasiewicz property. To illustrate the promising numerical performance of the proposed algorithm, we conduct numerical experiments on two important nonconvex models. These include a compressed sensing problem with a nonconvex regularization and an optimal power flow problem with distributed energy resources.
引用
收藏
页码:1763 / 1795
页数:33
相关论文
共 51 条
[1]   A review of optimal power flow studies applied to smart grids and microgrids [J].
Abdi, Hamdi ;
Beigvand, Soheil Derafshi ;
La Scala, Massimo .
RENEWABLE & SUSTAINABLE ENERGY REVIEWS, 2017, 71 :742-766
[2]  
Afef C, 2016, 2016 INTERNATIONAL SYMPOSIUM ON SIGNAL, IMAGE, VIDEO AND COMMUNICATIONS (ISIVC), P120, DOI 10.1109/ISIVC.2016.7893973
[3]   DIFFERENCE-OF-CONVEX LEARNING: DIRECTIONAL STATIONARITY, OPTIMALITY, AND SPARSITY [J].
Ahn, Miju ;
Pang, Jong-Shi ;
Xin, Jack .
SIAM JOURNAL ON OPTIMIZATION, 2017, 27 (03) :1637-1665
[4]   On the convergence of the proximal algorithm for nonsmooth functions involving analytic features [J].
Attouch, Hedy ;
Bolte, Jerome .
MATHEMATICAL PROGRAMMING, 2009, 116 (1-2) :5-16
[5]   CONVERGENCE RATES OF INERTIAL FORWARD-BACKWARD ALGORITHMS [J].
Attouch, Hedy ;
Cabot, Alexandre .
SIAM JOURNAL ON OPTIMIZATION, 2018, 28 (01) :849-874
[6]  
Beck A. :., 2017, MOS-SIAM SER OPTIMIZ, DOI [DOI 10.1137/1.9781611974997, 10.1137/1.9781611974997]
[7]   A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems [J].
Beck, Amir ;
Teboulle, Marc .
SIAM JOURNAL ON IMAGING SCIENCES, 2009, 2 (01) :183-202
[8]   Clarke subgradients of stratifiable functions [J].
Bolte, Jerome ;
Daniilidis, Aris ;
Lewis, Adrian ;
Shiota, Masahiro .
SIAM JOURNAL ON OPTIMIZATION, 2007, 18 (02) :556-572
[9]  
Bot R.I., 2022, MATH OPER RES, V47, P1707
[10]   INERTIAL PROXIMAL BLOCK COORDINATE METHOD FOR A CLASS OF NONSMOOTH SUM-OF-RATIOS OPTIMIZATION PROBLEMS [J].
Bot, Radu Ioan ;
Dao, Minh N. ;
Li, Guoyin .
SIAM JOURNAL ON OPTIMIZATION, 2023, 33 (02) :361-393