Quasi-Newton Methods for Monotone Inclusions: Efficient Resolvent Calculus and Primal-Dual Algorithms\ast

被引:0
作者
Wang, Shida [1 ]
Fadili, Jalal [2 ]
Ochs, Peter [1 ]
机构
[1] Saarland Univ, Dept Math & Comp Sci, D-66123 Saarbrucken, Saarland, Germany
[2] Normandie Univ, ENSICAEN, CNRS, GREYC, F-14050 Caen, Angola
来源
SIAM JOURNAL ON IMAGING SCIENCES | 2025年 / 18卷 / 01期
关键词
quasi-Newton; resolvent operator; primal-dual algorithm; OPTIMIZATION; CONVERGENCE;
D O I
10.1137/24M1646662
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We introduce two quasi-Newton forward-backward splitting algorithms to solve a class of monotone inclusion problems. The bottleneck is the evaluation of the resolvent operator. Changing the metric makes its computation even harder, and this is even true for a simple operator whose resolvent is known for the standard metric. To fully exploit the advantage of adapting the metric, we develop a new efficient resolvent calculus for a low-rank perturbed standard metric, which accounts exactly for quasi-Newton metrics. Moreover, we prove the convergence of our algorithms, including linear convergence rates in case one of the two considered operators is strongly monotone. As a by-product of our general monotone inclusion framework, we introduce two variants of the quasi-Newton primaldual hybrid gradient method (PDHG) for solving saddle point problems. The favorable performance of these two quasi-Newton PDHG methods is demonstrated on several numerical experiments in image processing.
引用
收藏
页码:308 / 344
页数:37
相关论文
共 42 条
  • [1] Abbas B., Attouch H., Svaiter B. F., Newton-like dynamics and forward-backward methods for structured monotone inclusions in Hilbert spaces, J. Optim. Theory Appl, 161, pp. 331-360, (2014)
  • [2] Attouch H., Alves M. M., Svaiter B. F., ), (2015)
  • [3] Attouch H., Redont P., Svaiter B. F., Global convergence of a closed-loop regularized Newton method for solving monotone inclusions in Hilbert spaces, J. Optim. Theory Appl, 157, pp. 624-650, (2013)
  • [4] Attouch H., Svaiter B. F., A continuous dynamical Newton-like approach to solving monotone inclusions, SIAM J. Control Optim, 49, pp. 574-598, (2011)
  • [5] Attouch H., ThEera M., A general duality principle for the sum of two operators, J. Convex Anal, 3, pp. 1-24, (1996)
  • [6] Bauschke H. H., Combettes P. L., Convex Analysis and Monotone Operator Theory in Hilbert Spaces, (2017)
  • [7] Becker S., Fadili J., A quasi-Newton proximal splitting method, Advances in Neural Information Processing Systems, (2012)
  • [8] Becker S., Fadili J., Ochs P., On quasi-Newton forward-backward splitting: Proximal calculus and convergence, SIAM J. Optim, 29, pp. 2445-2481, (2019)
  • [9] Bolte J., Daniilidis A., Lewis A., Tame functions are semismooth, Math. Program, 117, pp. 5-19, (2009)
  • [10] Bredies K., Lorenz D., Mathematical Image Processing, (2018)