The indefinite proximal point algorithms for maximal monotone operators

被引:6
作者
Jiang, Fan [1 ]
Cai, Xingju [1 ]
Han, Deren [2 ]
机构
[1] Nanjing Normal Univ, Key Lab NSLSCS Jiangsu Prov, Sch Math Sci, Nanjing, Peoples R China
[2] Beihang Univ, Beijing Adv Innovat Ctr Big Data & Brain Comp BDB, Sch Math Sci, Beijing, Peoples R China
关键词
Proximal point algorithm; indefinite proximal term; convex optimization; global convergence; inexact criteria; INEXACT; EXTRAGRADIENT; CONVERGENCE; ENLARGEMENT; SHRINKAGE;
D O I
10.1080/02331934.2020.1751158
中图分类号
C93 [管理学]; O22 [运筹学];
学科分类号
070105 ; 12 ; 1201 ; 1202 ; 120202 ;
摘要
The proximal point algorithm (PPA) has been widely used in convex optimization. Many algorithms fall into the framework of PPA. To guarantee the convergence of PPA, however, existing results conventionally need to ensure the positive definiteness of the corresponding proximal measure. In some senses, this essentially results in tiny step sizes (or over regularization) for the subproblems and thus inevitably decelerates the overall convergence speed of PPA. In this paper, we investigate the possibility of relaxing the positive definiteness requirement of the proximal measure in PPA. An indefinite PPA for finding a zero of maximal monotone operator is thus proposed via choosing an indefinite proximal regularization term, resulting in larger step sizes. Under some suitable conditions, we prove the global convergence of the proposed algorithm and its extension. To make our method more practical, we suggest to solve the subproblem in an approximate manner and propose two flexible inexact criteria. We show that the condition which guarantees the convergence of the proposed indefinite PPA is tight by a simple example. In addition, we show how to apply the indefinite PPA to some convex models. We report some preliminary numerical results, which show the efficiencies of the proposed algorithms.
引用
收藏
页码:1759 / 1790
页数:32
相关论文
共 51 条
[1]  
Bauschke HH, 2011, CMS BOOKS MATH, P1, DOI 10.1007/978-1-4419-9467-7
[2]   A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems [J].
Beck, Amir ;
Teboulle, Marc .
SIAM JOURNAL ON IMAGING SCIENCES, 2009, 2 (01) :183-202
[3]   Distributed optimization and statistical learning via the alternating direction method of multipliers [J].
Boyd S. ;
Parikh N. ;
Chu E. ;
Peleato B. ;
Eckstein J. .
Foundations and Trends in Machine Learning, 2010, 3 (01) :1-122
[4]   A generalized proximal point algorithm for the variational inequality problem in a Hilbert space [J].
Burachik, RS ;
Iusem, AN .
SIAM JOURNAL ON OPTIMIZATION, 1998, 8 (01) :197-216
[5]   Enlargement of monotone operators with applications to variational inequalities [J].
Burachik, RS ;
Iusem, AN ;
Svaiter, BF .
SET-VALUED ANALYSIS, 1997, 5 (02) :159-180
[6]   A variable metric proximal point algorithm for monotone operators [J].
Burke, JV ;
Qian, M .
SIAM JOURNAL ON CONTROL AND OPTIMIZATION, 1999, 37 (02) :353-375
[7]   On the superlinear convergence of the variable metric proximal point algorithm using Broyden and BFGS matrix secant updating [J].
Burke, JV ;
Qian, MJ .
MATHEMATICAL PROGRAMMING, 2000, 88 (01) :157-181
[8]   A proximal point algorithm with asymmetric linear term [J].
Cai, Xingju .
OPTIMIZATION LETTERS, 2019, 13 (04) :777-793
[9]   An improved first-order primal-dual algorithm with a new correction step [J].
Cai, Xingju ;
Han, Deren ;
Xu, Lingling .
JOURNAL OF GLOBAL OPTIMIZATION, 2013, 57 (04) :1419-1428
[10]   PROXIMAL MINIMIZATION ALGORITHM WITH D-FUNCTIONS [J].
CENSOR, Y ;
ZENIOS, SA .
JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS, 1992, 73 (03) :451-464