Inexact versions of Proximal Point and augmented Lagrangian algorithms in Banach spaces

被引:61
作者
Iusem, A [1 ]
Otero, RG [1 ]
机构
[1] Inst Matematica Pura & Aplicada, BR-22460320 Rio De Janeiro, Brazil
关键词
proximal point method; augmented Lagrangian; inexact solutions; Bregman projection; maximal monotone operator;
D O I
10.1081/NFA-100105310
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
We generalize a proximal-like method for finding zeroes of maximal monotone operators in Hilbert spaces with quadratic regularization due to Solodov and Svaiter, making it possible the use of other kind of regularizations and extending it to Banach spaces. In particular, we introduce an appropriate error criterium to obtain an inexact proximal iteration based on Bregman functions and construct a hyperplane which strictly separates the current iterate from the solution set. A Bregman projection onto this hyperplane is then used to obtain the next iterate. Boundedness of the sequence and optimality of the weak accumulation points are established under suitable assumptions on the regularizing function, which hold for any power greater than one of the norm of any uniformly smooth and uniformly convex Banach space, without any assumption on the operator other than existence of zeroes. These assumptions let us, also, obtain similar results in Banach spaces for the Hybrid Extragradient-Generalized Proximal Point method, proposed by Solodov and Svaiter for finite dimensional spaces. We then transpose such methods to generate augmented Lagrangian methods for L-P-constrained convex optimization problems in Banach spaces, obtaining two alternative procedures which allow for sequences, and optimality of primal and dual weak accumulation points, are then established, assuming only existence of Karush-Kuhn-Tucker pairs.
引用
收藏
页码:609 / 640
页数:32
相关论文
共 44 条
[1]  
Alber Y.I., 1997, ABSTR APPL ANAL, V2, P97
[2]  
[Anonymous], MATH OPER RES
[3]   THE NON-EXISTENCE OF SMOOTH DEMAND IN GENERAL BANACH-SPACES [J].
ARAUJO, A .
JOURNAL OF MATHEMATICAL ECONOMICS, 1988, 17 (04) :309-319
[4]   A logarithmic-quadratic proximal method for variational inequalities [J].
Auslender, A ;
Teboulle, M ;
Ben-Tiba, S .
COMPUTATIONAL OPTIMIZATION AND APPLICATIONS, 1999, 12 (1-3) :31-40
[5]   Interior proximal and multiplier methods based on second order homogeneous kernels [J].
Auslender, A ;
Teboulle, M ;
Ben-Tiba, S .
MATHEMATICS OF OPERATIONS RESEARCH, 1999, 24 (03) :645-668
[6]  
Bertsekas D., 2019, Reinforcement Learning and Optimal Control
[7]   PENALTY AND MULTIPLIER METHODS FOR CONSTRAINED MINIMIZATION [J].
BERTSEKAS, DP .
SIAM JOURNAL ON CONTROL, 1976, 14 (02) :216-235
[8]  
BROWDER FE, 1976, P S PURE MATH AM MAT, V18, P2
[9]   A proximal point method for the variational inequality problem in Banach spaces [J].
Burachik, RS ;
Scheimberg, S .
SIAM JOURNAL ON CONTROL AND OPTIMIZATION, 2000, 39 (05) :1633-1649
[10]   A generalized proximal point algorithm for the variational inequality problem in a Hilbert space [J].
Burachik, RS ;
Iusem, AN .
SIAM JOURNAL ON OPTIMIZATION, 1998, 8 (01) :197-216