Nonmonotone projected gradient methods based on barrier and Euclidean distances

被引:10
作者
Auslender, Alfred
Silva, Paulo J. S.
Teboulle, Marc [1 ]
机构
[1] Tel Aviv Univ, Sch Math Sci, IL-69978 Tel Aviv, Israel
[2] Univ Lyon 1, Inst Camille Jordan, F-69365 Lyon, France
[3] Univ Sao Paulo, Inst Math & Stat, Sao Paulo, Brazil
关键词
convex and nonconvex optimization; projected gradient algorithms; nonmonotone methods; spectral stepsizes; barrier proximal distances; convergence analysis;
D O I
10.1007/s10589-007-9025-0
中图分类号
C93 [管理学]; O22 [运筹学];
学科分类号
070105 ; 12 ; 1201 ; 1202 ; 120202 ;
摘要
We consider nonmonotone projected gradient methods based on non-Euclidean distances, which play the role of barrier for a given constraint set. Our basic scheme uses the resulting projection-like maps that produces interior trajectories, and combines it with the recent nonmonotone line search technique originally proposed for unconstrained problems by Zhang and Hager. The combination of these two ideas leads to produce a nonmonotone scheme for constrained nonconvex problems, which is proven to converge to a stationary point. Some variants of this algorithm that incorporate spectral steplength are also studied and compared with classical nonmonotone schemes based on the usual Euclidean projection. To validate our approach, we report on numerical results solving bound constrained problems from the CUTEr library collection.
引用
收藏
页码:305 / 327
页数:23
相关论文
共 22 条
[1]   Interior proximal and multiplier methods based on second order homogeneous kernels [J].
Auslender, A ;
Teboulle, M ;
Ben-Tiba, S .
MATHEMATICS OF OPERATIONS RESEARCH, 1999, 24 (03) :645-668
[2]   Interior gradient and proximal methods for convex and conic optimization [J].
Auslender, A ;
Teboulle, M .
SIAM JOURNAL ON OPTIMIZATION, 2006, 16 (03) :697-725
[3]   Interior projection-like methods for monotone variational inequalities [J].
Auslender, A ;
Teboulle, M .
MATHEMATICAL PROGRAMMING, 2005, 104 (01) :39-68
[4]   Interior gradient and epsilon-subgradient descent methods for constrained convex minimization [J].
Auslender, A ;
Teboulle, M .
MATHEMATICS OF OPERATIONS RESEARCH, 2004, 29 (01) :1-26
[5]   Mirror descent and nonlinear projected subgradient methods for convex optimization [J].
Beck, A ;
Teboulle, M .
OPERATIONS RESEARCH LETTERS, 2003, 31 (03) :167-175
[6]   The ordered subsets mirror descent optimization method with applications to tomography [J].
Ben-Tal, A ;
Margalit, T ;
Nemirovski, A .
SIAM JOURNAL ON OPTIMIZATION, 2001, 12 (01) :79-108
[7]  
Bertsekas D., 1999, NONLINEAR PROGRAMMIN
[8]   Nonmonotone spectral projected gradient methods on convex sets [J].
Birgin, EG ;
Martínez, JM ;
Raydan, M .
SIAM JOURNAL ON OPTIMIZATION, 2000, 10 (04) :1196-1211
[9]   Algorithm 813:: SPG -: Software for convex-constrained optimization [J].
Birgin, EG ;
Martínez, JM ;
Raydan, M .
ACM TRANSACTIONS ON MATHEMATICAL SOFTWARE, 2001, 27 (03) :340-349
[10]  
Dai Yuhong, 2002, Journal of Systems Science and Complexity, V15, P139