The efficiency of subgradient projection methods for convex optimization .1. General level methods

被引:46
作者
Kiwiel, KC
机构
[1] Systems Research Institute, 01-447 Warsaw
关键词
nondifferentiable (nonsmooth) optimization; convex programming; relaxation methods; subgradient optimization; successive projections; linear inequalities; parallel computing;
D O I
10.1137/0334031
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
We study subgradient methods for convex optimization that use projections onto successive approximations of level sets of the objective corresponding to estimates of the optimal value. We present several variants and show that they enjoy almost optimal efficiency estimates. In another paper we discuss possible implementations of such methods. In particular, their projection subproblems may he solved inexactly via relaxation methods, thus opening the way for parallel implementations. They can also exploit accelerations of relaxation methods based on simultaneous projections, surrogate constraints, and conjugate and projected (conditional) subgradient techniques.
引用
收藏
页码:660 / 676
页数:17
相关论文
共 19 条
[1]   THE RELAXATION METHOD FOR LINEAR INEQUALITIES [J].
AGMON, S .
CANADIAN JOURNAL OF MATHEMATICS-JOURNAL CANADIEN DE MATHEMATIQUES, 1954, 6 (03) :382-392
[2]   ON THE CHOICE OF STEP SIZE IN SUBGRADIENT OPTIMIZATION [J].
BAZARAA, MS ;
SHERALI, HD .
EUROPEAN JOURNAL OF OPERATIONAL RESEARCH, 1981, 7 (04) :380-388
[3]   THE NESTED BALL PRINCIPLE FOR THE RELAXATION METHOD [J].
DREZNER, Z .
OPERATIONS RESEARCH, 1983, 31 (03) :587-590
[4]  
GOFFIN JL, 1981, NONLINEAR PROGRAMMIN, V4, P283
[5]  
Gubin L., 1967, U.S.S.R. Computational Mathematics and Mathematical Physics, V7, P1211
[6]  
Hiriart-Urruty J. B., 1996, CONVEX ANAL MINIMIZA, V305
[7]  
KIM SH, 1991, MATH PROGRAM, V49, P359
[8]   PROXIMAL LEVEL BUNDLE METHODS FOR CONVEX NONDIFFERENTIABLE OPTIMIZATION, SADDLE-POINT PROBLEMS AND VARIATIONAL-INEQUALITIES [J].
KIWIEL, KC .
MATHEMATICAL PROGRAMMING, 1995, 69 (01) :89-109
[9]   The efficiency of subgradient projection methods for convex optimization .2. Implementations and extensions [J].
Kiwiel, KC .
SIAM JOURNAL ON CONTROL AND OPTIMIZATION, 1996, 34 (02) :677-697
[10]  
KIWIEL KC, 1985, LECT NOTES MATH, V1133