Convergence of the gradient sampling algorithm for nonsmooth nonconvex optimization

被引:83
作者
Kiwiel, Krzysztof C. [1 ]
机构
[1] Polish Acad Sci, Syst Res Inst, PL-01447 Warsaw, Poland
关键词
generalized gradient; nonsmooth optimization; subgradient; gradient sampling; nonconvex;
D O I
10.1137/050639673
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
We study the gradient sampling algorithm of Burke, Lewis, and Overton for minimizing a locally Lipschitz function f on R-n that is continuously differentiable on an open dense subset. We strengthen the existing convergence results for this algorithm and introduce a slightly revised version for which stronger results are established without requiring compactness of the level sets of f. In particular, we show that with probability 1 the revised algorithm either drives the f- values to -infinity, or each of its cluster points is Clarke stationary for f. We also consider a simplified variant in which the differentiability check is skipped and the user can control the number of f- evaluations per iteration.
引用
收藏
页码:379 / 388
页数:10
相关论文
共 10 条
[1]   Stabilization via nonsmooth, nonconvex optimization [J].
Burke, James V. ;
Henrion, Didier ;
Lewis, Adrian S. ;
Overton, Michael L. .
IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2006, 51 (11) :1760-1769
[2]   A robust gradient sampling algorithm for nonsmooth, nonconvex optimization [J].
Burke, JV ;
Lewis, AS ;
Overton, ML .
SIAM JOURNAL ON OPTIMIZATION, 2005, 15 (03) :751-779
[3]   Pseudospectral components and the distance to uncontrollability [J].
Burke, JV ;
Lewis, AS ;
Overton, ML .
SIAM JOURNAL ON MATRIX ANALYSIS AND APPLICATIONS, 2004, 26 (02) :350-361
[4]   Two numerical methods for optimizing matrix stability [J].
Burke, JV ;
Lewis, AS ;
Lewi, SB .
LINEAR ALGEBRA AND ITS APPLICATIONS, 2002, 351 :117-145
[5]   Approximating subdifferentials by random sampling of gradients [J].
Burke, JV ;
Lewis, AS ;
Overton, ML .
MATHEMATICS OF OPERATIONS RESEARCH, 2002, 27 (03) :567-584
[6]  
Clarke FH, 1983, OPTIMIZATION NONSMOO
[7]   OPTIMIZATION OF LIPSCHITZ CONTINUOUS-FUNCTIONS [J].
GOLDSTEIN, AA .
MATHEMATICAL PROGRAMMING, 1977, 13 (01) :14-22
[8]   Restricted step and Levenberg-Marquardt techniques in proximal bundle methods for nonconvex nondifferentiable optimization [J].
Kiwiel, KC .
SIAM JOURNAL ON OPTIMIZATION, 1996, 6 (01) :227-249
[9]  
LEWIS AS, 2005, LOCAL STRUCTURE ALGO, P104
[10]  
Rockafellar R. T., 1970, Convex Analysis