SEQUENTIAL QUADRATIC OPTIMIZATION FOR NONLINEAR OPTIMIZATION PROBLEMS ON RIEMANNIAN MANIFOLDS

被引:7
作者
Obara, Mitsuaki [1 ]
Okuno, Takayuki [2 ]
Takeda, Akiko [1 ,2 ]
机构
[1] Univ Tokyo, Grad Sch Informat Sci & Technol, Tokyo, Japan
[2] RIKEN, Ctr Adv Intelligence Project, Tokyo, Japan
基金
日本学术振兴会;
关键词
Riemannian manifolds; Riemannian optimization; nonlinear optimization; sequential quadratic optimization; ell1 penalty function; STABILIZED SQP METHOD; SUPERLINEAR CONVERGENCE; ALGORITHM; RETRACTION;
D O I
10.1137/20M1370173
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
We consider optimization problems on Riemannian manifolds with equality and inthey have numerous applications, the existing studies on them are limited especially in terms of algorithms. In this paper, we propose Riemannian sequential quadratic optimization (RSQO) that uses a line-search technique with an \ell 1 penalty function as an extension of the standard SQO algorithm for constrained nonlinear optimization problems in Euclidean spaces to Riemannian manifolds. We prove its global convergence to a Karush-Kuhn-Tucker point of the RNLO problem by means of parallel transport and the exponential mapping. Furthermore, we establish its local quadratic convergence by analyzing the relationship between sequences generated by RSQO and the Riemannian Newton method. Ours is the first algorithm that has both global and local convergence properties for constrained nonlinear optimization on Riemannian manifolds. Empirical results show that RSQO finds solutions more stably and with higher accuracy compared with the existing Riemannian penalty and augmented Lagrangian methods.
引用
收藏
页码:822 / 853
页数:32
相关论文
共 54 条
[1]  
Absil PA, 2008, OPTIMIZATION ALGORITHMS ON MATRIX MANIFOLDS, P1
[2]  
[Anonymous], 2000, TRUST REGION METHODS, DOI [DOI 10.1137/1.9780898719857, 10.1137/1.9780898719857]
[3]  
[Anonymous], 2009, Technical report UCLINMA-2009.024
[4]  
BAI Y., 2019, ANAL SEQUENTIAL QUAD
[5]   INTRINSIC FORMULATION OF KKT CONDITIONS AND CONSTRAINT QUALIFICATIONS ON SMOOTH MANIFOLDS [J].
Bergmann, Ronny ;
Herzog, Roland .
SIAM JOURNAL ON OPTIMIZATION, 2019, 29 (04) :2423-2444
[6]  
Boggs P.T., 1995, Acta numerica, V4, P1, DOI [10.1017/s0962492900002518, DOI 10.1017/S0962492900002518]
[7]   Stochastic Gradient Descent on Riemannian Manifolds [J].
Bonnabel, Silvere .
IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2013, 58 (09) :2217-2229
[8]   Damped Newton's method on Riemannian manifolds [J].
Bortoloti, Marcio Antonio de A. ;
Fernandes, Teles A. ;
Ferreira, Orizon P. ;
Yuan, Jinyun .
JOURNAL OF GLOBAL OPTIMIZATION, 2020, 77 (03) :643-660
[9]  
Boumal N., 2020, INTRO OPTIMIZATION S
[10]   Global rates of convergence for nonconvex optimization on manifolds [J].
Boumal, Nicolas ;
Absil, P-A. ;
Cartis, Coralia .
IMA JOURNAL OF NUMERICAL ANALYSIS, 2019, 39 (01) :1-33