A regularized interior-point method for constrained linear least squares

被引:3
作者
Dehghani, Mohsen [1 ,2 ]
Lambe, Andrew [1 ,2 ]
Orban, Dominique [1 ,2 ]
机构
[1] Ecole Polytech Montreal, GERAD, Montreal, PQ, Canada
[2] Ecole Polytech Montreal, Dept Math & Ind Engn, Montreal, PQ, Canada
基金
加拿大自然科学与工程研究理事会;
关键词
Linear least squares; symmetric quasi-definite system; interior-point method; primal-dual regularization; proximal point; augmented Lagrangian; FACTORIZATION; ALGORITHMS; STABILITY; EQUATIONS; SYSTEMS;
D O I
10.1080/03155986.2018.1559428
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
We propose an infeasible interior-point algorithm for constrained linear least-squares problems based on the primal-dual regularization of convex programs of Friedlander and Orban. Regularization allows us to dispense with the assumption that the active gradients are linearly independent. At each iteration, a linear system with a symmetric quasi-definite (SQD) matrix is solved. This matrix is shown to be uniformly bounded and nonsingular. While the linear system may be solved using sparse LDLT factorization, we observe that other approaches may be used. In particular, we build on the connection between SQD linear systems and unconstrained linear least-squares problems to solve the linear system with sparse QR factorization. We establish conditions under which a solution of the original, constrained least-squares problem is recovered. We report computational experience with the sparse QR factorization and illustrate the potential advantages of our approach.
引用
收藏
页码:202 / 224
页数:23
相关论文
共 30 条
[1]   Uniform boundedness of the inverse of a Jacobian matrix arising in regularized interior-point methods [J].
Armand, Paul ;
Benoist, Joel .
MATHEMATICAL PROGRAMMING, 2013, 137 (1-2) :587-592
[2]  
Arreckx S, 2016, G201642 GERAD
[3]   2-POINT STEP SIZE GRADIENT METHODS [J].
BARZILAI, J ;
BORWEIN, JM .
IMA JOURNAL OF NUMERICAL ANALYSIS, 1988, 8 (01) :141-148
[4]   An interior point Newton-like method for non-negative least-squares problems with degenerate solution [J].
Bellavia, Stefania ;
Macconi, Maria ;
Morini, Benedetta .
NUMERICAL LINEAR ALGEBRA WITH APPLICATIONS, 2006, 13 (10) :825-846
[5]   Computational experience with numerical methods for nonnegative least-squares problems [J].
Bellavia, Stefania ;
Gondzio, Jacek ;
Morini, Benedetta .
NUMERICAL LINEAR ALGEBRA WITH APPLICATIONS, 2011, 18 (03) :363-385
[6]   Regularization and preconditioning of KKT systems arising in nonnegative least-squares problems [J].
Bellavia, Stefania ;
Gondzii, Jacek ;
Morini, Benedetta .
NUMERICAL LINEAR ALGEBRA WITH APPLICATIONS, 2009, 16 (01) :39-61
[7]   ON ITERATIVE ALGORITHMS FOR LINEAR LEAST-SQUARES PROBLEMS WITH BOUND CONSTRAINTS [J].
BIERLAIRE, M ;
TOINT, PL ;
TUYTTENS, D .
LINEAR ALGEBRA AND ITS APPLICATIONS, 1991, 143 :111-143
[8]   STABILITY ANALYSIS OF THE METHOD OF SEMINORMAL EQUATIONS FOR LINEAR LEAST-SQUARES PROBLEMS [J].
BJORCK, A .
LINEAR ALGEBRA AND ITS APPLICATIONS, 1987, 88-9 :31-48
[9]  
Bjorck A., 1996, OT51 SIAM
[10]   FINE-GRAINED MULTITHREADING FOR THE MULTIFRONTAL QR FACTORIZATION OF SPARSE MATRICES [J].
Buttari, Alfredo .
SIAM JOURNAL ON SCIENTIFIC COMPUTING, 2013, 35 (04) :C323-C345