Performance of first- and second-order methods for -regularized least squares problems

被引：0

作者：

Fountoulakis, Kimon ^{[1
,2
]}

Gondzio, Jacek ^{[1
,2
,3
]}

机构：

[1] Univ Edinburgh, Sch Math, James Clerk Maxwell Bldg,Kings Bldg, Edinburgh EH9 3FD, Midlothian, Scotland

[2] Univ Edinburgh, Maxwell Inst, James Clerk Maxwell Bldg,Kings Bldg, Edinburgh EH9 3FD, Midlothian, Scotland

[3] NASK Res Inst, Wawozowa 18, PL-02796 Warsaw, Poland

来源：

COMPUTATIONAL OPTIMIZATION AND APPLICATIONS | 2016年 / 65卷 / 03期

关键词：

l(1)-Regularised least-squares; First-order methods; Second-order methods; Sparse least squares instance generator; Ill-conditioned problems; COORDINATE DESCENT METHOD; OPTIMIZATION; MINIMIZATION; CONVERGENCE; ALGORITHM;

D O I：

10.1007/s10589-016-9853-x

中图分类号：

C93 [管理学]; O22 [运筹学];

学科分类号：

070105 ; 12 ; 1201 ; 1202 ; 120202 ;

摘要：

We study the performance of first- and second-order optimization methods for -regularized sparse least-squares problems as the conditioning of the problem changes and the dimensions of the problem increase up to one trillion. A rigorously defined generator is presented which allows control of the dimensions, the conditioning and the sparsity of the problem. The generator has very low memory requirements and scales well with the dimensions of the problem.

引用

页码：605 / 635

页数：31

共 45 条

[1]

[Anonymous], J MACH LEARN RES

[2]

[Anonymous], COSAMP OMP SPARSE RE

[3]

[Anonymous], 2012, RUTCOR RES REPORTS

[4]

[Anonymous], TECHNICAL REPORT

[5]

[Anonymous], 2006, Deblurring images: matrices, spectra, and filtering

[6]

[Anonymous], GIGA SCI

[7]

[Anonymous], INTRO LECT NOTE CONV

[8] Optimization with Sparsity-Inducing Penalties [J].

Bach, Francis ;

Jenatton, Rodolphe ;

Mairal, Julien ;

Obozinski, Guillaume .

FOUNDATIONS AND TRENDS IN MACHINE LEARNING, 2012, 4 (01) :1-106

[9] A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems [J].

Beck, Amir ;

Teboulle, Marc .

SIAM JOURNAL ON IMAGING SCIENCES, 2009, 2 (01) :183-202

[10]

BECKER S., 2012, NIPS 12, V2, P2618

← 1 2 3 4 5 →