A Path Algorithm for the Fused Lasso Signal Approximator

被引:152
作者
Hoefling, Holger [1 ]
机构
[1] Univ Med Ctr Freiburg, Dept Med Biometry & Stat, Inst Med Biometry & Med Informat, D-70194 Freiburg, Germany
关键词
Convex optimization; Lasso; Penalized regression; SELECTION;
D O I
10.1198/jcgs.2010.09208
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
The Lasso is a very well-known penalized regression model, which adds an L-1 penalty with parameter lambda(1) on the coefficients to the squared error loss function. The Fused Lasso extends this model by also putting an L-1 penalty with parameter lambda(2) on the difference of neighboring coefficients, assuming there is a natural ordering. In this article, we develop a path algorithm for solving the Fused Lasso Signal Approximator that computes the solutions for all values of lambda(1) and lambda(2). We also present an approximate algorithm that has considerable speed advantages for a moderate trade-off in accuracy. In the Online Supplement for this article, we provide proofs and further details for the methods developed in the article.
引用
收藏
页码:984 / 1006
页数:23
相关论文
共 15 条
[1]  
[Anonymous], 2007, Graphs, Networks and Algorithms
[2]  
Bertsekas D. P, 1999, Nonlinear Programming, V2nd
[3]  
Cormen T., 2001, Introduction to Algorithms
[4]   Least angle regression - Rejoinder [J].
Efron, B ;
Hastie, T ;
Johnstone, I ;
Tibshirani, R .
ANNALS OF STATISTICS, 2004, 32 (02) :494-499
[5]   PATHWISE COORDINATE OPTIMIZATION [J].
Friedman, Jerome ;
Hastie, Trevor ;
Hoefling, Holger ;
Tibshirani, Robert .
ANNALS OF APPLIED STATISTICS, 2007, 1 (02) :302-332
[6]  
Grant M., 2014, CVX MATLAB SOFTWARE
[7]   Graph implementations for nonsmooth convex programs [J].
Stanford University, United States .
Lect. Notes Control Inf. Sci., 2008, (95-110) :95-110
[8]  
Hastie T, 2004, J MACH LEARN RES, V5, P1391
[9]   A new approach to variable selection in least squares problems [J].
Osborne, MR ;
Presnell, B ;
Turlach, BA .
IMA JOURNAL OF NUMERICAL ANALYSIS, 2000, 20 (03) :389-403
[10]   L1-regularization path algorithm for generalized linear models [J].
Park, Mee Young ;
Hastie, Trevor .
JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES B-STATISTICAL METHODOLOGY, 2007, 69 :659-677