MINIMIZATION OF TRANSFORMED L1 PENALTY: CLOSED FORM REPRESENTATION AND ITERATIVE THRESHOLDING ALGORITHMS

被引:46
|
作者
Zhang, Shuai [1 ]
Xin, Jack [1 ]
机构
[1] Univ Calif Irvine, Dept Math, Irvine, CA 92697 USA
基金
美国国家科学基金会;
关键词
Transformed l(1) penalty; closed form thresholding functions; iterative thresholding algorithms; compressed sensing; robust recovery; VARIABLE SELECTION; REGULARIZATION; RECOVERY; SPARSITY;
D O I
10.4310/CMS.2017.v15.n2.a9
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
The transformed l(1) penalty (TL1) functions are a one parameter family of bilinear transformations composed with the absolute value function. When acting on vectors, the TL1 penalty interpolates l(0) and l(1) similar to lp norm, where p is in (0,1). In our companion paper, we showed that TL1 is a robust sparsity promoting penalty in compressed sensing (CS) problems for a broad range of incoherent and coherent sensing matrices. Here we develop an explicit fixed point representation for the TL1 regularized minimization problem. The TL1 thresholding functions are in closed form for all parameter values. In contrast, the lp thresholding functions (p is in [0,1]) are in closed form only for p= 0,1,1/2, 2/3, known as hard, soft, half, and 2/3 thresholding respectively. The TL1 threshold values differ in subcritical (supercritical) parameter regime where the TL1 threshold functions are continuous (discontinuous) similar to soft-thresholding (half-thresholding) functions. We propose TL1 iterative thresholding algorithms and compare them with hard and half thresholding algorithms in CS test problems. For both incoherent and coherent sensing matrices, a proposed TL1 iterative thresholding algorithm with adaptive subcritical and supercritical thresholds (TL1IT-s1 for short), consistently performs the best in sparse signal recovery with and without measurement noise.
引用
收藏
页码:511 / 537
页数:27
相关论文
共 50 条
  • [1] L1/2 Regularization: Convergence of Iterative Half Thresholding Algorithm
    Zeng, Jinshan
    Lin, Shaobo
    Wang, Yao
    Xu, Zongben
    IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2014, 62 (09) : 2317 - 2329
  • [2] TRANSFORMED SCHATTEN-1 ITERATIVE THRESHOLDING ALGORITHMS FOR LOW RANK MATRIX COMPLETION
    Zhang, Shuai
    Yin, Penghang
    Xin, Jack
    COMMUNICATIONS IN MATHEMATICAL SCIENCES, 2017, 15 (03) : 839 - 862
  • [3] Minimization of multi-penalty functionals by alternating iterative thresholding and optimal parameter choices
    Naumova, Valeriya
    Peter, Steffen
    INVERSE PROBLEMS, 2014, 30 (12)
  • [4] ITERATIVE l1 MINIMIZATION FOR NON-CONVEX COMPRESSED SENSING
    Yin, Penghang
    Xin, Jack
    JOURNAL OF COMPUTATIONAL MATHEMATICS, 2017, 35 (04) : 439 - 451
  • [5] L1/2 Regularization: A Thresholding Representation Theory and a Fast Solver
    Xu, Zongben
    Chang, Xiangyu
    Xu, Fengmin
    Zhang, Hai
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2012, 23 (07) : 1013 - 1027
  • [6] On first-order algorithms for l1/nuclear norm minimization
    Nesterov, Yurii
    Nemirovski, Arkadi
    ACTA NUMERICA, 2013, 22 : 509 - 575
  • [7] Analysis L1/2 Regularization: Iterative Half Thresholding Algorithm for CS-MRI
    Yuan, Lianjun
    Li, Yunyi
    Dai, Fei
    Long, Yan
    Cheng, Xiefeng
    Gui, Guan
    IEEE ACCESS, 2019, 7 : 79366 - 79373
  • [8] Global Search and Analysis for the Nonconvex Two-Level l1 Penalty
    He, Fan
    He, Mingzhen
    Shi, Lei
    Huang, Xiaolin
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (03) : 3886 - 3899
  • [9] Bregman Iterative Algorithms for l1-Minimization with Applications to Compressed Sensing
    Yin, Wotao
    Osher, Stanley
    Goldfarb, Donald
    Darbon, Jerome
    SIAM JOURNAL ON IMAGING SCIENCES, 2008, 1 (01): : 143 - 168
  • [10] Fast and Accurate Algorithms for Re-Weighted l1-Norm Minimization
    Asif, M. Salman
    Romberg, Justin
    IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2013, 61 (23) : 5905 - 5916