MINIMIZATION OF TRANSFORMED L1 PENALTY: CLOSED FORM REPRESENTATION AND ITERATIVE THRESHOLDING ALGORITHMS

被引:46
作者
Zhang, Shuai [1 ]
Xin, Jack [1 ]
机构
[1] Univ Calif Irvine, Dept Math, Irvine, CA 92697 USA
基金
美国国家科学基金会;
关键词
Transformed l(1) penalty; closed form thresholding functions; iterative thresholding algorithms; compressed sensing; robust recovery; VARIABLE SELECTION; REGULARIZATION; RECOVERY; SPARSITY;
D O I
10.4310/CMS.2017.v15.n2.a9
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
The transformed l(1) penalty (TL1) functions are a one parameter family of bilinear transformations composed with the absolute value function. When acting on vectors, the TL1 penalty interpolates l(0) and l(1) similar to lp norm, where p is in (0,1). In our companion paper, we showed that TL1 is a robust sparsity promoting penalty in compressed sensing (CS) problems for a broad range of incoherent and coherent sensing matrices. Here we develop an explicit fixed point representation for the TL1 regularized minimization problem. The TL1 thresholding functions are in closed form for all parameter values. In contrast, the lp thresholding functions (p is in [0,1]) are in closed form only for p= 0,1,1/2, 2/3, known as hard, soft, half, and 2/3 thresholding respectively. The TL1 threshold values differ in subcritical (supercritical) parameter regime where the TL1 threshold functions are continuous (discontinuous) similar to soft-thresholding (half-thresholding) functions. We propose TL1 iterative thresholding algorithms and compare them with hard and half thresholding algorithms in CS test problems. For both incoherent and coherent sensing matrices, a proposed TL1 iterative thresholding algorithm with adaptive subcritical and supercritical thresholds (TL1IT-s1 for short), consistently performs the best in sparse signal recovery with and without measurement noise.
引用
收藏
页码:511 / 537
页数:27
相关论文
共 50 条
  • [31] Iterative Reweighted l2/l1 Recovery Algorithms for Compressed Sensing of Block Sparse Signals
    Zeinalkhani, Zeinab
    Banihashemi, Amir H.
    IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2015, 63 (17) : 4516 - 4531
  • [32] Efficient L1/2 Regularization-Based Reconstruction for Photoacoustic Imaging Using Adaptively Iterative Thresholding Algorithm
    Liu, Xueyan
    Kong, Xu
    Qiao, Lishan
    Zhao, Jianli
    JOURNAL OF MEDICAL IMAGING AND HEALTH INFORMATICS, 2020, 10 (07) : 1506 - 1514
  • [33] Recovery Threshold for Optimal Weight l1 Minimization
    Oymak, Samet
    Khajehnejad, M. Amin
    Hassibi, Babak
    2012 IEEE INTERNATIONAL SYMPOSIUM ON INFORMATION THEORY PROCEEDINGS (ISIT), 2012,
  • [34] Threshold variable selection via a L1 penalty approach
    Jiang, Qian
    Xia, Yingcun
    STATISTICS AND ITS INTERFACE, 2011, 4 (02) : 137 - 148
  • [35] On Recovery of Sparse Signals Via l1 Minimization
    Cai, T. Tony
    Xu, Guangwu
    Zhang, Jun
    IEEE TRANSACTIONS ON INFORMATION THEORY, 2009, 55 (07) : 3388 - 3397
  • [36] l1 penalty for ill-posed inverse problems
    Loubes, Jean-Michel
    COMMUNICATIONS IN STATISTICS-THEORY AND METHODS, 2008, 37 (09) : 1399 - 1411
  • [37] P-splines with an l1 penalty for repeated measures
    Segal, Brian D.
    Elliott, Michael R.
    Braun, Thomas
    Jiang, Hui
    ELECTRONIC JOURNAL OF STATISTICS, 2018, 12 (02): : 3554 - 3600
  • [38] A unified class of penalties with the capability of producing a differentiable alternative to l1 norm penalty
    Haselimashhadi, Hamed
    COMMUNICATIONS IN STATISTICS-THEORY AND METHODS, 2019, 48 (22) : 5530 - 5545
  • [39] A novel property to modify weighted l1 minimization for improved compressed sensing
    He, Yudong
    Woo, Baeck Hyun
    Abdurrahim, Fauzan
    So, Richard H. Y.
    SIGNAL PROCESSING, 2025, 230
  • [40] Sparse logistic regression with a L1/2 penalty for gene selection in cancer classification
    Liang, Yong
    Liu, Cheng
    Luan, Xin-Ze
    Leung, Kwong-Sak
    Chan, Tak-Ming
    Xu, Zong-Ben
    Zhang, Hai
    BMC BIOINFORMATICS, 2013, 14