On Partial Smoothness, Activity Identification and Faster Algorithms of L1 Over L2 Minimization

被引:0
|
作者
Tao, Min [1 ]
Zhang, Xiao-Ping [2 ]
Xia, Zi-Hao [3 ]
机构
[1] Nanjing Univ, Dept Math, Natl Key Lab Novel Software Technol, Nanjing 210093, Peoples R China
[2] Tsinghua Univ, Shenzhen Int Grad Sch, Shenzhen Key Lab Ubiquitous Data Enabling, Shenzhen 518055, Peoples R China
[3] Nanjing Univ, Dept Math, Nanjing 210093, Peoples R China
关键词
Manifolds; Minimization; Signal processing algorithms; Convergence; Newton method; Vectors; Linear programming; Sparse recovery; partly smooth; prox-regularity; active set; nonsmooth analysis; identifiable surface; SPARSE REPRESENTATION; L(2) NORMS; OPTIMIZATION; REGULARIZATION; CONSTRAINTS; SIGNAL; RATIO; L(1);
D O I
10.1109/TSP.2024.3404250
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
The L-1 /L-2 norm ratio arose as a sparseness measure and attracted a considerable amount of attention due tothree merits: (i) sharper approximations ofL0compared to theL(1); (ii) parameter-free and scale-invariant; (iii) more attractive than L-1 under highly-coherent matrices. In this paper, we firstestablish the partly smooth property of L-1 ove rL(2) minimizationrelative to an active manifold M and also demonstrate itsprox-regularity property. Second, we reveal that AD M Mp(orADMM+p) can identify the active manifold within a finite itera-tions. This discovery contributes to a deeper understanding of the optimization landscape associated with L-1 over L-2 minimization. Third, we propose a novel heuristic algorithm framework that combines ADMMp(or ADMM+p) with a globalized semismooth Newton method tailored for the active manifold M. This hybrid approach leverages the strengths of both methods to enhance convergence. Finally, through extensive numerical simulations, we show case the superiority of our heuristic algorithm over existing state-of-the-art methods for sparse recovery.
引用
收藏
页码:2874 / 2889
页数:16
相关论文
共 50 条
  • [31] KERNEL LEARNING FOR SOUND FIELD ESTIMATION WITH L1 AND L2 REGULARIZATIONS
    Horiuchi, Ryosuke
    Koyama, Shoichi
    Ribeiro, Juliano G. C.
    Ueno, Natsuki
    Saruwatari, Hiroshi
    2021 IEEE WORKSHOP ON APPLICATIONS OF SIGNAL PROCESSING TO AUDIO AND ACOUSTICS (WASPAA), 2021, : 261 - 265
  • [32] Approximate affine linear relationship between L1 norm objective functional values and L2 norm constraint bounds
    Yang, Zhijing
    Ling, Bingo Wing-Kuen
    Bingham, Chris
    IET SIGNAL PROCESSING, 2015, 9 (09) : 670 - 680
  • [33] Planar Gradient Coil Design Using L1 and L2 Norms
    Lopez, Hector Sanchez
    Xu, Yajie
    Andono, Pulung Nurtantio
    Chang, Yan
    Yang, Xiaodong
    APPLIED MAGNETIC RESONANCE, 2018, 49 (09) : 959 - 973
  • [34] Improved Sufficient Condition for l1 - l2-Minimization on Cumulative Coherence
    Shi, Hongyan
    Wang, Jiangtao
    IEEE ACCESS, 2024, 12 : 89707 - 89712
  • [35] Orbital minimization method with l1 regularization
    Lu, Jianfeng
    Thicke, Kyle
    JOURNAL OF COMPUTATIONAL PHYSICS, 2017, 336 : 87 - 103
  • [36] Data-Driven Attack Detection and Identification for Cyber-Physical Systems Under Sparse Sensor Attacks: Iterative Reweighted l2/l1 Recovery Approach
    Wang, Jun-Lan
    Li, Xiao-Jian
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS I-REGULAR PAPERS, 2025,
  • [37] Image Reconstruction in Ultrasonic Transmission Tomography Using L1/L2 Regularization
    Li, Aoyu
    Liang, Guanghui
    Dong, Feng
    2024 IEEE INTERNATIONAL INSTRUMENTATION AND MEASUREMENT TECHNOLOGY CONFERENCE, I2MTC 2024, 2024,
  • [38] MINIMIZATION OF TRANSFORMED L1 PENALTY: CLOSED FORM REPRESENTATION AND ITERATIVE THRESHOLDING ALGORITHMS
    Zhang, Shuai
    Xin, Jack
    COMMUNICATIONS IN MATHEMATICAL SCIENCES, 2017, 15 (02) : 511 - 537
  • [39] An image restoration model combining mixed L1/L2 fidelity terms
    Jia, Tongtong
    Shi, Yuying
    Zhu, Yonggui
    Wang, Lei
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2016, 38 : 461 - 473
  • [40] Subspace clustering via joint l1,2 and l2,1 norms
    Dong, Wenhua
    Wu, Xiao-Jun
    Kittler, Josef
    INFORMATION SCIENCES, 2022, 612 : 675 - 686