On Partial Smoothness, Activity Identification and Faster Algorithms of L1 Over L2 Minimization

被引:0
|
作者
Tao, Min [1 ]
Zhang, Xiao-Ping [2 ]
Xia, Zi-Hao [3 ]
机构
[1] Nanjing Univ, Dept Math, Natl Key Lab Novel Software Technol, Nanjing 210093, Peoples R China
[2] Tsinghua Univ, Shenzhen Int Grad Sch, Shenzhen Key Lab Ubiquitous Data Enabling, Shenzhen 518055, Peoples R China
[3] Nanjing Univ, Dept Math, Nanjing 210093, Peoples R China
关键词
Manifolds; Minimization; Signal processing algorithms; Convergence; Newton method; Vectors; Linear programming; Sparse recovery; partly smooth; prox-regularity; active set; nonsmooth analysis; identifiable surface; SPARSE REPRESENTATION; L(2) NORMS; OPTIMIZATION; REGULARIZATION; CONSTRAINTS; SIGNAL; RATIO; L(1);
D O I
10.1109/TSP.2024.3404250
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
The L-1 /L-2 norm ratio arose as a sparseness measure and attracted a considerable amount of attention due tothree merits: (i) sharper approximations ofL0compared to theL(1); (ii) parameter-free and scale-invariant; (iii) more attractive than L-1 under highly-coherent matrices. In this paper, we firstestablish the partly smooth property of L-1 ove rL(2) minimizationrelative to an active manifold M and also demonstrate itsprox-regularity property. Second, we reveal that AD M Mp(orADMM+p) can identify the active manifold within a finite itera-tions. This discovery contributes to a deeper understanding of the optimization landscape associated with L-1 over L-2 minimization. Third, we propose a novel heuristic algorithm framework that combines ADMMp(or ADMM+p) with a globalized semismooth Newton method tailored for the active manifold M. This hybrid approach leverages the strengths of both methods to enhance convergence. Finally, through extensive numerical simulations, we show case the superiority of our heuristic algorithm over existing state-of-the-art methods for sparse recovery.
引用
收藏
页码:2874 / 2889
页数:16
相关论文
共 50 条
  • [41] Sentiment Analysis of Tweets by Convolution Neural Network with L1 and L2 Regularization
    Rangra, Abhilasha
    Sehgal, Vivek Kumar
    Shukla, Shailendra
    ADVANCED INFORMATICS FOR COMPUTING RESEARCH, ICAICR 2018, PT I, 2019, 955 : 355 - 365
  • [42] Euclid in a Taxicab: Sparse Blind Deconvolution with Smoothed l1/l2 Regularization
    Repetti, Audrey
    Mai Quyen Pham
    Duval, Laurent
    Chouzenoux, Emilie
    Pesquet, Jean-Christophe
    IEEE SIGNAL PROCESSING LETTERS, 2015, 22 (05) : 539 - 543
  • [43] A new Sigma-Pi-Sigma neural network based on L1 and L2 regularization and applications
    Jiao, Jianwei
    Su, Keqin
    AIMS MATHEMATICS, 2024, 9 (03): : 5995 - 6012
  • [44] An antinoise sparse representation method for robust face recognition via joint l1 and l2 regularization
    Zeng, Shaoning
    Gou, Jianping
    Deng, Lunman
    EXPERT SYSTEMS WITH APPLICATIONS, 2017, 82 : 1 - 9
  • [45] Filler-gap dependencies and islands in L2 English production: Comparing transfer from L1 Norwegian and L1 Swedish
    Kush, Dave
    Dahl, Anne
    Lindahl, Filippa
    SECOND LANGUAGE RESEARCH, 2024, 40 (03) : 739 - 763
  • [46] Design of Sparse FIR Decision Feedback Equalizers in MIMO Systems Using Hybrid l1/l2 Norm Minimization and the OMP Algorithm
    Yu, Lihong
    Zhao, Jiaxiang
    Xu, Wei
    Liu, Haiyuan
    SENSORS, 2018, 18 (06)
  • [47] Direct minimization: Alternative to the traditional L2 norm to derive partial atomic charges
    Haschka, Thomas
    Henon, Eric
    Jaillet, Christophe
    Martiny, Laurent
    Etchebest, Catherine
    Dauchez, Manuel
    COMPUTATIONAL AND THEORETICAL CHEMISTRY, 2015, 1074 : 50 - 57
  • [48] MINIMIZATION OF l1-2 FOR COMPRESSED SENSING
    Yin, Penghang
    Lou, Yifei
    He, Qi
    Xin, Jack
    SIAM JOURNAL ON SCIENTIFIC COMPUTING, 2015, 37 (01) : A536 - A563
  • [49] RIP Analysis for l1/lp (p > 1) Minimization Method
    Xie, Yujia
    Su, Xinhua
    Ge, Huanmin
    IEEE SIGNAL PROCESSING LETTERS, 2023, 30 : 997 - 1001
  • [50] A projected gradient method for nonlinear inverse problems with αl1 - βl2 sparsity regularization
    Zhao, Zhuguang
    Ding, Liang
    JOURNAL OF INVERSE AND ILL-POSED PROBLEMS, 2024, 32 (03): : 513 - 528