On Partial Smoothness, Activity Identification and Faster Algorithms of L1 Over L2 Minimization

被引:0
|
作者
Tao, Min [1 ]
Zhang, Xiao-Ping [2 ]
Xia, Zi-Hao [3 ]
机构
[1] Nanjing Univ, Dept Math, Natl Key Lab Novel Software Technol, Nanjing 210093, Peoples R China
[2] Tsinghua Univ, Shenzhen Int Grad Sch, Shenzhen Key Lab Ubiquitous Data Enabling, Shenzhen 518055, Peoples R China
[3] Nanjing Univ, Dept Math, Nanjing 210093, Peoples R China
关键词
Manifolds; Minimization; Signal processing algorithms; Convergence; Newton method; Vectors; Linear programming; Sparse recovery; partly smooth; prox-regularity; active set; nonsmooth analysis; identifiable surface; SPARSE REPRESENTATION; L(2) NORMS; OPTIMIZATION; REGULARIZATION; CONSTRAINTS; SIGNAL; RATIO; L(1);
D O I
10.1109/TSP.2024.3404250
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
The L-1 /L-2 norm ratio arose as a sparseness measure and attracted a considerable amount of attention due tothree merits: (i) sharper approximations ofL0compared to theL(1); (ii) parameter-free and scale-invariant; (iii) more attractive than L-1 under highly-coherent matrices. In this paper, we firstestablish the partly smooth property of L-1 ove rL(2) minimizationrelative to an active manifold M and also demonstrate itsprox-regularity property. Second, we reveal that AD M Mp(orADMM+p) can identify the active manifold within a finite itera-tions. This discovery contributes to a deeper understanding of the optimization landscape associated with L-1 over L-2 minimization. Third, we propose a novel heuristic algorithm framework that combines ADMMp(or ADMM+p) with a globalized semismooth Newton method tailored for the active manifold M. This hybrid approach leverages the strengths of both methods to enhance convergence. Finally, through extensive numerical simulations, we show case the superiority of our heuristic algorithm over existing state-of-the-art methods for sparse recovery.
引用
收藏
页码:2874 / 2889
页数:16
相关论文
共 50 条
  • [21] L1 norm minimization in partial errors-in-variables model
    Jun Zhao
    Qingming Gui
    Feixiao Guo
    Acta Geodaetica et Geophysica, 2017, 52 : 389 - 406
  • [22] On first-order algorithms for l1/nuclear norm minimization
    Nesterov, Yurii
    Nemirovski, Arkadi
    ACTA NUMERICA, 2013, 22 : 509 - 575
  • [23] Connectivity effects in pseudoclefts in L1 and L2 speakers of German
    Drummer, Janna-Deborah
    Felser, Claudia
    SECOND LANGUAGE RESEARCH, 2024, 40 (02) : 377 - 397
  • [24] L1 norm minimization in partial errors-in-variables model
    Zhao, Jun
    Gui, Qingming
    Guo, Feixiao
    ACTA GEODAETICA ET GEOPHYSICA, 2017, 52 (03) : 389 - 406
  • [25] Analysis of the ratio of l1 and l2 norms in compressed sensing
    Xu, Yiming
    Narayan, Akil
    Hoang Tran
    Webster, Clayton G.
    APPLIED AND COMPUTATIONAL HARMONIC ANALYSIS, 2021, 55 : 486 - 511
  • [26] Processing syntactic and semantic information in the L2: Evidence for differential cue-weighting in the L1 and L2
    Deniz, Nazik Dinctopal
    BILINGUALISM-LANGUAGE AND COGNITION, 2022, 25 (05) : 713 - 725
  • [27] Application of L1 - L2 Regularization in Sparse-View Photoacoustic Imaging Reconstruction
    Wang, Mengyu
    Dai, Shuo
    Wang, Xin
    Liu, Xueyan
    IEEE PHOTONICS JOURNAL, 2024, 16 (03): : 1 - 8
  • [28] Beyond sparsity:: Recovering structured representations by l1 minimization and greedy algorithms
    Gribonval, Remi
    Nielsen, Morten
    ADVANCES IN COMPUTATIONAL MATHEMATICS, 2008, 28 (01) : 23 - 41
  • [29] On Recovery of Sparse Signals Via l1 Minimization
    Cai, T. Tony
    Xu, Guangwu
    Zhang, Jun
    IEEE TRANSACTIONS ON INFORMATION THEORY, 2009, 55 (07) : 3388 - 3397
  • [30] Morozov's Discrepancy Principle For αl1 - βl2 Sparsity Regularization
    Ding, Liang
    Han, Weimin
    INVERSE PROBLEMS AND IMAGING, 2023, 17 (01) : 157 - 179