Role of sparsity and structure in the optimization landscape of non-convex matrix sensing

被引:2
|
作者
Molybog, Igor [1 ]
Sojoudi, Somayeh [1 ]
Lavaei, Javad [1 ]
机构
[1] Univ Calif Berkeley, Berkeley, CA 94720 USA
关键词
Non-convex optimization; Spurious local minima; Matrix sensing; COMPLETION;
D O I
10.1007/s10107-020-01590-2
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
In this work, we study the optimization landscape of the non-convex matrix sensing problem that is known to have many local minima in the worst case. Since the existing results are related to the notion of restricted isometry property (RIP) that cannot directly capture the underlying structure of a given problem, they can hardly be applied to real-world problems where the amount of data is not exorbitantly high. To address this issue, we develop the notion of kernel structure property to obtain necessary and sufficient conditions for the inexistence of spurious local solutions for any class of matrix sensing problems over a given search space. This notion precisely captures the underlying sparsity and structure of the problem, based on tools in conic optimization. We simplify the conditions for a certain class of problems to show their satisfaction and apply them to data analytics for power systems.
引用
收藏
页码:75 / 111
页数:37
相关论文
共 50 条
  • [11] Optimization of Non-Convex Multiband Cooperative Sensing With Genetic Algorithms
    Sanna, Michele
    Murroni, Maurizio
    IEEE JOURNAL OF SELECTED TOPICS IN SIGNAL PROCESSING, 2011, 5 (01) : 87 - 96
  • [12] Compressed sensing of large-scale local field potentials using adaptive sparsity analysis and non-convex optimization
    Sun, Biao
    Zhang, Han
    Zhang, Yunyan
    Wu, Zexu
    Bao, Botao
    Hu, Yong
    Li, Ting
    JOURNAL OF NEURAL ENGINEERING, 2021, 18 (02)
  • [13] The non-convex geometry of low-rank matrix optimization
    Li, Qiuwei
    Zhu, Zhihui
    Tang, Gongguo
    INFORMATION AND INFERENCE-A JOURNAL OF THE IMA, 2019, 8 (01) : 51 - 96
  • [14] THE LANDSCAPE OF NON-CONVEX QUADRATIC FEASIBILITY
    Bower, Amanda
    Jain, Lalit
    Balzano, Laura
    2018 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2018, : 3974 - 3978
  • [15] NON-CONVEX GROUP SPARSITY: APPLICATION TO COLOR IMAGING
    Majumdar, Angshul
    Ward, Rabab K.
    2010 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, 2010, : 469 - 472
  • [16] Multiple kernel learning with NOn-conVex group spArsity
    Lu, W. (luwm@zju.edu.cn), 1616, Academic Press Inc. (25):
  • [17] Non-Convex Rank/Sparsity Regularization and Local Minima
    Olsson, Carl
    Carlsson, Marcus
    Andersson, Fredrik
    Larsson, Viktor
    2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, : 332 - 340
  • [18] Multiple kernel learning with NOn-conVex group spArsity
    Yuan, Ying
    Lu, Weiming
    Wu, Fei
    Zhuang, Yueting
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2014, 25 (07) : 1616 - 1624
  • [19] ON THE MINIMIZATION OF A TIKHONOV FUNCTIONAL WITH A NON-CONVEX SPARSITY CONSTRAINT
    Ramlau, Ronny
    Zarzer, Clemens A.
    ELECTRONIC TRANSACTIONS ON NUMERICAL ANALYSIS, 2012, 39 : 476 - 507
  • [20] FUSED LASSO WITH A NON-CONVEX SPARSITY INDUCING PENALTY
    Bayram, Ilker
    Chen, Po-Yu
    Selesnick, Ivan W.
    2014 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2014,