Role of sparsity and structure in the optimization landscape of non-convex matrix sensing

被引:2
|
作者
Molybog, Igor [1 ]
Sojoudi, Somayeh [1 ]
Lavaei, Javad [1 ]
机构
[1] Univ Calif Berkeley, Berkeley, CA 94720 USA
关键词
Non-convex optimization; Spurious local minima; Matrix sensing; COMPLETION;
D O I
10.1007/s10107-020-01590-2
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
In this work, we study the optimization landscape of the non-convex matrix sensing problem that is known to have many local minima in the worst case. Since the existing results are related to the notion of restricted isometry property (RIP) that cannot directly capture the underlying structure of a given problem, they can hardly be applied to real-world problems where the amount of data is not exorbitantly high. To address this issue, we develop the notion of kernel structure property to obtain necessary and sufficient conditions for the inexistence of spurious local solutions for any class of matrix sensing problems over a given search space. This notion precisely captures the underlying sparsity and structure of the problem, based on tools in conic optimization. We simplify the conditions for a certain class of problems to show their satisfaction and apply them to data analytics for power systems.
引用
收藏
页码:75 / 111
页数:37
相关论文
共 50 条
  • [21] On the minimization of a tikhonov functional with a non-convex sparsity constraint
    Ramlau, R. (ronny.ramlau@jku.at), 1600, Kent State University (39):
  • [22] Non-convex scenario optimization
    Garatti, Simone
    Campi, Marco C.
    MATHEMATICAL PROGRAMMING, 2025, 209 (1-2) : 557 - 608
  • [23] Non-Convex Distributed Optimization
    Tatarenko, Tatiana
    Touri, Behrouz
    IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2017, 62 (08) : 3744 - 3757
  • [24] Non-Convex Optimization: A Review
    Trehan, Dhruv
    PROCEEDINGS OF THE INTERNATIONAL CONFERENCE ON INTELLIGENT COMPUTING AND CONTROL SYSTEMS (ICICCS 2020), 2020, : 418 - 423
  • [25] DUALITY IN NON-CONVEX OPTIMIZATION
    TOLAND, JF
    JOURNAL OF MATHEMATICAL ANALYSIS AND APPLICATIONS, 1978, 66 (02) : 399 - 415
  • [26] Sensing Cloud Optimization applied to a non-convex constrained economical dispatch
    Fonte, P. M.
    Monteiro, Claudio
    Maciel Barbosa, F. P.
    39TH ANNUAL CONFERENCE OF THE IEEE INDUSTRIAL ELECTRONICS SOCIETY (IECON 2013), 2013, : 2163 - 2168
  • [27] NON-CONVEX SHREDDED SIGNAL RECONSTRUCTION VIA SPARSITY ENHANCEMENT
    Bose, Arindam
    Soltanalian, Mojtaba
    2017 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2017, : 4691 - 4695
  • [28] Natasha: Faster Non-Convex Stochastic Optimization via Strongly Non-Convex Parameter
    Allen-Zhu, Zeyuan
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 70, 2017, 70
  • [29] Non-Convex P-norm Projection for Robust Sparsity
    Das Gupta, Mithun
    Kumar, Sanjeev
    2013 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2013, : 1593 - 1600
  • [30] Sparsity and Cosparsity for Audio Declipping: A Flexible Non-convex Approach
    Kitic, Srdan
    Bertin, Nancy
    Gribonval, Remi
    LATENT VARIABLE ANALYSIS AND SIGNAL SEPARATION, LVA/ICA 2015, 2015, 9237 : 243 - 250