Role of sparsity and structure in the optimization landscape of non-convex matrix sensing

被引:2
|
作者
Molybog, Igor [1 ]
Sojoudi, Somayeh [1 ]
Lavaei, Javad [1 ]
机构
[1] Univ Calif Berkeley, Berkeley, CA 94720 USA
关键词
Non-convex optimization; Spurious local minima; Matrix sensing; COMPLETION;
D O I
10.1007/s10107-020-01590-2
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
In this work, we study the optimization landscape of the non-convex matrix sensing problem that is known to have many local minima in the worst case. Since the existing results are related to the notion of restricted isometry property (RIP) that cannot directly capture the underlying structure of a given problem, they can hardly be applied to real-world problems where the amount of data is not exorbitantly high. To address this issue, we develop the notion of kernel structure property to obtain necessary and sufficient conditions for the inexistence of spurious local solutions for any class of matrix sensing problems over a given search space. This notion precisely captures the underlying sparsity and structure of the problem, based on tools in conic optimization. We simplify the conditions for a certain class of problems to show their satisfaction and apply them to data analytics for power systems.
引用
收藏
页码:75 / 111
页数:37
相关论文
共 50 条
  • [31] Network localization by non-convex optimization
    Saha, Ananya
    Sau, Buddhadeb
    MOBIMWAREHN'17: PROCEEDINGS OF THE 7TH ACM WORKSHOP ON MOBILITY, INTERFERENCE, AND MIDDLEWARE MANAGEMENT IN HETNETS, 2017,
  • [32] Gradient Methods for Non-convex Optimization
    Jain, Prateek
    JOURNAL OF THE INDIAN INSTITUTE OF SCIENCE, 2019, 99 (02) : 247 - 256
  • [33] Parallel continuous non-convex optimization
    Holmqvist, K
    Migdalas, A
    Pardalos, PM
    PARALLEL COMPUTING IN OPTIMIZATION, 1997, 7 : 471 - 527
  • [34] Gradient Methods for Non-convex Optimization
    Prateek Jain
    Journal of the Indian Institute of Science, 2019, 99 : 247 - 256
  • [35] Replica Exchange for Non-Convex Optimization
    Dong, Jing
    Tong, Xin T.
    JOURNAL OF MACHINE LEARNING RESEARCH, 2021, 22
  • [36] Replica exchange for non-convex optimization
    Dong, Jing
    Tong, Xin T.
    1600, Microtome Publishing (22):
  • [37] Robust Optimization for Non-Convex Objectives
    Chen, Robert
    Lucier, Brendan
    Singer, Yaron
    Syrgkanis, Vasilis
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 30 (NIPS 2017), 2017, 30
  • [38] EXISTENCE THEOREMS IN NON-CONVEX OPTIMIZATION
    AUBERT, G
    TAHRAOUI, R
    APPLICABLE ANALYSIS, 1984, 18 (1-2) : 75 - 100
  • [39] CLASS OF NON-CONVEX OPTIMIZATION PROBLEMS
    HIRCHE, J
    TAN, HK
    ZEITSCHRIFT FUR ANGEWANDTE MATHEMATIK UND MECHANIK, 1977, 57 (04): : 247 - 253
  • [40] Accelerated algorithms for convex and non-convex optimization on manifolds
    Lin, Lizhen
    Saparbayeva, Bayan
    Zhang, Michael Minyi
    Dunson, David B.
    MACHINE LEARNING, 2025, 114 (03)