Role of sparsity and structure in the optimization landscape of non-convex matrix sensing

被引:2
|
作者
Molybog, Igor [1 ]
Sojoudi, Somayeh [1 ]
Lavaei, Javad [1 ]
机构
[1] Univ Calif Berkeley, Berkeley, CA 94720 USA
关键词
Non-convex optimization; Spurious local minima; Matrix sensing; COMPLETION;
D O I
10.1007/s10107-020-01590-2
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
In this work, we study the optimization landscape of the non-convex matrix sensing problem that is known to have many local minima in the worst case. Since the existing results are related to the notion of restricted isometry property (RIP) that cannot directly capture the underlying structure of a given problem, they can hardly be applied to real-world problems where the amount of data is not exorbitantly high. To address this issue, we develop the notion of kernel structure property to obtain necessary and sufficient conditions for the inexistence of spurious local solutions for any class of matrix sensing problems over a given search space. This notion precisely captures the underlying sparsity and structure of the problem, based on tools in conic optimization. We simplify the conditions for a certain class of problems to show their satisfaction and apply them to data analytics for power systems.
引用
收藏
页码:75 / 111
页数:37
相关论文
共 50 条
  • [41] Convex and Non-convex Optimization Under Generalized Smoothness
    Li, Haochuan
    Qian, Jian
    Tian, Yi
    Rakhlin, Alexander
    Jadbabaie, Ali
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 36 (NEURIPS 2023), 2023,
  • [42] A non-convex regularization approach for compressive sensing
    Fan, Ya-Ru
    Buccini, Alessandro
    Donatelli, Marco
    Huang, Ting-Zhu
    ADVANCES IN COMPUTATIONAL MATHEMATICS, 2019, 45 (02) : 563 - 588
  • [43] A non-convex regularization approach for compressive sensing
    Ya-Ru Fan
    Alessandro Buccini
    Marco Donatelli
    Ting-Zhu Huang
    Advances in Computational Mathematics, 2019, 45 : 563 - 588
  • [44] Non-convex approach to binary compressed sensing
    Fosson, Sophie M.
    2018 CONFERENCE RECORD OF 52ND ASILOMAR CONFERENCE ON SIGNALS, SYSTEMS, AND COMPUTERS, 2018, : 1959 - 1963
  • [45] A new accelerating method for global non-convex quadratic optimization with non-convex quadratic constraints
    Wu, Huizhuo
    Zhang, KeCun
    APPLIED MATHEMATICS AND COMPUTATION, 2008, 197 (02) : 810 - 818
  • [46] Image Deblurring Based on Nonlocal Regularization With a Non-Convex Sparsity Constraint
    Zhu, Simiao
    Su, Zhenming
    Li, Lian
    Yang, Yi
    NINTH INTERNATIONAL CONFERENCE ON GRAPHIC AND IMAGE PROCESSING (ICGIP 2017), 2018, 10615
  • [47] GloptiNets: Scalable Non-Convex Optimization with Certificates
    Beugnot, Gaspard
    Mairal, Julien
    Rudi, Alessandro
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 36 (NEURIPS 2023), 2023,
  • [48] AN EFFICIENT ALGORITHM FOR NON-CONVEX SPARSE OPTIMIZATION
    Wang, Yong
    Liu, Wanquan
    Zhou, Guanglu
    JOURNAL OF INDUSTRIAL AND MANAGEMENT OPTIMIZATION, 2019, 15 (04) : 2009 - 2021
  • [49] STABILITY FOR A CLASS OF NON-CONVEX OPTIMIZATION PROBLEMS
    ZALINESCU, C
    COMPTES RENDUS DE L ACADEMIE DES SCIENCES SERIE I-MATHEMATIQUE, 1988, 307 (12): : 643 - 646
  • [50] LAGRANGE MULTIPLIERS IN NON-CONVEX OPTIMIZATION AND APPLICATIONS
    AUBIN, JP
    CLARKE, FH
    COMPTES RENDUS HEBDOMADAIRES DES SEANCES DE L ACADEMIE DES SCIENCES SERIE A, 1977, 285 (06): : 451 - 454