CERTIFYING THE ABSENCE OF SPURIOUS LOCAL MINIMA AT INFINITY

被引:1
作者
Josz, Cedric [1 ]
Li, Xiaopeng [1 ]
机构
[1] Columbia Univ, Dept Ind Engn & Operat Res, New York, NY 10027 USA
关键词
global optimization; Morse-Sard theorem; subgradient trajectories; VARIATIONAL PRINCIPLE; MATRIX; NETWORKS;
D O I
10.1137/22M1479531
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
When searching for global optima of nonconvex unconstrained optimization problems, it is desirable that every local minimum be a global minimum. This property of having no spurious local minima is true in various problems of interest nowadays, including principal component analysis, matrix sensing, and linear neural networks. However, since these problems are noncoercive, they may yet have spurious local minima at infinity. The classical tools used to analyze the optimization landscape, namely the gradient and the Hessian, are incapable of detecting spurious local minima at infinity. In this paper, we identify conditions that certify the absence of spurious local minima at infinity, one of which is having bounded subgradient trajectories. We check that they hold in several applications of interest.
引用
收藏
页码:1416 / 1439
页数:24
相关论文
共 26 条
[21]   Finding improved local minima of power system optimization problems by interior-point methods [J].
Santos, JR ;
Lora, AT ;
Expósito, AG ;
Ramos, JLM .
IEEE TRANSACTIONS ON POWER SYSTEMS, 2003, 18 (01) :238-244
[22]   Machine-learning-based sampling method for exploring local energy minima of interstitial species in a crystal [J].
Toyoura, Kazuaki ;
Kanayama, Kansei .
PHYSICAL REVIEW B, 2020, 102 (17)
[23]   Algorithm 829: Software for generation of classes of test functions with known local and global minima for global optimization [J].
Gaviano, M ;
Kvasov, DE ;
Lera, D ;
Sergeyev, YD .
ACM TRANSACTIONS ON MATHEMATICAL SOFTWARE, 2003, 29 (04) :469-480
[24]   The normalized risk-averting error criterion for avoiding nonglobal local minima in training neural networks [J].
Lo, James Ting-Ho ;
Gui, Yichuan ;
Peng, Yun .
NEUROCOMPUTING, 2015, 149 :3-12
[25]   A class of one-parameter filled functions with the same local minima as the objective function for global optimization problems [J].
Shang, Youlin ;
Sun, Guanglei ;
Wang, Xiaoqiang ;
Zhang, Roxin .
OPTIMIZATION, 2024,
[26]   Investigating regional identities within the pan-Alpine governance system: The presence or absence of identification with a "community of problems" among local political actors [J].
Del Biaggio, Cristina .
ENVIRONMENTAL SCIENCE & POLICY, 2015, 49 :45-56