Bilevel Imaging Learning Problems as Mathematical Programs with Complementarity Constraints: Reformulation and Theory

被引:2
作者
De los Reyes, Juan Carlos [1 ]
机构
[1] Escuela Politec Nacl, Res Ctr Math Modeling MODEMAT, Quito, Ecuador
关键词
bilevel optimization; variational models; machine learning; OPTIMALITY CONDITIONS; OPTIMIZATION;
D O I
10.1137/21M1450744
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We investigate a family of bilevel imaging learning problems where the lower-level instance corre-sponds to a convex variational model involving first-and second-order nonsmooth sparsity-based regularizers. By using geometric properties of the primal-dual reformulation of the lower-level prob-lem and introducing suitable auxiliary variables, we are able to reformulate the original bilevel problems as mathematical programs with complementarity constraints (MPCC). For the latter, we prove tight constraint qualification conditions (MPCC-RCPLD and partial MPCC-LICQ) and derive Mordukhovich (M-) and strong (S-) stationarity conditions. The stationarity systems for the MPCC turn also into stationarity conditions for the original formulation. Second-order suf lcient optimality conditions are derived as well, together with a local uniqueness result for stationary points. The proposed reformulation may be extended to problems in function spaces, leading to MPCC with constraints on the gradient of the state. The MPCC reformulation also leads to the ef lcient use of available large-scale nonlinear programming solvers, as shown in a companion paper, where different imaging applications are studied.
引用
收藏
页码:1655 / 1686
页数:32
相关论文
共 37 条
[1]  
[Anonymous], 2013, IFIP C SYST MOD OPT
[2]  
BARTELS S., 2020, arXiv
[3]   Total Generalized Variation [J].
Bredies, Kristian ;
Kunisch, Karl ;
Pock, Thomas .
SIAM JOURNAL ON IMAGING SCIENCES, 2010, 3 (03) :492-526
[4]  
Calatroni L., 2017, VARIATIONAL METHODS, V18, P252, DOI DOI 10.1515/9783110430394-008
[5]   Analysis and automatic parameter selection of a variational model for mixed Gaussian and salt-and-pepper noise removal [J].
Calatroni, Luca ;
Papafitsoros, Kostas .
INVERSE PROBLEMS, 2019, 35 (11)
[6]  
De los Reyes JC, 2022, HANDBOOK OF MATHEMATICAL MODELS AND ALGORITHMS IN COMPUTER VISION AND IMAGING, P909, DOI 10.1007/978-3-030-98661-2_66
[7]   IMAGE DENOISING: LEARNING THE NOISE MODEL VIA NONSMOOTH PDE-CONSTRAINED OPTIMIZATION [J].
Carlos De los Reyes, Juan ;
Schoenlieb, Carola-Bibiane .
INVERSE PROBLEMS AND IMAGING, 2013, 7 (04) :1183-1214
[8]   Image recovery via total variation minimization and related problems [J].
Chambolle, A ;
Lions, PL .
NUMERISCHE MATHEMATIK, 1997, 76 (02) :167-188
[9]   High-order total variation-based image restoration [J].
Chan, T ;
Marquina, A ;
Mulet, P .
SIAM JOURNAL ON SCIENTIFIC COMPUTING, 2000, 22 (02) :503-516
[10]   Identification of discontinuous coefficients in elliptic problems using total variation regularization [J].
Chan, TF ;
Tai, XC .
SIAM JOURNAL ON SCIENTIFIC COMPUTING, 2003, 25 (03) :881-904