Generalized Nonconvex Nonsmooth Low-Rank Matrix Recovery Framework With Feasible Algorithm Designs and Convergence Analysis

被引:28
作者
Zhang, Hengmin [1 ,2 ]
Qian, Feng [1 ,3 ]
Shi, Peng [4 ,5 ]
Du, Wenli [1 ,3 ]
Tang, Yang [1 ,3 ]
Qian, Jianjun [6 ,7 ]
Gong, Chen [6 ,7 ]
Yang, Jian [6 ,7 ]
机构
[1] East China Univ Sci & Technol, Sch Informat Sci & Engn, Key Lab Adv Smart Mfg Energy Chem Proc, Minist Educ, Shanghai 200237, Peoples R China
[2] Univ Macau, Dept Comp & Informat Sci, Macau, Peoples R China
[3] Tongji Univ, Shanghai Inst Intelligent Sci & Technol, Shanghai 200092, Peoples R China
[4] Univ Adelaide, Sch Elect & Elect Engn, Adelaide, SA 5005, Australia
[5] Victoria Univ, Coll Engn & Sci, Melbourne, Vic 8001, Australia
[6] Nanjing Univ Sci & Technol, PCA Lab, Nanjing 210094, Peoples R China
[7] Nanjing Univ Sci & Technol, Key Lab Intelligent Percept & Syst High Dimens In, Minist Educ, Nanjing 210094, Peoples R China
基金
中国博士后科学基金;
关键词
Convergence; Optimization; Minimization; Linear programming; Matrix decomposition; Convex functions; Learning systems; Algorithm designs; convergence analysis; low-rank matrix recovery; multiple variables; nonconvex alternating direction method of multiplier (ADMM); ALTERNATING DIRECTION METHOD; ROBUST SUBSPACE SEGMENTATION; VARIABLE SELECTION; NORM; MULTIPLIERS;
D O I
10.1109/TNNLS.2022.3183970
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Decomposing data matrix into low-rank plus additive matrices is a commonly used strategy in pattern recognition and machine learning. This article mainly studies the alternating direction method of multiplier (ADMM) with two dual variables, which is used to optimize the generalized nonconvex nonsmooth low-rank matrix recovery problems. Furthermore, the minimization framework with a feasible optimization procedure is designed along with the theoretical analysis, where the variable sequences generated by the proposed ADMM can be proved to be bounded. Most importantly, it can be concluded from the Bolzano-Weierstrass theorem that there must exist a subsequence converging to a critical point, which satisfies the Karush-Kuhn-Tucher (KKT) conditions. Meanwhile, we further ensure the local and global convergence properties of the generated sequence relying on constructing the potential objective function Particularly, the detailed convergence analysis would be regarded as one of the core contributions besides the algorithm designs and the model generality. Finally, the numerical simulations and the real-world applications are both provided to verify the consistence of the theoretical results, and we also validate the superiority in performance over several mostly related solvers to the tasks of image inpainting and subspace clustering.
引用
收藏
页码:5342 / 5353
页数:12
相关论文
共 59 条
[51]  
Wright J., 2009, C NEUR INF PROC SYST
[52]   Weighted Schatten p-Norm Minimization for Image Denoising and Background Subtraction [J].
Xie, Yuan ;
Gu, Shuhang ;
Liu, Yan ;
Zuo, Wangmeng ;
Zhang, Wensheng ;
Zhang, Lei .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2016, 25 (10) :4842-4857
[53]   Scaled Simplex Representation for Subspace Clustering [J].
Xu, Jun ;
Yu, Mengyang ;
Shao, Ling ;
Zuo, Wangmeng ;
Meng, Deyu ;
Zhang, Lei ;
Zhang, David .
IEEE TRANSACTIONS ON CYBERNETICS, 2021, 51 (03) :1493-1505
[54]   Alternating Direction Method of Multipliers for a Class of Nonconvex and Nonsmooth Problems with Applications to Background/Foreground Extraction [J].
Yang, Lei ;
Pong, Ting Kei ;
Chen, Xiaojun .
SIAM JOURNAL ON IMAGING SCIENCES, 2017, 10 (01) :74-110
[55]  
Yao QM, 2018, J MACH LEARN RES, V18
[56]   NEARLY UNBIASED VARIABLE SELECTION UNDER MINIMAX CONCAVE PENALTY [J].
Zhang, Cun-Hui .
ANNALS OF STATISTICS, 2010, 38 (02) :894-942
[57]   Scalable Proximal Jacobian Iteration Method With Global Convergence Analysis for Nonconvex Unconstrained Composite Optimizations [J].
Zhang, Hengmin ;
Qian, Jianjun ;
Gao, Junbin ;
Yang, Jian ;
Xu, Chunyan .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2019, 30 (09) :2825-2839
[58]   LRR for Subspace Segmentation via Tractable Schatten-p Norm Minimization and Factorization [J].
Zhang, Hengmin ;
Yang, Jian ;
Shang, Fanhua ;
Gong, Chen ;
Zhang, Zhenyu .
IEEE TRANSACTIONS ON CYBERNETICS, 2019, 49 (05) :1722-1734
[59]   A Generalized Iterated Shrinkage Algorithm for Non-convex Sparse Coding [J].
Zuo, Wangmeng ;
Meng, Deyu ;
Zhang, Lei ;
Feng, Xiangchu ;
Zhang, David .
2013 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2013, :217-224