Efficient Implementation of Truncated Reweighting Low-Rank Matrix Approximation

被引:19
作者
Zheng, Jianwei [1 ]
Qin, Mengjie [1 ]
Zhou, Xiaolong [2 ]
Mao, Jiafa [1 ]
Yu, Hongchuan [3 ]
机构
[1] Zhejiang Univ Technol, Sch Comp Sci & Engn, Hangzhou 311122, Peoples R China
[2] Quzhou Univ, Coll Elect & Informat Engn, Quzhou 324002, Peoples R China
[3] Bournemouth Univ, Natl Ctr Comp Animat, Poole BH12 5BB, Dorset, England
基金
中国国家自然科学基金;
关键词
Minimization; Convergence; Informatics; Visualization; Acceleration; Manganese; Optimization; Accelerated proximal gradient; matrix completion; nuclear norm minimization; singular value thresholding; subspace clustering; NUCLEAR NORM MINIMIZATION; REGULARIZATION;
D O I
10.1109/TII.2019.2916986
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The weighted nuclear norm minimization and truncated nuclear norm minimization are two well-known low-rank constraint for visual applications. In this paper, by integrating their advantages into a unified formulation, we find a better weighting strategy, namely truncated reweighting norm minimization (TRNM), which provides better approximation to the target rank for some specific task. Albeit nonconvex and truncated, we prove that TRNM is equivalent to certain weighted quadratic programming problems, whose global optimum can be accessed by the newly presented reweighting singular value thresholding operator. More importantly, we design a computationally efficient optimization algorithm, namely momentum update and rank propagation (MURP), for the general TRNM regularized problems. The individual advantages of MURP include, first, reducing iterations through nonmonotonic search, and second, mitigating computational cost by reducing the size of target matrix. Furthermore, the descent property and convergence of MURP are proven. Finally, two practical models, i.e., Matrix Completion Problem via TRNM (MCTRNM) and Space Clustering Model via TRNM (SCTRNM), are presented for visual applications. Extensive experimental results show that our methods achieve better performance, both qualitatively and quantitatively, compared with several state-of-the-art algorithms.
引用
收藏
页码:488 / 500
页数:13
相关论文
共 31 条
[1]  
Bigot J, 2017, J MACH LEARN RES, V18
[2]   Recovering low-rank and sparse matrix based on the truncated nuclear norm [J].
Cao, Feilong ;
Chen, Jiaying ;
Ye, Hailiang ;
Zhao, Jianwei ;
Zhou, Zhenghua .
NEURAL NETWORKS, 2017, 85 :10-20
[3]  
Clopton L., 2017, CSMR REU, P1
[4]   Truncated Nuclear Norm Minimization Based Group Sparse Representation for Image Restoration [J].
Geng, Tianyu ;
Sun, Guiling ;
Xu, Yi ;
He, Jingfei .
SIAM JOURNAL ON IMAGING SCIENCES, 2018, 11 (03) :1878-1897
[5]   Weighted Nuclear Norm Minimization and Its Applications to Low Level Vision [J].
Gu, Shuhang ;
Xie, Qi ;
Meng, Deyu ;
Zuo, Wangmeng ;
Feng, Xiangchu ;
Zhang, Lei .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 2017, 121 (02) :183-208
[6]   Weighted Nuclear Norm Minimization with Application to Image Denoising [J].
Gu, Shuhang ;
Zhang, Lei ;
Zuo, Wangmeng ;
Feng, Xiangchu .
2014 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2014, :2862-2869
[7]   Finding Structure with Randomness: Probabilistic Algorithms for Constructing Approximate Matrix Decompositions [J].
Halko, N. ;
Martinsson, P. G. ;
Tropp, J. A. .
SIAM REVIEW, 2011, 53 (02) :217-288
[8]   Nonconvex nonsmooth optimization via convex-nonconvex majorization-minimization [J].
Lanza, A. ;
Morigi, S. ;
Selesnick, I. ;
Sgallari, F. .
NUMERISCHE MATHEMATIK, 2017, 136 (02) :343-381
[9]  
Li Qunwei, 2017, P MACHINE LEARNING R, V70
[10]   Temporal Subspace Clustering for Human Motion Segmentation [J].
Li, Sheng ;
Li, Kang ;
Fu, Yun .
2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2015, :4453-4461