A general multi-factor norm based low-rank tensor completion framework

被引:1
作者
Tian, Jialue [1 ]
Zhu, Yulian [2 ]
Liu, Jiahui [1 ]
机构
[1] Nanjing Univ Aeronaut & Astronaut, Coll Comp Sci & Technol, Coll Artificial Intelligence, Nanjing 211106, Jiangsu, Peoples R China
[2] Nanjing Univ Aeronaut & Astronaut, Fundamental Expt Teaching Dept, Nanjing 211106, Jiangsu, Peoples R China
关键词
Tensor completion; Tensor factorization; Unitary Transformed Tensor Multi-Factor Norm (UTTMFN); Tensor Nuclear Norm (TNN); Nonconvex optimization; COLOR IMAGE; FACTORIZATION; MATRIX; APPROXIMATION; MINIMIZATION; ALGORITHM;
D O I
10.1007/s10489-023-04477-9
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Low-rank tensor completion aims to recover the missing entries of the tensor from its partially observed data by using the low-rank property of the tensor. Since rank minimization is an NP-hard problem, the convex surrogate nuclear norm is usually used to replace the rank norm and has obtained promising results. However, the nuclear norm is not a tight envelope of the rank norm and usually over-penalizes large singular values. In this paper, inspired by the effectiveness of the matrix Schatten-q norm, which is a tighter approximation of rank norm when 0 < q < 1, we generalize the matrix Schatten-q norm to tensor case and propose a Unitary Transformed Tensor Schatten-q Norm (UTT-S-q) with an arbitrary unitary transform matrix. More importantly, the factor tensor norm surrogate theorem is derived. We prove large-scale UTT-S-q norm (which is nonconvex and not tractable when 0 < q < 1) is equivalent to minimizing the weighted sum formulation of multiple small-scale UTT-S-qi(with different q(i) and q(i) >= 1). Based on this equivalence, we propose a low-rank tensor completion framework using Unitary Transformed Tensor Multi-Factor Norm (UTTMFN) penalty. The optimization problem is solved using the Alternating Direction Method of Multipliers (ADMM) with the proof of convergence. Experimental results on synthetic data, images and videos show that the proposed UTTMFN can achieve competitive results with the state-of-the-art methods for tensor completion.
引用
收藏
页码:19317 / 19337
页数:21
相关论文
共 44 条
  • [1] Scalable tensor factorizations for incomplete data
    Acar, Evrim
    Dunlavy, Daniel M.
    Kolda, Tamara G.
    Morup, Morten
    [J]. CHEMOMETRICS AND INTELLIGENT LABORATORY SYSTEMS, 2011, 106 (01) : 41 - 56
  • [2] Efficient Tensor Completion for Color Image and Video Recovery: Low-Rank Tensor Train
    Bengua, Johann A.
    Phien, Ho N.
    Hoang Duong Tuan
    Do, Minh N.
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2017, 26 (05) : 2466 - 2479
  • [3] A SINGULAR VALUE THRESHOLDING ALGORITHM FOR MATRIX COMPLETION
    Cai, Jian-Feng
    Candes, Emmanuel J.
    Shen, Zuowei
    [J]. SIAM JOURNAL ON OPTIMIZATION, 2010, 20 (04) : 1956 - 1982
  • [4] ANALYSIS OF INDIVIDUAL DIFFERENCES IN MULTIDIMENSIONAL SCALING VIA AN N-WAY GENERALIZATION OF ECKART-YOUNG DECOMPOSITION
    CARROLL, JD
    CHANG, JJ
    [J]. PSYCHOMETRIKA, 1970, 35 (03) : 283 - &
  • [5] The direct extension of ADMM for multi-block convex minimization problems is not necessarily convergent
    Chen, Caihua
    He, Bingsheng
    Ye, Yinyu
    Yuan, Xiaoming
    [J]. MATHEMATICAL PROGRAMMING, 2016, 155 (1-2) : 57 - 79
  • [6] Logarithmic Norm Regularized Low-Rank Factorization for Matrix and Tensor Completion
    Chen, Lin
    Jiang, Xue
    Liu, Xingzhao
    Zhou, Zhixin
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 : 3434 - 3449
  • [7] Enhanced tensor low-rank representation for clustering and denoising
    Du, Shiqiang
    Liu, Baokai
    Shan, Guangrong
    Shi, Yuqing
    Wang, Weilan
    [J]. KNOWLEDGE-BASED SYSTEMS, 2022, 243
  • [8] Unifying tensor factorization and tensor nuclear norm approaches for low-rank tensor completion
    Du, Shiqiang
    Xiao, Qingjiang
    Shi, Yuqing
    Cucchiara, Rita
    Ma, Yide
    [J]. NEUROCOMPUTING, 2021, 458 : 204 - 218
  • [9] Epton M. A., 1980, BIT (Nordisk Tidskrift for Informationsbehandling), V20, P341, DOI 10.1007/BF01932775
  • [10] Log-det heuristic for matrix rank minimization with applications to Hankel and Euclidean distance matrices
    Fazel, M
    Hindi, H
    Boyd, SP
    [J]. PROCEEDINGS OF THE 2003 AMERICAN CONTROL CONFERENCE, VOLS 1-6, 2003, : 2156 - 2162