SVD-based algorithms for tensor wheel decomposition

被引:0
作者
Wang, Mengyu [1 ]
Cui, Honghua [2 ]
Li, Hanyu [1 ,3 ]
机构
[1] Chongqing Univ, Coll Math & Stat, Chongqing, Peoples R China
[2] Xiamen Univ, Wang Yanan Inst Studies Econ, Fujian, Peoples R China
[3] Chongqing Univ, Key Lab Nonlinear Anal & its Applicat, Minist Educ, Chongqing, Peoples R China
基金
中国国家自然科学基金;
关键词
Tensor wheel decomposition; SVD; Alternating least squares; Deterministic algorithm; Randomized algorithm; Sketching; RANDOMIZED ALGORITHMS; APPROXIMATION; TUCKER; COMPUTATION;
D O I
10.1007/s10444-024-10194-9
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
Tensor wheel (TW) decomposition combines the popular tensor ring and fully connected tensor network decompositions and has achieved excellent performance in tensor completion problem. A standard method to compute this decomposition is the alternating least squares (ALS). However, it usually suffers from slow convergence and numerical instability. In this work, the fast and robust SVD-based algorithms are investigated. Based on a result on TW-ranks, we first propose a deterministic algorithm that can estimate the TW decomposition of the target tensor under a controllable accuracy. Then, the randomized versions of this algorithm are presented, which can be divided into two categories and allow various types of sketching. Numerical results on synthetic and real data show that our algorithms have much better performance than the ALS-based method and are also quite robust. In addition, with one SVD-based algorithm, we also numerically explore the variability of TW decomposition with respect to TW-ranks and the comparisons between TW decomposition and other famous formats in terms of the performance on approximation and compression.
引用
收藏
页数:23
相关论文
共 42 条
[11]   Tensor Networks for Dimensionality Reduction and Large-Scale Optimization Part 1 Low-Rank Tensor Decompositions [J].
Cichocki, Andrzej ;
Lee, Namgil ;
Oseledets, Ivan ;
Anh-Huy Phan ;
Zhao, Qibin ;
Mandic, Danilo P. .
FOUNDATIONS AND TRENDS IN MACHINE LEARNING, 2016, 9 (4-5) :I-+
[12]   A multilinear singular value decomposition [J].
De Lathauwer, L ;
De Moor, B ;
Vandewalle, J .
SIAM JOURNAL ON MATRIX ANALYSIS AND APPLICATIONS, 2000, 21 (04) :1253-1278
[13]   STRUCTURAL CONVERGENCE RESULTS FOR APPROXIMATION OF DOMINANT SUBSPACES FROM BLOCK KRYLOV SPACES [J].
Drineas, Petros ;
Ipsen, Ilse C. F. ;
Kontopoulou, Eugenia-Maria ;
Magdon-Ismail, Malik .
SIAM JOURNAL ON MATRIX ANALYSIS AND APPLICATIONS, 2018, 39 (02) :567-586
[14]  
Espig M, 2015, Arxiv, DOI arXiv:1506.00062
[15]   On best rank one approximation of tensors [J].
Friedland, S. ;
Mehrmann, V. ;
Pajarola, R. ;
Suter, S. K. .
NUMERICAL LINEAR ALGEBRA WITH APPLICATIONS, 2013, 20 (06) :942-955
[16]   SUBSPACE ITERATION RANDOMIZATION AND SINGULAR VALUE PROBLEMS [J].
Gu, M. .
SIAM JOURNAL ON SCIENTIFIC COMPUTING, 2015, 37 (03) :A1139-A1173
[17]   Finding Structure with Randomness: Probabilistic Algorithms for Constructing Approximate Matrix Decompositions [J].
Halko, N. ;
Martinsson, P. G. ;
Tropp, J. A. .
SIAM REVIEW, 2011, 53 (02) :217-288
[18]   A Randomized Tensor Train Singular Value Decomposition [J].
Huber, Benjamin ;
Schneider, Reinhold ;
Wolf, Sebastian .
COMPRESSED SENSING AND ITS APPLICATIONS, 2017, :261-290
[19]   Tensor Decompositions and Applications [J].
Kolda, Tamara G. ;
Bader, Brett W. .
SIAM REVIEW, 2009, 51 (03) :455-500
[20]   STREAMING TENSOR TRAIN APPROXIMATION [J].
Kressner, Daniel ;
Vandereycken, Bart ;
Voorhaar, Rik .
SIAM JOURNAL ON SCIENTIFIC COMPUTING, 2023, 45 (05) :A2610-A2631