SVD-based algorithms for tensor wheel decomposition

被引:0
作者
Wang, Mengyu [1 ]
Cui, Honghua [2 ]
Li, Hanyu [1 ,3 ]
机构
[1] Chongqing Univ, Coll Math & Stat, Chongqing, Peoples R China
[2] Xiamen Univ, Wang Yanan Inst Studies Econ, Fujian, Peoples R China
[3] Chongqing Univ, Key Lab Nonlinear Anal & its Applicat, Minist Educ, Chongqing, Peoples R China
基金
中国国家自然科学基金;
关键词
Tensor wheel decomposition; SVD; Alternating least squares; Deterministic algorithm; Randomized algorithm; Sketching; RANDOMIZED ALGORITHMS; APPROXIMATION; TUCKER; COMPUTATION;
D O I
10.1007/s10444-024-10194-9
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
Tensor wheel (TW) decomposition combines the popular tensor ring and fully connected tensor network decompositions and has achieved excellent performance in tensor completion problem. A standard method to compute this decomposition is the alternating least squares (ALS). However, it usually suffers from slow convergence and numerical instability. In this work, the fast and robust SVD-based algorithms are investigated. Based on a result on TW-ranks, we first propose a deterministic algorithm that can estimate the TW decomposition of the target tensor under a controllable accuracy. Then, the randomized versions of this algorithm are presented, which can be divided into two categories and allow various types of sketching. Numerical results on synthetic and real data show that our algorithms have much better performance than the ALS-based method and are also quite robust. In addition, with one SVD-based algorithm, we also numerically explore the variability of TW decomposition with respect to TW-ranks and the comparisons between TW decomposition and other famous formats in terms of the performance on approximation and compression.
引用
收藏
页数:23
相关论文
共 42 条
[1]   Randomized algorithms for fast computation of low rank tensor ring model [J].
Ahmadi-Asl, Salman ;
Cichocki, Andrzej ;
Huy Phan, Anh ;
Asante-Mensah, Maame G. ;
Musavian Ghazani, Mirfarid ;
Tanaka, Toshihisa ;
Oseledets, Ivan .
MACHINE LEARNING-SCIENCE AND TECHNOLOGY, 2021, 2 (01)
[2]   Randomized Algorithms for Computation of Tucker Decomposition and Higher Order SVD (HOSVD) [J].
Ahmadi-Asl, Salman ;
Abukhovich, Stanislav ;
Asante-Mensah, Maame G. ;
Cichocki, Andrzej ;
Phan, Anh Huy ;
Tanaka, Tohishisa ;
Oseledets, Ivan .
IEEE ACCESS, 2021, 9 :28684-28706
[3]   RANDOMIZED ALGORITHMS FOR ROUNDING IN THE TENSOR-TRAIN FORMAT [J].
Al Daas, Hussam ;
Ballard, Grey ;
Cazeaux, Paul ;
Hallman, Eric ;
Miedlar, Agnieszka ;
Pasha, Mirjeta ;
Reid, Tim W. ;
Saibaba, Arvind K. .
SIAM JOURNAL ON SCIENTIFIC COMPUTING, 2023, 45 (01) :A74-A95
[4]  
Bader B.W., 2021, Tensor toolbox for MATLAB, version 3.2.1
[5]   Improving the speed of multiway algorithms part II. Compression [J].
Bro, R ;
Andersson, CA .
CHEMOMETRICS AND INTELLIGENT LABORATORY SYSTEMS, 1998, 42 (1-2) :105-113
[6]  
Che ML, 2023, Arxiv, DOI arXiv:2303.11612
[7]   An Efficient Randomized Algorithm for Computing the Approximate Tucker Decomposition [J].
Che, Maolin ;
Wei, Yimin ;
Yan, Hong .
JOURNAL OF SCIENTIFIC COMPUTING, 2021, 88 (02)
[8]   Randomized algorithms for the low multilinear rank approximations of tensors [J].
Che, Maolin ;
Wei, Yimin ;
Yan, Hong .
JOURNAL OF COMPUTATIONAL AND APPLIED MATHEMATICS, 2021, 390 (390)
[9]   THE COMPUTATION OF LOW MULTILINEAR RANK APPROXIMATIONS OF TENSORS VIA POWER SCHEME AND RANDOM PROJECTION [J].
Che, Maolin ;
Wei, Yimin ;
Yan, Hong .
SIAM JOURNAL ON MATRIX ANALYSIS AND APPLICATIONS, 2020, 41 (02) :605-636
[10]   Randomized algorithms for the approximations of Tucker and the tensor train decompositions [J].
Che, Maolin ;
Wei, Yimin .
ADVANCES IN COMPUTATIONAL MATHEMATICS, 2019, 45 (01) :395-428