MULTIRESOLUTION LOW-RANK TENSOR FORMATS

被引:2
作者
Mickelin, Oscar [1 ]
Karaman, Sertac [2 ]
机构
[1] MIT, Dept Math, Cambridge, MA 02139 USA
[2] MIT, Dept Aeronaut & Astronaut, Cambridge, MA 02139 USA
关键词
tensors; tensor-train format; multiresolution linear algebra; ONE APPROXIMATION; DATA ASSIMILATION; DECOMPOSITIONS; CONVERGENCE; ALGORITHM; SPARSE;
D O I
10.1137/19M1284579
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
We describe a simple, black-box compression format for tensors with a multiscale structure. By representing the tensor as a sum of compressed tensors defined on increasingly coarse grids, we capture low-rank structures on each grid-scale, and we show how this leads to an increase in compression for a fixed accuracy. We devise an alternating algorithm to represent a given tensor in the multiresolution format and prove local convergence guarantees. In two dimensions, we provide examples that show that this approach can beat the Eckart-Young theorem, and for dimensions higher than two, we achieve higher compression than the tensor-train format on six real-world datasets. We also provide results on the closedness and stability of the tensor format and discuss how to perform common linear algebra operations on the level of the compressed tensors.
引用
收藏
页码:1086 / 1114
页数:29
相关论文
共 43 条
[1]  
Anandkumar A, 2014, J MACH LEARN RES, V15, P2773
[2]  
[Anonymous], 2012, SPRINGER SER COMPUT
[3]  
[Anonymous], 2013, MATRIX COMPUTATIONS
[4]  
[Anonymous], 2010, DIFFERENTIAL TOPOLOG
[5]  
Bader B. W., 2015, Matlab tensor toolbox
[6]   Efficient MATLAB computations with sparse and factored tensors [J].
Bader, Brett W. ;
Kolda, Tamara G. .
SIAM JOURNAL ON SCIENTIFIC COMPUTING, 2007, 30 (01) :205-231
[7]   Algorithm 862: MATLAB tensor classes for fast algorithm prototyping [J].
Bader, Brett W. ;
Kolda, Tamara G. .
ACM TRANSACTIONS ON MATHEMATICAL SOFTWARE, 2006, 32 (04) :635-653
[8]   Multiresolution Volume Filtering in the Tensor Compressed Domain [J].
Ballester-Ripoll, Rafael ;
Steiner, David ;
Pajarola, Renato .
IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2018, 24 (10) :2714-2727
[9]   Randomized algorithms for the approximations of Tucker and the tensor train decompositions [J].
Che, Maolin ;
Wei, Yimin .
ADVANCES IN COMPUTATIONAL MATHEMATICS, 2019, 45 (01) :395-428
[10]   ON THE TENSOR SVD AND THE OPTIMAL LOW RANK ORTHOGONAL APPROXIMATION OF TENSORS [J].
Chen, Jie ;
Saad, Yousef .
SIAM JOURNAL ON MATRIX ANALYSIS AND APPLICATIONS, 2008, 30 (04) :1709-1734