Factorization strategies for third-order tensors

被引:921
作者
Kilmer, Misha E. [1 ]
Martin, Carla D. [2 ]
机构
[1] Tufts Univ, Medford, MA 02155 USA
[2] James Madison Univ, Harrisonburg, VA 22807 USA
基金
美国国家科学基金会;
关键词
Multilinear algebra; Tensor decomposition; Singular value decomposition; Multidimensional arrays; APPROXIMATION; ALGORITHM;
D O I
10.1016/j.laa.2010.09.020
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
Operations with tensors, or multiway arrays, have become increasingly prevalent in recent years. Traditionally, tensors are represented or decomposed as a sum of rank-1 outer products using either the CANDECOMP/PARAFAC (CP) or the Tucker models, or some variation thereof. Such decompositions are motivated by specific applications where the goal is to find an approximate such representation for a given multiway array. The specifics of the approximate representation (such as how many terms to use in the sum, orthogonality constraints, etc.) depend on the application. In this paper, we explore an alternate representation of tensors which shows promise with respect to the tensor approximation problem. Reminiscent of matrix factorizations, we present a new factorization of a tensor as a product of tensors. To derive the new factorization, we define a closed multiplication operation between tensors. A major motivation for considering this new type of tensor multiplication is to devise new types of factorizations for tensors which can then be used in applications. Specifically, this new multiplication allows us to introduce concepts such as tensor transpose, inverse, and identity, which lead to the notion of an orthogonal tensor. The multiplication also gives rise to a linear operator, and the null space of the resulting operator is identified. We extend the concept of outer products of vectors to outer products of matrices. All derivations are presented for third-order tensors. However, they can be easily extended to the order-p (p > 3) case. We conclude with an application in image deblurring. (C) 2010 Elsevier Inc. All rights reserved.
引用
收藏
页码:641 / 658
页数:18
相关论文
共 50 条
[1]  
Acar E, 2005, LECT NOTES COMPUT SC, V3495, P256
[2]  
[Anonymous], 1989, Multiway Data Analysis
[3]  
[Anonymous], 1989, Multiway data analysis
[4]  
[Anonymous], 2000, SIAM Journal on Matrix Analysis and Applications, DOI DOI 10.1137/S0895479896305696
[5]   Algorithm 862: MATLAB tensor classes for fast algorithm prototyping [J].
Bader, Brett W. ;
Kolda, Tamara G. .
ACM TRANSACTIONS ON MATHEMATICAL SOFTWARE, 2006, 32 (04) :635-653
[6]   Tensorial extensions of independent component analysis for multisubject FMRI analysis [J].
Beckmann, CF ;
Smith, SM .
NEUROIMAGE, 2005, 25 (01) :294-311
[7]  
Berge J.M. T., 1991, Psychometrika, V56, P631
[8]   Third-order tensors as linear operators on a space of matrices [J].
Braman, Karen .
LINEAR ALGEBRA AND ITS APPLICATIONS, 2010, 433 (07) :1241-1253
[9]  
Bro R, 1997, J CHEMOMETR, V11, P393, DOI 10.1002/(SICI)1099-128X(199709/10)11:5<393::AID-CEM483>3.3.CO
[10]  
2-C