Model-Based Tensor Low-Rank Clustering

被引:1
作者
Li, Junge [1 ]
Mai, Qing [1 ]
机构
[1] Florida State Univ, Dept Stat, Tallahassee, FL 32306 USA
基金
美国国家科学基金会;
关键词
Dimension reduction; EM algorithm; Mixture models; Sparsity; Tucker decomposition; MAXIMUM-LIKELIHOOD; REGRESSION; DECOMPOSITIONS; CLASSIFICATION; ALGORITHM; SELECTION; MIXTURES;
D O I
10.1080/10618600.2023.2205913
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
Tensors have become prevalent in business applications and scientific studies. It is of great interest to analyze and understand the heterogeneity in tensor-variate observations. We propose a novel tensor low-rank mixture model (TLMM) to conduct efficient estimation and clustering on tensors. The model combines the Tucker low-rank structure in mean contrasts and the separable covariance structure to achieve parsimonious and interpretable modeling. To implement efficient computation under this model, we develop a low-rank enhanced expectation-maximization (LEEM) algorithm. The pseudo E-step and the pseudo M-step are carefully designed to incorporate variable selection and efficient parameter estimation. Numerical results in extensive experiments demonstrate the encouraging performance of the proposed method compared to popular vector and tensor methods. for this article are available online.
引用
收藏
页码:208 / 218
页数:11
相关论文
共 41 条
[1]  
Absil PA, 2008, OPTIMIZATION ALGORITHMS ON MATRIX MANIFOLDS, P1
[2]  
Anandkumar A, 2014, J MACH LEARN RES, V15, P2773
[3]   Some theory for Fisher's linear discriminant function, 'naive Bayes', and some alternatives when there are many more variables than observations [J].
Bickel, PJ ;
Levina, E .
BERNOULLI, 2004, 10 (06) :989-1010
[4]  
Cai B., 2021, ARXIV
[5]   CHIME: CLUSTERING OF HIGH-DIMENSIONAL GAUSSIAN MIXTURES WITH EM ALGORITHM AND ITS OPTIMALITY [J].
Cai, T. Tony ;
Ma, Jing ;
Zhang, Linjun .
ANNALS OF STATISTICS, 2019, 47 (03) :1234-1267
[6]   A Direct Estimation Approach to Sparse Linear Discriminant Analysis [J].
Cai, Tony ;
Liu, Weidong .
JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2011, 106 (496) :1566-1577
[7]  
Cook R.D., 2018, An Introduction To Envelopes: Dimension Reduction for Efficient Estimation in Multivariate Statistics
[8]   A multilinear singular value decomposition [J].
De Lathauwer, L ;
De Moor, B ;
Vandewalle, J .
SIAM JOURNAL ON MATRIX ANALYSIS AND APPLICATIONS, 2000, 21 (04) :1253-1278
[9]   On the best rank-1 and rank-(R1,R2,...,RN) approximation of higher-order tensors [J].
De Lathauwer, L ;
De Moor, B ;
Vandewalle, J .
SIAM JOURNAL ON MATRIX ANALYSIS AND APPLICATIONS, 2000, 21 (04) :1324-1342
[10]   MAXIMUM LIKELIHOOD FROM INCOMPLETE DATA VIA EM ALGORITHM [J].
DEMPSTER, AP ;
LAIRD, NM ;
RUBIN, DB .
JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES B-METHODOLOGICAL, 1977, 39 (01) :1-38