A Generalized Graph Regularized Non-Negative Tucker Decomposition Framework for Tensor Data Representation

被引:59
作者
Qiu, Yuning [1 ]
Zhou, Guoxu [1 ,2 ]
Wang, Yanjiao [1 ,2 ]
Zhang, Yu [3 ]
Xie, Shengli [1 ,4 ]
机构
[1] Guangdong Univ Technol, Sch Automat, Guangzhou 510006, Peoples R China
[2] Minist Educ, Key Lab Intelligent Detect & Internet Things Mfg, Guangzhou 510006, Peoples R China
[3] Stanford Univ, Dept Psychiat & Behav Sci, Stanford, CA 94305 USA
[4] Guangdong Univ Technol, Guangdong Hong Kong Macao Joint Lab Smart Discret, Guangzhou 510006, Peoples R China
关键词
Tensile stress; Manifolds; Laplace equations; Matrix decomposition; Learning systems; Convergence; Automation; Clustering; graph Laplacian; non-negative Tucker decomposition (NTD); tensor decomposition; MATRIX FACTORIZATION; GRADIENT-METHOD; ALGORITHMS;
D O I
10.1109/TCYB.2020.2979344
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Non-negative Tucker decomposition (NTD) is one of the most popular techniques for tensor data representation. To enhance the representation ability of NTD by multiple intrinsic cues, that is, manifold structure and supervisory information, in this article, we propose a generalized graph regularized NTD (GNTD) framework for tensor data representation. We first develop the unsupervised GNTD (UGNTD) method by constructing the nearest neighbor graph to maintain the intrinsic manifold structure of tensor data. Then, when limited must-link and cannot-link constraints are given, unlike most existing semisupervised learning methods that only use the pregiven supervisory information, we propagate the constraints through the entire dataset and then build a semisupervised graph weight matrix by which we can formulate the semisupervised GNTD (SGNTD). Moreover, we develop a fast and efficient alternating proximal gradient-based algorithm to solve the optimization problem and show its convergence and correctness. The experimental results on unsupervised and semisupervised clustering tasks using four image datasets demonstrate the effectiveness and high efficiency of the proposed methods.
引用
收藏
页码:594 / 607
页数:14
相关论文
共 52 条
[1]  
[Anonymous], 2009, NONNEGATIVE MATRIX T
[2]   A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems [J].
Beck, Amir ;
Teboulle, Marc .
SIAM JOURNAL ON IMAGING SCIENCES, 2009, 2 (01) :183-202
[3]  
Belkin M, 2002, ADV NEUR IN, V14, P585
[4]   Graph Regularized Nonnegative Matrix Factorization for Data Representation [J].
Cai, Deng ;
He, Xiaofei ;
Han, Jiawei ;
Huang, Thomas S. .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2011, 33 (08) :1548-1560
[5]   Tensor Decompositions for Signal Processing Applications [J].
Cichocki, Andrzej ;
Mandic, Danilo P. ;
Anh Huy Phan ;
Caiafa, Cesar F. ;
Zhou, Guoxu ;
Zhao, Qibin ;
De Lathauwer, Lieven .
IEEE SIGNAL PROCESSING MAGAZINE, 2015, 32 (02) :145-163
[6]   NeNMF: An Optimal Gradient Method for Nonnegative Matrix Factorization [J].
Guan, Naiyang ;
Tao, Dacheng ;
Luo, Zhigang ;
Yuan, Bo .
IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2012, 60 (06) :2882-2898
[7]   Tensor Learning for Regression [J].
Guo, Weiwei ;
Kotsia, Irene ;
Patras, Ioannis .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2012, 21 (02) :816-827
[8]  
Horn RA., 1991, Topics in matrix analysis, V37, DOI DOI 10.1017/CBO9780511840371
[9]   Semi-Supervised Tensor-Based Graph Embedding Learning and Its Application to Visual Discriminant Tracking [J].
Hu, Weiming ;
Gao, Jin ;
Xing, Junliang ;
Zhang, Chao ;
Maybank, Stephen .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2017, 39 (01) :172-188
[10]   Image Representation and Learning With Graph-Laplacian Tucker Tensor Decomposition [J].
Jiang, Bo ;
Ding, Chris ;
Tang, Jin ;
Luo, Bin .
IEEE TRANSACTIONS ON CYBERNETICS, 2019, 49 (04) :1417-1426