Efficient Nonnegative Tensor Factorization via Saturating Coordinate Descent

被引:9
|
作者
Balasubramaniam, Thirunavukarasu [1 ]
Nayak, Richi [1 ]
Yuen, Chau [2 ]
机构
[1] Queensland Univ Technol, 2 George St, Brisbane, Qld 4000, Australia
[2] Singapore Univ Technol & Design, 8 Somapah Rd, Singapore 487372, Singapore
关键词
Nonnegative tensor factorization; coordinate descent; element selection; saturating coordinate descent; pattern mining; recommender systems; INDIVIDUAL-DIFFERENCES; MATRIX; ALGORITHMS; DECOMPOSITIONS; OPTIMIZATION;
D O I
10.1145/3385654
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
With the advancements in computing technology and web-based applications, data are increasingly generated in multi-dimensional form. These data are usually sparse due to the presence of a large number of users and fewer user interactions. To deal with this, the Nonnegative Tensor Factorization (NTF) based methods have been widely used. However existing factorization algorithms are not suitable to process in all three conditions of size, density, and rank of the tensor. Consequently, their applicability becomes limited. In this article, we propose a novel fast and efficient NTF algorithm using the element selection approach. We calculate the element importance using Lipschitz continuity and propose a saturation point-based element selection method that chooses a set of elements column-wise for updating to solve the optimization problem. Empirical analysis reveals that the proposed algorithm is scalable in terms of tensor size, density, and rank in comparison to the relevant state-of-the-art algorithms.
引用
收藏
页数:28
相关论文
共 50 条
  • [1] Accelerating block coordinate descent for nonnegative tensor factorization
    Ang, Andersen Man Shun
    Cohen, Jeremy E.
    Gillis, Nicolas.
    Hien, Le Thi Khanh
    NUMERICAL LINEAR ALGEBRA WITH APPLICATIONS, 2021, 28 (05)
  • [2] Column-Wise Element Selection for Computationally Efficient Nonnegative Coupled Matrix Tensor Factorization
    Balasubramaniam, Thirunavukarasu
    Nayak, Richi
    Yuen, Chau
    Tian, Yu-Chu
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2021, 33 (09) : 3173 - 3186
  • [3] Efficient and Non-Convex Coordinate Descent for Symmetric Nonnegative Matrix Factorization
    Vandaele, Arnaud
    Gillis, Nicolas
    Lei, Qi
    Zhong, Kai
    Dhillon, Inderjit
    IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2016, 64 (21) : 5571 - 5584
  • [4] Variable Selection for Efficient Nonnegative Tensor Factorization
    Kimura, Keigo
    Kudo, Mineichi
    2015 IEEE INTERNATIONAL CONFERENCE ON DATA MINING (ICDM), 2015, : 805 - 810
  • [5] DID: Distributed Incremental Block Coordinate Descent for Nonnegative Matrix Factorization
    Gao, Tianxiang
    Chu, Chris
    THIRTY-SECOND AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTIETH INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE / EIGHTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2018, : 2991 - 2998
  • [6] Sparse non-negative tensor factorization using columnwise coordinate descent
    Liu, Ji
    Liu, Jun
    Wonka, Peter
    Ye, Jieping
    PATTERN RECOGNITION, 2012, 45 (01) : 649 - 656
  • [7] Parallel Nonnegative Tensor Factorization via Newton Iteration on Matrices
    Flatz, Markus
    Vajtersic, Marian
    2014 INTERNATIONAL CONFERENCE ON HIGH PERFORMANCE COMPUTING & SIMULATION (HPCS), 2014, : 1014 - 1015
  • [8] Fast Nonnegative Tensor Factorization by Using Accelerated Proximal Gradient
    Zhou, Guoxu
    Zhao, Qibin
    Zhang, Yu
    Cichocki, Andrzej
    ADVANCES IN NEURAL NETWORKS - ISNN 2014, 2014, 8866 : 459 - 468
  • [9] Scenario Discovery Using Nonnegative Tensor Factorization
    Bader, Brett W.
    Puretskiy, Andrev A.
    Berry, Michael V.
    PROGRESS IN PATTERN RECOGNITION, IMAGE ANALYSIS AND APPLICATIONS, PROCEEDINGS, 2008, 5197 : 791 - +
  • [10] Mobility Mining Using Nonnegative Tensor Factorization
    Nosratabadi, Hamid Eslami
    Fanaee-T, Hadi
    Gama, Joao
    PROGRESS IN ARTIFICIAL INTELLIGENCE (EPIA 2017), 2017, 10423 : 321 - 330