Two fast vector-wise update algorithms for orthogonal nonnegative matrix factorization with sparsity constraint

被引:7
|
作者
Li, Wenbo [1 ]
Li, Jicheng [1 ]
Liu, Xuenian [1 ]
Dong, Liqiang [1 ]
机构
[1] Xi An Jiao Tong Univ, Sch Math & Stat, Xian 710049, Peoples R China
基金
中国国家自然科学基金;
关键词
Nonnegative matrix factorization; Orthogonality constraint; Sparsity constraint; Alternating least squares method; Clustering method; CONVERGENT ALGORITHM; DESCENT METHOD; OPTIMIZATION; PARTS;
D O I
10.1016/j.cam.2020.112785
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
Recently, orthogonal nonnegative matrix factorization (ONMF) has been introduced and shown to work remarkably well for clustering tasks. Because of the nonnegativity and the orthogonality constraints, the orthogonal factor matrix of ONMF is naturally sparse. Based on this fact, by introducing sparsity constraints on the orthogonal coefficient matrix, we propose two vector-wise algorithms based on Hierarchical Alternating Least Squares (HALS) and Block Prox-linear (BPL) methods to the approximately sparse orthogonal nonnegative matrix factorization (SONMF). Some global convergence results are established under the mild conditions. Numerical results including synthetic and real-world datasets are given to illustrate that the proposed algorithms compute highly accurate values and perform better than the other testing ONMF methods. (C) 2020 Elsevier B.V. All rights reserved.
引用
收藏
页数:21
相关论文
共 12 条
  • [1] Two Efficient Algorithms for Orthogonal Nonnegative Matrix Factorization
    Wu, Jing
    Chen, Bin
    Han, Tao
    MATHEMATICAL PROBLEMS IN ENGINEERING, 2021, 2021
  • [2] Two Efficient Algorithms for Approximately Orthogonal Nonnegative Matrix Factorization
    Li, Bo
    Zhou, Guoxu
    Cichocki, Andrzej
    IEEE SIGNAL PROCESSING LETTERS, 2015, 22 (07) : 843 - 846
  • [3] Two algorithms for orthogonal nonnegative matrix factorization with application to clustering
    Pompili, Filippo
    Gillis, Nicolas
    Absil, P. -A.
    Glineur, Francois
    NEUROCOMPUTING, 2014, 141 : 15 - 25
  • [4] Community Detection using Nonnegative Matrix Factorization with Orthogonal Constraint
    Qin, Yaoyao
    Jia, Caiyan
    Li, Yafang
    2016 EIGHTH INTERNATIONAL CONFERENCE ON ADVANCED COMPUTATIONAL INTELLIGENCE (ICACI), 2016, : 49 - 54
  • [5] Stability Analysis of Multiplicative Update Algorithms and Application to Nonnegative Matrix Factorization
    Badeau, Roland
    Bertin, Nancy
    Vincent, Emmanuel
    IEEE TRANSACTIONS ON NEURAL NETWORKS, 2010, 21 (12): : 1869 - 1881
  • [6] Fast and Robust Recursive Algorithms for Separable Nonnegative Matrix Factorization
    Gillis, Nicolas
    Vavasis, Stephen A.
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2014, 36 (04) : 698 - 714
  • [7] Fast Orthogonal Nonnegative Matrix Tri-Factorization for Simultaneous Clustering
    Li, Zhao
    Wu, Xindong
    Lu, Zhenyu
    ADVANCES IN KNOWLEDGE DISCOVERY AND DATA MINING, PT II, PROCEEDINGS, 2010, 6119 : 214 - 221
  • [8] Combined new nonnegative matrix factorization algorithms with two-dimensional nonnegative matrix factorization for image processing
    Hu, Liying
    Guo, Gongde
    Ma, Changfeng
    MULTIMEDIA TOOLS AND APPLICATIONS, 2016, 75 (18) : 11127 - 11155
  • [9] DISTRIBUTED ALGORITHMS FOR UNMIXING HYPERSPECTRAL DATA USING NONNEGATIVE MATRIX FACTORIZATION WITH SPARSITY CONSTRAINTS
    Robila, Stefan A.
    Ricart, Daniel
    2013 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS), 2013, : 2156 - 2159
  • [10] Hyperspectral Unmixing Using Nonnegative Matrix Factorization With an Approximate L0 Sparsity Constraint
    Zhang, Zhou
    Shi, Zhenwei
    Tang, Wei
    Liu, Liu
    2012 5TH INTERNATIONAL CONGRESS ON IMAGE AND SIGNAL PROCESSING (CISP), 2012, : 1058 - 1062