Projected gradient methods for nonnegative matrix factorization

被引:1163
|
作者
Lin, Chih-Jen [1 ]
机构
[1] Natl Taiwan Univ, Dept Comp Sci, Taipei 106, Taiwan
关键词
D O I
10.1162/neco.2007.19.10.2756
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Nonnegative matrix factorization (NMF) can be formulated as a minimization problem with bound constraints. Although bound-constrained optimization has been studied extensively in both theory and practice, so far no study has formally applied its techniques to NME In this letter, we propose two projected gradient methods for NMF, both of which exhibit strong optimization properties. We discuss efficient implementations and demonstrate that one of the proposed methods converges faster than the popular multiplicative update approach. A simple Matlab code is also provided.
引用
收藏
页码:2756 / 2779
页数:24
相关论文
共 50 条
  • [21] Quadratic regularization projected Barzilai-Borwein method for nonnegative matrix factorization
    Huang, Yakui
    Liu, Hongwei
    Zhou, Shuisheng
    DATA MINING AND KNOWLEDGE DISCOVERY, 2015, 29 (06) : 1665 - 1684
  • [22] An efficient monotone projected Barzilai-Borwein method for nonnegative matrix factorization
    Huang, Yakui
    Liu, Hongwei
    Zhou, Sha
    APPLIED MATHEMATICS LETTERS, 2015, 45 : 12 - 17
  • [23] Nonnegative Matrix Factorization
    不详
    IEEE CONTROL SYSTEMS MAGAZINE, 2021, 41 (03): : 102 - 102
  • [24] Nonnegative Matrix Factorization
    SAIBABA, A. R. V. I. N. D. K.
    SIAM REVIEW, 2022, 64 (02) : 510 - 511
  • [25] Manifold Regularized Discriminative Nonnegative Matrix Factorization With Fast Gradient Descent
    Guan, Naiyang
    Tao, Dacheng
    Luo, Zhigang
    Yuan, Bo
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2011, 20 (07) : 2030 - 2048
  • [26] Relative gradient speeding up additive updates for nonnegative matrix factorization
    Liu, WX
    Zheng, NN
    Li, X
    NEUROCOMPUTING, 2004, 57 : 493 - 499
  • [27] The relationships among various nonnegative matrix factorization methods for clustering
    Li, Tao
    Ding, Chris
    ICDM 2006: SIXTH INTERNATIONAL CONFERENCE ON DATA MINING, PROCEEDINGS, 2006, : 362 - 371
  • [28] An efficient nonmonotone projected Barzilai-Borwein method for nonnegative matrix factorization with extrapolation
    Li, Jicheng
    Li, Wenbo
    Liu, Xuenian
    INTERNATIONAL JOURNAL OF COMPUTER MATHEMATICS, 2021, 98 (01) : 11 - 27
  • [29] A PROJECTED NEWTON-TYPE ALGORITHM FOR NONNEGATIVE MATRIX FACTORIZATION WITH MODEL ORDER SELECTION
    Giampouras, Paris V.
    Rontogiannis, Athanasios A.
    Koutroumbas, Konstantinos D.
    2019 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2019, : 3497 - 3501
  • [30] Nonnegative matrix factorization of a correlation matrix
    Sonneveld, P.
    van Kan, J. J. I. M.
    Huang, X.
    Oosterlee, C. W.
    LINEAR ALGEBRA AND ITS APPLICATIONS, 2009, 431 (3-4) : 334 - 349