THE NONNEGATIVE MATRIX FACTORIZATION: REGULARIZATION AND COMPLEXITY

被引:3
作者
Ito, K. [1 ]
Landi, A. K. [1 ]
机构
[1] N Carolina State Univ, Raleigh, NC 27695 USA
关键词
nonnegative matrix factorization; primal-dual active set; regularization; complexity; MODEL;
D O I
10.1137/14099841X
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
Data continues to grow, and it has become ever important to find effective big data analysis techniques. Computational tools, such as singular value decomposition, have been employed in the interpretation of big data. Another tool has recently gained popularity and comparative success: the nonnegative matrix factorization (NMF). The NMF method is a feature selection, dimension reduction algorithm which takes a data matrix and finds a simpler representation. In this paper, we discuss the choice of regularization parameters for a regularized NMF problem, and we develop a primal-dual active set method which enhances the representation. In addition, we examine rank determination for the case of the NMF problem. We develop a method to choose the proper complexity based on the concept of NMF-singular values.
引用
收藏
页码:B327 / B346
页数:20
相关论文
共 28 条
  • [1] Primal-dual strategy for constrained optimal control problems
    Bergounioux, M
    Ito, K
    Kunisch, K
    [J]. SIAM JOURNAL ON CONTROL AND OPTIMIZATION, 1999, 37 (04) : 1176 - 1194
  • [2] Algorithms and applications for approximate nonnegative matrix factorization
    Berry, Michael W.
    Browne, Murray
    Langville, Amy N.
    Pauca, V. Paul
    Plemmons, Robert J.
    [J]. COMPUTATIONAL STATISTICS & DATA ANALYSIS, 2007, 52 (01) : 155 - 173
  • [4] Multimodel inference - understanding AIC and BIC in model selection
    Burnham, KP
    Anderson, DR
    [J]. SOCIOLOGICAL METHODS & RESEARCH, 2004, 33 (02) : 261 - 304
  • [5] Butenko Sergiy., 2014, Numerical Methods and Optimization: An Introduction, V1
  • [6] Discovering Subgroups of Patients from DNA Copy Number Data Using NMF on Compacted Matrices
    de Campos, Cassio P.
    Rancoita, Paola M. V.
    Kwee, Ivo
    Zucca, Emanuele
    Zaffalon, Marco
    Bertoni, Francesco
    [J]. PLOS ONE, 2013, 8 (11):
  • [7] MAXIMUM LIKELIHOOD FROM INCOMPLETE DATA VIA EM ALGORITHM
    DEMPSTER, AP
    LAIRD, NM
    RUBIN, DB
    [J]. JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES B-METHODOLOGICAL, 1977, 39 (01): : 1 - 38
  • [8] Nonnegative Matrix Factorization: An Analytical and Interpretive Tool in Computational Biology
    Devarajan, Karthik
    [J]. PLOS COMPUTATIONAL BIOLOGY, 2008, 4 (07)
  • [9] Ding C, 2006, P 12 ACM SIGKDD INT, P126, DOI 10.1145/1150402.1150420
  • [10] On the equivalence between Non-negative Matrix Factorization and Probabilistic Latent Semantic Indexing
    Ding, Chris
    Li, Tao
    Peng, Wei
    [J]. COMPUTATIONAL STATISTICS & DATA ANALYSIS, 2008, 52 (08) : 3913 - 3927