A new algorithm for solving a class of matrix optimization problem arising in unsupervised feature selection

被引:0
作者
Yang, Naya [1 ,2 ]
Duan, Xuefeng [1 ,2 ]
Li, Chunmei [1 ,2 ]
Wang, Qingwen [3 ]
机构
[1] Guilin Univ Elect Technol, Coll Math & Computat Sci, Guangxi Coll, Ctr Appl Math Guangxi GUET, Guilin 541004, Guangxi, Peoples R China
[2] Guilin Univ Elect Technol, Univ Key Lab Data Anal & Computat, Guilin 541004, Guangxi, Peoples R China
[3] Shanghai Univ, Dept Math, Shanghai 200444, Peoples R China
基金
中国国家自然科学基金;
关键词
Matrix optimization problem; Online optimization algorithm; Convergence analysis; Unsupervised feature selection; FACTORIZATION;
D O I
10.1007/s11075-024-01997-4
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
In this paper, we consider a class of matrix optimization problem in unsupervised feature selection, which has many applications in machine learning, pattern detection and data mining. A sparse graph-constrained matrix optimization model is established and it can preserve the local geometric structure of the feature manifold. Based on the idea of Monte Carlo, the matrix optimization problem is firstly transformed into a stochastic programming problem and then an online optimization algorithm has been designed to solve this model. Different from traditional feature selection methods, the new algorithm can better deal with big data and data stream problems. Numerical results show that the new method is feasible and effective. Especially, some simulation experiments in unsupervised feature selection illustrate that our algorithm is more effective than the existed algorithms.
引用
收藏
页数:22
相关论文
共 37 条
  • [1] [Anonymous], 2012, P 2012 SIAM INT C DA
  • [2] Bertsekas D.P., 1997, J. Oper. Res. Soc., V48, p334., DOI 10.1057/palgrave.jors.2600425
  • [3] Borokov AA., 2019, Mathematical statistics, DOI [10.1201/9780203749326, DOI 10.1201/9780203749326]
  • [4] Cai Deng, 2010, P 16 ACM SIGKDD INT, P333, DOI DOI 10.1145/1835804.1835848
  • [5] AN ALTERNATING RANK-k NONNEGATIVE LEAST SQUARES FRAMEWORK (ARkNLS) FOR NONNEGATIVE MATRIX FACTORIZATION
    Chu, Delin
    Shi, Weya
    Eswar, Srinivas
    Park, Haesun
    [J]. SIAM JOURNAL ON MATRIX ANALYSIS AND APPLICATIONS, 2021, 42 (04) : 1451 - 1479
  • [6] Cichocki A, 2007, LECT NOTES COMPUT SC, V4493, P793
  • [7] FAST NONNEGATIVE LEAST SQUA RES THROUGH FLEXIBLE KRYLOV SUBSPACES
    Gazzola, Silvia
    Wiaux, Yves
    [J]. SIAM JOURNAL ON SCIENTIFIC COMPUTING, 2017, 39 (02) : A655 - A679
  • [8] Gu R., 2021, arXiv
  • [9] Guo F., 2020, 2020 2 INT C MACH LE, P548
  • [10] Han J., 2022, Data Mining: Concepts and Techniques