Multi-label feature selection via similarity constraints with non-negative matrix factorization

被引:8
|
作者
He, Zhuoxin [1 ,2 ]
Lin, Yaojin [1 ,2 ]
Lin, Zilong [1 ,2 ]
Wang, Chenxi [1 ,3 ]
机构
[1] Minnan Normal Univ, Sch Comp Sci, Zhangzhou 363000, Peoples R China
[2] Minnan Normal Univ, Key Lab Data Sci & Intelligence Applicat, Zhangzhou 363000, Fujian, Peoples R China
[3] Wuyi Univ, Fujian Key Lab Big Data Applicat & Intellectualiza, Wuyishan 354300, Fujian, Peoples R China
基金
中国国家自然科学基金;
关键词
Multi-label feature selection; Similarity constraints; Non-negative matrix factorization; Multi-label learning; ALGORITHMS; CLASSIFICATION;
D O I
10.1016/j.knosys.2024.111948
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Feature selection plays a key role in preprocessing, effectively addressing the curse of dimensionality in multi -label learning. While current approaches commonly utilize feature or label similarity to construct the weight matrix, typically through manifold learning regularization, there has been a dearth of progress in developing similarity -constrained regularization terms for multi -label feature selection. To address this gap, this paper conducts a comprehensive investigation and proposes a novel similarity constraint leveraging non -negative matrix factorization techniques. Subsequently, a new algorithm is introduced termed Multilabel Feature Selection via Similarity Constraints with Non -negative Matrix Factorization (SCNMF). Initially, the Gaussian similarity matrix among features is computed and factorized into a weight matrix using nonnegative matrix factorization. Subsequently, the Cosine distance matrix among labels is computed to constrain the weight matrix. Finally, an objective function is formulated based on the aforementioned constraint mechanisms and iteratively optimized. Extensive experiments conducted across more than 10 multi -label datasets demonstrate the superior performance of our proposed approach. The source code is accessible at the URL: https://github.com/BIGOatMNNU/SCNMF.
引用
收藏
页数:16
相关论文
共 50 条
  • [1] Non-negative multi-label feature selection with dynamic graph constraints
    Zhang, Yao
    Ma, Yingcang
    KNOWLEDGE-BASED SYSTEMS, 2022, 238
  • [2] Non-negative matrix factorization based modeling and training algorithm for multi-label learning
    Liang Sun
    Hongwei Ge
    Wenjing Kang
    Frontiers of Computer Science, 2019, 13 : 1243 - 1254
  • [3] Non-negative matrix factorization based modeling and training algorithm for multi-label learning
    Sun, Liang
    Ge, Hongwei
    Kang, Wenjing
    FRONTIERS OF COMPUTER SCIENCE, 2019, 13 (06) : 1243 - 1254
  • [4] Soft-label guided non-negative matrix factorization for unsupervised feature selection
    Zhou, Shixuan
    Song, Peng
    Song, Zihao
    Ji, Liang
    EXPERT SYSTEMS WITH APPLICATIONS, 2023, 216
  • [5] Non-Negative Matrix Factorization with Constraints
    Liu, Haifeng
    Wu, Zhaohui
    PROCEEDINGS OF THE TWENTY-FOURTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE (AAAI-10), 2010, : 506 - 511
  • [6] Constrained Projective Non-negative Matrix Factorization for Semi-supervised Multi-label Learning
    Zhang, Xiang
    Guan, Naiyang
    Luo, Zhigang
    Yang, Xuejun
    2015 IEEE 14TH INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND APPLICATIONS (ICMLA), 2015, : 588 - 593
  • [7] Non-negative matrix factorization with sparseness constraints
    Hoyer, PO
    JOURNAL OF MACHINE LEARNING RESEARCH, 2004, 5 : 1457 - 1469
  • [8] Feature Weighted Non-Negative Matrix Factorization
    Chen, Mulin
    Gong, Maoguo
    Li, Xuelong
    IEEE TRANSACTIONS ON CYBERNETICS, 2023, 53 (02) : 1093 - 1105
  • [9] Consensus and discriminative non-negative matrix factorization for multi-view unsupervised feature selection
    Duan, Meng
    Song, Peng
    Zhou, Shixuan
    Mu, Jinshuai
    Liu, Zhaowei
    DIGITAL SIGNAL PROCESSING, 2024, 154
  • [10] MLNMF: multi-label learning based on non-negative matrix factorisation
    Han, Yu
    Shao, Cheng
    Yang, ShouTao
    Deng, Weiwei
    INTERNATIONAL JOURNAL OF MODELLING IDENTIFICATION AND CONTROL, 2018, 30 (01) : 1 - 8