Multi-target feature selection with subspace learning and manifold regularization

被引:2
作者
He, Dubo [1 ]
Sun, Shengxiang [1 ]
Xie, Li [1 ]
机构
[1] Naval Univ Engn, Dept Management Engn & Equipment Econ, Wuhan 430033, Peoples R China
关键词
Multi-target regression; Subspace learning; Feature selection; Adaptive graph learning; Manifold framework; SUPPORT VECTOR REGRESSION; STATISTICAL COMPARISONS; DIFFERENTIAL EVOLUTION; MULTIOUTPUT; CLASSIFIERS; MODEL;
D O I
10.1016/j.neucom.2024.127533
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Existing supervised Multi -Target Feature Selection (MTFS) methods seldom consider the nearest -neighbor relationship and statistical correlation of samples underlying the output space, which leads the result of feature selection to be easily interfered by the output noise, thus making it difficult to achieve satisfactory performance. This paper proposes a novel MTFS method to preserve both the global and local target correlations. Specifically, the low -rank constraint is introduced to achieve multi -layer regression structure to better decouple the inter -input and inter -target relationships. Moreover, the local nearest -neighbor relationships and variable correlations of the sample points in the output space are also explored through adaptive graph and manifold learning, to better utilize the target correlations to improve the MTFS performance. Following the above principle, the resulting objective function and the corresponding optimization algorithm are proposed. Extensive experiments on several public datasets show that the proposed method is superior to other state-of-the-art methods.
引用
收藏
页数:18
相关论文
共 50 条
[21]   Random Manifold Sampling and Joint Sparse Regularization for Multi-Label Feature Selection [J].
Li, Haibao ;
Zhai, Hongzhi .
BIG DATA RESEARCH, 2023, 32
[22]   Sparse multi-label feature selection via dynamic graph manifold regularization [J].
Zhang, Yao ;
Ma, Yingcang .
INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2023, 14 (03) :1021-1036
[23]   Joint subspace learning and subspace clustering based unsupervised feature selection [J].
Xiao, Zijian ;
Chen, Hongmei ;
Mi, Yong ;
Luo, Chuan ;
Horng, Shi-Jinn ;
Li, Tianrui .
NEUROCOMPUTING, 2025, 635
[24]   Rotation Forest for multi-target regression [J].
Rodriguez, Juan J. ;
Juez-Gil, Mario ;
Lopez-Nozal, Carlos ;
Arnaiz-Gonzalez, Alvar .
INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2022, 13 (02) :523-548
[25]   Feature ranking for multi-target regression [J].
Petkovic, Matej ;
Kocev, Dragi ;
Dzeroski, Saso .
MACHINE LEARNING, 2020, 109 (06) :1179-1204
[26]   Localized Feature Ranking approach for Multi-Target Regression [J].
Bertrand, Hugo ;
Elghazel, Haytham ;
Masmoudi, Sahar ;
Coquery, Emmanuel ;
Hacid, Mohand-Said .
2022 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2022,
[27]   Feature ranking for multi-target regression [J].
Matej Petković ;
Dragi Kocev ;
Sašo Džeroski .
Machine Learning, 2020, 109 :1179-1204
[28]   Subspace Learning and Feature Selection via Orthogonal Mapping [J].
Mandanas, Fotios D. ;
Kotropoulos, Constantine L. .
IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2020, 68 :1034-1047
[29]   Feature selection by combining subspace learning with sparse representation [J].
Debo Cheng ;
Shichao Zhang ;
Xingyi Liu ;
Ke Sun ;
Ming Zong .
Multimedia Systems, 2017, 23 :285-291
[30]   Feature selection by combining subspace learning with sparse representation [J].
Cheng, Debo ;
Zhang, Shichao ;
Liu, Xingyi ;
Sun, Ke ;
Zong, Ming .
MULTIMEDIA SYSTEMS, 2017, 23 (03) :285-291