High-Dimensional Ensemble Learning Classification: An Ensemble Learning Classification Algorithm Based on High-Dimensional Feature Space Reconstruction

被引:2
作者
Zhao, Miao [1 ]
Ye, Ning [1 ]
机构
[1] Nanjing Forestry Univ, Coll Informat Sci & Technol, Nanjing 210037, Peoples R China
来源
APPLIED SCIENCES-BASEL | 2024年 / 14卷 / 05期
关键词
classification ensemble; feature selection; high dimensional; space reconstruction; ensemble learning;
D O I
10.3390/app14051956
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
When performing classification tasks on high-dimensional data, traditional machine learning algorithms often fail to filter out valid information in the features adequately, leading to low levels of classification accuracy. Therefore, this paper explores the high-dimensional data from both the data feature dimension and the model ensemble dimension. We propose a high-dimensional ensemble learning classification algorithm focusing on feature space reconstruction and classifier ensemble, called the HDELC algorithm. First, the algorithm considers feature space reconstruction and then generates a feature space reconstruction matrix. It effectively achieves feature selection and reconstruction for high-dimensional data. An optimal feature space is generated for the subsequent ensemble of the classifier, which enhances the representativeness of the feature space. Second, we recursively determine the number of classifiers and the number of feature subspaces in the ensemble model. Different classifiers in the ensemble system are assigned mutually exclusive non-intersecting feature subspaces for model training. The experimental results show that the HDELC algorithm has advantages compared with most high-dimensional datasets due to its more efficient feature space ensemble capability and relatively reliable ensemble operation performance. The HDELC algorithm makes it possible to solve the classification problem for high-dimensional data effectively and has vital research and application value.
引用
收藏
页数:25
相关论文
共 38 条
[1]   An Efficient Marine Predators Algorithm for Feature Selection [J].
Abd Elminaam, Diaa Salama ;
Nabil, Ayman ;
Ibraheem, Shimaa A. ;
Houssein, Essam H. .
IEEE ACCESS, 2021, 9 :60136-60153
[2]   Multi-model ensemble predictions of precipitation and temperature using machine learning algorithms [J].
Ahmed, Kamal ;
Sachindra, D. A. ;
Shahid, Shamsuddin ;
Iqbal, Zafar ;
Nawaz, Nadeem ;
Khan, Najeebullah .
ATMOSPHERIC RESEARCH, 2020, 236
[3]   Prediction of asphalt binder elastic recovery using tree-based ensemble bagging and boosting models [J].
Asadi, Babak ;
Hajj, Ramez .
CONSTRUCTION AND BUILDING MATERIALS, 2024, 410
[4]   A joint multiobjective optimization of feature selection and classifier design for high-dimensional data classification [J].
Bai, Lixia ;
Li, Hong ;
Gao, Weifeng ;
Xie, Jin ;
Wang, Houqiang .
INFORMATION SCIENCES, 2023, 626 :457-473
[5]   Aggregation models in ensemble learning: A large-scale comparison [J].
Campagner, Andrea ;
Ciucci, Davide ;
Cabitza, Federico .
INFORMATION FUSION, 2023, 90 :241-252
[6]  
Campos David, 2023, Proceedings of the ACM on Management of Data, V1, DOI 10.1145/3589316
[7]   Discrete Boltzmann modeling of Rayleigh-Taylor instability: Effects of interfacial tension, viscosity, and heat conductivity [J].
Chen, Jie ;
Xu, Aiguo ;
Chen, Dawei ;
Zhang, Yudong ;
Chen, Zhihua .
PHYSICAL REVIEW E, 2022, 106 (01)
[8]   A multi model ensemble based deep convolution neural network structure for detection of COVID19 [J].
Deb, Sagar Deep ;
Jha, Rajib Kumar ;
Jha, Kamlesh ;
Tripathi, Prem S. .
BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2022, 71
[9]   Deep ensemble learning for accurate retinal vessel segmentation [J].
Du, Lingling ;
Liu, Hanruo ;
Zhang, Lan ;
Lu, Yao ;
Li, Mengyao ;
Hu, Yang ;
Zhang, Yi .
COMPUTERS IN BIOLOGY AND MEDICINE, 2023, 158
[10]  
Dua D., 2019, UCI machine learning repository: Adult (census income) data set