A two-stage deep learning model based on feature combination effects

被引:4
|
作者
Teng, Xuyang [1 ]
Zhang, Yunxiao [1 ]
He, Meilin [1 ]
Han, Meng [2 ]
Liu, Erxiao [1 ]
机构
[1] Hangzhou Dianzi Univ, Sch Commun Engn, Hangzhou 310018, Zhejiang, Peoples R China
[2] Zhejiang Univ, Data Intelligence Res Ctr, Binjiang Inst, Hangzhou 310053, Zhejiang, Peoples R China
关键词
Deep learning; Feature selection; Correlation information entropy; Combination effect; STACKED DENOISING AUTOENCODERS; FEATURE-SELECTION; MUTUAL INFORMATION; NETWORK; ALGORITHM; CLASSIFICATION; RELEVANCE;
D O I
10.1016/j.neucom.2022.09.082
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Deep learning currently provides the best solutions in various industries involving tremendous data, such as object recognition and intrusion detection. In deep learning models, the quality and volume of data are two of the factors that determine task performance. This study concentrates on utilizing high-quality data to simultaneously improve the efficiency and accuracy of deep networks. This paper proposes a two-stage learning model that aims to generate high-quality data with reduced features during the first stage. Then, the selected data subset is regarded as the input in the second stage, i.e., the deep learning stage. However, most existing feature selection methods neglect the combination effect induced by inte-grated feature subsets. A correlation information entropy-based approach is developed to evaluate the integrated non-linear subspace. Experiments are carried out on six well-known classification datasets. The results indicate that our proposed two-stage learning model performs better than the compared high-dimensional deep learning models in speeding up the learning process and improving classification accuracy. Moreover, our developed feature selection method outperforms state-of-the-art feature selec-tion techniques in terms of time consumption and classification accuracy when combined with three deep learning models.(c) 2022 Elsevier B.V. All rights reserved.
引用
收藏
页码:307 / 322
页数:16
相关论文
共 50 条
  • [11] CorrDQN-FS: A two-stage feature selection method for energy consumption prediction via deep reinforcement learning
    Liu, Lu
    Fu, Qiming
    Lu, You
    Wang, Yunzhe
    Wu, Hongjie
    Chen, Jianping
    JOURNAL OF BUILDING ENGINEERING, 2023, 80
  • [12] A two-stage deep-learning based segmentation model for crop disease quantification based on corn field imagery
    Divyanth, L. G.
    Ahmad, Aanis
    Saraswat, Dharmendra
    SMART AGRICULTURAL TECHNOLOGY, 2023, 3
  • [13] A Deep Feature Learning Model for Pneumonia Detection Applying a Combination of mRMR Feature Selection and Machine Learning Models
    Togacar, M.
    Ergen, B.
    Comert, Z.
    Ozyurt, F.
    IRBM, 2020, 41 (04) : 212 - 222
  • [14] A two-stage stacked-based heterogeneous ensemble learning for cancer survival prediction
    Yan, Fangzhou
    Feng, Yi
    COMPLEX & INTELLIGENT SYSTEMS, 2022, 8 (06) : 4619 - 4639
  • [15] SWTNet: hyperspectral image classification using two-stage combined shallow and deep feature extraction
    Ladi, Pradeep Kumar
    Kakita, Murali Gopal
    Dash, Ratnakar
    Ladi, Sandeep Kumar
    NEURAL COMPUTING & APPLICATIONS, 2022, 34 (21) : 18439 - 18459
  • [16] Automatic Segmentation of Pneumothorax in Chest Radiographs Based on a Two-Stage Deep Learning Method
    Wang, Xiyue
    Yang, Sen
    Lan, Jun
    Fang, Yuqi
    He, Jianhui
    Wang, Minghui
    Zhang, Jing
    Han, Xiao
    IEEE TRANSACTIONS ON COGNITIVE AND DEVELOPMENTAL SYSTEMS, 2022, 14 (01) : 205 - 218
  • [17] Two-stage stacked autoencoder monitoring model based on deep slow feature representation for dynamic processes
    Li, Qing
    Wan, Jiaqi
    Yang, Xu
    Huang, Jian
    Cui, Jiarui
    Yan, Qun
    JOURNAL OF PROCESS CONTROL, 2025, 147
  • [18] A novel deep learning-based feature selection model for improving the static analysis of vulnerability detection
    Sahin, Canan Batur
    Abualigah, Laith
    NEURAL COMPUTING & APPLICATIONS, 2021, 33 (20) : 14049 - 14067
  • [19] On Two-Stage Feature Selection Methods for Text Classification
    Uysal, Alper Kursat
    IEEE ACCESS, 2018, 6 : 43233 - 43251
  • [20] A two-stage feature selection method with its application
    Zhao, Xuehua
    Li, Daoliang
    Yang, Bo
    Chen, Huiling
    Yang, Xinbin
    Yu, Chenglong
    Liu, Shuangyin
    COMPUTERS & ELECTRICAL ENGINEERING, 2015, 47 : 114 - 125