A two-stage deep learning model based on feature combination effects

被引:4
|
作者
Teng, Xuyang [1 ]
Zhang, Yunxiao [1 ]
He, Meilin [1 ]
Han, Meng [2 ]
Liu, Erxiao [1 ]
机构
[1] Hangzhou Dianzi Univ, Sch Commun Engn, Hangzhou 310018, Zhejiang, Peoples R China
[2] Zhejiang Univ, Data Intelligence Res Ctr, Binjiang Inst, Hangzhou 310053, Zhejiang, Peoples R China
关键词
Deep learning; Feature selection; Correlation information entropy; Combination effect; STACKED DENOISING AUTOENCODERS; FEATURE-SELECTION; MUTUAL INFORMATION; NETWORK; ALGORITHM; CLASSIFICATION; RELEVANCE;
D O I
10.1016/j.neucom.2022.09.082
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Deep learning currently provides the best solutions in various industries involving tremendous data, such as object recognition and intrusion detection. In deep learning models, the quality and volume of data are two of the factors that determine task performance. This study concentrates on utilizing high-quality data to simultaneously improve the efficiency and accuracy of deep networks. This paper proposes a two-stage learning model that aims to generate high-quality data with reduced features during the first stage. Then, the selected data subset is regarded as the input in the second stage, i.e., the deep learning stage. However, most existing feature selection methods neglect the combination effect induced by inte-grated feature subsets. A correlation information entropy-based approach is developed to evaluate the integrated non-linear subspace. Experiments are carried out on six well-known classification datasets. The results indicate that our proposed two-stage learning model performs better than the compared high-dimensional deep learning models in speeding up the learning process and improving classification accuracy. Moreover, our developed feature selection method outperforms state-of-the-art feature selec-tion techniques in terms of time consumption and classification accuracy when combined with three deep learning models.(c) 2022 Elsevier B.V. All rights reserved.
引用
收藏
页码:307 / 322
页数:16
相关论文
共 50 条
  • [21] TDR: Two-stage deep recommendation model based on mSDA and DNN
    Wang, Ruiqin
    Jiang, Yunliang
    Lou, Jungang
    EXPERT SYSTEMS WITH APPLICATIONS, 2020, 145
  • [22] A Two-Stage Hybrid Default Discriminant Model Based on Deep Forest
    Li, Gang
    Ma, Hong-Dong
    Liu, Rong-Yue
    Shen, Meng-Di
    Zhang, Ke-Xin
    ENTROPY, 2021, 23 (05)
  • [23] MRI-based two-stage deep learning model for automatic detection and segmentation of brain metastases
    Li, Ruikun
    Guo, Yujie
    Zhao, Zhongchen
    Chen, Mingming
    Liu, Xiaoqing
    Gong, Guanzhong
    Wang, Lisheng
    EUROPEAN RADIOLOGY, 2023, 33 (05) : 3521 - 3531
  • [24] MRI-based two-stage deep learning model for automatic detection and segmentation of brain metastases
    Ruikun Li
    Yujie Guo
    Zhongchen Zhao
    Mingming Chen
    Xiaoqing Liu
    Guanzhong Gong
    Lisheng Wang
    European Radiology, 2023, 33 : 3521 - 3531
  • [25] A Novel Groundwater Burial Depth Prediction Model Based on Two-Stage Modal Decomposition and Deep Learning
    Zhang, Xianqi
    Zheng, Zhiwen
    INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH, 2023, 20 (01)
  • [26] A Two-Stage Deep-Learning Model for Link Prediction Based on Network Structure and Node Attributes
    Liu, Peng
    Gui, Liang
    Wang, Huirong
    Riaz, Muhammad
    SUSTAINABILITY, 2022, 14 (23)
  • [27] Two-stage model-based feature compensation for robust speech recognition
    Haifeng Shen
    Gang Liu
    Jun Guo
    Computing, 2012, 94 : 1 - 20
  • [28] Two-stage model-based feature compensation for robust speech recognition
    Shen, Haifeng
    Liu, Gang
    Guo, Jun
    COMPUTING, 2012, 94 (01) : 1 - 20
  • [29] Fabric Defect Detection Algorithm Based on Two-stage Deep Transfer Learning
    Zhao S.
    Zhang J.
    Wang J.
    Xu C.
    Jixie Gongcheng Xuebao/Journal of Mechanical Engineering, 2021, 57 (17): : 86 - 97
  • [30] Two-Stage Unsupervised Hyperspectral Band Selection Based on Deep Reinforcement Learning
    Guo, Yi
    Wang, Qianqian
    Hu, Bingliang
    Qian, Xueming
    Ye, Haibo
    REMOTE SENSING, 2025, 17 (04)