A dual encoder DAE neural network for imbalanced binary classification based on NSGA-III and GAN

被引:4
|
作者
Qu, Jiantao [1 ,2 ,3 ]
Liu, Feng [1 ,2 ]
Ma, Yuxiang [3 ]
机构
[1] Beijing Jiaotong Univ, Sch Comp & Informat Technol, Beijing 100044, Peoples R China
[2] Minist Educ, Engn Res Ctr Network Management Technol High Spee, Beijing 100044, Peoples R China
[3] Henan Univ, Sch Comp & Informat Engn, Kaifeng 475004, Peoples R China
关键词
Imbalanced data; GAN; NSGA-III; Denoising auto-encoder; Deep learning; PREDICTION; SMOTE;
D O I
10.1007/s10044-021-01035-2
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In real-world datasets, the number of samples in each class is often imbalanced, which results in the classifier's suboptimal performance. Presently, the imbalanced binary classification approach based on deep learning has achieved good results and gets more attention constantly. In this study, we present a dual encoder (Denoising Auto-Encoder) DAE neural network based on non-dominated sorting genetic algorithm (NSGA-III) and generative adversarial network (GAN) to address the imbalanced binary classification problem. The primary aim of our approach is to increase the separability between the reconstruction error of minority class latent features and the reconstruction error of majority class latent features. For this purpose, we first create a dual encoder DAE network to obtain the reconstruction error of latent features of training data. Second, when training the neural network, we introduced GAN to perform a layer-wise training which can improve the training effect of the model. Third, in order to increase the separability of the reconstruction error of minority class and majority class, we utilize NSGA-III to optimize the parameters of the second encoder. Then, we can obtain a set of non-dominated solutions. Finally, based on the Technique for Order Preference by Similarity to Ideal Solution (TOPSIS) method, we can get the best solution, which is the most appropriate parameter set of the second encoder to distinguish the minority class and the majority class. The experiment results on both benchmark datasets and a real-world dataset for communication anomaly detection demonstrate the superiority of the proposed approach in imbalanced binary classification problem.
引用
收藏
页码:17 / 34
页数:18
相关论文
共 50 条
  • [21] Classification of Imbalanced Data Using SMOTE and AutoEncoder Based Deep Convolutional Neural Network
    Alex, Suja A.
    Nayahi, J. Jesu Vedha
    INTERNATIONAL JOURNAL OF UNCERTAINTY FUZZINESS AND KNOWLEDGE-BASED SYSTEMS, 2023, 31 (03) : 437 - 469
  • [22] Deep neural network for halftone image classification based on sparse auto-encoder
    Zhang, Yan
    Zhang, Erhu
    Chen, Wanjun
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2016, 50 : 245 - 255
  • [23] Power Load Profile Classification Method Based on Neural Network of Sparse Automatic Encoder
    Lin S.
    Gu X.
    Tang J.
    Li D.
    Fu Y.
    Lin, Shunfu (shunfulin@shiep.edu.cn), 1600, Power System Technology Press (44): : 3508 - 3515
  • [24] Binary Protocol Classification based on Information Entropy and Convolution Neural Network
    Yin, Shizhuang
    Shi, Quan
    PROCEEDINGS OF 2020 IEEE 2ND INTERNATIONAL CONFERENCE ON CIVIL AVIATION SAFETY AND INFORMATION TECHNOLOGY (ICCASIT), 2020, : 500 - 507
  • [25] Coronary artery segmentation based on Transformer and convolutional neural networks dual parallel branch encoder neural network
    Pan, Dan
    Luo, Genqiang
    Zeng, An
    Shengwu Yixue Gongchengxue Zazhi/Journal of Biomedical Engineering, 2024, 41 (06): : 1195 - 1203
  • [26] Weighted feature fusion of dual attention convolutional neural network and transformer encoder module for ocean HABs classification
    Wu, Geng-Kun
    Xu, Jie
    Zhang, Yi-Dan
    Wen, Bi-Yao
    Zhang, Bei-Ping
    EXPERT SYSTEMS WITH APPLICATIONS, 2024, 243
  • [27] Generative adversarial network and convolutional neural network-based EEG imbalanced classification model for seizure detection
    Gao, Bin
    Zhou, Jiazheng
    Yang, Yuying
    Chi, Jinxin
    Yuan, Qi
    BIOCYBERNETICS AND BIOMEDICAL ENGINEERING, 2022, 42 (01) : 1 - 15
  • [28] Cost-Sensitive Neural Network with ROC-Based Moving Threshold for Imbalanced Classification
    Krawczyk, Bartosz
    Wozniak, Michal
    INTELLIGENT DATA ENGINEERING AND AUTOMATED LEARNING - IDEAL 2015, 2015, 9375 : 45 - 52
  • [29] Dual deterministic model based on deep neural network for the classification of pneumonia
    Khan, Muhammad Mustafa
    UI Islam, Muhammad Saif
    Siddiqui, Ali Akbar
    Qadri, Muhammad Tahir
    INTELLIGENT DECISION TECHNOLOGIES-NETHERLANDS, 2023, 17 (03): : 641 - 654
  • [30] Freshwater Microscopic Algae Detection Based on Deep Neural Network with GAN-Based Augmentation for Imbalanced Algal Data
    Fung, Benjamin S. B.
    Chan, Wang Hin
    Lo, Irene M. C.
    Tsang, Danny H. K.
    ACS ES&T WATER, 2023, 4 (03): : 982 - 990