Classification of Imbalanced Data Using Deep Learning with Adding Noise

被引:6
作者
Fan, Wan-Wei [1 ]
Lee, Ching-Hung [1 ]
机构
[1] Natl Yang Ming Chiao Tung Univ, Dept Elect & Comp Engn, Hsinchu, Taiwan
关键词
SURFACE DEFECT DETECTION;
D O I
10.1155/2021/1735386
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
This paper proposes a method to treat the classification of imbalanced data by adding noise to the feature space of convolutional neural network (CNN) without changing a data set (ratio of majority and minority data). Besides, a hybrid loss function of crossentropy and KL divergence is proposed. The proposed approach can improve the accuracy of minority class in the testing data. In addition, a simple design method for selecting structure of CNN is first introduced and then, we add noise in feature space of CNN to obtain proper features by a training process and to improve the classification results. From comparison results, we can find that the proposed method can extract the suitable features to improve the accuracy of minority class. Finally, illustrated examples of multiclass classification problems and the corresponding discussion in balance ratio are presented. Our approach performs well with smaller network structure compared with other deep models. In addition, the performance is improved over 40% in defective accuracy by adding noise approach. Finally, the accuracy is higher than 96%; even the imbalanced ratio (IR) is one hundred.
引用
收藏
页数:18
相关论文
共 54 条
  • [1] CNN based automatic detection of photovoltaic cell defects in electroluminescence images
    Akram, M. Waqar
    Li, Guiqiang
    Jin, Yi
    Chen, Xiao
    Zhu, Changan
    Zhao, Xudong
    Khaliq, Abdul
    Faheem, M.
    Ahmad, Ashfaq
    [J]. ENERGY, 2019, 189
  • [2] MFC-GAN: Class-imbalanced dataset classification using Multiple Fake Class Generative Adversarial Network
    Ali-Gombe, Adamu
    Elyan, Eyad
    [J]. NEUROCOMPUTING, 2019, 361 : 212 - 221
  • [3] Bansal A., 2021, ARXIV PREPRINT ARXIV
  • [4] A systematic study of the class imbalance problem in convolutional neural networks
    Buda, Mateusz
    Maki, Atsuto
    Mazurowski, Maciej A.
    [J]. NEURAL NETWORKS, 2018, 106 : 249 - 259
  • [5] Deep Learning-Based Crack Damage Detection Using Convolutional Neural Networks
    Cha, Young-Jin
    Choi, Wooram
    Buyukozturk, Oral
    [J]. COMPUTER-AIDED CIVIL AND INFRASTRUCTURE ENGINEERING, 2017, 32 (05) : 361 - 378
  • [6] ChaboNet : Design of a deep CNN for prediction of visual saliency in natural video
    Chaabouni, Souad
    Benois-Pineau, Jenny
    Ben Amar, Chokri
    [J]. JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2019, 60 : 79 - 93
  • [7] Vibration Signals Analysis by Explainable Artificial Intelligence (XAI) Approach: Application on Bearing Faults Diagnosis
    Chen, Han-Yun
    Lee, Ching-Hung
    [J]. IEEE ACCESS, 2020, 8 : 134246 - 134256
  • [8] Cogswell M., 2016, 4 INT C LEARN REPR I
  • [9] Deepshikha K., 2020, C COMP VIS PATT REC
  • [10] Deng L., 2012, IEEE Signal Process. Mag., V29, P141, DOI [10.1109/MSP.2012.2211477, DOI 10.1109/MSP.2012.2211477]