An Incremental Self-Labeling Strategy for Semi-Supervised Deep Learning Based on Generative Adversarial Networks

被引:8
作者
Wei, Xiaotao [1 ]
Wei, Xiang [1 ]
Xing, Weiwei [1 ]
Lu, Siyang [2 ]
Lu, Wei [1 ]
机构
[1] Beijing Jiaotong Univ, Sch Software Engn, Beijing 100044, Peoples R China
[2] Beijing Jiaotong Univ, Beijing Key Lab Secur & Privacy Intelligent Trans, Beijing 100044, Peoples R China
关键词
Deep learning; semi-supervised learning; generative adversarial networks; self-labeling;
D O I
10.1109/ACCESS.2020.2964315
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The recent success of deep neural networks is attributed in part to large-scale well-labeled training data. However, with the ever-increasing size of modern datasets, combined with the difficulty of obtaining label information, semi-supervised learning (SSL) has become one of the most remarkable issues in data analysis. In this paper, we propose an Incremental Self-Labeling strategy for SSL based on Generative Adversarial Nets (ISL-GAN), which functions by constantly assigning unlabeled data with virtual labels for promoting the training process. Specifically, during the virtual labeling process, we introduce a temporal-based self-labeling strategy for safe and stable data labeling. Then, to dynamically assign more virtual labels to data during the training, we conduct a phased incremental label screening and updating strategy. Finally, to balance the contribution of samples with different loss during the training process, we further introduce the Balance factor Term (BT). The experimental results show that the proposed method gives rise to state-of-the-art semi-supervised learning results for the MNIST, CIFAR-10, and SVHN datasets. Particularly, our model performs well with fewer labeled conditions. With a dataset of only 1,000 labeled CIFAR-10 images with CONV-Large Net, a test error of 11.2; can be achieved, and nearly the same performance with a 3.5; test error can be achieved with both 500 and 1,000 image-labeled SVHN datasets.
引用
收藏
页码:8913 / 8921
页数:9
相关论文
共 35 条
  • [1] [Anonymous], ARXIV181102657
  • [2] [Anonymous], ISA T
  • [3] [Anonymous], P CVPR WORKSH JUN
  • [4] [Anonymous], P ICLR
  • [5] [Anonymous], 2016, CONDITIONAL IMAGE SY
  • [6] [Anonymous], 2017, PROC ADV NEURAL INF
  • [7] [Anonymous], 2016, ARXIV160600704
  • [8] Athiwaratkun B., 2019, P INT C LEARN REPR
  • [9] Not-so-supervised: A survey of semi-supervised, multi-instance, and transfer learning in medical image analysis
    Cheplygina, Veronika
    de Bruijne, Marleen
    Pluim, Josien P. W.
    [J]. MEDICAL IMAGE ANALYSIS, 2019, 54 : 280 - 296
  • [10] Semi-Supervised Learning With Deep Embedded Clustering for Image Classification and Segmentation
    Enguehard, Joseph
    O'Halloran, Peter
    Gholipour, Ali
    [J]. IEEE ACCESS, 2019, 7 : 11093 - 11104