Stabilizing and Improving Training of Generative Adversarial Networks Through Identity Blocks and Modified Loss Function

被引:7
|
作者
Fathallah, Mohamed [1 ]
Sakr, Mohamed [2 ]
Eletriby, Sherif [2 ]
机构
[1] Kafrelsheikh Univ, Fac Comp & Informat, Dept Comp Sci, Kafrelsheikh 33516, Egypt
[2] Menoufia Univ, Fac Comp & Informat, Dept Comp Sci, Shibin Al Kawm 32511, Menoufia, Egypt
关键词
Training; Generators; Generative adversarial networks; Smoothing methods; Data models; Standards; Optimization; Generative adversarial network; deep learning; mode collapse; label smoothing; identity block;
D O I
10.1109/ACCESS.2023.3272032
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Generative adversarial networks (GANs) are a powerful tool for synthesizing realistic images, but they can be difficult to train and are prone to instability and mode collapse. This paper proposes a new model called Identity Generative Adversarial Network (IGAN) that addresses these issues. This model is based on three modifications to the baseline deep convolutional generative adversarial network (DCGAN). The first change is to add a non-linear identity block to the architecture. This will make it easier for the model to fit complex data types and cut down on the time it takes to train. The second change is to smooth out the standard GAN loss function by using a modified loss function and label smoothing. The third and final change is to use minibatch training to let the model use other examples from the same minibatch as side information to improve the quality and variety of generated images. These changes help to stabilize the training process and improve the model's performance. The performance of the GAN models is compared using the inception score (IS) and the Frechet inception distance (FID), which are widely used metrics for evaluating the quality and diversity of generated images. The effectiveness of our approach was tested by comparing an IGAN model with other GAN models on the CelebA and stacked MNIST datasets. Results show that IGAN outperforms all the other models, achieving an IS of 13.95 and an FID of 43.71 after traning for 200 epochs. In addition to demonstrating the improvement in the performance of the IGAN, the instabilities, diversity, and fidelity of the models were investigated. The results showed that the IGAN was able to converge to a distribution of the real data more quickly. Furthermore, the experiments revealed that IGAN is capable of producing more stable and high-quality images. This suggests that IGAN is a promising approach for improving the training and performance of GANs and may have a range of applications in image synthesis and other areas.
引用
收藏
页码:43276 / 43285
页数:10
相关论文
共 50 条
  • [41] Evolution and Effectiveness of Loss Functions in Generative Adversarial Networks
    Saqlain, Ali Syed
    Fang, Fang
    Ahmad, Tanvir
    Wang, Liyun
    Abidin, Zain-ul
    CHINA COMMUNICATIONS, 2021, 18 (10) : 45 - 76
  • [42] Training Generative Adversarial Networks with Adaptive Composite Gradient
    Qi, Huiqing
    Li, Fang
    Tan, Shengli
    Zhang, Xiangyun
    DATA INTELLIGENCE, 2024, 6 (01) : 120 - 157
  • [43] Low-Dose CT Image Denoising Using a Generative Adversarial Network With a Hybrid Loss Function for Noise Learning
    Ma, Yinjin
    Wei, Biao
    Feng, Peng
    He, Peng
    Guo, Xiaodong
    Wang, Ge
    IEEE ACCESS, 2020, 8 (08): : 67519 - 67529
  • [44] Real-World DEM Super-Resolution Based on Generative Adversarial Networks for Improving InSAR Topographic Phase Simulation
    Wu, Zherong
    Zhao, Zhuoyi
    Ma, Peifeng
    Huang, Bo
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2021, 14 : 8373 - 8385
  • [45] An improved generative adversarial network with modified loss function for crack detection in electromagnetic nondestructive testing
    Lulu Tian
    Zidong Wang
    Weibo Liu
    Yuhua Cheng
    Fuad E. Alsaadi
    Xiaohui Liu
    Complex & Intelligent Systems, 2022, 8 : 467 - 476
  • [46] Improving Image Super-Resolution Based on Multiscale Generative Adversarial Networks
    Yuan, Cao
    Deng, Kaidi
    Li, Chen
    Zhang, Xueting
    Li, Yaqin
    ENTROPY, 2022, 24 (08)
  • [47] Improving Autonomous Vehicles Maneuverability and Collision Avoidance in Adverse Weather Conditions Using Generative Adversarial Networks
    Meftah, Leila Haj
    Cherif, Asma
    Braham, Rafik
    IEEE ACCESS, 2024, 12 : 89679 - 89690
  • [48] Surgical Tool Segmentation Using Generative Adversarial Networks With Unpaired Training Data
    Zhang, Zhongkai
    Rosa, Benoit
    Nageotte, Florent
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2021, 6 (04) : 6266 - 6273
  • [49] GEGAN: Generative Adversarial Networks Training based on Gradient Directed Evolutionary Strategy
    Li, Mengzhen
    Pei, Xinmin
    Liang, Xijun
    Yu, Qi
    Jia, Wenwen
    Jian, Ling
    Shi, Zhang-Lei
    2024 9TH INTERNATIONAL CONFERENCE ON SIGNAL AND IMAGE PROCESSING, ICSIP, 2024, : 481 - 486
  • [50] Improving Conditional Sequence Generative Adversarial Networks by Stepwise Evaluation
    Tuan, Yi-Lin
    Lee, Hung-Yi
    IEEE-ACM TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING, 2019, 27 (04) : 788 - 798