length Learning-aware feature denoising discriminator

被引:8
作者
Gan, Yan [1 ]
Xiang, Tao [1 ]
Liu, Hangcheng [1 ]
Ye, Mao [2 ]
机构
[1] Chongqing Univ, Coll Comp Sci, Chongqing 400044, Peoples R China
[2] Univ Elect Sci & Technol China, Sch Comp Sci & Engn, Chengdu 611731, Peoples R China
基金
中国博士后科学基金;
关键词
GANs; Image synthesis; Feature denoising; Robustness; TO-IMAGE TRANSLATION;
D O I
10.1016/j.inffus.2022.08.006
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Although generative adversarial networks (GANs) show great prospects for the task of image synthesis, the quality of synthesized images by existing GANs is sometimes inferior to real images because their discriminators cannot effectively learn robust identification features from input images. In addition, the training process of discriminator is prone to be unstable. To this end, inspired by the denoising auto-encoders, we propose learning-aware feature denoising discriminator. It is designed to pay attention to robust features of input images, so as to improve its robustness in identifying features and recognition ability in training process. First, we use a decoder to generate perturbing noise and add it to real image to get corrupted image. Then, we get the encodings of the corrupted image and real image through an encoder. Finally, we minimize both types of encoding to constitute a denoising penalty and add it to the loss of the discriminator. We also show that our method is compatible with most existing GANs for three image synthesis tasks. Extensive experimental results show that compared with baseline models, our proposed method not only improves the quality of synthesized images, but also stabilizes the training process of discriminator.
引用
收藏
页码:143 / 154
页数:12
相关论文
共 66 条
  • [1] [Anonymous], 2010, ENCY RES DES
  • [2] Arjovsky M, 2017, PR MACH LEARN RES, V70
  • [3] Arjovsky Martin, 2017, P INT C LEARN REPR
  • [4] CVAE-GAN: Fine-Grained Image Generation through Asymmetric Training
    Bao, Jianmin
    Chen, Dong
    Wen, Fang
    Li, Houqiang
    Hua, Gang
    [J]. 2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, : 2764 - 2773
  • [5] Brock A, 2019, Arxiv, DOI [arXiv:1809.11096, DOI 10.48550/ARXIV.1809.11096]
  • [6] Chen X, 2016, ADV NEUR IN, V29
  • [7] Homomorphic Latent Space Interpolation for Unpaired Image-To-Image Translation
    Chen, Ying-Cong
    Xu, Xiaogang
    Tian, Zhuotao
    Jia, Jiaya
    [J]. 2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 2403 - 2411
  • [8] Choi Y, 2020, PROC CVPR IEEE, P8185, DOI 10.1109/CVPR42600.2020.00821
  • [9] Semantic Image Synthesis via Adversarial Learning
    Dong, Hao
    Yu, Simiao
    Wu, Chao
    Guo, Yike
    [J]. 2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, : CP1 - CP38
  • [10] Gan Y., 2019, NEURAL COMPUT APPL, P1