Improved generative adversarial networks with reconstruction loss

被引:20
作者
Li, Yanchun [1 ]
Xiao, Nanfeng [1 ]
Ouyang, Wanli [2 ]
机构
[1] South China Univ Technol, Sch Comp Sci & Engn, Guangzhou, Guangdong, Peoples R China
[2] Univ Sydney, Sch Elect & Informat Engn, Sydney, NSW, Australia
基金
中国国家自然科学基金;
关键词
Generative adversarial networks (GAN); Image generation; Reconstruction loss; Deep generative model;
D O I
10.1016/j.neucom.2018.10.014
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We propose a simple regularization scheme to handle the problem of mode missing and unstable training in the generative adversarial networks (GAN). The key idea is to utilize the visual features learned by the discriminator. We reconstruct the real data by feeding the generator with the real data features extracted by the discriminator. A reconstruction loss is added to the GAN's objective function to enforce the generator can reconstruct from the features of the discriminator, which helps to explicitly guide the generator towards to near the probable configurations of real data. The proposed reconstruction loss improves the performance of GAN, produces higher quality images on different dataset, and can be easily combined with other regularization loss functions such as gradient penalty to improve the performance of various GANs. We conducted experiments on the widespread adopted architecture DCGAN and the complicated ResNet architecture across different datasets, the results of which show the effectiveness and robustness of our proposed method. (C) 2018 Elsevier B.V. All rights reserved.
引用
收藏
页码:363 / 372
页数:10
相关论文
共 47 条
[41]  
van den Oord A, 2016, PR MACH LEARN RES, V48
[42]   Deep Visual Attention Prediction [J].
Wang, Wenguan ;
Shen, Jianbing .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2018, 27 (05) :2368-2378
[43]   Deep Cropping via Attention Box Prediction and Aesthetics Assessment [J].
Wang, Wenguan ;
Shen, Jianbing .
2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, :2205-2213
[44]   Video Salient Object Detection via Fully Convolutional Networks [J].
Wang, Wenguan ;
Shen, Jianbing ;
Shao, Ling .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2018, 27 (01) :38-49
[45]  
Welling M, 2014, AUTOENCODING VARIATI
[46]  
Zhang SY, 2018, IEEE IPCCC
[47]   Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networks [J].
Zhu, Jun-Yan ;
Park, Taesung ;
Isola, Phillip ;
Efros, Alexei A. .
2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, :2242-2251