A Low Spectral Bias Generative Adversarial Model for Image Generation

被引:0
作者
Xu, Lei [1 ]
Liu, Zhentao [1 ]
Liu, Peng [1 ]
Cai, Liyan [2 ]
机构
[1] Peng Cheng Lab, Shenzhen, Peoples R China
[2] Sun Yat Sen Univ, Guangzhou, Peoples R China
来源
DATA SCIENCE (ICPCSEE 2022), PT I | 2022年 / 1628卷
关键词
Deep learning applications; Image generation models; Generative adversarial network;
D O I
10.1007/978-981-19-5194-7_26
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
We propose a systematic analysis of the neglected spectral bias in the frequency domain in this paper. Traditional generative adversarial networks (GANs) try to fulfill the details of images by designing specific network architectures or losses, focusing on generating visually qualitative images. The convolution theorem shows that image processing in the frequency domain is parallelizable and performs better and faster than that in the spatial domain. However, there is little work about discussing the bias of frequency features between the generated images and the real ones. In this paper, we first empirically demonstrate the general distribution bias across datasets and GANs with different sampling methods. Then, we explain the causes of the spectral bias through the deduction that reconsiders the sampling process of the GAN generator. Based on these studies, we provide a low-spectral-bias hybrid generative model to reduce the spectral bias and improve the quality of the generated images.
引用
收藏
页码:354 / 362
页数:9
相关论文
共 19 条
[1]  
Baddeley R, 1997, COGNITIVE SCI, V21, P351, DOI 10.1207/s15516709cog2103_4
[2]  
Chen XL, 2017, Arxiv, DOI arXiv:1702.02138
[3]   StarGAN: Unified Generative Adversarial Networks for Multi-Domain Image-to-Image Translation [J].
Choi, Yunjey ;
Choi, Minje ;
Kim, Munyoung ;
Ha, Jung-Woo ;
Kim, Sunghun ;
Choo, Jaegul .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :8789-8797
[4]  
Dongyu Zhang, 2010, Proceedings of the 2010 20th International Conference on Pattern Recognition (ICPR 2010), P29, DOI 10.1109/ICPR.2010.16
[5]   Watch your Up-Convolution: CNN Based Generative Deep Neural Networks are Failing to Reproduce Spectral Distributions [J].
Durall, Ricard ;
Keuper, Margret ;
Keuper, Janis .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2020), 2020, :7887-7896
[6]  
Goodfellow IJ, 2014, ADV NEUR IN, V27, P2672
[7]   High-frequency Component Helps Explain the Generalization of Convolutional Neural Networks [J].
Wang, Haohan ;
Wu, Xindi ;
Huang, Zeyi ;
Xing, Eric P. .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2020), 2020, :8681-8691
[8]  
Heusel M, 2017, ADV NEUR IN, V30
[9]  
Gulrajani I, 2017, ADV NEUR IN, V30
[10]  
Jolicoeur-Martineau A, 2018, Arxiv, DOI arXiv:1807.00734