Boundary equilibrium SR: effective loss functions for single image super-resolution

被引:2
|
作者
Zhang, Zhechen [1 ]
Lu, Weigang [2 ]
Chen, Shuo [1 ]
Yang, Fei [1 ,3 ]
Jingchang, Pan [1 ]
机构
[1] Shandong Univ, Sch Mech Elect & Informat Engn, Weihai 264200, Peoples R China
[2] Ocean Univ China, Dept Educ Technol, Qingdao 266000, Peoples R China
[3] Shandong Univ, Sch Comp Sci & Technol, Qingdao 266000, Peoples R China
关键词
Deep learning; Image super-resolution; Boundary equilibrium GANs; LPIPS-based perceptual loss; Auto-encoder;
D O I
10.1007/s10489-022-04162-3
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Recently, single image super-resolution (SISR) has made great progress due to the rapid development of deep convolutional neural networks (CNN), and the application of Generative Adversarial Networks (GAN ) has made super-resolution networks even more effective. However, GAN-based methods have many problems such as lengthy and unstable convergence. To solve these problems, this paper presents a mechanism that employs boundary equilibrium in the image super-resolution network to balance the convergence of the generator and the discriminator and improve the visual quality of the generated synthetic images. Furthermore, current methods often use perceptual loss based on the VGG network. However, experiments show that the visual quality improvement brought by this perceptual loss is very limited, so we propose an improved perceptual loss based on Learned Perceptual Image Patch Similarity (LPIPS) to acquire better human visual effects rather than adopting the traditional perceptual loss based on VGG. The experimental results clearly show that using our proposed method can considerably improve the performance of image super-resolution and obtain clearer details than state-of-the-arts.
引用
收藏
页码:17128 / 17138
页数:11
相关论文
共 50 条
  • [21] Learn to Zoom in Single Image Super-Resolution
    Zhang, Zili
    Favaro, Paolo
    Tian, Yan
    Li, Jianxiang
    IEEE SIGNAL PROCESSING LETTERS, 2022, 29 : 1237 - 1241
  • [22] Image super-resolution reconstruction based on implicit image functions
    Lin, Hai
    Yang, JunJie
    IET IMAGE PROCESSING, 2024, 18 (10) : 2690 - 2701
  • [23] Single-Image Super-Resolution: A Benchmark
    Yang, Chih-Yuan
    Ma, Chao
    Yang, Ming-Hsuan
    COMPUTER VISION - ECCV 2014, PT IV, 2014, 8692 : 372 - 386
  • [24] Single image super-resolution reconstruction method
    Tao, Hongjiu
    Rao, Junfei
    Zhou, Zude
    Wuhan Ligong Daxue Xuebao (Jiaotong Kexue Yu Gongcheng Ban)/Journal of Wuhan University of Technology (Transportation Science and Engineering), 2004, 28 (06):
  • [25] STRUCTURE PRESERVING SINGLE IMAGE SUPER-RESOLUTION
    Yang, Fan
    Xie, Don
    Jia, Huizhu
    Chen, Rui
    Xiang, Guoqing
    Gao, Wen
    2016 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2016, : 1409 - 1413
  • [26] A Progressive Approach for Single Image Super-Resolution
    Liang, Yongbo
    Cao, Guo
    Li, Xuesong
    FOURTH INTERNATIONAL WORKSHOP ON PATTERN RECOGNITION, 2019, 11198
  • [27] Gradient boosting for single image super-resolution
    Xiong, Dongping
    Gui, Qiuling
    Hou, Wenguang
    Ding, Mingyue
    INFORMATION SCIENCES, 2018, 454 : 328 - 343
  • [28] Subspace Constraint for Single Image Super-Resolution
    Zhang, Yanlin
    Qin, Ding
    Gu, Xiaodong
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING - ICANN 2021, PT III, 2021, 12893 : 395 - 407
  • [29] Single Image Super-Resolution Using ConvNeXt
    You, Chenghui
    Hong, Chaoqun
    Liu, Lijuan
    Lin, Xuehan
    2022 IEEE INTERNATIONAL CONFERENCE ON VISUAL COMMUNICATIONS AND IMAGE PROCESSING (VCIP), 2022,
  • [30] Single Image Super-Resolution with Gradient Guidance
    Man, Wang
    Du, Xiaofeng
    2021 INTERNATIONAL CONFERENCE ON COMPUTER, CONTROL AND ROBOTICS (ICCCR 2021), 2021, : 304 - 309