Boundary equilibrium SR: effective loss functions for single image super-resolution

被引:2
|
作者
Zhang, Zhechen [1 ]
Lu, Weigang [2 ]
Chen, Shuo [1 ]
Yang, Fei [1 ,3 ]
Jingchang, Pan [1 ]
机构
[1] Shandong Univ, Sch Mech Elect & Informat Engn, Weihai 264200, Peoples R China
[2] Ocean Univ China, Dept Educ Technol, Qingdao 266000, Peoples R China
[3] Shandong Univ, Sch Comp Sci & Technol, Qingdao 266000, Peoples R China
关键词
Deep learning; Image super-resolution; Boundary equilibrium GANs; LPIPS-based perceptual loss; Auto-encoder;
D O I
10.1007/s10489-022-04162-3
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Recently, single image super-resolution (SISR) has made great progress due to the rapid development of deep convolutional neural networks (CNN), and the application of Generative Adversarial Networks (GAN ) has made super-resolution networks even more effective. However, GAN-based methods have many problems such as lengthy and unstable convergence. To solve these problems, this paper presents a mechanism that employs boundary equilibrium in the image super-resolution network to balance the convergence of the generator and the discriminator and improve the visual quality of the generated synthetic images. Furthermore, current methods often use perceptual loss based on the VGG network. However, experiments show that the visual quality improvement brought by this perceptual loss is very limited, so we propose an improved perceptual loss based on Learned Perceptual Image Patch Similarity (LPIPS) to acquire better human visual effects rather than adopting the traditional perceptual loss based on VGG. The experimental results clearly show that using our proposed method can considerably improve the performance of image super-resolution and obtain clearer details than state-of-the-arts.
引用
收藏
页码:17128 / 17138
页数:11
相关论文
共 50 条
  • [1] Boundary equilibrium SR: effective loss functions for single image super-resolution
    Zhechen Zhang
    Weigang Lu
    Shuo Chen
    Fei Yang
    Pan Jingchang
    Applied Intelligence, 2023, 53 : 17128 - 17138
  • [2] Analyzing different loss functions for Single Image Super-Resolution
    Shojaei, Shakiba
    Mahmoudi-Aznaveh, Ahmad
    PROCEEDINGS OF THE 13TH IRANIAN/3RD INTERNATIONAL MACHINE VISION AND IMAGE PROCESSING CONFERENCE, MVIP, 2024, : 175 - 180
  • [3] Single Image Super-Resolution with Vision Loss Function
    Song, Yi-Zhen
    Liu, Wen-Yen
    Chen, Ju-Chin
    Lin, Kawuu W.
    INTELLIGENT INFORMATION AND DATABASE SYSTEMS, ACIIDS 2019, PT II, 2019, 11432 : 173 - 179
  • [4] Single image super-resolution by approximated Heaviside functions
    Deng, Liang-Jian
    Guo, Weihong
    Huang, Ting-Zhu
    INFORMATION SCIENCES, 2016, 348 : 107 - 123
  • [5] Uncertainty-Driven Loss for Single Image Super-Resolution
    Ning, Qian
    Dong, Weisheng
    Li, Xin
    Wu, Jinjian
    Shi, Guangming
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 34 (NEURIPS 2021), 2021,
  • [6] A novel perceptual loss function for single image super-resolution
    Wu, Qiong
    Fan, Chunxiao
    Li, Yong
    Lie, Yang
    Hu, Jiahao
    MULTIMEDIA TOOLS AND APPLICATIONS, 2020, 79 (29-30) : 21265 - 21278
  • [7] SROBB: Targeted Perceptual Loss for Single Image Super-Resolution
    Rad, Mohammad Saeed
    Bozorgtabar, Behzad
    Marti, Urs-Viktor
    Basler, Max
    Ekenel, Hazim Kemal
    Thiran, Jean-Philippe
    2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 2710 - 2719
  • [8] A novel perceptual loss function for single image super-resolution
    Qiong Wu
    Chunxiao Fan
    Yong Li
    Yang Li
    Jiahao Hu
    Multimedia Tools and Applications, 2020, 79 : 21265 - 21278
  • [9] Transformer for Single Image Super-Resolution
    Lu, Zhisheng
    Li, Juncheng
    Liu, Hong
    Huang, Chaoyan
    Zhang, Linlin
    Zeng, Tieyong
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, CVPRW 2022, 2022, : 456 - 465
  • [10] Super-Resolution from a Single Image
    Glasner, Daniel
    Bagon, Shai
    Irani, Michal
    2009 IEEE 12TH INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2009, : 349 - 356