Boundary equilibrium SR: effective loss functions for single image super-resolution

被引:2
|
作者
Zhang, Zhechen [1 ]
Lu, Weigang [2 ]
Chen, Shuo [1 ]
Yang, Fei [1 ,3 ]
Jingchang, Pan [1 ]
机构
[1] Shandong Univ, Sch Mech Elect & Informat Engn, Weihai 264200, Peoples R China
[2] Ocean Univ China, Dept Educ Technol, Qingdao 266000, Peoples R China
[3] Shandong Univ, Sch Comp Sci & Technol, Qingdao 266000, Peoples R China
关键词
Deep learning; Image super-resolution; Boundary equilibrium GANs; LPIPS-based perceptual loss; Auto-encoder;
D O I
10.1007/s10489-022-04162-3
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Recently, single image super-resolution (SISR) has made great progress due to the rapid development of deep convolutional neural networks (CNN), and the application of Generative Adversarial Networks (GAN ) has made super-resolution networks even more effective. However, GAN-based methods have many problems such as lengthy and unstable convergence. To solve these problems, this paper presents a mechanism that employs boundary equilibrium in the image super-resolution network to balance the convergence of the generator and the discriminator and improve the visual quality of the generated synthetic images. Furthermore, current methods often use perceptual loss based on the VGG network. However, experiments show that the visual quality improvement brought by this perceptual loss is very limited, so we propose an improved perceptual loss based on Learned Perceptual Image Patch Similarity (LPIPS) to acquire better human visual effects rather than adopting the traditional perceptual loss based on VGG. The experimental results clearly show that using our proposed method can considerably improve the performance of image super-resolution and obtain clearer details than state-of-the-arts.
引用
收藏
页码:17128 / 17138
页数:11
相关论文
共 50 条
  • [31] DRCS-SR: Deep Robust Compressed Sensing for Single Image Super-Resolution
    Kasem, Hossam M.
    Selim, Mahmoud M.
    Mohamed, Ehab Mahmoud
    Hussein, Amr H.
    IEEE ACCESS, 2020, 8 (08): : 170618 - 170634
  • [32] Patch loss: A generic multi-scale perceptual loss for single image super-resolution
    An, Tai
    Mao, Binjie
    Xue, Bin
    Huo, Chunlei
    Xiang, Shiming
    Pan, Chunhong
    PATTERN RECOGNITION, 2023, 139
  • [33] Single Image Super-Resolution: Depthwise Separable Convolution Super-Resolution Generative Adversarial Network
    Jiang, Zetao
    Huang, Yongsong
    Hu, Lirui
    APPLIED SCIENCES-BASEL, 2020, 10 (01):
  • [34] INTERPRETABLE MULTIPLE LOSS FUNCTIONS IN A LOW-RANK DEEP IMAGE PRIOR BASED METHOD FOR SINGLE HYPERSPECTRAL IMAGE SUPER-RESOLUTION
    Gelvez, Tatiana
    Bacca, Jorge
    Arguello, Henry
    29TH EUROPEAN SIGNAL PROCESSING CONFERENCE (EUSIPCO 2021), 2021, : 696 - 700
  • [35] Single image super-resolution based on image patch classification
    Xia, Ping
    Yan, Hua
    Li, Jing
    Sun, Jiande
    SECOND INTERNATIONAL WORKSHOP ON PATTERN RECOGNITION, 2017, 10443
  • [36] An Efficient Super-Resolution Single Image Network using Sharpness Loss Metrics for Iris
    Tapia, Juan
    Gomez-Barrero, Marta
    Busch, Christoph
    2020 IEEE INTERNATIONAL WORKSHOP ON INFORMATION FORENSICS AND SECURITY (WIFS), 2020,
  • [37] FINE-GRAINED DYNAMIC LOSS FOR ACCURATE SINGLE-IMAGE SUPER-RESOLUTION
    Wang, Haoquan
    Zhang, Gang
    Lei, Zhichun
    2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 2150 - 2154
  • [38] Deep Feature Translation Network Guided by Combined Loss for Single Image Super-Resolution
    Guan, Mingyang
    Song, Dandan
    Tao, Linmi
    PRICAI 2019: TRENDS IN ARTIFICIAL INTELLIGENCE, PT III, 2019, 11672 : 664 - 677
  • [39] Hyperspectral Image Super-Resolution with RGB Image Super-Resolution as an Auxiliary Task
    Li, Ke
    Dai, Dengxin
    van Gool, Luc
    2022 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV 2022), 2022, : 4039 - 4048
  • [40] Single Image Super-resolution Based on Residual Learning
    Xie, Chao
    Lu, Xiaobo
    PROCEEDINGS OF 2017 INTERNATIONAL CONFERENCE ON VIDEO AND IMAGE PROCESSING (ICVIP 2017), 2017, : 124 - 129