Boundary equilibrium SR: effective loss functions for single image super-resolution

被引:2
|
作者
Zhang, Zhechen [1 ]
Lu, Weigang [2 ]
Chen, Shuo [1 ]
Yang, Fei [1 ,3 ]
Jingchang, Pan [1 ]
机构
[1] Shandong Univ, Sch Mech Elect & Informat Engn, Weihai 264200, Peoples R China
[2] Ocean Univ China, Dept Educ Technol, Qingdao 266000, Peoples R China
[3] Shandong Univ, Sch Comp Sci & Technol, Qingdao 266000, Peoples R China
关键词
Deep learning; Image super-resolution; Boundary equilibrium GANs; LPIPS-based perceptual loss; Auto-encoder;
D O I
10.1007/s10489-022-04162-3
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Recently, single image super-resolution (SISR) has made great progress due to the rapid development of deep convolutional neural networks (CNN), and the application of Generative Adversarial Networks (GAN ) has made super-resolution networks even more effective. However, GAN-based methods have many problems such as lengthy and unstable convergence. To solve these problems, this paper presents a mechanism that employs boundary equilibrium in the image super-resolution network to balance the convergence of the generator and the discriminator and improve the visual quality of the generated synthetic images. Furthermore, current methods often use perceptual loss based on the VGG network. However, experiments show that the visual quality improvement brought by this perceptual loss is very limited, so we propose an improved perceptual loss based on Learned Perceptual Image Patch Similarity (LPIPS) to acquire better human visual effects rather than adopting the traditional perceptual loss based on VGG. The experimental results clearly show that using our proposed method can considerably improve the performance of image super-resolution and obtain clearer details than state-of-the-arts.
引用
收藏
页码:17128 / 17138
页数:11
相关论文
共 50 条
  • [41] Edge-Informed Single Image Super-Resolution
    Nazeri, Kamyar
    Thasarathan, Harrish
    Ebrahimi, Mehran
    2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW), 2019, : 3275 - 3284
  • [42] Single Image Super-resolution with Self-similarity
    Nam, Yoojun
    Mun, Junwon
    Jang, Yunseok
    Kim, Jaeseok
    2019 IEEE INTERNATIONAL CONFERENCE ON CONSUMER ELECTRONICS (ICCE), 2019,
  • [43] Guided Dual Networks for Single Image Super-Resolution
    Chen, Wenhui
    Liu, Chuangchuang
    Yan, Yitong
    Jin, Longcun
    Sun, Xianfang
    Peng, Xinyi
    IEEE ACCESS, 2020, 8 : 93608 - 93620
  • [44] SRFeat: Single Image Super-Resolution with Feature Discrimination
    Park, Seong-Jin
    Son, Hyeongseok
    Cho, Sunghyun
    Hong, Ki-Sang
    Lee, Seungyong
    COMPUTER VISION - ECCV 2018, PT XVI, 2018, 11220 : 455 - 471
  • [45] SINGLE IMAGE SUPER-RESOLUTION WITH LIMITED NUMBER OF FILTERS
    Nakahara, Yusuke
    Yamaguchi, Takuro
    Ikehara, Masaaki
    2018 IEEE GLOBAL CONFERENCE ON SIGNAL AND INFORMATION PROCESSING (GLOBALSIP 2018), 2018, : 36 - 40
  • [46] An Optimal Weight Model for Single Image Super-Resolution
    Dinh Hoan Trinh
    Luong, Marie
    Rocchisani, Jean-Marie
    Canh Duong Pham
    Huy Dien Pham
    Dibos, Francoise
    2012 INTERNATIONAL CONFERENCE ON DIGITAL IMAGE COMPUTING TECHNIQUES AND APPLICATIONS (DICTA), 2012,
  • [47] Coupled Deep Autoencoder for Single Image Super-Resolution
    Zeng, Kun
    Yu, Jun
    Wang, Ruxin
    Li, Cuihua
    Tao, Dacheng
    IEEE TRANSACTIONS ON CYBERNETICS, 2017, 47 (01) : 27 - 37
  • [48] A compendious study of super-resolution techniques by single image
    Pandey, Garima
    Ghanekar, Umesh
    OPTIK, 2018, 166 : 147 - 160
  • [49] Generative collaborative networks for single image super-resolution
    Seddik, Mohamed El Amine
    Tamaazousti, Mohamed
    Lin, John
    NEUROCOMPUTING, 2020, 398 : 293 - 303
  • [50] Lightweight refined networks for single image super-resolution
    Tong, Jiahui
    Dou, Qingyu
    Yang, Haoran
    Jeon, Gwanggil
    Yang, Xiaomin
    MULTIMEDIA TOOLS AND APPLICATIONS, 2022, 81 (03) : 3439 - 3458