RSRGAN: computationally efficient real-world single image super-resolution using generative adversarial network

被引:9
作者
Chudasama, Vishal [1 ]
Upla, Kishor [1 ]
机构
[1] Sardar Vallabhbhai Natl Inst Technol SVNIT, Dept Elect Engn, Surat, India
关键词
Real-world image super-resolution; Generative adversarial network; Perceptual index; Learned perceptual image patch similarity;
D O I
10.1007/s00138-020-01135-9
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Recently, convolutional neural network has been employed to obtain better performance in single image super-resolution task. Most of these models are trained and evaluated on synthetic datasets in which low-resolution images are synthesized with known bicubic degradation and hence they perform poorly on real-world images. However, by stacking more convolution layers, the super-resolution (SR) performance can be improved. But, such idea increases the number of training parameters and it offers a heavy computational burden on resources which makes them unsuitable for real-world applications. To solve this problem, we propose a computationally efficient real-world image SR network referred as RSRN. The RSRN model is optimized using pixel-wise L1 loss function which produces overly-smooth blurry images. Hence, to recover the perceptual quality of SR image, a real-world image SR using generative adversarial network called RSRGAN is proposed. Generative adversarial network has an ability to generate perceptual plausible solutions. Several experiments have been conducted to validate the effectiveness of the proposed RSRGAN model, and it shows that the proposed RSRGAN generates SR samples with more high-frequency details and better perception quality than that of recently proposed SRGAN and SRFeatIF models, while it sets comparable performance with the ESRGAN model with significant less number of training parameters.
引用
收藏
页数:18
相关论文
共 43 条
[1]   NTIRE 2017 Challenge on Single Image Super-Resolution: Dataset and Study [J].
Agustsson, Eirikur ;
Timofte, Radu .
2017 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2017, :1122-1131
[2]  
[Anonymous], 2015, Tiny ImageNet Visual Recognition Challenge., DOI DOI 10.1109/ICCV.2015.123
[3]  
[Anonymous], ICLR 2016
[4]  
[Anonymous], 2016, Distill, DOI DOI 10.23915/DISTILL.00003
[5]   A Deep Journey into Super-resolution: A Survey [J].
Anwar, Saeed ;
Khan, Salman ;
Barnes, Nick .
ACM COMPUTING SURVEYS, 2020, 53 (03)
[6]  
Barron J.T., 2017, A more general robust loss function
[7]   Low-Complexity Single-Image Super-Resolution based on Nonnegative Neighbor Embedding [J].
Bevilacqua, Marco ;
Roumy, Aline ;
Guillemot, Christine ;
Morel, Marie-Line Alberi .
PROCEEDINGS OF THE BRITISH MACHINE VISION CONFERENCE 2012, 2012,
[8]   The 2018 PIRM Challenge on Perceptual Image Super-Resolution [J].
Blau, Yochai ;
Mechrez, Roey ;
Timofte, Radu ;
Michaeli, Tomer ;
Zelnik-Manor, Lihi .
COMPUTER VISION - ECCV 2018 WORKSHOPS, PT V, 2019, 11133 :334-355
[9]   The Perception-Distortion Tradeoff [J].
Blau, Yochai ;
Michaeli, Tomer .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :6228-6237
[10]   NTIRE 2019 Challenge on Real Image Super-Resolution: Methods and Results [J].
Cai, Jianrui ;
Gu, Shuhang ;
Timofte, Radu ;
Zhang, Lei ;
Liu, Xiao ;
Ding, Yukang ;
He, Dongliang ;
Li, Chao ;
Fu, Yi ;
Wen, Shilei ;
Feng, Ruicheng ;
Gu, Jinjin ;
Qiao, Yu ;
Dong, Chao ;
Park, Dongwon ;
Chun, Se Young ;
Yoon, Sanghoon ;
Kwak, Junhyung ;
Son, Donghee ;
Zamir, Syed Waqas ;
Arora, Aditya ;
Khan, Salman ;
Khan, Fahad Shahbaz ;
Shao, Ling ;
Wei, Zhengping ;
Liu, Lei ;
Cai, Hong ;
Li, Darui ;
Gao, Fujie ;
Hui, Zheng ;
Wang, Xiumei ;
Gao, Xinbo ;
Cheng, Guoan ;
Matsune, Ai ;
Li, Qiuyu ;
Zhu, Leilei ;
Zang, Huaijuan ;
Zhan, Shu ;
Qiu, Yajun ;
Wang, Ruxin ;
Li, Jiawei ;
Jing, Yongcheng ;
Song, Mingli ;
Liu, Pengju ;
Zhang, Kai ;
Liu, Jingdong ;
Liu, Jiye ;
Zhang, Hongzhi ;
Zuo, Wangmeng ;
Tang, Wenyi .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW 2019), 2019, :2211-2223