Cascading residual-residual attention generative adversarial network for image super resolution

被引:1
作者
Chen, Jianqiang [1 ]
Zhang, Yali [1 ]
Hu, Xiang [1 ]
Chen, Calvin Yu-Chian [1 ,2 ,3 ]
机构
[1] Sun Yat Sen Univ, Artificial Intelligence Med Ctr, Sch Intelligent Engn, Shenzhen, Peoples R China
[2] China Med Univ Hosp, Dept Med Res, Taichung, Taiwan
[3] Asia Univ, Dept Bioinformat & Med Engn, Taichung, Taiwan
关键词
Deep learning; Image super resolution; Cascading residual– residual block; Generative adversarial network;
D O I
10.1007/s00500-021-05730-4
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Image super resolution technology plays an important role in the field of computer vision. With the application of deep learning in the field of image super-resolution, the generative adversarial network is applied to image super-resolution and obtains images with great quality. In this paper, we propose a novel generative adversarial network structure called Cascading Residual-Residual Attention Generative Adversarial Network (CRRAGAN). First, this paper proposes a novel and efficient feature extraction module: Cascading Residual-Residual Block, which can extract multi-scale information and low-level cascade information to high-level information. CRRAGAN directly uses the channel attention module to capture low-resolution image key information and fuse it into the next stage feature. Second, a new loss combination function is proposed, a weighted sum of image loss, adversarial loss, perceptual loss, and charbonnier loss, to make the network training more stable. In the end, we compare our proposed method with 15 previous state-of-the-art methods and discuss the performance of different training datasets. Experimental results demonstrate that our model exhibits improved performance.
引用
收藏
页码:9651 / 9662
页数:12
相关论文
共 53 条
[1]   NTIRE 2017 Challenge on Single Image Super-Resolution: Dataset and Study [J].
Agustsson, Eirikur ;
Timofte, Radu .
2017 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2017, :1122-1131
[2]   Fast, Accurate, and Lightweight Super-Resolution with Cascading Residual Network [J].
Ahn, Namhyuk ;
Kang, Byungkon ;
Sohn, Kyung-Ah .
COMPUTER VISION - ECCV 2018, PT X, 2018, 11214 :256-272
[3]  
[Anonymous], 2017, ARXIV171205927
[4]   Low-Complexity Single-Image Super-Resolution based on Nonnegative Neighbor Embedding [J].
Bevilacqua, Marco ;
Roumy, Aline ;
Guillemot, Christine ;
Morel, Marie-Line Alberi .
PROCEEDINGS OF THE BRITISH MACHINE VISION CONFERENCE 2012, 2012,
[5]   The Perception-Distortion Tradeoff [J].
Blau, Yochai ;
Michaeli, Tomer .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :6228-6237
[6]   Elliptic entropy of uncertain random variables with application to portfolio selection [J].
Chen, Lin ;
Gao, Rong ;
Bian, Yuxiang ;
Di, Huafei .
SOFT COMPUTING, 2021, 25 (03) :1925-1939
[7]   Pricing and effort decisions for a supply chain with uncertain information [J].
Chen, Lin ;
Peng, Jin ;
Liu, Zhibing ;
Zhao, Ruiqing .
INTERNATIONAL JOURNAL OF PRODUCTION RESEARCH, 2017, 55 (01) :264-284
[8]   Second-order Attention Network for Single Image Super-Resolution [J].
Dai, Tao ;
Cai, Jianrui ;
Zhang, Yongbing ;
Xia, Shu-Tao ;
Zhang, Lei .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :11057-11066
[9]   Accelerating the Super-Resolution Convolutional Neural Network [J].
Dong, Chao ;
Loy, Chen Change ;
Tang, Xiaoou .
COMPUTER VISION - ECCV 2016, PT II, 2016, 9906 :391-407
[10]   Image Super-Resolution Using Deep Convolutional Networks [J].
Dong, Chao ;
Loy, Chen Change ;
He, Kaiming ;
Tang, Xiaoou .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2016, 38 (02) :295-307