Multi-scale fractal residual network for image super-resolution

被引:22
作者
Feng, Xinxin [1 ,2 ,3 ,4 ]
Li, Xianguo [1 ,2 ,3 ,4 ]
Li, Jianxiong [1 ,2 ,3 ,4 ]
机构
[1] Tiangong Univ, Sch Elect, Informat Engn, Tianjin, Peoples R China
[2] Tianjin Key Lab Optoelectron Detect Technol, Syst, Tianjin, Peoples R China
[3] Tiangong Univ, Sch Elect & Informat Engn, Tianjin 300387, Peoples R China
[4] Tianjin Key Lab Optoelect Detect Technol & Syst, Tianjin 300387, Peoples R China
关键词
Image super-resolution; Residual learning; Multi-scale feature fusion; Fractal network; INTERPOLATION;
D O I
10.1007/s10489-020-01909-8
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Recent studies have shown that the use of deep convolutional neural networks (CNNs) can improve the performance of single image super-resolution reconstruction (SISR) methods. However, the existing CNN-based SISR model ignores the multi-scale features and shallow and deep features of the image, resulting in relatively low image reconstruction performance. To address these issues, this paper proposes a new multi-scale fractal residual network (MSFRN) for image super-resolution. On the basis of residual learning, a multi-scale fractal residual block (MSFRB) is designed. This block uses convolution kernels of different sizes to extract image multi-scale features and uses multiple paths to extract and fuse image features of different depths. Then, the shallow features extracted at the shallow feature extraction stage and the local features output by all MSFRBs are used to perform global hierarchical feature fusion. Finally, through sub-pixel convolution, the fused global features are used to reconstruct high-resolution images from low-resolution images. The experimental results on the five standard benchmark datasets show that MSFRN improved subjective visual effects and objective image quality evaluation indicators, and is superior to other state-of-the-art SISR methods.
引用
收藏
页码:1845 / 1856
页数:12
相关论文
共 42 条
[1]   Fast, Accurate, and Lightweight Super-Resolution with Cascading Residual Network [J].
Ahn, Namhyuk ;
Kang, Byungkon ;
Sohn, Kyung-Ah .
COMPUTER VISION - ECCV 2018, PT X, 2018, 11214 :256-272
[2]   Low-Complexity Single-Image Super-Resolution based on Nonnegative Neighbor Embedding [J].
Bevilacqua, Marco ;
Roumy, Aline ;
Guillemot, Christine ;
Morel, Marie-Line Alberi .
PROCEEDINGS OF THE BRITISH MACHINE VISION CONFERENCE 2012, 2012,
[3]   New architecture of deep recursive convolution networks for super-resolution [J].
Cao, Feilong ;
Chen, Baijie .
KNOWLEDGE-BASED SYSTEMS, 2019, 178 :98-110
[4]   Single image super-resolution via multi-scale residual channel attention network [J].
Cao, Feilong ;
Liu, Huan .
NEUROCOMPUTING, 2019, 358 :424-436
[5]   Accelerating the Super-Resolution Convolutional Neural Network [J].
Dong, Chao ;
Loy, Chen Change ;
Tang, Xiaoou .
COMPUTER VISION - ECCV 2016, PT II, 2016, 9906 :391-407
[6]   Image Super-Resolution Using Deep Convolutional Networks [J].
Dong, Chao ;
Loy, Chen Change ;
He, Kaiming ;
Tang, Xiaoou .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2016, 38 (02) :295-307
[7]  
Goodfellow IJ, 2014, ADV NEUR IN, V27, P2672
[8]  
He K., 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), DOI [DOI 10.1109/CVPR.2016.90, 10.1109/CVPR.2016.90]
[9]  
Huang G., 2017, Computer Vision and Pattern Recognition CVPR, P4700, DOI [DOI 10.1109/CVPR.2017.243, 10.1109/CVPR.2017.243]
[10]  
Huang J.-B., 2015, CVPR, DOI [10.1109/cvpr.2015. 7299156, DOI 10.1109/CVPR.2015.7299156, 10.1109/CVPR.2015.7299156]