DRFN: Deep Recurrent Fusion Network for Single-Image Super-Resolution With Large Factors

被引:103
作者
Yang, Xin [1 ]
Mei, Haiyang [1 ]
Zhang, Jiqing [1 ]
Xu, Ke [1 ]
Yin, Baocai [1 ]
Zhang, Qiang [1 ]
Wei, Xiaopeng [1 ]
机构
[1] Dalian Univ Technol, Dept Elect Informat & Elect Engn, Dalian 116024, Peoples R China
基金
中国国家自然科学基金;
关键词
Image super-resolution; transposed convolution; deep recurrent network; multi-level fusion structure; large factors; QUALITY ASSESSMENT;
D O I
10.1109/TMM.2018.2863602
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Recently, single-image super-resolution has made great progress due to the development of deep convolutional neural networks (CNNs). The vast majority of CNN-based models use a predefined upsampling operator, such as bicubic interpolation, to upscale input low-resolution images to the desired size and learn nonlinear mapping between the interpolated image and ground truth high-resolution (HR) image. However, interpolation processing can lead to visual artifacts as details are over smoothed, particularly when the super-resolution factor is high. In this paper, we propose a deep recurrent fusion network (DRFN), which utilizes transposed convolution instead of bicubic interpolation for upsampling and integrates different-level features extracted from recurrent residual blocks to reconstruct the final HR images. We adopt a deep recurrence learning strategy and, thus, have a larger receptive field, which is conducive to reconstructing an image more accurately. Furthermore, we show that the multilevel fusion structure is suitable for dealing with image super-resolution problems. Extensive benchmark evaluations demonstrate that the proposed DRFN performs better than most current deep learning methods in terms of accuracy and visual effects, especially for large-scale images, while using fewer parameters.
引用
收藏
页码:328 / 337
页数:10
相关论文
共 45 条
[1]  
[Anonymous], 2001, P IEEECVF INT C COMP, DOI [DOI 10.1109/ICCV.2001.937655, 10.1109/ICCV.2001.937655]
[2]  
[Anonymous], STUD APPL MATH
[3]   Contour Detection and Hierarchical Image Segmentation [J].
Arbelaez, Pablo ;
Maire, Michael ;
Fowlkes, Charless ;
Malik, Jitendra .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2011, 33 (05) :898-916
[4]   Low-Complexity Single-Image Super-Resolution based on Nonnegative Neighbor Embedding [J].
Bevilacqua, Marco ;
Roumy, Aline ;
Guillemot, Christine ;
Morel, Marie-Line Alberi .
PROCEEDINGS OF THE BRITISH MACHINE VISION CONFERENCE 2012, 2012,
[5]  
Cui Z, 2014, LECT NOTES COMPUT SC, V8693, P49, DOI 10.1007/978-3-319-10602-1_4
[6]   Jointly Optimized Regressors for Image Super-resolution [J].
Dai, D. ;
Timofte, R. ;
Van Gool, L. .
COMPUTER GRAPHICS FORUM, 2015, 34 (02) :95-104
[7]  
Dai S., 2007, P IEEE C COMP VIS PA, V7, P1, DOI DOI 10.1109/CVPR.2007.383028
[8]  
Deng J, 2009, PROC CVPR IEEE, P248, DOI 10.1109/CVPRW.2009.5206848
[9]   Accelerating the Super-Resolution Convolutional Neural Network [J].
Dong, Chao ;
Loy, Chen Change ;
Tang, Xiaoou .
COMPUTER VISION - ECCV 2016, PT II, 2016, 9906 :391-407
[10]   Image Super-Resolution Using Deep Convolutional Networks [J].
Dong, Chao ;
Loy, Chen Change ;
He, Kaiming ;
Tang, Xiaoou .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2016, 38 (02) :295-307