Multiscale super-resolution reconstruction via multibranch prediction and selection network

被引:0
作者
Wang, Wei [1 ]
Wang, Fei [1 ]
Qiu, Zhiliang [1 ]
Jin, Ruizhi [1 ]
机构
[1] Xidian Univ, Sch Telecommun Engn, Xian, Shaanxi, Peoples R China
关键词
single image super-resolution; multiscale; multibranch; cascaded; convolutional neural networks;
D O I
10.1117/1.JEI.27.4.043007
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Convolutional neural networks have been recently shown to have the highest accuracy for single-image super-resolution reconstruction. A multibranch prediction and selection network that can gradually reconstruct robust images in multiple scales is proposed. This endeavor is achieved through a network structure with two interacting subnetworks: one is a deep cascaded, multibranch prediction network (DCMBPN) and another is a deep block-selection network (DBSN). In particular, in each cascade, DCMBPN predicts multiple reconstructed images progressively with its special multibranch and cascaded structure. DBSN then adaptively selects the predicted confident blocks from these reconstructed images. Our method does not require traditional interpolation methods to upsample the image as a preprocessing step. It, thus, greatly reduces the computational complexity. We use Euclidean and perception loss functions in each branch to obtain two high-quality reconstructions. In addition, for the cascade structure, our network can achieve reconstructions in different scales, such as 1.5x, 2x, 2.5x, 3x, 3.5x, and 4x. Extensive quantitative and qualitative evaluations on benchmark datasets show that the proposed algorithm performs favorably against the state-of-the-art methods in terms of accuracy and visual improvement. (C) 2018 SPIE and IS&T
引用
收藏
页数:10
相关论文
共 25 条
[1]  
[Anonymous], 2001, 8 IEEE INT C COMPUTE, DOI [DOI 10.1109/ICCV.2001.937655, 10.1109/ICCV.2001.937655]
[2]   Low-Complexity Single-Image Super-Resolution based on Nonnegative Neighbor Embedding [J].
Bevilacqua, Marco ;
Roumy, Aline ;
Guillemot, Christine ;
Morel, Marie-Line Alberi .
PROCEEDINGS OF THE BRITISH MACHINE VISION CONFERENCE 2012, 2012,
[3]   Super-resolution through neighbor embedding [J].
Chang, H ;
Yeung, DY ;
Xiong, Y .
PROCEEDINGS OF THE 2004 IEEE COMPUTER SOCIETY CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, VOL 1, 2004, :275-282
[4]   Accelerating the Super-Resolution Convolutional Neural Network [J].
Dong, Chao ;
Loy, Chen Change ;
Tang, Xiaoou .
COMPUTER VISION - ECCV 2016, PT II, 2016, 9906 :391-407
[5]   Learning a Deep Convolutional Network for Image Super-Resolution [J].
Dong, Chao ;
Loy, Chen Change ;
He, Kaiming ;
Tang, Xiaoou .
COMPUTER VISION - ECCV 2014, PT IV, 2014, 8692 :184-199
[6]   Image and Video Upscaling from Local Self-Examples [J].
Freedman, Gilad ;
Fattal, Raanan .
ACM TRANSACTIONS ON GRAPHICS, 2011, 30 (02)
[7]  
Glasner D, 2009, IEEE I CONF COMP VIS, P349, DOI 10.1109/ICCV.2009.5459271
[8]  
Huang J-B., 2015, IEEE C COMPUTER VISI, DOI [DOI 10.1109/CVPR.2015.7299156, 10.1109/cvpr.2015. 7299156]
[9]   Perceptual Losses for Real-Time Style Transfer and Super-Resolution [J].
Johnson, Justin ;
Alahi, Alexandre ;
Li Fei-Fei .
COMPUTER VISION - ECCV 2016, PT II, 2016, 9906 :694-711
[10]   Accurate Image Super-Resolution Using Very Deep Convolutional Networks [J].
Kim, Jiwon ;
Lee, Jung Kwon ;
Lee, Kyoung Mu .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :1646-1654