VIDEO SUPER-RESOLUTION USING MOTION COMPENSATION AND RESIDUAL BIDIRECTIONAL RECURRENT CONVOLUTIONAL NETWORK

被引:0
作者
Li, Dingyi [1 ]
Liu, Yu [2 ]
Wang, Zengfu [1 ,3 ]
机构
[1] Univ Sci & Technol China, Dept Automat, Hefei, Anhui, Peoples R China
[2] Hefei Univ Technol, Dept Biomed Engn, Hefei, Anhui, Peoples R China
[3] Chinese Acad Sci, Inst Intelligent Machines, Hefei, Anhui, Peoples R China
来源
2017 24TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP) | 2017年
基金
中国国家自然科学基金;
关键词
Video super-resolution; recurrent neural networks (RNNs); convolutional neural networks (CNNs); deep residual learning;
D O I
暂无
中图分类号
TB8 [摄影技术];
学科分类号
0804 ;
摘要
Video super-resolution (SR) aims at restoring finer details and enhancing visual experience. In this paper, we propose a novel method named residual recurrent convolutional network (RRCN) for video SR. In our method, motion compensation and bidirectional residual convolutional network are combined to model the spatial and temporal non-linear mappings. To leverage sufficient amount of temporal information, we employ motion compensation, bidirectional recurrent convolutional layers and late fusion in of our network. We also apply residual connections in our recurrent structure for more accurate SR. Experimental results demonstrate the superiority of the proposed method over state-of-the-art single-image and multi-frame based SR approaches in terms of both quantitative assessment and visual quality.
引用
收藏
页码:1642 / 1646
页数:5
相关论文
共 28 条
[1]  
[Anonymous], 2015, ADV NEURAL INFPROCES
[2]   Super-resolution through neighbor embedding [J].
Chang, H ;
Yeung, DY ;
Xiong, Y .
PROCEEDINGS OF THE 2004 IEEE COMPUTER SOCIETY CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, VOL 1, 2004, :275-282
[3]   Image Super-Resolution Using Deep Convolutional Networks [J].
Dong, Chao ;
Loy, Chen Change ;
He, Kaiming ;
Tang, Xiaoou .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2016, 38 (02) :295-307
[4]   Learning a Deep Convolutional Network for Image Super-Resolution [J].
Dong, Chao ;
Loy, Chen Change ;
He, Kaiming ;
Tang, Xiaoou .
COMPUTER VISION - ECCV 2014, PT IV, 2014, 8692 :184-199
[5]  
Drulea M, 2011, IEEE INT C INTELL TR, P318, DOI 10.1109/ITSC.2011.6082986
[6]   Fast and robust multiframe super resolution [J].
Farsiu, S ;
Robinson, MD ;
Elad, M ;
Milanfar, P .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2004, 13 (10) :1327-1344
[7]   Example-based super-resolution [J].
Freeman, WT ;
Jones, TR ;
Pasztor, EC .
IEEE COMPUTER GRAPHICS AND APPLICATIONS, 2002, 22 (02) :56-65
[8]  
Glasner D, 2009, IEEE I CONF COMP VIS, P349, DOI 10.1109/ICCV.2009.5459271
[9]   Deep Residual Learning for Image Recognition [J].
He, Kaiming ;
Zhang, Xiangyu ;
Ren, Shaoqing ;
Sun, Jian .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :770-778
[10]  
Huang J-B., 2015, IEEE C COMPUTER VISI, DOI [DOI 10.1109/CVPR.2015.7299156, 10.1109/cvpr.2015. 7299156]