Sparse Representation-Based Multiple Frame Video Super-Resolution

被引:30
作者
Dai, Qiqin [1 ]
Yoo, Seunghwan [1 ]
Kappeler, Armin [1 ]
Katsaggelos, Aggelos K. [1 ]
机构
[1] Northwestern Univ, Dept Elect Engn & Comp Sci, Evanston, IL 60208 USA
关键词
Video super-resolution; dictionary learning; sparse coding; optical flow; motion estimation; IMAGE SUPERRESOLUTION; MOTION; RECONSTRUCTION; ALGORITHM;
D O I
10.1109/TIP.2016.2631339
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper, we propose two multiple-frame super-resolution (SR) algorithms based on dictionary learning (DL) and motion estimation. First, we adopt the use of video bilevel DL, which has been used for single-frame SR. It is extended to multiple frames by using motion estimation with sub-pixel accuracy. We propose a batch and a temporally recursive multi-frame SR algorithm, which improves over single-frame SR. Finally, we propose a novel DL algorithm utilizing consecutive video frames, rather than still images or individual video frames, which further improves the performance of the video SR algorithms. Extensive experimental comparisons with the state-of-the-art SR algorithms verify the effectiveness of our proposed multiple-frame video SR approach.
引用
收藏
页码:765 / 781
页数:17
相关论文
共 48 条
[21]   Learning-Based Video Superresolution Reconstruction Using Spatiotemporal Nonlocal Similarity [J].
Liang, Meiyu ;
Du, Junping ;
Li, Linghui .
MATHEMATICAL PROBLEMS IN ENGINEERING, 2015, 2015
[22]   Video Super-Resolution via Deep Draft-Ensemble Learning [J].
Liao, Renjie ;
Tao, Xin ;
Li, Ruiyu ;
Ma, Ziyang ;
Jia, Jiaya .
2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2015, :531-539
[23]   On Bayesian Adaptive Video Super Resolution [J].
Liu, Ce ;
Sun, Deqing .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2014, 36 (02) :346-360
[24]  
Liu C, 2011, PROC CVPR IEEE, P209, DOI 10.1109/CVPR.2011.5995614
[25]  
Ma ZY, 2015, PROC CVPR IEEE, P5224, DOI 10.1109/CVPR.2015.7299159
[26]   VQ-based blind image restoration algorithm [J].
Nakagaki, R ;
Katsaggelos, AK .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2003, 12 (09) :1044-1053
[27]   Super-resolution: a comprehensive survey [J].
Nasrollahi, Kamal ;
Moeslund, Thomas B. .
MACHINE VISION AND APPLICATIONS, 2014, 25 (06) :1423-1468
[28]   Regularized high-resolution image reconstruction considering inaccurate motion information [J].
Park, Min Kyu ;
Kang, Moon Gi ;
Katsaggelos, Aggelos K. .
OPTICAL ENGINEERING, 2007, 46 (11)
[29]  
Park SC, 2003, IEEE SIGNAL PROC MAG, V20, P21, DOI 10.1109/MSP.2003.1203207
[30]   Image Sequence Denoising via Sparse and Redundant Representations [J].
Protter, Matan ;
Elad, Michael .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2009, 18 (01) :27-35