Hand-Held Video Deblurring Via Efficient Fourier Aggregation

被引:48
作者
Delbracio, Mauricio [1 ]
Sapiro, Guillermo [1 ]
机构
[1] Duke Univ, Dept Elect & Comp Engn, Durham, NC 27708 USA
基金
美国国家科学基金会;
关键词
Video deblurring; camera shake; Fourier accumulation;
D O I
10.1109/TCI.2015.2501245
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Videos captured with hand-held cameras often suffer from a significant amount of blur, mainly caused by the inevitable natural tremor of the photographer's hand. In this work, we present an algorithm that removes blur due to camera shake by combining information in the Fourier domain from nearby frames in a video. The dynamic nature of typical videos with the presence of multiplemoving objects and occlusions makes this problem of camera shake removal extremely challenging, in particular when low complexity is needed. Given an input video frame, we first create a consistent registered version of temporally adjacent frames. Then, the set of consistently registered frames is blockwise fused in the Fourier domain with weights depending on the Fourier spectrum magnitude. The method is motivated from the physiological fact that camera shake blur has a random nature; therefore, nearby video frames are generally blurred differently. Experiments with numerous videos recorded in the wild, along with extensive comparisons, show that the proposed algorithm achieves state-of-the-art results while at the same time being much faster than its competitors.
引用
收藏
页码:270 / 283
页数:14
相关论文
共 45 条
[1]  
Alvarez L., 2002, P IEEE EUR C COMP VI
[2]  
Aubailly M., 2009, P SPIE OPT ENG APPL
[3]   A Database and Evaluation Methodology for Optical Flow [J].
Baker, Simon ;
Scharstein, Daniel ;
Lewis, J. P. ;
Roth, Stefan ;
Black, Michael J. ;
Szeliski, Richard .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 2011, 92 (01) :1-31
[4]  
Ballester Coloma, 2012, Pattern Recognition. Proceedings Joint 34th DAGM and 36th OAGM Symposium, P31, DOI 10.1007/978-3-642-32717-9_4
[5]   PERFORMANCE OF OPTICAL-FLOW TECHNIQUES [J].
BARRON, JL ;
FLEET, DJ ;
BEAUCHEMIN, SS .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 1994, 12 (01) :43-77
[6]  
CAI J, 2009, P IEEE C COMP VIS PA
[7]   Blind motion deblurring using multiple images [J].
Cai, Jian-Feng ;
Ji, Hui ;
Liu, Chaoqiang ;
Shen, Zuowei .
JOURNAL OF COMPUTATIONAL PHYSICS, 2009, 228 (14) :5057-5071
[8]   Quantifying the importance of high frequency components on the amplitude of physiological tremor [J].
Carignan, Benoit ;
Daneault, Jean-Francois ;
Duval, Christian .
EXPERIMENTAL BRAIN RESEARCH, 2010, 202 (02) :299-306
[9]  
Chen J., 2008, P IEEE C COMP VIS PA
[10]   Video Deblurring for Hand-held Cameras Using Patch-based Synthesis [J].
Cho, Sunghyun ;
Wang, Jue ;
Lee, Seungyong .
ACM TRANSACTIONS ON GRAPHICS, 2012, 31 (04)