Image and Video Restorations via Nonlocal Kernel Regression

被引:70
作者
Zhang, Haichao [1 ]
Yang, Jianchao [2 ]
Zhang, Yanning [1 ]
Huang, Thomas S. [3 ]
机构
[1] Northwestern Polytech Univ, Sch Comp Sci, Xian 710129, Peoples R China
[2] Adobe Syst Inc, Adv Technol Lab, San Jose, CA 95110 USA
[3] Univ Illinois, Dept Elect & Comp Engn, Beckman Inst, Urbana, IL 61801 USA
基金
国家高技术研究发展计划(863计划); 中国国家自然科学基金;
关键词
Deblurring; denoising; local structural regression; nonlocal self-similarity; restoration; superresolution (SR); SUPER RESOLUTION; SUPERRESOLUTION; SPARSE;
D O I
10.1109/TSMCB.2012.2222375
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
A nonlocal kernel regression (NL-KR) model is presented in this paper for various image and video restoration tasks. The proposed method exploits both the nonlocal self-similarity and local structural regularity properties in natural images. The nonlocal self-similarity is based on the observation that image patches tend to repeat themselves in natural images and videos, and the local structural regularity observes that image patches have regular structures where accurate estimation of pixel values via regression is possible. By unifying both properties explicitly, the proposed NL-KR framework is more robust in image estimation, and the algorithm is applicable to various image and video restoration tasks. In this paper, we apply the proposed model to image and video denoising, deblurring, and superresolution reconstruction. Extensive experimental results on both single images and realistic video sequences demonstrate that the proposed framework performs favorably with previous works both qualitatively and quantitatively.
引用
收藏
页码:1035 / 1046
页数:12
相关论文
共 44 条
[1]   Gaussian KD-Trees for Fast High-Dimensional Filtering [J].
Adams, Andrew ;
Gelfand, Natasha ;
Dolson, Jennifer ;
Levoy, Marc .
ACM TRANSACTIONS ON GRAPHICS, 2009, 28 (03)
[2]  
[Anonymous], 2010, LECT NOTES COMPUT SC
[3]   PatchMatch: A Randomized Correspondence Algorithm for Structural Image Editing [J].
Barnes, Connelly ;
Shechtman, Eli ;
Finkelstein, Adam ;
Goldman, Dan B. .
ACM TRANSACTIONS ON GRAPHICS, 2009, 28 (03)
[4]   A non-local algorithm for image denoising [J].
Buades, A ;
Coll, B ;
Morel, JM .
2005 IEEE COMPUTER SOCIETY CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, VOL 2, PROCEEDINGS, 2005, :60-65
[5]   Super-resolution through neighbor embedding [J].
Chang, H ;
Yeung, DY ;
Xiong, Y .
PROCEEDINGS OF THE 2004 IEEE COMPUTER SOCIETY CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, VOL 1, 2004, :275-282
[6]  
Chatterjee Partha., 2008, History in the Vernacular, P1
[7]  
Dabov K., 2008, P SPIE ELECT IMAG SA, p681 207
[8]   Image denoising by sparse 3-D transform-domain collaborative filtering [J].
Dabov, Kostadin ;
Foi, Alessandro ;
Katkovnik, Vladimir ;
Egiazarian, Karen .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2007, 16 (08) :2080-2095
[9]  
Danielyan A., 2008, P INT WORKSH LOC NON, P1
[10]  
Efros A. A., 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision, P1033, DOI 10.1109/ICCV.1999.790383