Coupled Deep Autoencoder for Single Image Super-Resolution

被引:171
作者
Zeng, Kun [1 ]
Yu, Jun [2 ,3 ]
Wang, Ruxin [4 ]
Li, Cuihua [1 ]
Tao, Dacheng [4 ]
机构
[1] Xiamen Univ, Sch Informat Sci & Engn, Dept Comp Sci, Xiamen 361005, Peoples R China
[2] Hangzhou Dianzi Univ, Minist Educ, Sch Comp Sci, Hangzhou 310018, Zhejiang, Peoples R China
[3] Hangzhou Dianzi Univ, Minist Educ, Key Lab Complex Syst Modeling & Simulat, Hangzhou 310018, Zhejiang, Peoples R China
[4] Univ Technol Sydney, Ctr Quantum Computat & Intelligent Syst, Fac Engn & Informat Technol, Ultimo, NSW 2007, Australia
基金
高等学校博士学科点专项科研基金; 中国国家自然科学基金;
关键词
Autoencoder; deep learning; single image super-resolution (SR); DICTIONARY; RECONSTRUCTION; FRAMEWORK; COLOR;
D O I
10.1109/TCYB.2015.2501373
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Sparse coding has been widely applied to learning-based single image super-resolution (SR) and has obtained promising performance by jointly learning effective representations for low-resolution (LR) and high-resolution (HR) image patch pairs. However, the resulting HR images often suffer from ringing, jaggy, and blurring artifacts due to the strong yet ad hoc assumptions that the LR image patch representation is equal to, is linear with, lies on a manifold similar to, or has the same support set as the corresponding HR image patch representation. Motivated by the success of deep learning, we develop a data-driven model coupled deep autoencoder (CDA) for single image SR. CDA is based on a new deep architecture and has high representational capability. CDA simultaneously learns the intrinsic representations of LR and HR image patches and a big-data-driven function that precisely maps these LR representations to their corresponding HR representations. Extensive experimentation demonstrates the superior effectiveness and efficiency of CDA for single image SR compared to other state-of-the-art methods on Set5 and Set14 datasets.
引用
收藏
页码:27 / 37
页数:11
相关论文
共 52 条
[1]  
Adler A, 2010, LECT NOTES COMPUT SC, V6312, P622, DOI 10.1007/978-3-642-15552-9_45
[2]  
[Anonymous], 2006, NIPS
[3]   Learning Deep Architectures for AI [J].
Bengio, Yoshua .
FOUNDATIONS AND TRENDS IN MACHINE LEARNING, 2009, 2 (01) :1-127
[4]   Low-Complexity Single-Image Super-Resolution based on Nonnegative Neighbor Embedding [J].
Bevilacqua, Marco ;
Roumy, Aline ;
Guillemot, Christine ;
Morel, Marie-Line Alberi .
PROCEEDINGS OF THE BRITISH MACHINE VISION CONFERENCE 2012, 2012,
[5]   Super-Resolution Image Reconstruction Using Nonparametric Bayesian INLA Approximation [J].
Camponez, Marcelo Oliveira ;
Teatini Salles, Evandro Ottoni ;
Sarcinelli-Filho, Mario .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2012, 21 (08) :3491-3501
[6]   Super-resolution through neighbor embedding [J].
Chang, H ;
Yeung, DY ;
Xiong, Y .
PROCEEDINGS OF THE 2004 IEEE COMPUTER SOCIETY CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, VOL 1, 2004, :275-282
[7]   Learning a Deep Convolutional Network for Image Super-Resolution [J].
Dong, Chao ;
Loy, Chen Change ;
He, Kaiming ;
Tang, Xiaoou .
COMPUTER VISION - ECCV 2014, PT IV, 2014, 8692 :184-199
[8]   Nonlocally Centralized Sparse Representation for Image Restoration [J].
Dong, Weisheng ;
Zhang, Lei ;
Shi, Guangming ;
Li, Xin .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2013, 22 (04) :1618-1628
[9]   Accurate Blur Models vs. Image Priors in Single Image Super-Resolution [J].
Efrat, Netalee ;
Glasner, Daniel ;
Apartsin, Alexander ;
Nadler, Boaz ;
Levin, Anat .
2013 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2013, :2832-2839
[10]   Super-resolution via Transform-invariant Group-sparse Regularization [J].
Fernandez-Granda, Carlos ;
Candes, Emmanuel J. .
2013 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2013, :3336-3343