Coupled Deep Autoencoder for Single Image Super-Resolution

被引:168
|
作者
Zeng, Kun [1 ]
Yu, Jun [2 ,3 ]
Wang, Ruxin [4 ]
Li, Cuihua [1 ]
Tao, Dacheng [4 ]
机构
[1] Xiamen Univ, Sch Informat Sci & Engn, Dept Comp Sci, Xiamen 361005, Peoples R China
[2] Hangzhou Dianzi Univ, Minist Educ, Sch Comp Sci, Hangzhou 310018, Zhejiang, Peoples R China
[3] Hangzhou Dianzi Univ, Minist Educ, Key Lab Complex Syst Modeling & Simulat, Hangzhou 310018, Zhejiang, Peoples R China
[4] Univ Technol Sydney, Ctr Quantum Computat & Intelligent Syst, Fac Engn & Informat Technol, Ultimo, NSW 2007, Australia
基金
中国国家自然科学基金; 高等学校博士学科点专项科研基金;
关键词
Autoencoder; deep learning; single image super-resolution (SR); DICTIONARY; RECONSTRUCTION; FRAMEWORK; COLOR;
D O I
10.1109/TCYB.2015.2501373
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Sparse coding has been widely applied to learning-based single image super-resolution (SR) and has obtained promising performance by jointly learning effective representations for low-resolution (LR) and high-resolution (HR) image patch pairs. However, the resulting HR images often suffer from ringing, jaggy, and blurring artifacts due to the strong yet ad hoc assumptions that the LR image patch representation is equal to, is linear with, lies on a manifold similar to, or has the same support set as the corresponding HR image patch representation. Motivated by the success of deep learning, we develop a data-driven model coupled deep autoencoder (CDA) for single image SR. CDA is based on a new deep architecture and has high representational capability. CDA simultaneously learns the intrinsic representations of LR and HR image patches and a big-data-driven function that precisely maps these LR representations to their corresponding HR representations. Extensive experimentation demonstrates the superior effectiveness and efficiency of CDA for single image SR compared to other state-of-the-art methods on Set5 and Set14 datasets.
引用
收藏
页码:27 / 37
页数:11
相关论文
共 50 条
  • [1] Coupled Autoencoder Network with Joint Regularizations for image super-resolution
    Zheng, Huanhuan
    Qu, Yanyun
    Zeng, Kun
    8TH INTERNATIONAL CONFERENCE ON INTERNET MULTIMEDIA COMPUTING AND SERVICE (ICIMCS2016), 2016, : 114 - 117
  • [2] Deep Super-Resolution Network for Single Image Super-Resolution with Realistic Degradations
    Umer, Rao Muhammad
    Foresti, Gian Luca
    Micheloni, Christian
    ICDSC 2019: 13TH INTERNATIONAL CONFERENCE ON DISTRIBUTED SMART CAMERAS, 2019,
  • [3] Coupled Adversarial Learning for Single Image Super-Resolution
    Hsu, Chih-Chung
    Huang, Kuan-Yu
    2020 IEEE 11TH SENSOR ARRAY AND MULTICHANNEL SIGNAL PROCESSING WORKSHOP (SAM), 2020,
  • [4] Deep Residual Network for Single Image Super-Resolution
    Wang, Haimin
    Liao, Kai
    Yan, Bin
    Ye, Run
    ICCCV 2019: PROCEEDINGS OF THE 2ND INTERNATIONAL CONFERENCE ON CONTROL AND COMPUTER VISION, 2019, : 66 - 70
  • [5] DEEP LEARNING BASED IMAGE SUPER-RESOLUTION WITH COUPLED BACKPROPAGATION
    Guo, Tiantong
    Mousavi, Hojjai S.
    Monga, Vishal
    2016 IEEE GLOBAL CONFERENCE ON SIGNAL AND INFORMATION PROCESSING (GLOBALSIP), 2016, : 237 - 241
  • [6] Coupled Directionally Structured Dictionaries for Single Image Super-Resolution
    Ahmed, Junaid
    Baloch, Gulsher Lund
    Bhatti, Anam
    Klette, Reinhard
    2017 IEEE INTERNATIONAL CONFERENCE ON IMAGING SYSTEMS AND TECHNIQUES (IST), 2017, : 420 - 425
  • [7] From Deep Image Decomposition to Single Depth Image Super-Resolution
    Zhao, Lijun
    Wang, Ke
    Zhang, Jinjing
    Bai, Huihui
    Zhao, Yao
    IMAGE AND GRAPHICS TECHNOLOGIES AND APPLICATIONS, IGTA 2021, 2021, 1480 : 23 - 34
  • [8] Variational AutoEncoder for Reference based Image Super-Resolution
    Liu, Zhi-Song
    Siu, Wan-Chi
    Wang, Li-Wen
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, CVPRW 2021, 2021, : 516 - 525
  • [9] Remote Sensing Image Super-Resolution Using Sparse Representation and Coupled Sparse Autoencoder
    Shao, Zhenfeng
    Wang, Lei
    Wang, Zhongyuan
    Deng, Juan
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2019, 12 (08) : 2663 - 2674
  • [10] Enhanced Deep Residual Networks for Single Image Super-Resolution
    Lim, Bee
    Son, Sanghyun
    Kim, Heewon
    Nah, Seungjun
    Lee, Kyoung Mu
    2017 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2017, : 1132 - 1140