Wavelet-Based Dual Recursive Network for Image Super-Resolution

被引:52
|
作者
Xin, Jingwei [1 ]
Li, Jie [1 ]
Jiang, Xinrui [2 ]
Wang, Nannan [2 ]
Huang, Heng [3 ]
Gao, Xinbo [4 ,5 ]
机构
[1] Xidian Univ, State Key Lab Integrated Serv Networks, Sch Elect Engn, Xian 710071, Peoples R China
[2] Xidian Univ, State Key Lab Integrated Serv Networks, Sch Telecommun Engn, Xian 710071, Peoples R China
[3] Univ Pittsburgh, Dept Elect & Comp Engn, Pittsburgh, PA 15261 USA
[4] Chongqing Univ Posts & Telecommun, Chongqing Key Lab Image Cognit, Chongqing 400065, Peoples R China
[5] Xidian Univ, Sch Elect Engn, Xian 710071, Peoples R China
基金
中国国家自然科学基金;
关键词
Computational complexity; model parameters; single-image super-resolution (SISR); time-saving; wavelet coefficients (WCs);
D O I
10.1109/TNNLS.2020.3028688
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Although remarkable progress has been made on single-image super-resolution (SISR), deep learning methods cannot he easily applied to real-world applications due to the requirement of its heavy computation, especially for mobile devices. Focusing on the fewer parameters and faster inference SISR approach, we propose an efficient and time-saving wavelet transform-based network architecture, where the image super-resolution (SR) processing is carried out in the wavelet domain. Different from the existing methods that directly infer high-resolution (HR) image with the input low-resolution (LR) image, our approach first decomposes the LR image into a series of wavelet coefficients (WCs) and the network learns to predict the corresponding series of HR WCs and then reconstructs the HR image. Particularly, in order to further enhance the relationship between WCs and image deep characteristics, we propose two novel modules [wavelet feature mapping block (WFMB) and wavelet coefficients reconstruction block (WCRB)] and a dual recursive framework for joint learning strategy, thus forming a WCs prediction model to realize the efficient and accurate reconstruction of HR WCs. Experimental results show that the proposed method can outperform state-of-the-art methods with more than a 2x reduction in model parameters and computational complexity.
引用
收藏
页码:707 / 720
页数:14
相关论文
共 50 条
  • [1] Wavelet-based residual attention network for image super-resolution
    Xue, Shengke
    Qiu, Wenyuan
    Liu, Fan
    Jin, Xinyu
    NEUROCOMPUTING, 2020, 382 : 116 - 126
  • [2] Wavelet-Based Texture Reformation Network for Image Super-Resolution
    Li, Zhen
    Kuang, Zeng-Sheng
    Zhu, Zuo-Liang
    Wang, Hong-Peng
    Shao, Xiu-Li
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2022, 31 : 2647 - 2660
  • [3] Wavelet-based residual attention network for image super-resolution
    Xue, Shengke
    Qiu, Wenyuan
    Liu, Fan
    Jin, Xinyu
    Xue, Shengke (xueshengke@zju.edu.cn), 1600, Elsevier B.V., Netherlands (382): : 116 - 126
  • [4] A Wavelet-Based Asymmetric Convolution Network for Single Image Super-Resolution
    Zhang, Wanxu
    Jiang, Kai
    Wang, Lin
    Meng, Na
    Zhou, Yan
    Li, Yanyan
    Hu, Hailong
    Chen, Xiaoxuan
    Jiang, Bo
    IEEE ACCESS, 2021, 9 : 28976 - 28986
  • [5] Lightweight Wavelet-Based Transformer for Image Super-Resolution
    Ran, Jinye
    Zhang, Zili
    PRICAI 2022: TRENDS IN ARTIFICIAL INTELLIGENCE, PT III, 2022, 13631 : 368 - 382
  • [6] WAVELET-BASED SINGLE IMAGE SUPER-RESOLUTION WITH AN OVERALL ENHANCEMENT PROCEDURE
    Lu, Zongqing
    Zou, Quan
    Zhou, Fei
    Liao, Qingmin
    2017 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2017, : 1447 - 1451
  • [7] Image Super-resolution via Hybrid NEDI and Wavelet-based Scheme
    Liu, Zhi-Song
    Siu, Wan-Chi
    Huang, Jun-Jie
    2015 ASIA-PACIFIC SIGNAL AND INFORMATION PROCESSING ASSOCIATION ANNUAL SUMMIT AND CONFERENCE (APSIPA), 2015, : 1131 - 1136
  • [8] Wavelet-Based Eigentransformation for Face Super-Resolution
    Zhuo, Hui
    Lam, Kin-Man
    ADVANCES IN MULTIMEDIA INFORMATION PROCESSING-PCM 2010, PT II, 2010, 6298 : 226 - 234
  • [9] Image Super-Resolution Based on Dual Path Network
    Kuang, Hailan
    Wang, Hongchuan
    Ma, Xiaolin
    Liu, Xinhua
    2018 10TH INTERNATIONAL CONFERENCE ON MEASURING TECHNOLOGY AND MECHATRONICS AUTOMATION (ICMTMA), 2018, : 225 - 228
  • [10] Multiscale Recursive Feedback Network for Image Super-Resolution
    Chen, Xiao
    Sun, Chaowen
    IEEE ACCESS, 2022, 10 : 6393 - 6406