G2-DUN: Gradient Guided Deep Unfolding Network for Image Compressive Sensing

被引:0
作者
Cui, Wenxue [1 ]
Wang, Xingtao [1 ]
Fan, Xiaopeng [1 ]
Liu, Shaohui [1 ]
Ma, Chen [1 ]
Zhao, Debin [1 ]
机构
[1] Harbin Inst Technol, Harbin, Peoples R China
来源
PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2023 | 2023年
基金
中国国家自然科学基金;
关键词
Image compressive sensing; proximal gradient descent (PGD); deep unfolding network (DUN); convolutional neural network (CNN); transformer; RECONSTRUCTION;
D O I
10.1145/3581783.3612339
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Inspired by certain optimization solvers, the deep unfolding network (DUN) usually inherits a multi-phase structure for image compressive sensing (CS). However, in existing DUNs, the message transmission within and between phases still faces two issues: 1) the roughness of transmitted information, e.g., the low-dimensional representations. 2) the inefficiency of transmitted policy, e.g., simply concatenating deep features. In this paper, by unfolding the Proximal Gradient Descent (PGD) algorithm, a novel gradient guided DUN (G2-DUN) for image CS is proposed, in which a gradient map is delicately introduced within each phase for providing richer informational guidance at both intra-phase and inter-phase levels. Specifically, corresponding to the gradient descent (GD) of PGD, a gradient guided GD module is designed, in which the gradient map can adaptively guide step size allocation for different textures of input image, realizing a content-aware gradient updating. On the other hand, corresponding to the proximal mapping (PM) of PGD, a gradient guided PM module is developed, in which the gradient map can dynamically guide the exploring of deep textural priors in multi-scale space, achieving the dynamic perception of the proposed deep model. By introducing the gradient map, the proposed message transmission system not only facilitates the informational communication between different functional modules within each phase, but also strengthens the inferential cooperation among cascaded phases. Extensive experiments manifest that the proposed G2-DUN outperforms existing state-of-the-art CS methods.
引用
收藏
页码:7933 / 7942
页数:10
相关论文
共 80 条
  • [1] MoDL: Model-Based Deep Learning Architecture for Inverse Problems
    Aggarwal, Hemant K.
    Mani, Merry P.
    Jacob, Mathews
    [J]. IEEE TRANSACTIONS ON MEDICAL IMAGING, 2019, 38 (02) : 394 - 405
  • [2] Wavelet-Based Compressive Imaging of Sparse Targets
    Anselmi, Nicola
    Salucci, Marco
    Oliveri, Giacomo
    Massa, Andrea
    [J]. IEEE TRANSACTIONS ON ANTENNAS AND PROPAGATION, 2015, 63 (11) : 4889 - 4900
  • [3] A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems
    Beck, Amir
    Teboulle, Marc
    [J]. SIAM JOURNAL ON IMAGING SCIENCES, 2009, 2 (01): : 183 - 202
  • [4] A new TwIST: Two-step iterative shrinkage/thresholding algorithms for image restoration
    Bioucas-Dias, Jose M.
    Figueiredo, Mario A. T.
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2007, 16 (12) : 2992 - 3004
  • [5] Development of human visual function
    Braddick, Oliver
    Atkinson, Janette
    [J]. VISION RESEARCH, 2011, 51 (13) : 1588 - 1609
  • [6] Robust uncertainty principles:: Exact signal reconstruction from highly incomplete frequency information
    Candès, EJ
    Romberg, J
    Tao, T
    [J]. IEEE TRANSACTIONS ON INFORMATION THEORY, 2006, 52 (02) : 489 - 509
  • [7] Candès EJ, 2008, IEEE SIGNAL PROC MAG, V25, P21, DOI 10.1109/MSP.2007.914731
  • [8] Content-Aware Scalable Deep Compressed Sensing
    Chen, Bin
    Zhang, Jian
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2022, 31 : 5412 - 5426
  • [9] Chen C, 2011, CONF REC ASILOMAR C, P1193, DOI 10.1109/ACSSC.2011.6190204
  • [10] Fast Hierarchical Deep Unfolding Network for Image Compressed Sensing
    Cui, Wenxue
    Liu, Shaohui
    Zhao, Debin
    [J]. PROCEEDINGS OF THE 30TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2022, 2022, : 2739 - 2748