Uformer-ICS: A U-Shaped Transformer for Image Compressive Sensing Service

被引:0
作者
Zhang, Kuiyuan [1 ]
Hua, Zhongyun [1 ]
Li, Yuanman [2 ,3 ]
Zhang, Yushu [4 ]
Zhou, Yicong [5 ]
机构
[1] Harbin Inst Technol, Sch Comp Sci & Technol, Shenzhen 518055, Guangdong, Peoples R China
[2] Guangdong Prov Key Lab Novel Secur Intelligence Te, Shenzhen 518055, Guangdong, Peoples R China
[3] Shenzhen Univ, Coll Elect & Informat Engn, Guangdong Key Lab Intelligent Informat Proc, Shenzhen 518060, Peoples R China
[4] Nanjing Univ Aeronaut & Astronaut, Coll Comp Sci & Technol, Nanjing 210016, Peoples R China
[5] Univ Macau, Dept Comp & Informat Sci, Macau 999078, Peoples R China
基金
中国国家自然科学基金;
关键词
Image reconstruction; Transformers; Task analysis; Computer architecture; Image coding; Iterative methods; Extraterrestrial measurements; Compressive sensing service; compressive sampling; image reconstruction; adaptive sampling; deep learning; RECONSTRUCTION; ALGORITHMS;
D O I
10.1109/TSC.2023.3334446
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Many service computing applications require real-time dataset collection from multiple devices, necessitating efficient sampling techniques to reduce bandwidth and storage pressure. Compressive sensing (CS) has found wide-ranging applications in image acquisition and reconstruction. Recently, numerous deep-learning methods have been introduced for CS tasks. However, the accurate reconstruction of images from measurements remains a significant challenge, especially at low sampling rates. In this article, we propose Uformer-ICS as a novel U-shaped transformer for image CS tasks by introducing inner characteristics of CS into transformer architecture. To utilize the uneven sparsity distribution of image blocks, we design an adaptive sampling architecture that allocates measurement resources based on the estimated block sparsity, allowing the compressed results to retain maximum information from the original image. Additionally, we introduce a multi-channel projection (MCP) module inspired by traditional CS optimization methods. By integrating the MCP module into the transformer blocks, we construct projection-based transformer blocks, and then form a symmetrical reconstruction model using these blocks and residual convolutional blocks. Therefore, our reconstruction model can simultaneously utilize the local features and long-range dependencies of image, and the prior projection knowledge of CS theory. Experimental results demonstrate its significantly better reconstruction performance than state-of-the-art deep learning-based CS methods.
引用
收藏
页码:2974 / 2988
页数:15
相关论文
共 39 条
  • [11] Desmoking of the Endoscopic Surgery Images Based on a Local-Global U-Shaped Transformer Model
    Wang, Wanqing
    Liu, Fucheng
    Hao, Jianxiong
    Yu, Xiangyang
    Zhang, Bo
    Shi, Chaoyang
    IEEE TRANSACTIONS ON MEDICAL ROBOTICS AND BIONICS, 2025, 7 (01): : 254 - 265
  • [12] ULST: U-shaped LeWin Spectral Transformer for virtual staining of pathological sections
    Zhang, Haoran
    Pan, Mingzhong
    Zhang, Chenglong
    Xu, Chenyang
    Qi, Hongxing
    Lei, Dapeng
    Ma, Xiaopeng
    COMPUTERIZED MEDICAL IMAGING AND GRAPHICS, 2025, 123
  • [13] Low-count PET image reconstruction based on truncated inverse radon layer and U-shaped network
    Ye, Jianbo
    Kuang, Zhonghua
    Yang, Yongfeng
    Cui, Ke
    Li, Xiangyu
    PHYSICS IN MEDICINE AND BIOLOGY, 2023, 68 (15)
  • [14] Fourier Transform-Based U-Shaped Network for Single Image Motion Deblrring
    Feng, Jianxin
    Hao, Enguang
    Du, Yue
    Zhang, Jianhao
    Ding, Yuanming
    Fang, Hui
    IEEE ACCESS, 2024, 12 : 12745 - 12759
  • [15] LUCF-Net: Lightweight U-Shaped Cascade Fusion Network for Medical Image Segmentation
    She, Qingshan
    Sun, Songkai
    Ma, Yuliang
    Li, Rihui
    Zhang, Yingchun
    IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2025, 29 (03) : 2088 - 2099
  • [16] UM2Former: U-Shaped Multimixed Transformer Network for Large-Scale Hyperspectral Image Semantic Segmentation
    Xu, Aijun
    Xue, Zhaohui
    Li, Ziyu
    Cheng, Shun
    Su, Hongjun
    Xia, Junshi
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2025, 63
  • [17] UCR-Net: U-shaped context residual network for medical image
    Sun, Qi
    Dai, Mengyun
    Lan, Ziyang
    Cai, Fanggang
    Wei, Lifang
    Yang, Changcai
    Chen, Riqing
    COMPUTERS IN BIOLOGY AND MEDICINE, 2022, 151
  • [18] LMU-Net: lightweight U-shaped network for medical image segmentation
    Ting Ma
    Ke Wang
    Feng Hu
    Medical & Biological Engineering & Computing, 2024, 62 : 61 - 70
  • [19] URNet: A U-Shaped Residual Network for Lightweight Image Super-Resolution
    Wang, Yuntao
    Zhao, Lin
    Liu, Liman
    Hu, Huaifei
    Tao, Wenbing
    REMOTE SENSING, 2021, 13 (19)
  • [20] Two-dimensional medical image segmentation based on U-shaped structure
    Cai, Sijing
    Xiao, Yuwei
    Wang, Yanyu
    INTERNATIONAL JOURNAL OF IMAGING SYSTEMS AND TECHNOLOGY, 2024, 34 (01)