Uformer-ICS: A U-Shaped Transformer for Image Compressive Sensing Service

被引:0
作者
Zhang, Kuiyuan [1 ]
Hua, Zhongyun [1 ]
Li, Yuanman [2 ,3 ]
Zhang, Yushu [4 ]
Zhou, Yicong [5 ]
机构
[1] Harbin Inst Technol, Sch Comp Sci & Technol, Shenzhen 518055, Guangdong, Peoples R China
[2] Guangdong Prov Key Lab Novel Secur Intelligence Te, Shenzhen 518055, Guangdong, Peoples R China
[3] Shenzhen Univ, Coll Elect & Informat Engn, Guangdong Key Lab Intelligent Informat Proc, Shenzhen 518060, Peoples R China
[4] Nanjing Univ Aeronaut & Astronaut, Coll Comp Sci & Technol, Nanjing 210016, Peoples R China
[5] Univ Macau, Dept Comp & Informat Sci, Macau 999078, Peoples R China
基金
中国国家自然科学基金;
关键词
Image reconstruction; Transformers; Task analysis; Computer architecture; Image coding; Iterative methods; Extraterrestrial measurements; Compressive sensing service; compressive sampling; image reconstruction; adaptive sampling; deep learning; RECONSTRUCTION; ALGORITHMS;
D O I
10.1109/TSC.2023.3334446
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Many service computing applications require real-time dataset collection from multiple devices, necessitating efficient sampling techniques to reduce bandwidth and storage pressure. Compressive sensing (CS) has found wide-ranging applications in image acquisition and reconstruction. Recently, numerous deep-learning methods have been introduced for CS tasks. However, the accurate reconstruction of images from measurements remains a significant challenge, especially at low sampling rates. In this article, we propose Uformer-ICS as a novel U-shaped transformer for image CS tasks by introducing inner characteristics of CS into transformer architecture. To utilize the uneven sparsity distribution of image blocks, we design an adaptive sampling architecture that allocates measurement resources based on the estimated block sparsity, allowing the compressed results to retain maximum information from the original image. Additionally, we introduce a multi-channel projection (MCP) module inspired by traditional CS optimization methods. By integrating the MCP module into the transformer blocks, we construct projection-based transformer blocks, and then form a symmetrical reconstruction model using these blocks and residual convolutional blocks. Therefore, our reconstruction model can simultaneously utilize the local features and long-range dependencies of image, and the prior projection knowledge of CS theory. Experimental results demonstrate its significantly better reconstruction performance than state-of-the-art deep learning-based CS methods.
引用
收藏
页码:2974 / 2988
页数:15
相关论文
共 39 条
  • [31] Multiscale U-Shaped CNN Building Instance Extraction Framework With Edge Constraint for High-Spatial-Resolution Remote Sensing Imagery
    Liu, Yuanyuan
    Chen, Dingyuan
    Ma, Ailong
    Zhong, Yanfei
    Fang, Fang
    Xu, Kai
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2021, 59 (07): : 6106 - 6120
  • [32] USCT-UNet: Rethinking the Semantic Gap in U-Net Network From U-Shaped Skip Connections With Multichannel Fusion Transformer
    Xie, Xiaoshan
    Yang, Min
    IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2024, 32 : 3782 - 3793
  • [33] SWTRU: Star-shaped Window Transformer Reinforced U-Net for medical image segmentation
    Zhang, Jianyi
    Liu, Yong
    Wu, Qihang
    Wang, Yongpan
    Liu, Yuhai
    Xu, Xianchong
    Song, Bo
    COMPUTERS IN BIOLOGY AND MEDICINE, 2022, 150
  • [34] A Compressive Sensing based privacy preserving outsourcing of image storage and identity authentication service in cloud
    Hu, Guiqiang
    Xiao, Di
    Xiang, Tao
    Bai, Sen
    Zhang, Yushu
    INFORMATION SCIENCES, 2017, 387 : 132 - 145
  • [35] LMU-Net: lightweight U-shaped network for medical image segmentation (vol 62, pg 61, 2024)
    Ma, Ting
    Wang, Ke
    Hu, Feng
    MEDICAL & BIOLOGICAL ENGINEERING & COMPUTING, 2024, 62 (01) : 71 - 71
  • [36] UMRFormer-net: a three-dimensional U-shaped pancreas segmentation method based on a double-layer bridged transformer network
    Fang, Kun
    He, Baochun
    Liu, Libo
    Hu, Haoyu
    Fang, Chihua
    Huang, Xuguang
    Jia, Fucang
    QUANTITATIVE IMAGING IN MEDICINE AND SURGERY, 2023, 13 (03) : 1619 - 1630
  • [37] Low-light Image Enhancement Method Based on Shifted Window Multi-head Self-attention U-shaped Network
    Sun Bangyong
    Zhao Xingyun
    Wu Siyuan
    Yu Tao
    JOURNAL OF ELECTRONICS & INFORMATION TECHNOLOGY, 2022, 44 (10) : 3399 - 3408
  • [38] DUFormer: dual-channel image splicing detection based on anchor-shaped U-Net and stepwise transformer for power systems
    Tian, Xiuxia
    Zhao, Jianren
    Wen, Longfang
    SIGNAL IMAGE AND VIDEO PROCESSING, 2024, 18 (10) : 7237 - 7245
  • [39] Snow Detection in Gaofen-1 Multi-Spectral Images Based on Swin-Transformer and U-Shaped Dual-Branch Encoder Structure Network with Geographic Information
    Wu, Yue
    Shi, Chunxiang
    Shen, Runping
    Gu, Xiang
    Tie, Ruian
    Ge, Lingling
    Sun, Shuai
    REMOTE SENSING, 2024, 16 (17)