Uformer-ICS: A U-Shaped Transformer for Image Compressive Sensing Service

被引:0
作者
Zhang, Kuiyuan [1 ]
Hua, Zhongyun [1 ]
Li, Yuanman [2 ,3 ]
Zhang, Yushu [4 ]
Zhou, Yicong [5 ]
机构
[1] Harbin Inst Technol, Sch Comp Sci & Technol, Shenzhen 518055, Guangdong, Peoples R China
[2] Guangdong Prov Key Lab Novel Secur Intelligence Te, Shenzhen 518055, Guangdong, Peoples R China
[3] Shenzhen Univ, Coll Elect & Informat Engn, Guangdong Key Lab Intelligent Informat Proc, Shenzhen 518060, Peoples R China
[4] Nanjing Univ Aeronaut & Astronaut, Coll Comp Sci & Technol, Nanjing 210016, Peoples R China
[5] Univ Macau, Dept Comp & Informat Sci, Macau 999078, Peoples R China
基金
中国国家自然科学基金;
关键词
Image reconstruction; Transformers; Task analysis; Computer architecture; Image coding; Iterative methods; Extraterrestrial measurements; Compressive sensing service; compressive sampling; image reconstruction; adaptive sampling; deep learning; RECONSTRUCTION; ALGORITHMS;
D O I
10.1109/TSC.2023.3334446
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Many service computing applications require real-time dataset collection from multiple devices, necessitating efficient sampling techniques to reduce bandwidth and storage pressure. Compressive sensing (CS) has found wide-ranging applications in image acquisition and reconstruction. Recently, numerous deep-learning methods have been introduced for CS tasks. However, the accurate reconstruction of images from measurements remains a significant challenge, especially at low sampling rates. In this article, we propose Uformer-ICS as a novel U-shaped transformer for image CS tasks by introducing inner characteristics of CS into transformer architecture. To utilize the uneven sparsity distribution of image blocks, we design an adaptive sampling architecture that allocates measurement resources based on the estimated block sparsity, allowing the compressed results to retain maximum information from the original image. Additionally, we introduce a multi-channel projection (MCP) module inspired by traditional CS optimization methods. By integrating the MCP module into the transformer blocks, we construct projection-based transformer blocks, and then form a symmetrical reconstruction model using these blocks and residual convolutional blocks. Therefore, our reconstruction model can simultaneously utilize the local features and long-range dependencies of image, and the prior projection knowledge of CS theory. Experimental results demonstrate its significantly better reconstruction performance than state-of-the-art deep learning-based CS methods.
引用
收藏
页码:2974 / 2988
页数:15
相关论文
共 39 条
  • [21] A Swin Transformer-Based Encoding Booster Integrated in U-Shaped Network for Building Extraction
    Xiao, Xiao
    Guo, Wenliang
    Chen, Rui
    Hui, Yilong
    Wang, Jianing
    Zhao, Hongyu
    REMOTE SENSING, 2022, 14 (11)
  • [22] UST-Net: A U-Shaped Transformer Network Using Shifted Windows for Hyperspectral Unmixing
    Yang, Zhiru
    Xu, Mingming
    Liu, Shanwei
    Sheng, Hui
    Wan, Jianhua
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [23] Research on Thyroid CT Image Segmentation Based on U-Shaped Convolutional Neural Network
    Zeng, Yunzhi
    Zhang, Yanfen
    Gong, Ning
    Li, Mei
    Wang, Meili
    FOURTEENTH INTERNATIONAL CONFERENCE ON GRAPHICS AND IMAGE PROCESSING, ICGIP 2022, 2022, 12705
  • [24] Multi-Focus Image Fusion Using U-Shaped Networks With a Hybrid Objective
    Li, Huaguang
    Nie, Rencan
    Cao, Jinde
    Guo, Xiaopeng
    Zhou, Dongming
    He, Kangjian
    IEEE SENSORS JOURNAL, 2019, 19 (21) : 9755 - 9765
  • [25] Residual Forward-Subtracted U-Shaped Network for Dynamic and Static Image Restoration
    Jung, Ho Min
    Kim, Byeong Hak
    Kim, Min Young
    IEEE ACCESS, 2020, 8 : 145401 - 145412
  • [26] Parotid Gland Segmentation Using Purely Transformer-Based U-Shaped Network and Multimodal MRI
    Xu, Zi'an
    Dai, Yin
    Liu, Fayu
    Li, Siqi
    Liu, Sheng
    Shi, Lifu
    Fu, Jun
    ANNALS OF BIOMEDICAL ENGINEERING, 2024, 52 (08) : 2101 - 2117
  • [27] U-Shaped CNN-ViT Siamese Network With Learnable Mask Guidance for Remote Sensing Building Change Detection
    Cui, Yongjing
    Chen, He
    Dong, Shan
    Wang, Guanqun
    Zhuang, Yin
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2024, 17 : 11402 - 11418
  • [28] CCTNet: CNN and Cross-Shaped Transformer Hybrid Network for Remote Sensing Image Semantic Segmentation
    Wu, Honglin
    Zeng, Zhaobin
    Huang, Peng
    Yu, Xinyu
    Zhang, Min
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2024, 17 : 19986 - 19997
  • [29] Burned Area Segmentation in Optical Remote Sensing Images Driven by U-Shaped Multistage Masked Autoencoder
    Fu, Yuxiang
    Fang, Wei
    Sheng, Victor S.
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2024, 17 : 10770 - 10780
  • [30] Semantic segmentation of remote sensing images based on U-shaped network combined with spatial enhance attention
    Bao Y.
    Liu W.
    Li R.
    Li Q.
    Hu Q.
    Beijing Hangkong Hangtian Daxue Xuebao/Journal of Beijing University of Aeronautics and Astronautics, 2023, 49 (07): : 1828 - 1837