Context-aware lightweight remote-sensing image super-resolution network

被引:0
|
作者
Peng, Guangwen [1 ]
Xie, Minghong [1 ]
Fang, Liuyang [2 ]
机构
[1] Kunming Univ Sci & Technol, Fac Informat Engn & Automat, Kunming, Peoples R China
[2] Yunnan Key Lab Digital Commun, Kunming, Peoples R China
关键词
convolutional neural network; transformer; remote-sensing image super-resolution; lightweight network; context-aware;
D O I
10.3389/fnbot.2023.1220166
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In recent years, remote-sensing image super-resolution (RSISR) methods based on convolutional neural networks (CNNs) have achieved significant progress. However, the limited receptive field of the convolutional kernel in CNNs hinders the network's ability to effectively capture long-range features in images, thus limiting further improvements in model performance. Additionally, the deployment of existing RSISR models to terminal devices is challenging due to their high computational complexity and large number of parameters. To address these issues, we propose a Context-Aware Lightweight Super-Resolution Network (CALSRN) for remote-sensing images. The proposed network primarily consists of Context-Aware Transformer Blocks (CATBs), which incorporate a Local Context Extraction Branch (LCEB) and a Global Context Extraction Branch (GCEB) to explore both local and global image features. Furthermore, a Dynamic Weight Generation Branch (DWGB) is designed to generate aggregation weights for global and local features, enabling dynamic adjustment of the aggregation process. Specifically, the GCEB employs a Swin Transformer-based structure to obtain global information, while the LCEB utilizes a CNN-based cross-attention mechanism to extract local information. Ultimately, global and local features are aggregated using the weights acquired from the DWGB, capturing the global and local dependencies of the image and enhancing the quality of super-resolution reconstruction. The experimental results demonstrate that the proposed method is capable of reconstructing high-quality images with fewer parameters and less computational complexity compared with existing methods.
引用
收藏
页数:15
相关论文
共 50 条
  • [41] Remote Sensing Image Super-Resolution via Multiscale Enhancement Network
    Wang, Yu
    Shao, Zhenfeng
    Lu, Tao
    Wu, Changzhi
    Wang, Jiaming
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2023, 20
  • [42] Resolution-Aware Network for Image Super-Resolution
    Wang, Yifan
    Wang, Lijun
    Wang, Hongyu
    Li, Peihua
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2019, 29 (05) : 1259 - 1269
  • [43] Context-Aware Guided Attention Based Cross-Feedback Dense Network for Hyperspectral Image Super-Resolution
    Dong, Wenqian
    Qu, Jiahui
    Zhang, Tongzhen
    Li, Yunsong
    Du, Qian
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [44] A lightweight distillation CNN-transformer architecture for remote sensing image super-resolution
    Wang, Yu
    Shao, Zhenfeng
    Lu, Tao
    Liu, Lifeng
    Huang, Xiao
    Wang, Jiaming
    Jiang, Kui
    Zeng, Kangli
    INTERNATIONAL JOURNAL OF DIGITAL EARTH, 2023, 16 (01) : 3560 - 3579
  • [45] A Lightweight Remote Sensing Image Super-Resolution Method and Its Application in Smart Cities
    Zhang, Nenghuan
    Wang, Yongbin
    Feng, Shuang
    ELECTRONICS, 2022, 11 (07)
  • [46] Multi-Scale Fast Fourier Transform Based Attention Network for Remote-Sensing Image Super-Resolution
    Wang, Zheng
    Zhao, Yanwei
    Chen, Jiacheng
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2023, 16 : 2728 - 2740
  • [47] Lightweight Remote Sensing Image Super-Resolution via Background-Based Multiscale Feature Enhancement Network
    Wu, Tianren
    Zhao, Rundong
    Lv, Ming
    Jia, Zhenhong
    Li, Liangliang
    Wang, Zheyuan
    Ma, Hongbing
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2024, 21
  • [48] Lightweight remote sensing super-resolution with multi-scale graph attention network
    Wang, Yu
    Shao, Zhenfeng
    Lu, Tao
    Huang, Xiao
    Wang, Jiaming
    Zhang, Zhizheng
    Zuo, Xiaolong
    PATTERN RECOGNITION, 2025, 160
  • [49] Scale-Aware Backprojection Transformer for Single Remote Sensing Image Super-Resolution
    Hao, Jinglei
    Li, Wukai
    Lu, Yuting
    Jin, Yang
    Zhao, Yongqiang
    Wang, Shunzhou
    Wang, Binglu
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62
  • [50] An efficient and lightweight image super-resolution with feature network
    Zang, Yongsheng
    Zhou, Dongming
    Wang, Changcheng
    Nie, Rencan
    Guo, Yanbu
    OPTIK, 2022, 255