Lightweight Remote Sensing Image Super-Resolution via Background-Based Multiscale Feature Enhancement Network

被引:2
|
作者
Wu, Tianren [1 ]
Zhao, Rundong [1 ]
Lv, Ming [1 ]
Jia, Zhenhong [1 ]
Li, Liangliang [2 ]
Wang, Zheyuan [3 ]
Ma, Hongbing [4 ]
机构
[1] Xinjiang Univ, Sch Comp Sci & Technol, Urumqi 830017, Peoples R China
[2] Beijing Inst Technol, Sch Informat & Elect, Beijing 100081, Peoples R China
[3] Shanghai Jiao Tong Univ, Dept Comp Sci & Engn, Shanghai 200240, Peoples R China
[4] Tsinghua Univ, Dept Elect Engn, Beijing 100084, Peoples R China
关键词
Feature extraction; Convolution; Remote sensing; Kernel; Superresolution; Image reconstruction; Lattices; Computational modeling; Complexity theory; 5G mobile communication; Image super-resolution (SR); large kernel feature supplement block (LFSB); lightweight neural network; multiscale mechanism; remote sensing image (RSI);
D O I
10.1109/LGRS.2024.3481645
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
In the field of remote sensing image super-resolution (RSISR), most methods based on convolutional neural networks (CNNs) tend to focus on high-weight features in the convolutional kernels, thus overlooking low-weight background features. This bias may result in the neglect of some important information in the background. To address this challenge, we propose a background-based multiscale feature enhancement network (BMFENet), which can extract and supplement missing features from different scale backgrounds to improve the reconstruction of remote sensing images (RSIs). Specifically, we constructed a large kernel feature supplement block (LFSB). The LFSB uses large kernel attention mechanism and multiscale mechanism to expand the receptive field, aggregating global information. Meanwhile, it generates background feature weights to increase the attention to neglected information, thereby reducing the distortion of detailed features. Furthermore, to enhance the nonlinear expression capability of the model, we designed a lattice gated unit (LGU). The LGU removes redundant information through a gating mechanism, efficiently aggregates useful channel information through interchannel interactions and attention mechanisms, and introduces directional convolution to make the model more adaptable to super-resolution (SR) tasks in complex scenes. We validated our method on two remote sensing and four SR benchmark datasets, and the results show that our approach achieves a good balance between performance and complexity.
引用
收藏
页数:5
相关论文
共 50 条
  • [21] Lightweight image super-resolution with a feature-refined network
    Liu, Feiqiang
    Yang, Xiaomin
    De Baets, Bernard
    SIGNAL PROCESSING-IMAGE COMMUNICATION, 2023, 111
  • [22] Remote Sensing Image Super-Resolution Adversarial Network Based on Reverse Feature Fusion and Residual Feature Dilation
    Han, Rui
    Mei, Bingxiao
    Huang, Xiaoming
    Xue, Hanbo
    Jiang, Xiongwei
    Yang, Shengying
    IEEE ACCESS, 2023, 11 : 85259 - 85267
  • [23] Image Super-Resolution via Lightweight Attention-Directed Feature Aggregation Network
    Wang, Li
    Li, Ke
    Tang, Jingjing
    Liang, Yuying
    ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, 2023, 19 (02)
  • [24] Image Super-Resolution Using Lightweight Multiscale Residual Dense Network
    Li, Shilin
    Zhao, Ming
    Fang, Zhengyun
    Zhang, Yafei
    Li, Hongjie
    INTERNATIONAL JOURNAL OF OPTICS, 2020, 2020
  • [25] RFCNet: Remote Sensing Image Super-Resolution Using Residual Feature Calibration Network
    Xue, Yuan
    Li, Liangliang
    Wang, Zheyuan
    Jiang, Chenchen
    Liu, Minqin
    Wang, Jiawen
    Sun, Kaipeng
    Ma, Hongbing
    TSINGHUA SCIENCE AND TECHNOLOGY, 2023, 28 (03): : 475 - 485
  • [26] Efficient Adaptive Feature Fusion Network for Remote-Sensing Image Super-Resolution
    Hao, Shuai
    Liu, Shuai
    Jia, Xu
    Lu, Huchuan
    He, You
    IEEE SIGNAL PROCESSING LETTERS, 2024, 31 : 3089 - 3093
  • [27] MambaFormerSR: A Lightweight Model for Remote-Sensing Image Super-Resolution
    Zhi, Ruicong
    Fan, Xiaopei
    Shi, Jingye
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2024, 21
  • [28] Transformer-Based Multistage Enhancement for Remote Sensing Image Super-Resolution
    Lei, Sen
    Shi, Zhenwei
    Mo, Wenjing
    IEEE Transactions on Geoscience and Remote Sensing, 2022, 60
  • [29] Transformer-Based Multistage Enhancement for Remote Sensing Image Super-Resolution
    Lei, Sen
    Shi, Zhenwei
    Mo, Wenjing
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [30] Scene-Adaptive Remote Sensing Image Super-Resolution Using a Multiscale Attention Network
    Zhang, Shu
    Yuan, Qiangqiang
    Li, Jie
    Sun, Jing
    Zhang, Xuguo
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2020, 58 (07): : 4764 - 4779