Hyperspectral Image Super-Resolution Based on Multiscale Mixed Attention Network Fusion

被引:53
|
作者
Hu, Jianwen [1 ,2 ]
Tang, Yuan [1 ,2 ]
Liu, Yaoting [1 ,2 ]
Fan, Shaosheng [1 ,2 ]
机构
[1] Changsha Univ Sci & Technol, Sch Elect & Informat Engn, Changsha 410114, Peoples R China
[2] Changsha Univ Sci & Technol, Key Lab Elect Power Robot Hunan Prov, Changsha 410114, Peoples R China
基金
中国国家自然科学基金;
关键词
Three-dimensional displays; Superresolution; Convolution; Spatial resolution; Hyperspectral imaging; Image reconstruction; Feature extraction; Hyperspectral image (HSI); image super-resolution (SR); mixed attention; mutual learning;
D O I
10.1109/LGRS.2021.3124974
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Hyperspectral images (HSIs) contain rich spectral information and have great application value. However, due to various hardware limitations, the spatial resolution of HSIs acquired by the sensor is low. HSI super-resolution (SR) attracts much attention to improve spatial quality. In this letter, a single HSI SR method based on network fusion is proposed. Our method includes the SR network part and fusion part. In the SR network part, we construct 3-D multiscale mixed attention networks (3-D-MSMANs) by cascading 3-D multiscale mixed attention block (3-D-MSMAB) to restore high-resolution HSIs. 3-D-MSMAB consists of the 3-D Res2net module and the mixed attention module. 3-D Res2net module is a simple and effective multiscale method. The mixed attention module is proposed by combining the first- and second-order statistics of features. In addition, we use the mutual learning loss between 3-D-MSMAN so that they can learn from each other. In the fusion part, the fusion module is designed to merge the output of each 3-D-MSMAN. Our method can achieve good results in both simulated and real SR experiments. Code is available at https://github.com/LYT-max/Mixed-Attention-for-HSI-SR.
引用
收藏
页数:5
相关论文
共 50 条
  • [31] Multi-feature fusion attention network for single image super-resolution
    Chen, Jiacheng
    Wang, Wanliang
    Xing, Fangsen
    Tu, Hangyao
    IET IMAGE PROCESSING, 2023, 17 (05) : 1389 - 1402
  • [32] StructureColor Preserving Network for Hyperspectral Image Super-Resolution
    Pan, Bin
    Qu, Qiaoying
    Xu, Xia
    Shi, Zhenwei
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [33] Hyperspectral Image Super-Resolution via Intrafusion Network
    Hu, Jing
    Jia, Xiuping
    Li, Yunsong
    He, Gang
    Zhao, Minghua
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2020, 58 (10): : 7459 - 7471
  • [34] A Lightweight Hyperspectral Image Super-Resolution Method Based on Multiple Attention Mechanisms
    Bu, Lijing
    Dai, Dong
    Zhang, Zhengpeng
    Xie, Xinyu
    Deng, Mingjun
    ADVANCED INTELLIGENT COMPUTING TECHNOLOGY AND APPLICATIONS, ICIC 2023, PT II, 2023, 14087 : 639 - 651
  • [35] Deep Recursive Network for Hyperspectral Image Super-Resolution
    Wei, Wei
    Nie, Jiangtao
    Li, Yong
    Zhang, Lei
    Zhang, Yanning
    IEEE TRANSACTIONS ON COMPUTATIONAL IMAGING, 2020, 6 (06) : 1233 - 1244
  • [36] External-Internal Attention for Hyperspectral Image Super-Resolution
    Guo, Zhiling
    Xin, Jingwei
    Wang, Nannan
    Li, Jie
    Gao, Xinbo
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [37] Hyperspectral Image Super-Resolution Network of Local-Global Attention Feature Reuse
    Size, Wang
    Xin, Guan
    Qiang, Li
    ACTA OPTICA SINICA, 2023, 43 (21)
  • [38] A SWIN TRANSFORMER- BASED FUSION APPROACH FOR HYPERSPECTRAL IMAGE SUPER-RESOLUTION
    Yang, Yuchao
    Wang, Yulei
    Zhao, Enyu
    Song, Meiping
    Zhang, Qiang
    IGARSS 2023 - 2023 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, 2023, : 7372 - 7375
  • [39] UMMFF: Unsupervised Multimodal Multilevel Feature Fusion Network for Hyperspectral Image Super-Resolution
    Jiang, Zhongmin
    Chen, Mengyao
    Wang, Wenju
    REMOTE SENSING, 2024, 16 (17)
  • [40] Local-Global Feature Fusion Network for Efficient Hyperspectral Image Super-Resolution
    Xu, Jingran
    Zhao, Jiankang
    Cui, Chao
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2024, 21 : 1 - 5