Hyperspectral Image Super-Resolution Based on Multiscale Mixed Attention Network Fusion

被引:53
|
作者
Hu, Jianwen [1 ,2 ]
Tang, Yuan [1 ,2 ]
Liu, Yaoting [1 ,2 ]
Fan, Shaosheng [1 ,2 ]
机构
[1] Changsha Univ Sci & Technol, Sch Elect & Informat Engn, Changsha 410114, Peoples R China
[2] Changsha Univ Sci & Technol, Key Lab Elect Power Robot Hunan Prov, Changsha 410114, Peoples R China
基金
中国国家自然科学基金;
关键词
Three-dimensional displays; Superresolution; Convolution; Spatial resolution; Hyperspectral imaging; Image reconstruction; Feature extraction; Hyperspectral image (HSI); image super-resolution (SR); mixed attention; mutual learning;
D O I
10.1109/LGRS.2021.3124974
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Hyperspectral images (HSIs) contain rich spectral information and have great application value. However, due to various hardware limitations, the spatial resolution of HSIs acquired by the sensor is low. HSI super-resolution (SR) attracts much attention to improve spatial quality. In this letter, a single HSI SR method based on network fusion is proposed. Our method includes the SR network part and fusion part. In the SR network part, we construct 3-D multiscale mixed attention networks (3-D-MSMANs) by cascading 3-D multiscale mixed attention block (3-D-MSMAB) to restore high-resolution HSIs. 3-D-MSMAB consists of the 3-D Res2net module and the mixed attention module. 3-D Res2net module is a simple and effective multiscale method. The mixed attention module is proposed by combining the first- and second-order statistics of features. In addition, we use the mutual learning loss between 3-D-MSMAN so that they can learn from each other. In the fusion part, the fusion module is designed to merge the output of each 3-D-MSMAN. Our method can achieve good results in both simulated and real SR experiments. Code is available at https://github.com/LYT-max/Mixed-Attention-for-HSI-SR.
引用
收藏
页数:5
相关论文
共 50 条
  • [21] Multiscale Factor Joint Learning for Hyperspectral Image Super-Resolution
    Li, Qiang
    Yuan, Yuan
    Wang, Qi
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [22] MSDformer: Multiscale Deformable Transformer for Hyperspectral Image Super-Resolution
    Chen, Shi
    Zhang, Lefei
    Zhang, Liangpei
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [23] DEEP RESIDUAL NETWORK OF SPECTRAL AND SPATIAL FUSION FOR HYPERSPECTRAL IMAGE SUPER-RESOLUTION
    Han, Xian-Hua
    Chen, Yen-Wei
    2019 IEEE FIFTH INTERNATIONAL CONFERENCE ON MULTIMEDIA BIG DATA (BIGMM 2019), 2019, : 266 - 270
  • [24] Multiscale Feature Fusion Back-projection Network for Image Super-resolution
    Sun C.-W.
    Chen X.
    Zidonghua Xuebao/Acta Automatica Sinica, 2021, 47 (07): : 1689 - 1700
  • [25] PSMFNet: Lightweight Partial Separation and Multiscale Fusion Network for Image Super-Resolution
    Cao, Shuai
    Liang, Jianan
    Cao, Yongjun
    Huang, Jinglun
    Yang, Zhishu
    CMC-COMPUTERS MATERIALS & CONTINUA, 2024, 81 (01):
  • [26] Image super-resolution based on adaptive cascading attention network
    Zhou, Dengwen
    Chen, Yiming
    Li, Wenbin
    Li, Jinxin
    EXPERT SYSTEMS WITH APPLICATIONS, 2021, 186
  • [27] Image super-resolution reconstruction based on dynamic attention network
    Zhao X.-Q.
    Wang Z.
    Song Z.-Y.
    Jiang H.-M.
    Zhejiang Daxue Xuebao (Gongxue Ban)/Journal of Zhejiang University (Engineering Science), 2023, 57 (08): : 1487 - 1494
  • [28] Adaptive Attention Network for Image Super-resolution
    Chen Y.-M.
    Zhou D.-W.
    Zidonghua Xuebao/Acta Automatica Sinica, 2022, 48 (08): : 1950 - 1960
  • [29] Multi-Scale Cross-Attention Fusion Network Based on Image Super-Resolution
    Ma, Yimin
    Xu, Yi
    Liu, Yunqing
    Yan, Fei
    Zhang, Qiong
    Li, Qi
    Liu, Quanyang
    APPLIED SCIENCES-BASEL, 2024, 14 (06):
  • [30] Multiscale Recursive Feedback Network for Image Super-Resolution
    Chen, Xiao
    Sun, Chaowen
    IEEE ACCESS, 2022, 10 : 6393 - 6406