Hyperspectral Image Super-Resolution Based on Spatial-Spectral-Frequency Multidimensional Features

被引:0
|
作者
Sifan Zheng [1 ,2 ]
Tao Zhang [1 ,2 ]
Haibing Yin [1 ,2 ]
Hao Hu [3 ]
Jian Jiang [3 ]
Chenggang Yan [1 ,2 ]
机构
[1] School of Communication Engineering, Hangzhou Dianzi University
[2] Lishui Institute of Hangzhou Dianzi University
[3] China Mobile (Zhejiang) Innovation Research Institute Co,
关键词
D O I
暂无
中图分类号
TP391.41 [];
学科分类号
080203 ;
摘要
Due to the limitations of existing imaging hardware, obtaining high-resolution hyperspectral images is challenging. Hyperspectral image super-resolution(HSI SR) has been a very attractive research topic in computer vision, attracting the attention of many researchers. However, most HSI SR methods focus on the tradeoff between spatial resolution and spectral information, and cannot guarantee the efficient extraction of image information. In this paper, a multidimensional features network(MFNet) for HSI SR is proposed, which simultaneously learns and fuses the spatial,spectral, and frequency multidimensional features of HSI. Spatial features contain rich local details,spectral features contain the information and correlation between spectral bands, and frequency feature can reflect the global information of the image and can be used to obtain the global context of HSI. The fusion of the three features can better guide image super-resolution, to obtain higher-quality high-resolution hyperspectral images. In MFNet, we use the frequency feature extraction module(FFEM) to extract the frequency feature. On this basis, a multidimensional features extraction module(MFEM) is designed to learn and fuse multidimensional features. In addition, experimental results on two public datasets demonstrate that MFNet achieves state-of-the-art performance.
引用
收藏
页码:28 / 41
页数:14
相关论文
共 50 条
  • [1] Hyperspectral Image Super-Resolution Based on Spatial and Spectral Correlation Fusion
    Yi, Chen
    Zhao, Yong-Qiang
    Chan, Jonathan Cheung-Wai
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2018, 56 (07): : 4165 - 4177
  • [2] LEARNING SPECTRAL AND SPATIAL FEATURES BASED ON GENERATIVE ADVERSARIAL NETWORK FOR HYPERSPECTRAL IMAGE SUPER-RESOLUTION
    Jiang, Ruituo
    Li, Xu
    Gao, Ang
    Li, Lixin
    Meng, Hongying
    Yue, Shigang
    Zhang, Lei
    2019 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS 2019), 2019, : 3161 - 3164
  • [3] Hyperspectral image super-resolution with spectral-spatial network
    Jia, Jinrang
    Ji, Luyan
    Zhao, Yongchao
    Geng, Xiurui
    INTERNATIONAL JOURNAL OF REMOTE SENSING, 2018, 39 (22) : 7806 - 7829
  • [4] A spectral and spatial transformer for hyperspectral remote sensing image super-resolution
    Wang, Bingqian
    Chen, Jianhua
    Wang, Huajun
    Tang, Yipeng
    Chen, Jiongling
    Jiang, Ye
    INTERNATIONAL JOURNAL OF DIGITAL EARTH, 2024, 17 (01)
  • [5] Hyperspectral Image Super-Resolution by Deep Spatial-Spectral Exploitation
    Hu, Jing
    Zhao, Minghua
    Li, Yunsong
    REMOTE SENSING, 2019, 11 (10)
  • [6] A novel spatial and spectral transformer network for hyperspectral image super-resolution
    Wu, Huapeng
    Xu, Hui
    Zhan, Tianming
    MULTIMEDIA SYSTEMS, 2024, 30 (03)
  • [7] Spectral-Spatial MLP Network for Hyperspectral Image Super-Resolution
    Yao, Yunze
    Hu, Jianwen
    Liu, Yaoting
    Zhao, Yushan
    REMOTE SENSING, 2023, 15 (12)
  • [8] Hyperspectral Image Super-Resolution Method Based on Spatial Spectral Joint Sparse Representation
    Xu Meng'en
    Xie Baoling
    Xu Guoming
    LASER & OPTOELECTRONICS PROGRESS, 2018, 55 (07)
  • [9] Hyperspectral Image Super-Resolution Based on Spatial-Spectral Feature Extraction Network
    Li Yanshan
    Chen Shifu
    Luo Wenhan
    Zhou Li
    Xie Weixin
    CHINESE JOURNAL OF ELECTRONICS, 2023, 32 (03) : 415 - 428
  • [10] Thangka Hyperspectral Image Super-Resolution Based on a Spatial-Spectral Integration Network
    Wang, Sai
    Fan, Fenglei
    REMOTE SENSING, 2023, 15 (14)