Hyperspectral Image Super-Resolution Based on Feature Diversity Extraction

被引:2
|
作者
Zhang, Jing [1 ,2 ,3 ,4 ]
Zheng, Renjie [4 ]
Wan, Zekang [2 ]
Geng, Ruijing [5 ]
Wang, Yi [6 ]
Yang, Yu [6 ]
Zhang, Xuepeng [2 ]
Li, Yunsong [1 ,2 ]
机构
[1] Xidian Univ, State Key Lab Lntegrated Serv Network, Xian 710071, Peoples R China
[2] Xidian Univ, Sch Telecommun Engn, Xian 710071, Peoples R China
[3] Xidian Univ, Guangzhou Inst Technol, Guangzhou 510700, Peoples R China
[4] Xidian Univ, Hangzhou Inst Technol, Hangzhou 311231, Peoples R China
[5] Space Engn Univ, Sch Space Informat, Beijing 101416, Peoples R China
[6] Syst Engn Res Inst CSSC, Beijing 10094, Peoples R China
基金
美国国家科学基金会;
关键词
feature diversity; rank upper bound; loss function; image up-sampling; deep learning;
D O I
10.3390/rs16030436
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
Deep learning is an important research topic in the field of image super-resolution. Problematically, the performance of existing hyperspectral image super-resolution networks is limited by feature learning for hyperspectral images. Nevertheless, the current algorithms exhibit some limitations in extracting diverse features. In this paper, we address limitations to existing hyperspectral image super-resolution networks, focusing on feature learning challenges. We introduce the Channel-Attention-Based Spatial-Spectral Feature Extraction network (CSSFENet) to enhance hyperspectral image feature diversity and optimize network loss functions. Our contributions include: (a) a convolutional neural network super-resolution algorithm incorporating diverse feature extraction to enhance the network's diversity feature learning by elevating the matrix rank, (b) a three-dimensional (3D) feature extraction convolution module, the Channel-Attention-Based Spatial-Spectral Feature Extraction Module (CSSFEM), to boost the network's performance in both the spatial and spectral domains, (c) a feature diversity loss function designed based on the image matrix's singular value to maximize element independence, and (d) a spatial-spectral gradient loss function introduced based on space and spectrum gradient values to enhance the reconstructed image's spatial-spectral smoothness. In contrast to existing hyperspectral super-resolution algorithms, we used four evaluation indexes, PSNR, mPSNR, SSIM, and SAM, and our method showed superiority during testing with three common hyperspectral datasets.
引用
收藏
页数:22
相关论文
共 50 条
  • [1] Hyperspectral Image Super-Resolution Based on Spatial-Spectral Feature Extraction Network
    Li Yanshan
    Chen Shifu
    Luo Wenhan
    Zhou Li
    Xie Weixin
    CHINESE JOURNAL OF ELECTRONICS, 2023, 32 (03) : 415 - 428
  • [2] Hyperspectral Image Super-Resolution Based on Spatial-Spectral Feature Extraction Network
    LI Yanshan
    CHEN Shifu
    LUO Wenhan
    ZHOU Li
    XIE Weixin
    Chinese Journal of Electronics, 2023, 32 (03) : 415 - 428
  • [3] Local feature extraction for image super-resolution
    Baboulaz, Loic
    Dragotti, Pier Luigi
    2007 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, VOLS 1-7, 2007, : 2653 - 2656
  • [4] Symmetrical Feature Propagation Network for Hyperspectral Image Super-Resolution
    Li, Qiang
    Gong, Maoguo
    Yuan, Yuan
    Wang, Qi
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [5] Hyperspectral Image Super-Resolution with RGB Image Super-Resolution as an Auxiliary Task
    Li, Ke
    Dai, Dengxin
    van Gool, Luc
    2022 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV 2022), 2022, : 4039 - 4048
  • [6] Hyperspectral Image Super-Resolution Using Deep Feature Matrix Factorization
    Xie, Weiying
    Jia, Xiuping
    Li, Yunsong
    Lei, Jie
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2019, 57 (08): : 6055 - 6067
  • [7] IMAGE FUSION FOR HYPERSPECTRAL IMAGE SUPER-RESOLUTION
    Irmak, Hasan
    Akar, Gozde Bozdagi
    Yuksel, Seniha Esen
    2018 9TH WORKSHOP ON HYPERSPECTRAL IMAGE AND SIGNAL PROCESSING: EVOLUTION IN REMOTE SENSING (WHISPERS), 2018,
  • [8] MFAAnet: New Feature Extraction Network in Image Super-Resolution
    Wang, Ningzhi
    Yu, Zhenda
    Li, Zerui
    Qi, Zhenyu
    Lv, Wenjun
    ADVANCED INTELLIGENT COMPUTING TECHNOLOGY AND APPLICATIONS, PT VIII, ICIC 2024, 2024, 14869 : 192 - 202
  • [9] Super-Resolution for Iris Feature Extraction
    Deshpande, Anand
    Patavardhan, Prashant P.
    Rao, D. H.
    2014 IEEE INTERNATIONAL CONFERENCE ON COMPUTATIONAL INTELLIGENCE AND COMPUTING RESEARCH (IEEE ICCIC), 2014, : 1123 - 1126
  • [10] RGB-Induced Feature Modulation Network for Hyperspectral Image Super-Resolution
    Li, Qiang
    Gong, Maoguo
    Yuan, Yuan
    Wang, Qi
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61