Hyperspectral Images Super-Resolution via Learning High-Order Coupled Tensor Ring Representation

被引:98
作者
Xu, Yang [1 ,2 ,3 ]
Wu, Zebin [1 ,2 ,3 ]
Chanussot, Jocelyn [4 ]
Wei, Zhihui [1 ,2 ,3 ]
机构
[1] Nanjing Univ Sci & Technol, Sch Comp Sci & Engn, Nanjing 210094, Peoples R China
[2] Nanjing Univ Sci & Technol, Minist Educ, Key Lab Intelligent Percept & Syst High Dimens In, Nanjing 210094, Peoples R China
[3] Nanjing Univ Sci & Technol, Jiangsu Key Lab Image & Video Understanding Socia, Nanjing 210094, Peoples R China
[4] Univ Grenoble Alpes, INRIA, CNRS, Grenoble INP,LJK, F-38000 Grenoble, France
基金
中国国家自然科学基金; 中国博士后科学基金;
关键词
Tensors; Sparse matrices; Hyperspectral imaging; Spatial resolution; Fuses; Hyperspectral image (HSI); multiscale; multispectral image (MSI); super-resolution; tensor ring (TR); FUSION; FACTORIZATION; REGRESSION;
D O I
10.1109/TNNLS.2019.2957527
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Hyperspectral image (HSI) super-resolution is a hot topic in remote sensing and computer vision. Recently, tensor analysis has been proven to be an efficient technology for HSI image processing. However, the existing tensor-based methods of HSI super-resolution are not able to capture the high-order correlations in HSI. In this article, we propose to learn a high-order coupled tensor ring (TR) representation for HSI super-resolution. The proposed method first tensorizes the HSI to be estimated into a high-order tensor in which multiscale spatial structures and the original spectral structure are represented. Then, a coupled TR representation model is proposed to fuse the low-resolution HSI (LR-HSI) and high-resolution multispectral image (HR-MSI). In the proposed model, some latent core tensors in TR of the LR-HSI and the HR-MSI are shared, and we use the relationship between the spectral core tensors to reconstruct the HSI. In addition, the graph-Laplacian regularization is introduced to the spectral core tensors to preserve the spectral information. To enhance the robustness of the proposed model, Frobenius norm regularizations are introduced to the other core tensors. Experimental results on both synthetic and real data sets show that the proposed method achieves the state-of-the-art super-resolution performance.
引用
收藏
页码:4747 / 4760
页数:14
相关论文
共 50 条
  • [31] RESOLUTION ENHANCEMENT FOR HYPERSPECTRAL IMAGES: A SUPER-RESOLUTION AND FUSION APPROACH
    Kwan, Chiman
    Choi, Joon Hee
    Chan, Stanley
    Zhou, Jin
    Budavari, Bence
    2017 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2017, : 6180 - 6184
  • [32] Hyperspectral Image Compression and Super-Resolution Using Tensor Decomposition Learning
    Aidini, A.
    Giannopoulos, M.
    Pentari, A.
    Fotiadou, K.
    Tsakalides, P.
    CONFERENCE RECORD OF THE 2019 FIFTY-THIRD ASILOMAR CONFERENCE ON SIGNALS, SYSTEMS & COMPUTERS, 2019, : 1369 - 1373
  • [33] Spatial-Spectral Structured Sparse Low-Rank Representation for Hyperspectral Image Super-Resolution
    Xue, Jize
    Zhao, Yong-Qiang
    Bu, Yuanyang
    Liao, Wenzhi
    Chan, Jonathan Cheung-Wai
    Philips, Wilfried
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 : 3084 - 3097
  • [34] COUPLED HYPERSPECTRAL SUPER-RESOLUTION AND UNMIXING
    Zhao, Yongqiang
    Yi, Chen
    Yang, Jingxiang
    Chan, Jonathan Cheung-Wai
    2014 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS), 2014, : 2641 - 2644
  • [35] Low-Rank Tensor Tucker Decomposition for Hyperspectral Images Super-Resolution
    Jia, Huidi
    Guo, Siyu
    Li, Zhenyu
    Chen, Xi'ai
    Han, Zhi
    Tang, Yandong
    INTELLIGENT ROBOTICS AND APPLICATIONS (ICIRA 2022), PT II, 2022, 13456 : 502 - 512
  • [36] COUPLED TENSOR LOW-RANK MULTILINEAR APPROXIMATION FOR HYPERSPECTRAL SUPER-RESOLUTION
    Prevost, C.
    Usevich, K.
    Comon, P.
    Brie, D.
    2019 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2019, : 5536 - 5540
  • [37] ANT COLONY OPTIMIZATION FOR SUPER-RESOLUTION OF HYPERSPECTRAL IMAGES
    Sharma, Shakti
    Sharma, Shreya
    Buddhiraju, Krishna Mohan
    2016 8TH WORKSHOP ON HYPERSPECTRAL IMAGE AND SIGNAL PROCESSING: EVOLUTION IN REMOTE SENSING (WHISPERS), 2016,
  • [38] A Super-Resolution and Fusion Approach to Enhancing Hyperspectral Images
    Kwan, Chiman
    Choi, Joon Hee
    Chan, Stanley H.
    Zhou, Jin
    Budavari, Bence
    REMOTE SENSING, 2018, 10 (09)
  • [39] MODIS Images Super-Resolution Algorithm via Sparse Representation
    Pang, Yue
    Gu, Lingjia
    Ren, Ruizhi
    Sun, Jian
    APPLICATIONS OF DIGITAL IMAGE PROCESSING XXXVII, 2014, 9217
  • [40] Learning Deep Resonant Prior for Hyperspectral Image Super-Resolution
    Gong, Zhaori
    Wang, Nannan
    Cheng, De
    Jiang, Xinrui
    Xin, Jingwei
    Yang, Xi
    Gao, Xinbo
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60