Hyperspectral Images Super-Resolution via Learning High-Order Coupled Tensor Ring Representation

被引:98
|
作者
Xu, Yang [1 ,2 ,3 ]
Wu, Zebin [1 ,2 ,3 ]
Chanussot, Jocelyn [4 ]
Wei, Zhihui [1 ,2 ,3 ]
机构
[1] Nanjing Univ Sci & Technol, Sch Comp Sci & Engn, Nanjing 210094, Peoples R China
[2] Nanjing Univ Sci & Technol, Minist Educ, Key Lab Intelligent Percept & Syst High Dimens In, Nanjing 210094, Peoples R China
[3] Nanjing Univ Sci & Technol, Jiangsu Key Lab Image & Video Understanding Socia, Nanjing 210094, Peoples R China
[4] Univ Grenoble Alpes, INRIA, CNRS, Grenoble INP,LJK, F-38000 Grenoble, France
基金
中国国家自然科学基金; 中国博士后科学基金;
关键词
Tensors; Sparse matrices; Hyperspectral imaging; Spatial resolution; Fuses; Hyperspectral image (HSI); multiscale; multispectral image (MSI); super-resolution; tensor ring (TR); FUSION; FACTORIZATION; REGRESSION;
D O I
10.1109/TNNLS.2019.2957527
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Hyperspectral image (HSI) super-resolution is a hot topic in remote sensing and computer vision. Recently, tensor analysis has been proven to be an efficient technology for HSI image processing. However, the existing tensor-based methods of HSI super-resolution are not able to capture the high-order correlations in HSI. In this article, we propose to learn a high-order coupled tensor ring (TR) representation for HSI super-resolution. The proposed method first tensorizes the HSI to be estimated into a high-order tensor in which multiscale spatial structures and the original spectral structure are represented. Then, a coupled TR representation model is proposed to fuse the low-resolution HSI (LR-HSI) and high-resolution multispectral image (HR-MSI). In the proposed model, some latent core tensors in TR of the LR-HSI and the HR-MSI are shared, and we use the relationship between the spectral core tensors to reconstruct the HSI. In addition, the graph-Laplacian regularization is introduced to the spectral core tensors to preserve the spectral information. To enhance the robustness of the proposed model, Frobenius norm regularizations are introduced to the other core tensors. Experimental results on both synthetic and real data sets show that the proposed method achieves the state-of-the-art super-resolution performance.
引用
收藏
页码:4747 / 4760
页数:14
相关论文
共 50 条
  • [1] High-Order Coupled Fully Connected Tensor Network Decomposition for Hyperspectral Image Super-Resolution
    Jin, Diyi
    Liu, Jianjun
    Yang, Jinlong
    Wu, Zebin
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19
  • [2] Hyperspectral super-resolution via coupled tensor ring factorization
    He, Wei
    Chen, Yong
    Yokoya, Naoto
    Li, Chao
    Zhao, Qibin
    PATTERN RECOGNITION, 2022, 122
  • [3] An Iterative Regularization Method Based on Tensor Subspace Representation for Hyperspectral Image Super-Resolution
    Xu, Ting
    Huang, Ting-Zhu
    Deng, Liang-Jian
    Yokoya, Naoto
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [4] HYPERSPECTRAL SUPER-RESOLUTION VIA COUPLED TENSOR FACTORIZATION: IDENTIFIABILITY AND ALGORITHMS
    Kanatsoulis, Charilaos I.
    Fu, Xiao
    Sidiropoulos, Nicholas D.
    Ma, Wing-Kin
    2018 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2018, : 3191 - 3195
  • [5] Hyperspectral Image Super-Resolution via Sparsity Regularization-Based Spatial-Spectral Tensor Subspace Representation
    Peng, Yidong
    Li, Weisheng
    Luo, Xiaobo
    Du, Jiao
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2024, 17 : 11707 - 11722
  • [6] Hyperspectral Super-Resolution: A Coupled Tensor Factorization Approach
    Kanatsoulis, Charilaos, I
    Fu, Xiao
    Sidiropoulos, Nicholas D.
    Ma, Wing-Kin
    IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2018, 66 (24) : 6503 - 6517
  • [7] Adaptive Nonnegative Sparse Representation for Hyperspectral Image Super-Resolution
    Li, Xuesong
    Zhang, Youqiang
    Ge, Zixian
    Cao, Guo
    Shi, Hao
    Fu, Peng
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2021, 14 : 4267 - 4283
  • [8] Implicit Neural Representation Learning for Hyperspectral Image Super-Resolution
    Zhang, Kaiwei
    Zhu, Dandan
    Min, Xiongkuo
    Zhai, Guangtao
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [9] Learning a Low Tensor-Train Rank Representation for Hyperspectral Image Super-Resolution
    Dian, Renwei
    Li, Shutao
    Fang, Leyuan
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2019, 30 (09) : 2672 - 2683
  • [10] Implicit Neural Representation Learning for Hyperspectral Image Super-Resolution
    Zhang, Kaiwei
    Zhu, Dandan
    Min, Xiongkuo
    Zhai, Guangtao
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61