Hyperspectral Images Super-Resolution via Learning High-Order Coupled Tensor Ring Representation

被引:112
作者
Xu, Yang [1 ,2 ,3 ]
Wu, Zebin [1 ,2 ,3 ]
Chanussot, Jocelyn [4 ]
Wei, Zhihui [1 ,2 ,3 ]
机构
[1] Nanjing Univ Sci & Technol, Sch Comp Sci & Engn, Nanjing 210094, Peoples R China
[2] Nanjing Univ Sci & Technol, Minist Educ, Key Lab Intelligent Percept & Syst High Dimens In, Nanjing 210094, Peoples R China
[3] Nanjing Univ Sci & Technol, Jiangsu Key Lab Image & Video Understanding Socia, Nanjing 210094, Peoples R China
[4] Univ Grenoble Alpes, INRIA, CNRS, Grenoble INP,LJK, F-38000 Grenoble, France
基金
中国国家自然科学基金; 中国博士后科学基金;
关键词
Tensors; Sparse matrices; Hyperspectral imaging; Spatial resolution; Fuses; Hyperspectral image (HSI); multiscale; multispectral image (MSI); super-resolution; tensor ring (TR); FUSION; FACTORIZATION; REGRESSION;
D O I
10.1109/TNNLS.2019.2957527
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Hyperspectral image (HSI) super-resolution is a hot topic in remote sensing and computer vision. Recently, tensor analysis has been proven to be an efficient technology for HSI image processing. However, the existing tensor-based methods of HSI super-resolution are not able to capture the high-order correlations in HSI. In this article, we propose to learn a high-order coupled tensor ring (TR) representation for HSI super-resolution. The proposed method first tensorizes the HSI to be estimated into a high-order tensor in which multiscale spatial structures and the original spectral structure are represented. Then, a coupled TR representation model is proposed to fuse the low-resolution HSI (LR-HSI) and high-resolution multispectral image (HR-MSI). In the proposed model, some latent core tensors in TR of the LR-HSI and the HR-MSI are shared, and we use the relationship between the spectral core tensors to reconstruct the HSI. In addition, the graph-Laplacian regularization is introduced to the spectral core tensors to preserve the spectral information. To enhance the robustness of the proposed model, Frobenius norm regularizations are introduced to the other core tensors. Experimental results on both synthetic and real data sets show that the proposed method achieves the state-of-the-art super-resolution performance.
引用
收藏
页码:4747 / 4760
页数:14
相关论文
共 59 条
[1]   K-SVD: An algorithm for designing overcomplete dictionaries for sparse representation [J].
Aharon, Michal ;
Elad, Michael ;
Bruckstein, Alfred .
IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2006, 54 (11) :4311-4322
[2]   Improving component substitution pansharpening through multivariate regression of MS plus Pan data [J].
Aiazzi, Bruno ;
Baronti, Stefano ;
Selva, Massimo .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2007, 45 (10) :3230-3239
[3]  
Akhtar N, 2015, PROC CVPR IEEE, P3631, DOI 10.1109/CVPR.2015.7298986
[4]  
[Anonymous], IEEE T CIRCUITS SYST
[5]  
[Anonymous], 2016, CoRR, abs/1606.05535
[6]   Hyperspectral Unmixing Overview: Geometrical, Statistical, and Sparse Regression-Based Approaches [J].
Bioucas-Dias, Jose M. ;
Plaza, Antonio ;
Dobigeon, Nicolas ;
Parente, Mario ;
Du, Qian ;
Gader, Paul ;
Chanussot, Jocelyn .
IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2012, 5 (02) :354-379
[7]   A Generalized Model for Robust Tensor Factorization With Noise Modeling by Mixture of Gaussians [J].
Chen, Xi'ai ;
Han, Zhi ;
Wang, Yao ;
Zhao, Qian ;
Meng, Deyu ;
Lin, Lin ;
Tang, Yandong .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2018, 29 (11) :5380-5393
[8]   Parallelized Tensor Train Learning of Polynomial Classifiers [J].
Chen, Zhongming ;
Batselier, Kim ;
Suykens, Johan A. K. ;
Wong, Ngai .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2018, 29 (10) :4621-4632
[9]  
Cichocki A, 2016, FOUND TRENDS MACH LE, V9, P431, DOI [10.1561/2200000059, 10.1561/2200000067]
[10]   Tensor Networks for Dimensionality Reduction and Large-Scale Optimization Part 1 Low-Rank Tensor Decompositions [J].
Cichocki, Andrzej ;
Lee, Namgil ;
Oseledets, Ivan ;
Anh-Huy Phan ;
Zhao, Qibin ;
Mandic, Danilo P. .
FOUNDATIONS AND TRENDS IN MACHINE LEARNING, 2016, 9 (4-5) :I-+