Hyperspectral Images Super-Resolution via Learning High-Order Coupled Tensor Ring Representation

被引:112
作者
Xu, Yang [1 ,2 ,3 ]
Wu, Zebin [1 ,2 ,3 ]
Chanussot, Jocelyn [4 ]
Wei, Zhihui [1 ,2 ,3 ]
机构
[1] Nanjing Univ Sci & Technol, Sch Comp Sci & Engn, Nanjing 210094, Peoples R China
[2] Nanjing Univ Sci & Technol, Minist Educ, Key Lab Intelligent Percept & Syst High Dimens In, Nanjing 210094, Peoples R China
[3] Nanjing Univ Sci & Technol, Jiangsu Key Lab Image & Video Understanding Socia, Nanjing 210094, Peoples R China
[4] Univ Grenoble Alpes, INRIA, CNRS, Grenoble INP,LJK, F-38000 Grenoble, France
基金
中国国家自然科学基金; 中国博士后科学基金;
关键词
Tensors; Sparse matrices; Hyperspectral imaging; Spatial resolution; Fuses; Hyperspectral image (HSI); multiscale; multispectral image (MSI); super-resolution; tensor ring (TR); FUSION; FACTORIZATION; REGRESSION;
D O I
10.1109/TNNLS.2019.2957527
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Hyperspectral image (HSI) super-resolution is a hot topic in remote sensing and computer vision. Recently, tensor analysis has been proven to be an efficient technology for HSI image processing. However, the existing tensor-based methods of HSI super-resolution are not able to capture the high-order correlations in HSI. In this article, we propose to learn a high-order coupled tensor ring (TR) representation for HSI super-resolution. The proposed method first tensorizes the HSI to be estimated into a high-order tensor in which multiscale spatial structures and the original spectral structure are represented. Then, a coupled TR representation model is proposed to fuse the low-resolution HSI (LR-HSI) and high-resolution multispectral image (HR-MSI). In the proposed model, some latent core tensors in TR of the LR-HSI and the HR-MSI are shared, and we use the relationship between the spectral core tensors to reconstruct the HSI. In addition, the graph-Laplacian regularization is introduced to the spectral core tensors to preserve the spectral information. To enhance the robustness of the proposed model, Frobenius norm regularizations are introduced to the other core tensors. Experimental results on both synthetic and real data sets show that the proposed method achieves the state-of-the-art super-resolution performance.
引用
收藏
页码:4747 / 4760
页数:14
相关论文
共 59 条
[31]   Robust Recovery of Subspace Structures by Low-Rank Representation [J].
Liu, Guangcan ;
Lin, Zhouchen ;
Yan, Shuicheng ;
Sun, Ju ;
Yu, Yong ;
Ma, Yi .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2013, 35 (01) :171-184
[32]   Hyperspectral Pansharpening: A Review [J].
Loncan, Laetitia ;
Almeida, Luis B. ;
Bioucas-Dias, Jose M. ;
Briottet, Xavier ;
Chanussot, Jocelyn ;
Dobigeon, Nicolas ;
Fabre, Sophie ;
Liao, Wenzhi ;
Licciardi, Giorgio A. ;
Simoes, Miguel ;
Tourneret, Jean-Yves ;
Veganzones, Miguel A. ;
Vivone, Gemine ;
Wei, Qi ;
Yokoya, Naoto .
IEEE GEOSCIENCE AND REMOTE SENSING MAGAZINE, 2015, 3 (03) :27-46
[33]   Joint Dictionary Learning for Multispectral Change Detection [J].
Lu, Xiaoqiang ;
Yuan, Yuan ;
Zheng, Xiangtao .
IEEE TRANSACTIONS ON CYBERNETICS, 2017, 47 (04) :884-897
[34]   Tensor Canonical Correlation Analysis for Multi-View Dimension Reduction [J].
Luo, Yong ;
Tao, Dacheng ;
Ramamohanarao, Kotagiri ;
Xu, Chao ;
Wen, Yonggang .
IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2015, 27 (11) :3111-3124
[35]   TENSOR-TRAIN DECOMPOSITION [J].
Oseledets, I. V. .
SIAM JOURNAL ON SCIENTIFIC COMPUTING, 2011, 33 (05) :2295-2317
[36]   Tensor Decomposition for Signal Processing and Machine Learning [J].
Sidiropoulos, Nicholas D. ;
De Lathauwer, Lieven ;
Fu, Xiao ;
Huang, Kejun ;
Papalexakis, Evangelos E. ;
Faloutsos, Christos .
IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2017, 65 (13) :3551-3582
[37]   A Convex Formulation for Hyperspectral Image Superresolution via Subspace-Based Regularization [J].
Simoes, Miguel ;
Bioucas-Dias, Jose ;
Almeida, Luis B. ;
Chanussot, Jocelyn .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2015, 53 (06) :3373-3388
[38]   Supervised Spectral-Spatial Hyperspectral Image Classification With Weighted Markov Random Fields [J].
Sun, Le ;
Wu, Zebin ;
Liu, Jianjun ;
Xiao, Liang ;
Wei, Zhihui .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2015, 53 (03) :1490-1503
[39]   General tensor discriminant analysis and Gabor features for gait recognition [J].
Tao, Dacheng ;
Li, Xuelong ;
Wu, Xindong ;
Maybank, Stephen J. .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2007, 29 (10) :1700-1715
[40]   Hyperspectral Super-Resolution of Locally Low Rank Images From Complementary Multisource Data [J].
Veganzones, Miguel A. ;
Simoes, Miguel ;
Licciardi, Giorgio ;
Yokoya, Naoto ;
Bioucas-Dias, Jose M. ;
Chanussot, Jocelyn .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2016, 25 (01) :274-288