Spatial-Spectral Structured Sparse Low-Rank Representation for Hyperspectral Image Super-Resolution

被引:166
作者
Xue, Jize [1 ,2 ]
Zhao, Yong-Qiang [1 ]
Bu, Yuanyang [1 ]
Liao, Wenzhi [2 ,3 ]
Chan, Jonathan Cheung-Wai [4 ]
Philips, Wilfried [2 ]
机构
[1] Northwestern Polytech Univ Shenzhen, Res & Dev Inst, Shenzhen 518057, Peoples R China
[2] Univ Ghent, IMEC Res Grp, Image Proc & Interpretat, B-9000 Ghent, Belgium
[3] Flemish Inst Technol Res VITO, Sustainable Mat Management, B-2400 Mol, Belgium
[4] Vrije Univ Brussel, Dept Elect & Informat, B-1050 Brussels, Belgium
基金
中国国家自然科学基金;
关键词
Superresolution; Sparse matrices; Spatial resolution; Dictionaries; Correlation; Tensors; Task analysis; Hyperspectral and multispectral images fusion; low-rank representation; structured sparse; subspace low-rank recovery; affinity matrix; TENSOR FACTORIZATION; OBJECT DETECTION; FUSION; REGULARIZATION; DECOMPOSITION; ALGORITHM; PIXEL;
D O I
10.1109/TIP.2021.3058590
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Hyperspectral image super-resolution by fusing high-resolution multispectral image (HR-MSI) and low-resolution hyperspectral image (LR-HSI) aims at reconstructing high resolution spatial-spectral information of the scene. Existing methods mostly based on spectral unmixing and sparse representation are often developed from a low-level vision task perspective, they cannot sufficiently make use of the spatial and spectral priors available from higher-level analysis. To this issue, this paper proposes a novel HSI super-resolution method that fully considers the spatial/spectral subspace low-rank relationships between available HR-MSI/LR-HSI and latent HSI. Specifically, it relies on a new subspace clustering method named "structured sparse low-rank representation" (SSLRR), to represent the data samples as linear combinations of the bases in a given dictionary, where the sparse structure is induced by low-rank factorization for the affinity matrix. Then we exploit the proposed SSLRR model to learn the SSLRR along spatial/spectral domain from the MSI/HSI inputs. By using the learned spatial and spectral low-rank structures, we formulate the proposed HSI super-resolution model as a variational optimization problem, which can be readily solved by the ADMM algorithm. Compared with state-of-the-art hyperspectral super-resolution methods, the proposed method shows better performance on three benchmark datasets in terms of both visual and quantitative evaluation.
引用
收藏
页码:3084 / 3097
页数:14
相关论文
共 65 条
[1]  
Akhtar N, 2015, PROC CVPR IEEE, P3631, DOI 10.1109/CVPR.2015.7298986
[2]   Sparse Spatio-spectral Representation for Hyperspectral Image Super-resolution [J].
Akhtar, Naveed ;
Shafait, Faisal ;
Mian, Ajmal .
COMPUTER VISION - ECCV 2014, PT VII, 2014, 8695 :63-78
[3]  
Boyd S., 2011, FOUND TRENDS MACH LE, DOI DOI 10.1561/2200000016
[4]   Hyperspectral and Multispectral Image Fusion via Graph Laplacian-Guided Coupled Tensor Decomposition [J].
Bu, Yuanyang ;
Zhao, Yongqiang ;
Xue, Jize ;
Chan, Jonathan Cheung-Wai ;
Kong, Seong G. ;
Yi, Chen ;
Wen, Jinhuan ;
Wang, Binglu .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2021, 59 (01) :648-662
[5]   A SINGULAR VALUE THRESHOLDING ALGORITHM FOR MATRIX COMPLETION [J].
Cai, Jian-Feng ;
Candes, Emmanuel J. ;
Shen, Zuowei .
SIAM JOURNAL ON OPTIMIZATION, 2010, 20 (04) :1956-1982
[6]  
Chakrabarti A, 2011, PROC CVPR IEEE, P193, DOI 10.1109/CVPR.2011.5995660
[7]   Robust Subspace Segmentation Via Low-Rank Representation [J].
Chen, Jinhui ;
Yang, Jian .
IEEE TRANSACTIONS ON CYBERNETICS, 2014, 44 (08) :1432-1445
[8]   Exploiting Spectral and Spatial Information in Hyperspectral Urban Data With High Resolution [J].
Dell'Acqua, F. ;
Gamba, P. ;
Ferrari, A. ;
Palmason, J. A. ;
Benediktsson, J. A. ;
Arnason, K. .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2004, 1 (04) :322-326
[9]   Nonlocal Sparse Tensor Factorization for Semiblind Hyperspectral and Multispectral Image Fusion [J].
Dian, Renwei ;
Li, Shutao ;
Fang, Leyuan ;
Lu, Ting ;
Bioucas-Dias, Jose M. .
IEEE TRANSACTIONS ON CYBERNETICS, 2020, 50 (10) :4469-4480
[10]   Hyperspectral Image Super-Resolution via Subspace-Based Low Tensor Multi-Rank Regularization [J].
Dian, Renwei ;
Li, Shutao .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2019, 28 (10) :5135-5146