Spectral Superresolution of Multispectral Imagery With Joint Sparse and Low-Rank Learning

被引:140
作者
Gao, Lianru [1 ]
Hong, Danfeng [2 ]
Yao, Jing [3 ]
Zhang, Bing [1 ,4 ]
Gamba, Paolo [5 ]
Chanussot, Jocelyn [1 ,6 ]
机构
[1] Chinese Acad Sci, Aerosp Informat Res Inst, Key Lab Digital Earth Sci, Beijing 100094, Peoples R China
[2] Univ Grenoble Alpes, CNRS, Grenoble INP, GIPSA Lab, F-38000 Grenoble, France
[3] Xi An Jiao Tong Univ, Sch Math & Stat, Xian 710049, Peoples R China
[4] Univ Chinese Acad Sci, Coll Resources & Environm, Beijing 100049, Peoples R China
[5] Univ Pavia, Dept Elect Comp & Biomed Engn, I-27100 Pavia, Italy
[6] Univ Grenoble Alpes, CNRS, Grenoble INP, INRIA,LJK, F-38000 Grenoble, France
来源
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING | 2021年 / 59卷 / 03期
基金
中国国家自然科学基金;
关键词
Dictionary learning; hyperspectral; joint learning; low-rank; multispectral; remote sensing; sparse representation; superresolution; MATRIX FACTORIZATION; FUSION; TRANSFORMATION; FRAMEWORK; MIXTURE;
D O I
10.1109/TGRS.2020.3000684
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Extensive attention has been widely paid to enhance the spatial resolution of hyperspectral (HS) images with the aid of multispectral (MS) images in remote sensing. However, the ability in the fusion of HS and MS images remains to be improved, particularly in large-scale scenes, due to the limited acquisition of HS images. Alternatively, we super-resolve MS images in the spectral domain by the means of partially overlapped HS images, yielding a novel and promising topic: spectral superresolution (SSR) of MS imagery. This is challenging and less investigated task due to its high ill-posedness in inverse imaging. To this end, we develop a simple but effective method, called joint sparse and low-rank learning (J-SLoL), to spectrally enhance MS images by jointly learning low-rank HS-MS dictionary pairs from overlapped regions. J-SLoL infers and recovers the unknown HS signals over a larger coverage by sparse coding on the learned dictionary pair. Furthermore, we validate the SSR performance on three HS-MS data sets ( two for classification and one for unmixing) in terms of reconstruction, classification, and unmixing by comparing with several existing state-of-the-art baselines, showing the effectiveness and superiority of the proposed J-SLoL algorithm. Furthermore, the codes and data sets will be available at https://github.com/danfenghong/IEEE_TGRS_ J-SLoL, contributing to the remote sensing (RS) community.
引用
收藏
页码:2269 / 2280
页数:12
相关论文
共 58 条
[1]   In Defense of Shallow Learned Spectral Reconstruction from RGB Images [J].
Aeschbacher, Jonas ;
Wu, Jiqing ;
Timofte, Radu .
2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW 2017), 2017, :471-479
[2]   Hyperspectral Recovery from RGB Images using Gaussian Processes [J].
Akhtar, Naveed ;
Mian, Ajmal .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2020, 42 (01) :100-113
[3]   Sparse Spatio-spectral Representation for Hyperspectral Image Super-resolution [J].
Akhtar, Naveed ;
Shafait, Faisal ;
Mian, Ajmal .
COMPUTER VISION - ECCV 2014, PT VII, 2014, 8695 :63-78
[4]   Sparse Recovery of Hyperspectral Signal from Natural RGB Images [J].
Arad, Boaz ;
Ben-Shahar, Ohad .
COMPUTER VISION - ECCV 2016, PT VII, 2016, 9911 :19-34
[5]  
Can Y. Baran, 2018, ARXIV180404647
[6]   An Enhanced 3-D Discrete Wavelet Transform for Hyperspectral Image Classification [J].
Cao, Xiangyong ;
Yao, Jing ;
Fu, Xueyang ;
Bi, Haixia ;
Hong, Danfeng .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2021, 18 (06) :1104-1108
[7]   Hyperspectral Image Classification With Convolutional Neural Network and Active Learning [J].
Cao, Xiangyong ;
Yao, Jing ;
Xu, Zongben ;
Meng, Deyu .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2020, 58 (07) :4604-4616
[8]  
Dias JM, 2010, INVESTIGACAO, P1, DOI 10.14195/978-989-26-0193-9
[9]  
Galliani S., 2017, ARXIV170309470
[10]   A New Low-Rank Representation Based Hyperspectral Image Denoising Method for Mineral Mapping [J].
Gao, Lianru ;
Yao, Dan ;
Li, Qingting ;
Zhuang, Lina ;
Zhang, Bing ;
Bioucas-Dias, Jose M. .
REMOTE SENSING, 2017, 9 (11)