Hyper-Embedder: Learning a Deep Embedder for Self-Supervised Hyperspectral Dimensionality Reduction

被引:5
作者
Wu, Xin [1 ,2 ]
Hong, Danfeng [3 ]
Zhao, Di [4 ,5 ]
机构
[1] Beijing Inst Technol, Sch Informat & Elect, Beijing 100081, Peoples R China
[2] Beijing Key Lab Fract Signals & Syst, Beijing 100081, Peoples R China
[3] Chinese Acad Sci, Aerosp Informat Res Inst, Key Lab Digital Earth Sci, Beijing 100094, Peoples R China
[4] Yulin Normal Univ, Guangxi Coll & Univ, Key Lab Complex Syst Optimizat & Big Data Proc, Yulin 537000, Peoples R China
[5] Yulin Normal Univ, Sch Phys & Telecommun Engn, Yulin 537000, Peoples R China
基金
中国国家自然科学基金; 中国博士后科学基金;
关键词
Hyperspectral imaging; Manifolds; Dimensionality reduction; Training; Testing; Vegetation; Redundancy; Deep learning; dimensionality reduction (DR); hyperspectral data; manifold embedding; regression; remote sensing; self-supervised; MANIFOLD ALIGNMENT; LAND-COVER; FRAMEWORK;
D O I
10.1109/LGRS.2021.3119339
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Hyperspectral imaging has attracted growing interest among researchers from the geoscience and remote sensing fields owing to its very rich spectral information. However, the high spectral dimensionality of hyperspectral images (HSI) tends to suffer from information redundancy. Manifold embedding is a mainstream strategy of nonlinear hyperspectral dimensionality reduction (DR). The sensitivity to the noise and the inflexibility to the out-of-sample problem (i.e., new samples) are the main drawbacks of the manifold embedding-based methods. To this end, we propose to learn a deep embedder in a self-supervised fashion for hyperspectral DR, called hyper-embedder. Hyper-embedder effectively reduces the computational complexity and storage-costing compared to conventional embedding models and improves the robustness against various noises, e.g., spectral variabilities. More significantly, hyper-embedder is capable of learning an explicit nonlinear mapping to make a one-to-one match between each original pixel (spectral signature) in the HSI and its dimension-reduced representation. These low-dimensional representations can be generated and given by existing and classic nonlinear manifold embedding methods. In this letter, we attempt to learn the correspondence or mapping by optimizing a deep regression network. The to-be-developed network cannot only capture the local topological knowledge graph of all spectral signatures of hyperspectral data but be applicable to fast prediction and inference of samples from other hyperspectral scenes. The proposed hyper-embedder outperforms existing state-of-the-art hyperspectral DR algorithms on two commonly used hyperspectral datasets, i.e., Indian pines and Augsburg scenes.
引用
收藏
页数:5
相关论文
共 29 条
[1]   Characterisation methods for the hyperspectral sensor HySpex at DLR's calibration home base [J].
Baumgartner, Andreas ;
Gege, Peter ;
Koehler, Claas ;
Lenhard, Karim ;
Schwarzmaier, Thomas .
SENSORS, SYSTEMS, AND NEXT-GENERATION SATELLITES XVI, 2012, 8533
[2]   Laplacian eigenmaps for dimensionality reduction and data representation [J].
Belkin, M ;
Niyogi, P .
NEURAL COMPUTATION, 2003, 15 (06) :1373-1396
[3]   Hyperspectral Unmixing Overview: Geometrical, Statistical, and Sparse Regression-Based Approaches [J].
Bioucas-Dias, Jose M. ;
Plaza, Antonio ;
Dobigeon, Nicolas ;
Parente, Mario ;
Du, Qian ;
Gader, Paul ;
Chanussot, Jocelyn .
IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2012, 5 (02) :354-379
[4]   Optimized Kernel Minimum Noise Fraction Transformation for Hyperspectral Image Classification [J].
Gao, Lianru ;
Zhao, Bin ;
Jia, Xiuping ;
Liao, Wenzhi ;
Zhang, Bing .
REMOTE SENSING, 2017, 9 (06)
[5]   Cascaded Recurrent Neural Networks for Hyperspectral Image Classification [J].
Hang, Renlong ;
Liu, Qingshan ;
Hong, Danfeng ;
Ghamisi, Pedram .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2019, 57 (08) :5384-5394
[6]  
Hong D., 2021, arXiv:2107.02988
[7]   Graph Convolutional Networks for Hyperspectral Image Classification [J].
Hong, Danfeng ;
Gao, Lianru ;
Yao, Jing ;
Zhang, Bing ;
Plaza, Antonio ;
Chanussot, Jocelyn .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2021, 59 (07) :5966-5978
[8]   Multimodal remote sensing benchmark datasets for land cover classification with a shared and specific feature learning model [J].
Hong, Danfeng ;
Hu, Jingliang ;
Yao, Jing ;
Chanussot, Jocelyn ;
Zhu, Xiao Xiang .
ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2021, 178 :68-80
[9]   Interpretable Hyperspectral Artificial Intelligence: When nonconvex modeling meets hyperspectral remote sensing [J].
Hong, Danfeng ;
He, Wei ;
Yokoya, Naoto ;
Yao, Jing ;
Gao, Lianru ;
Zhang, Liangpei ;
Chanussot, Jocelyn ;
Zhu, Xiaoxiang .
IEEE GEOSCIENCE AND REMOTE SENSING MAGAZINE, 2021, 9 (02) :52-87
[10]   Joint and Progressive Subspace Analysis (JPSA) With Spatial-Spectral Manifold Alignment for Semisupervised Hyperspectral Dimensionality Reduction [J].
Hong, Danfeng ;
Yokoya, Naoto ;
Chanussot, Jocelyn ;
Xu, Jian ;
Zhu, Xiao Xiang .
IEEE TRANSACTIONS ON CYBERNETICS, 2021, 51 (07) :3602-3615