MR-Selection: A Meta-Reinforcement Learning Approach for Zero-Shot Hyperspectral Band Selection

被引:33
作者
Feng, Jie [1 ]
Bai, Gaiqin [1 ]
Li, Di [1 ]
Zhang, Xiangrong [1 ]
Shang, Ronghua [1 ]
Jiao, Licheng [1 ]
机构
[1] Xidian Univ, Key Lab Intelligent Percept & Image Understanding, Minist Educ China, Xian 710071, Peoples R China
来源
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING | 2023年 / 61卷
基金
中国国家自然科学基金;
关键词
Task analysis; Hyperspectral imaging; Feature extraction; Correlation; Sparse matrices; Convolution; Training; Band selection; graph convolution neural network (CNN); hyperspectral images (HSIs); metalearning; reinforcement learning (RL); CONVOLUTIONAL NEURAL-NETWORK; CLASSIFICATION; INFORMATION;
D O I
10.1109/TGRS.2022.3231870
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Band selection is an effective method to deal with the difficulties in image transmission, storage, and processing caused by redundant and noisy bands in hyperspectral images (HSIs). Existing band selection methods usually need to learn a specific model for each HSI dataset, which ignores the inherent correlation and common knowledge among different band selection tasks. Meanwhile, these methods lead to a huge waste of computation. In this article, a novel zero-shot band selection method, called MR-Selection, is proposed for HSI classification. It formalizes zero-shot band selection as a metalearning problem, where advantage actor-critic algorithm-based reinforcement learning (A2C-RL) is designed to extract the metaknowledge in the band selection tasks of various seen hyperspectral datasets through a shared agent. To learn a consistent representation among different tasks, a dynamic structure-aware graph convolutional network is constructed to build a shared agent in A2C-RL. In A2C-RL, the state is tailored in a feasible way and easy to adapt to various tasks. Meanwhile, the reward is defined according to an efficient evaluation network, which can evaluate each state effectively without any fine-tuning. Furthermore, a two-stage optimization strategy is designed to coordinate optimization directions of a shared agent from different tasks effectively. Once the shared agent is optimized, it can be directly applied to unseen HSI band selection tasks without any available samples. Experimental results demonstrate the effectiveness and efficiency of the MR-Selection on the band selection of unseen HSI datasets.
引用
收藏
页数:20
相关论文
共 58 条
[1]   BS-Nets: An End-to-End Framework for Band Selection of Hyperspectral Image [J].
Cai, Yaoming ;
Liu, Xiaobo ;
Cai, Zhihua .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2020, 58 (03) :1969-1984
[2]   Semi-Supervised Hyperspectral Band Selection Based on Dynamic Classifier Selection [J].
Cao, Xianghai ;
Wei, Cuicui ;
Ge, Yiming ;
Feng, Jie ;
Zhao, Jing ;
Jiao, Licheng .
IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2019, 12 (04) :1289-1298
[3]  
Chang C.-I., 2007, HYPERSPECTRAL DATA E
[4]   A joint band prioritization and band-decorrelation approach to band selection for hyperspectral image classification [J].
Chang, CI ;
Du, Q ;
Sun, TL ;
Althouse, MLG .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 1999, 37 (06) :2631-2641
[5]   Meta-MSNet: Meta-Learning Based Multi-Source Data Fusion for Traffic Flow Prediction [J].
Fang, Shen ;
Pan, Xianbing ;
Xiang, Shiming ;
Pan, Chunhong .
IEEE SIGNAL PROCESSING LETTERS, 2021, 28 :6-10
[6]   Self-Supervised Divide-and-Conquer Generative Adversarial Network for Classification of Hyperspectral Images [J].
Feng, Jie ;
Zhao, Ning ;
Shang, Ronghua ;
Zhang, Xiangrong ;
Jiao, Licheng .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
[7]   Deep Reinforcement Learning for Semisupervised Hyperspectral Band Selection [J].
Feng, Jie ;
Li, Di ;
Gu, Jing ;
Cao, Xianghai ;
Shang, Ronghua ;
Zhang, Xiangrong ;
Jiao, Licheng .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
[8]   Convolutional Neural Network Based on Bandwise-Independent Convolution and Hard Thresholding for Hyperspectral Band Selection [J].
Feng, Jie ;
Chen, Jiantong ;
Sun, Qigong ;
Shang, Ronghua ;
Cao, Xianghai ;
Zhang, Xiangrong ;
Jiao, Licheng .
IEEE TRANSACTIONS ON CYBERNETICS, 2021, 51 (09) :4414-4428
[9]  
Feng J, 2019, INT GEOSCI REMOTE SE, P3804, DOI [10.1109/IGARSS.2019.8898889, 10.1109/igarss.2019.8898889]
[10]  
Francois-Lavet V, 2018, Arxiv, DOI arXiv:1811.12560