Nonlocal Band Attention Network for Hyperspectral Image Band Selection

被引:23
作者
Li, Tiancong [1 ]
Yaoming, Cai [1 ]
Cai, Zhihua [1 ]
Liu, Xiaobo [2 ,3 ]
Hu, Qiubo [1 ]
机构
[1] China Univ Geosci, Sch Comp Sci, Wuhan 430074, Peoples R China
[2] China Univ Geosci, Sch Automat, Wuhan 430074, Peoples R China
[3] China Univ Geosci, Hubei Key Lab Adv Control & Intelligent Automat C, Wuhan 430074, Peoples R China
基金
中国国家自然科学基金;
关键词
Feature extraction; Convolution; Kernel; Image reconstruction; Hyperspectral imaging; Data mining; Neural networks; Attention mechanism; band selection; global relationship; hyperspectral image; spectral reconstruction; MULTIOBJECTIVE OPTIMIZATION; DIMENSIONALITY REDUCTION;
D O I
10.1109/JSTARS.2021.3065687
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Band selection (BS) is a foundational problem for the analysis of high-dimensional hyperspectral image (HSI) cubes. Recent developments in the visual attention mechanism allow for specifically modeling the complex relationship among different components. Inspired by this, this article proposes a novel band selection network, termed as nonlocal band attention network (NBAN), based on using a nonlocal band attention reconstruction network to adaptively calculate band weights. The framework consists of a band attention module, which aims to extract the long-range attention and reweight the original spectral bands, and a reconstruction network which is used to restore the reweighted data, resulting in a flexible architecture. The resulting BS network is able to capture the nonlinear and the long-range dependencies between spectral bands, making it more effective and robust to select the informative bands automatically. Finally, we compare the result of NBAN with six popular existing band selection methods on three hyperspectral datasets, the result showing that the long-range relationship is helpful for band selection processing. Besides, the classification performance shows that the advantage of NBAN is particularly obvious when the size of the selected band subset is small. Extensive experiments strongly evidence that the proposed NBAN method outperforms many current models on three popular HSI images consistently.
引用
收藏
页码:3462 / 3474
页数:13
相关论文
共 45 条
[1]  
Agarwal A, 2007, 2007 IEEE INTERNATIONAL SYMPOSIUM ON SIGNAL PROCESSING AND INFORMATION TECHNOLOGY, VOLS 1-3, P1077
[2]   BS-Nets: An End-to-End Framework for Band Selection of Hyperspectral Image [J].
Cai, Yaoming ;
Liu, Xiaobo ;
Cai, Zhihua .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2020, 58 (03) :1969-1984
[3]   A joint band prioritization and band-decorrelation approach to band selection for hyperspectral image classification [J].
Chang, CI ;
Du, Q ;
Sun, TL ;
Althouse, MLG .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 1999, 37 (06) :2631-2641
[4]   Cooperative Spectral-Spatial Attention Dense Network for Hyperspectral Image Classification [J].
Dong, Zhimin ;
Cai, Yaoming ;
Cai, Zhihua ;
Liu, Xiaobo ;
Yang, Zhaoyu ;
Zhuge, Mingchen .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2021, 18 (05) :866-870
[5]   Hyperspectral imaging for non-contact analysis of forensic traces [J].
Edelman, G. J. ;
Gaston, E. ;
van Leeuwen, T. G. ;
Cullen, P. J. ;
Aalders, M. C. G. .
FORENSIC SCIENCE INTERNATIONAL, 2012, 223 (1-3) :28-39
[6]   Dual Attention Network for Scene Segmentation [J].
Fu, Jun ;
Liu, Jing ;
Tian, Haijie ;
Li, Yong ;
Bao, Yongjun ;
Fang, Zhiwei ;
Lu, Hanqing .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :3141-3149
[7]   A Fast Volume-Gradient-Based Band Selection Method for Hyperspectral Image [J].
Geng, Xiurui ;
Sun, Kang ;
Ji, Luyan ;
Zhao, Yongchao .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2014, 52 (11) :7111-7119
[8]   Generation of Spectral-Temporal Response Surfaces by Combining Multispectral Satellite and Hyperspectral UAV Imagery for Precision Agriculture Applications [J].
Gevaert, Caroline M. ;
Suomalainen, Juha ;
Tang, Jing ;
Kooistra, Lammert .
IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2015, 8 (06) :3140-3146
[9]   Unsupervised Band Selection Based on Evolutionary Multiobjective Optimization for Hyperspectral Images [J].
Gong, Maoguo ;
Zhang, Mingyang ;
Yuan, Yuan .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2016, 54 (01) :544-557
[10]   Recent advances in convolutional neural networks [J].
Gu, Jiuxiang ;
Wang, Zhenhua ;
Kuen, Jason ;
Ma, Lianyang ;
Shahroudy, Amir ;
Shuai, Bing ;
Liu, Ting ;
Wang, Xingxing ;
Wang, Gang ;
Cai, Jianfei ;
Chen, Tsuhan .
PATTERN RECOGNITION, 2018, 77 :354-377