Pixel-Level Remote Sensing Image Recognition Based on Bidirectional Word Vectors

被引:83
作者
Yo, Hongfeng [1 ]
Tian, Shengwei [2 ]
Yu, Long [3 ]
Lv, Yalong [1 ]
机构
[1] Xinjiang Univ, Sch Informat Sci & Engn, Urumqi 830000, Peoples R China
[2] Xinjiang Univ, Software Coll, Urumqi 830000, Peoples R China
[3] Xinjiang Univ, Network Ctr, Urumqi 830000, Peoples R China
来源
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING | 2020年 / 58卷 / 02期
关键词
Feature extraction; Remote sensing; Recurrent neural networks; Image recognition; Semantics; Deep learning; Image color analysis; Attention mechanism; bidirectional independent recurrent neural network (BiIndRNN); bidirectional word vector; graph convolutional networks (GCNs); parallel joint algorithm; sliced recurrent neural network (SRNN); CLASSIFICATION; SEGMENTATION; NETWORKS;
D O I
10.1109/TGRS.2019.2945591
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
In the traditional remote sensing image recognition, the traditional features (e.g., color features and texture features) cannot fully describe complex images, and the relationships between image pixels cannot be captured well. Using a single model or a traditional sequential joint model, it is easy to lose deep features during feature mining. This article proposes a new feature extraction method that uses the word embedding method from natural language processing to generate bidirectional real dense vectors to reflect the contextual relationships between the pixels. A bidirectional independent recurrent neural network (BiIndRNN) is combined with a convolutional neural network (CNN) to improve the sliced recurrent neural network (SRNN) algorithm model, which is then constructed in parallel with graph convolutional networks (GCNs) under an attention mechanism to fully exploit the deep features of images and to capture the semantic information of the context. This model is collectively named an improved SRNN and attention-treated GCN-based parallel (SAGP) model. Experiments conducted on Populus euphratica forests demonstrate that the proposed method outperforms traditional methods in terms of recognition accuracy. The validation done on public data set also proved it.
引用
收藏
页码:1281 / 1293
页数:13
相关论文
共 53 条
[1]  
[Anonymous], 2015, P PACLIC 2015
[2]  
[Anonymous], 2016, IEEE INT CONF ELECTR
[3]  
Ayyadevara K. V, 2018, Pro Machine Learning Algorithms: A Hands-On Approach to Implementing Algorithms in Python and R, P167
[4]   SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation [J].
Badrinarayanan, Vijay ;
Kendall, Alex ;
Cipolla, Roberto .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2017, 39 (12) :2481-2495
[5]  
Bahdanau D, 2016, Arxiv, DOI arXiv:1409.0473
[6]  
Barkan O, 2017, AAAI CONF ARTIF INTE, P3135
[7]  
Boukerch I., 2018, INT ARCH PHOTOGRAM R, V42, P149
[8]  
Chang W.-C., 2017, 2017 International Automatic Control Conference (CACS), P1, DOI DOI 10.1109/CACS.2017.8284244
[9]   FusionNet: Edge Aware Deep Convolutional Networks for Semantic Segmentation of Remote Sensing Harbor Images [J].
Cheng, Dongcai ;
Meng, Gaofeng ;
Xiang, Shiming ;
Pan, Chunhong .
IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2017, 10 (12) :5769-5783
[10]   When Deep Learning Meets Metric Learning: Remote Sensing Image Scene Classification via Learning Discriminative CNNs [J].
Cheng, Gong ;
Yang, Ceyuan ;
Yao, Xiwen ;
Guo, Lei ;
Han, Junwei .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2018, 56 (05) :2811-2821