Siamese Graph Embedding Network for Object Detection in Remote Sensing Images

被引:10
作者
Tian, Shu [1 ]
Kang, Lihong [1 ]
Xing, Xiangwei [1 ]
Li, Zhou [1 ]
Zhao, Liang [1 ]
Fan, Chunzhuo [1 ]
Zhang, Ye [2 ]
机构
[1] Beijing Remote Sensing Informat Inst, Beijing 100039, Peoples R China
[2] Harbin Inst Technol, Dept Informat Engn, Harbin 150001, Peoples R China
基金
中国国家自然科学基金;
关键词
Object detection; Feature extraction; Semantics; Remote sensing; Proposals; Geospatial analysis; Training; Convolutional neural networks (CNNs); deep learning; graph learning; object detection; remote sensing;
D O I
10.1109/LGRS.2020.2981420
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Multiclass geospatial object detection is a vital fundamental task for many remote sensing applications. However, it still faces several challenges in very high-resolution (VHR) images in remote sensing, such as the ambiguity of object appearance and the complexity of spatial distribution. In this letter, we propose a novel Siamese graph embedding network (SGEN) that leverages the spatial and semantic information to jointly extract the high-level feature representation for object detection. The main purpose of our SGEN is to learn an embedding discriminative feature space that strengthens the interclass compactness while alleviating the intraclass separability. Specifically, we first design a novel contrastive loss in terms of spatial dependence and semantic correspondence for graph similarity metric learning (ML). Then, the SGEN architecture is adopted for spatial and semantic similarity learning by training the novel contrastive loss function. The SGEN model contains two-stream graph convolutional networks (GCNs) for ML, which is helpful to capture the discriminative features. At last, these extracted features with high spatial and semantic discrimination are served to improve the performance of object detection. The comprehensive evaluations on a combined data set consisting of two public object detection data sets demonstrate the effectiveness of the proposed method.
引用
收藏
页码:602 / 606
页数:5
相关论文
共 20 条
[1]   Embedding Learning on Spectral-Spatial Graph for Semisupervised Hyperspectral Image Classification [J].
Cao, Jiayan ;
Wang, Bin .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2017, 14 (10) :1805-1809
[2]   Siamese graph convolutional network for content based remote sensing image retrieval [J].
Chaudhuri, Ushasi ;
Banerjee, Biplab ;
Bhattacharya, Avik .
COMPUTER VISION AND IMAGE UNDERSTANDING, 2019, 184 :22-30
[3]   Learning Rotation-Invariant Convolutional Neural Networks for Object Detection in VHR Optical Remote Sensing Images [J].
Cheng, Gong ;
Zhou, Peicheng ;
Han, Junwei .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2016, 54 (12) :7405-7415
[4]   Multi-class geospatial object detection and geographic image classification based on collection of part detectors [J].
Cheng, Gong ;
Han, Junwei ;
Zhou, Peicheng ;
Guo, Lei .
ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2014, 98 :119-132
[5]   Advanced Deep-Learning Techniques for Salient and Category-Specific Object Detection A survey [J].
Han, Junwei ;
Zhang, Dingwen ;
Cheng, Gong ;
Liu, Nian ;
Xu, Dong .
IEEE SIGNAL PROCESSING MAGAZINE, 2018, 35 (01) :84-100
[6]   Object Detection in Optical Remote Sensing Images Based on Weakly Supervised Learning and High-Level Feature Learning [J].
Han, Junwei ;
Zhang, Dingwen ;
Cheng, Gong ;
Guo, Lei ;
Ren, Jinchang .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2015, 53 (06) :3325-3337
[7]   MULTIPLE GRAPH CONVOLUTIONAL NETWORKS FOR CO-SALIENCY DETECTION [J].
Jiang, Bo ;
Jiang, Xingyue ;
Tang, Jin ;
Luo, Bin ;
Huang, Shilei .
2019 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO (ICME), 2019, :332-337
[8]   ImageNet Classification with Deep Convolutional Neural Networks [J].
Krizhevsky, Alex ;
Sutskever, Ilya ;
Hinton, Geoffrey E. .
COMMUNICATIONS OF THE ACM, 2017, 60 (06) :84-90
[9]   Learning Local Image Descriptors with Deep Siamese and Triplet Convolutional Networks by Minimizing Global Loss Functions [J].
Kumar, Vijay B. G. ;
Carneiro, Gustavo ;
Reid, Ian .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :5385-5394
[10]   Rotation-Insensitive and Context-Augmented Object Detection in Remote Sensing Images [J].
Li, Ke ;
Cheng, Gong ;
Bu, Shuhui ;
You, Xiong .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2018, 56 (04) :2337-2348