A Hierarchical Context Embedding Network for Object Detection in Remote Sensing Images

被引:31
作者
Zhang, Ke [1 ]
Wu, Yulin [1 ]
Wang, Jingyu [2 ]
Wang, Qi [3 ]
机构
[1] Northwestern Polytech Univ, Sch Astronaut, Xian 710072, Peoples R China
[2] Northwestern Polytech Univ, Sch Astronaut, Sch Artificial Intelligence OPt & Elect iOPEN, Xian 710072, Peoples R China
[3] Northwestern Polytech Univ, Sch Artificial Intelligence OPt & Elect iOPEN, Xian 710072, Peoples R China
基金
中国国家自然科学基金;
关键词
Feature extraction; Semantics; Convolution; Object detection; Task analysis; Remote sensing; Proposals; remote sensing images (RSIs); scene-level context; semantic context; VEHICLE DETECTION;
D O I
10.1109/LGRS.2022.3161938
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Compared with general optical images, remote sensing images (RSIs) capture large areas from high altitudes with a bird's eye view, which is responsible for the many categories and scale variations of objects in the images, as well as the abundant scene information. Although the complexity of the RSIs presents a significant challenge to the object detection task, the complexity presents opportunities as well. The RSIs contain plenty of object-related context information, which is valuable for boosting the object detection performance. To address the existing issue of poor context utilization in RSIs, we propose a hierarchical context embedding network (HCENet) in this letter. First, we construct a semantic feature pyramid, in which the semantic context aggregation module (SFAM) integrates the semantic contexts included in the adjacent layers of features with a novel feature fusion mechanism. Furthermore, the scene-level context embedding module (SLCEM) extracts the scene context of the overall image by a simple design and is utilized to guide feature classification. Finally, we outperform the popular object detectors on the publicly available DOTA-v1.5 dataset, achieving superior performance.
引用
收藏
页数:5
相关论文
共 28 条
[1]  
Bochkovskiy A., 2020, YOLOv4: Optimal Speed and Accuracy of Object Detection
[2]  
Cheng B., 2021, IEEE GEOSCI REMOTE S, V19, P1, DOI [10.1109/LGRS.2021.3087597, DOI 10.1109/LGRS.2021.3087597]
[3]   Dense Attention Pyramid Networks for Multi-Scale Ship Detection in SAR Images [J].
Cui, Zongyong ;
Li, Qi ;
Cao, Zongjie ;
Liu, Nengyuan .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2019, 57 (11) :8983-8997
[4]   Infrared Small UAV Target Detection Based on Residual Image Prediction via Global and Local Dilated Residual Networks [J].
Fang, Houzhang ;
Xia, Mingjiang ;
Zhou, Gang ;
Chang, Yi ;
Yan, Luxin .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19
[5]   Context-Aware Convolutional Neural Network for Object Detection in VHR Remote Sensing Imagery [J].
Gong, Yiping ;
Xiao, Zhifeng ;
Tan, Xiaowei ;
Sui, Haigang ;
Xu, Chuan ;
Duan, Haiwang ;
Li, Deren .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2020, 58 (01) :34-44
[6]   A Rotational Libra R-CNN Method for Ship Detection [J].
Guo, Haoyuan ;
Yang, Xi ;
Wang, Nannan ;
Song, Bin ;
Gao, Xinbo .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2020, 58 (08) :5772-5781
[7]   Improved Faster R-CNN With Multiscale Feature Fusion and Homography Augmentation for Vehicle Detection in Remote Sensing Images [J].
Ji, Hong ;
Gao, Zhi ;
Mei, Tiancan ;
Li, Yifan .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2019, 16 (11) :1761-1765
[8]   Feature Pyramid Networks for Object Detection [J].
Lin, Tsung-Yi ;
Dollar, Piotr ;
Girshick, Ross ;
He, Kaiming ;
Hariharan, Bharath ;
Belongie, Serge .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :936-944
[9]   Path Aggregation Network for Instance Segmentation [J].
Liu, Shu ;
Qi, Lu ;
Qin, Haifang ;
Shi, Jianping ;
Jia, Jiaya .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :8759-8768
[10]   SSD: Single Shot MultiBox Detector [J].
Liu, Wei ;
Anguelov, Dragomir ;
Erhan, Dumitru ;
Szegedy, Christian ;
Reed, Scott ;
Fu, Cheng-Yang ;
Berg, Alexander C. .
COMPUTER VISION - ECCV 2016, PT I, 2016, 9905 :21-37