Feature-Aligned Single-Stage Rotation Object Detection With Continuous Boundary

被引:22
作者
Yuan, Yuan [1 ,2 ]
Li, Zhiguo [1 ,3 ]
Ma, Dandan [1 ,2 ]
机构
[1] Northwestern Polytech Univ, Sch Artificial Intelligence Opt & Elect iOPEN, Xian 710072, Peoples R China
[2] Northwestern Polytech Univ, Key Lab Intelligent Interact & Applicat, Minist Ind & Informat Technol, Xian 710072, Peoples R China
[3] Northwestern Polytech Univ, Sch Comp Sci, Xian 710072, Peoples R China
来源
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING | 2022年 / 60卷
关键词
Detectors; Feature extraction; Object detection; Remote sensing; Task analysis; Convolution; Sensors; Feature alignment; remote sensing images; rotation detection; single-stage detector; CONVOLUTIONAL NEURAL-NETWORK; IMAGES; AWARE;
D O I
10.1109/TGRS.2022.3203983
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Recently, rotation detection has gained much attention and shown its potential for accurate localization in remote sensing scenes. However, the objects in remote sensing images have a variety of directions, sizes, and aspect ratios, which makes it difficult to locate and classify objects. Therefore, the object detection task is still facing great challenges in the field of remote sensing. In this article, we propose a novel single-stage detector, which includes feature alignment block (FAB), double regression branches (DRBs), and a circumcircle rotation box (CRB). FAB utilizes the deformable convolution to flexibly obtain the features of different aspect ratio objects and aligns the regression features with the corresponding classification features through fusion. Consequently, it can make the extracted feature information have stronger discrimination, which is conducive to improving the object position and classification accuracy. DRBs consist of a main regression branch and an auxiliary regression branch. The main regression branch is used to fine-tune the result of the auxiliary regression branch to obtain a more accurate regression result. Moreover, to eliminate the boundary discontinuity problem faced by regression-based detectors, we construct CRB through designing an angle of rotation and the radius of the circumcircle. Extensive experiments and visual analysis are conducted on three public benchmarks, i.e., DOTA, HRSC2016, and DIOR-R. The results show that our proposed method has excellent localization and classification performance for oriented objects on all the representative datasets.
引用
收藏
页数:11
相关论文
共 52 条
[1]   Towards Multi-class Object Detection in Unconstrained Remote Sensing Imagery [J].
Azimi, Seyed Majid ;
Vig, Eleonora ;
Bahmanyar, Reza ;
Koerner, Marco ;
Reinartz, Peter .
COMPUTER VISION - ACCV 2018, PT III, 2019, 11363 :150-165
[2]   End-to-End Object Detection with Transformers [J].
Carion, Nicolas ;
Massa, Francisco ;
Synnaeve, Gabriel ;
Usunier, Nicolas ;
Kirillov, Alexander ;
Zagoruyko, Sergey .
COMPUTER VISION - ECCV 2020, PT I, 2020, 12346 :213-229
[3]   Vehicle Detection in Satellite Images by Hybrid Deep Convolutional Neural Networks [J].
Chen, Xueyun ;
Xiang, Shiming ;
Liu, Cheng-Lin ;
Pan, Chun-Hong .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2014, 11 (10) :1797-1801
[4]   PIoU Loss: Towards Accurate Oriented Object Detection in Complex Environments [J].
Chen, Zhiming ;
Chen, Kean ;
Lin, Weiyao ;
See, John ;
Yu, Hui ;
Ke, Yan ;
Yang, Cong .
COMPUTER VISION - ECCV 2020, PT V, 2020, 12350 :195-211
[5]  
Cheng G, 2022, Arxiv, DOI arXiv:2110.01931
[6]   Deformable Convolutional Networks [J].
Dai, Jifeng ;
Qi, Haozhi ;
Xiong, Yuwen ;
Li, Yi ;
Zhang, Guodong ;
Hu, Han ;
Wei, Yichen .
2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, :764-773
[7]   Multi-scale object detection in remote sensing imagery with convolutional neural networks [J].
Deng, Zhipeng ;
Sun, Hao ;
Zhou, Shilin ;
Zhao, Juanping ;
Lei, Lin ;
Zou, Huanxin .
ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2018, 145 :3-22
[8]  
Ding J, 2018, Arxiv, DOI arXiv:1812.00155
[9]   CenterNet: Keypoint Triplets for Object Detection [J].
Duan, Kaiwen ;
Bai, Song ;
Xie, Lingxi ;
Qi, Honggang ;
Huang, Qingming ;
Tian, Qi .
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, :6568-6577
[10]   Rotation-aware and multi-scale convolutional neural network for object detection in remote sensing images [J].
Fu, Kun ;
Chang, Zhonghan ;
Zhang, Yue ;
Xu, Guangluan ;
Zhang, Keshu ;
Sun, Xian .
ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2020, 161 :294-308