Anchor-Free Oriented Proposal Generator for Object Detection

被引:282
作者
Cheng, Gong [1 ]
Wang, Jiabao [1 ]
Li, Ke [2 ]
Xie, Xingxing [1 ]
Lang, Chunbo [1 ]
Yao, Yanqing [1 ]
Han, Junwei [1 ]
机构
[1] Northwestern Polytech Univ, Sch Automat, Xian 710129, Peoples R China
[2] Zhengzhou Inst Surveying & Mapping, Zhengzhou 450052, Peoples R China
来源
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING | 2022年 / 60卷
基金
美国国家科学基金会;
关键词
Proposals; Detectors; Object detection; Generators; Feature extraction; Remote sensing; Shape; Anchor-free oriented proposal generator (AOPG); oriented object detection; oriented proposal generation;
D O I
10.1109/TGRS.2022.3183022
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Oriented object detection is a practical and challenging task in remote sensing image interpretation. Nowadays, oriented detectors mostly use horizontal boxes as intermedium to derive oriented boxes from them. However, the horizontal boxes are inclined to get small Intersection-over-Unions (IoUs) with ground truths, which may have some undesirable effects, such as introducing redundant noise, mismatching with ground truths, and detracting from the robustness of detectors. In this article, we propose a novel anchor-free oriented proposal generator (AOPG) that abandons horizontal box-related operations from the network architecture. AOPG first produces coarse oriented boxes by a coarse location module (CLM) in an anchor-free manner and then refines them into high-quality oriented proposals. After AOPG, we apply a Fast Region-based Convolutional Neural Network (R-CNN) head to produce the final detection results. Furthermore, the shortage of large-scale datasets is also a hindrance to the development of oriented object detection. To alleviate the data insufficiency, we release a new dataset on the basis of our DIOR dataset and name it DIOR-R. Massive experiments demonstrate the effectiveness of AOPG. Particularly, without bells and whistles, we achieve the accuracy of 64.41%, 75.24%, and 96.22% mAP on the DIOR-R, DOTA, and HRSC2016 datasets, respectively. Code and models are available at https://github.com/jbwang1997/AOPG.
引用
收藏
页数:11
相关论文
共 55 条
[31]   Ship Rotated Bounding Box Space for Ship Extraction From High-Resolution Optical Satellite Images With Complex Backgrounds [J].
Liu, Zikun ;
Wang, Hongzhen ;
Weng, Lubin ;
Yang, Yiping .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2016, 13 (08) :1074-1078
[32]   Arbitrary-Oriented Scene Text Detection via Rotation Proposals [J].
Ma, Jianqi ;
Shao, Weiyuan ;
Ye, Hao ;
Wang, Li ;
Wang, Hong ;
Zheng, Yingbin ;
Xue, Xiangyang .
IEEE TRANSACTIONS ON MULTIMEDIA, 2018, 20 (11) :3111-3122
[33]  
Ming Q., 2020, arXiv preprint arXiv:2012.04150
[34]   Dynamic Refinement Network for Oriented and Densely Packed Object Detection [J].
Pan, Xingjia ;
Ren, Yuqiang ;
Sheng, Kekai ;
Dong, Weiming ;
Yuan, Haolei ;
Guo, Xiaowei ;
Ma, Chongyang ;
Xu, Changsheng .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2020), 2020, :11204-11213
[35]   Libra R-CNN: Towards Balanced Learning for Object Detection [J].
Pang, Jiangmiao ;
Chen, Kai ;
Shi, Jianping ;
Feng, Huajun ;
Ouyang, Wanli ;
Lin, Dahua .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :821-830
[36]  
Qian W., 2019, ARXIV191108299
[37]   You Only Look Once: Unified, Real-Time Object Detection [J].
Redmon, Joseph ;
Divvala, Santosh ;
Girshick, Ross ;
Farhadi, Ali .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :779-788
[38]   Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks [J].
Ren, Shaoqing ;
He, Kaiming ;
Girshick, Ross ;
Sun, Jian .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2017, 39 (06) :1137-1149
[39]   Research Progress on Few-Shot Learning for Remote Sensing Image Interpretation [J].
Sun, Xian ;
Wang, Bing ;
Wang, Zhirui ;
Li, Hao ;
Li, Hengchao ;
Fu, Kun .
IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2021, 14 :2387-2402
[40]   FCOS: Fully Convolutional One-Stage Object Detection [J].
Tian, Zhi ;
Shen, Chunhua ;
Chen, Hao ;
He, Tong .
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, :9626-9635