AirDet: Few-Shot Detection Without Fine-Tuning for Autonomous Exploration

被引:20
作者
Li, Bowen [1 ,2 ]
Wang, Chen [1 ]
Reddy, Pranay [1 ,3 ]
Kim, Seungchan [1 ]
Scherer, Sebastian [1 ]
机构
[1] Carnegie Mellon Univ, Inst Robot, Pittsburgh, PA 15213 USA
[2] Tongji Univ, Sch Mech Engn, Shanghai, Peoples R China
[3] IIITDM Jabalpur, Elect & Commun Engn, Jabalpur, India
来源
COMPUTER VISION, ECCV 2022, PT XXXIX | 2022年 / 13699卷
关键词
Few-shot object detection; Online; Robot exploration;
D O I
10.1007/978-3-031-19842-7_25
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Few-shot object detection has attracted increasing attention and rapidly progressed in recent years. However, the requirement of an exhaustive offline fine-tuning stage in existing methods is timeconsuming and significantly hinders their usage in online applications such as autonomous exploration of low-power robots. We find that their major limitation is that the little but valuable information from a few support images is not fully exploited. To solve this problem, we propose a brand new architecture, AirDet, and surprisingly find that, by learning class-agnostic relation with the support images in all modules, including cross-scale object proposal network, shots aggregation module, and localization network, AirDet without fine-tuning achieves comparable or even better results than many fine-tuned methods, reaching up to 3040% improvements. We also present solid results of onboard tests on real-world exploration data from the DARPA Subterranean Challenge, which strongly validate the feasibility of AirDet in robotics. To the best of our knowledge, AirDet is the first feasible few-shot detection method for autonomous exploration of low-power robots. The code and pre-trained models are released at https://github.com/Jaraxxus-Me/AirDet.
引用
收藏
页码:427 / 444
页数:18
相关论文
共 44 条
[1]  
Cao Y, 2021, ADV NEURAL INF PROCE, V34, P1
[2]  
Chen H, 2018, AAAI CONF ARTIF INTE, P2836
[3]  
Chen Wang, 2020, Computer Vision - ECCV 2020. 16th European Conference. Proceedings. Lecture Notes in Computer Science (LNCS 12347), P52, DOI 10.1007/978-3-030-58536-5_4
[4]  
D. S. S. C. O, US
[5]  
Deng J, 2009, PROC CVPR IEEE, P248, DOI 10.1109/CVPRW.2009.5206848
[6]  
Everingham M., 2010, INT J COMPUT VISION, V88, P303, DOI DOI 10.1007/s11263-009-0275-4
[7]   Few-Shot Object Detection with Attention-RPN and Multi-Relation Detector [J].
Fan, Qi ;
Zhuo, Wei ;
Tang, Chi-Keung ;
Tai, Yu-Wing .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, :4012-4021
[8]   Generalized Few-Shot Object Detection without Forgetting [J].
Fan, Zhibo ;
Ma, Yuchen ;
Li, Zeming ;
Sun, Jian .
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, :4525-4534
[9]  
Farooq N, 2018, INT CONF INTEL INFOR, P116, DOI 10.1109/ICIIBMS.2018.8550003
[10]   Fast R-CNN [J].
Girshick, Ross .
2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2015, :1440-1448