Gaussian similarity-based adaptive dynamic label assignment for tiny object detection

被引:31
作者
Fu, Ronghao [1 ,2 ]
Chen, Chengcheng [3 ]
Yan, Shuang [4 ]
Heidari, Ali Asghar [5 ]
Wang, Xianchang [1 ,2 ,6 ]
Escorcia-Gutierrez, Jose [7 ]
Mansour, Romany F. [8 ]
Chene, Huiling [5 ,9 ]
机构
[1] Jilin Univ, Coll Comp Sci & Technol, Changchun 130021, Peoples R China
[2] Minist Educ, Key Lab Symbol Computat & Knowledge Engn, Changchun 130021, Peoples R China
[3] Shenyang Aerosp Univ, Sch Comp Sci, Shenyang 110136, Peoples R China
[4] Jilin Univ, Coll Instrumentat & Elect Engn, Changchun 130021, Peoples R China
[5] Wenzhou Univ, Key Lab Intelligent Informat Safety & Emergency Zh, Wenzhou 325035, Peoples R China
[6] Chengdu Kestrel Artificial Intelligence Inst, Chengdu 611730, Peoples R China
[7] Univ Costa, CUC, Dept Computat Sci & Elect, Barranquilla 080002, Colombia
[8] New Valley Univ, Fac Sci, Dept Math, El Kharga 72511, Egypt
[9] Wenzhou Univ, Coll Comp Sci & Artificial Intelligence, Wenzhou 325035, Peoples R China
基金
中国国家自然科学基金;
关键词
Tiny object detection; Gaussian; Label assignment; DEPLOYMENT OPTIMIZATION;
D O I
10.1016/j.neucom.2023.126285
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Benefiting from the advanced deep learning techniques, significant achievements have been made in gen-eric object detection. Tiny object detection (TOD) is a challenging task in computer vision due to the low resolution, insufficient geometric cues, and high noise levels. A recent trend for detectors is introducing more granular label assignment strategies to provide promising supervision information for classification and regression. However, most previous Intersection-Over-Union (IoU) based methods suffer from two main drawbacks, including (1) low tolerance of IoU for bounding box deviations in tiny objects and (2) deficient guidance for optimization caused by inter-sample and intra-sample imbalance. We propose two novel components to address these problems: the Gaussian probabilistic distribution-based fuzzy similarity metric (GPM) and the adaptive dynamic anchor mining strategy (ADAS). GPM aims to address the issue of inaccurate similarity measurement between small bounding boxes and pre-defined anchors, providing a more accurate basis for label assignment. ADAS adopts a dynamically adjusted strategy for label assignment to address the distribution bias between positive and negative samples, ensuring that the label assignment is consistent with the distribution of objects in the image. Extensive experiments are conducted on AI-TODv2 and other tiny object detection datasets to evaluate the proposed ADAS-GPM method's performance. The results demonstrate that incorporating ADAS-GPM into an anchor -based object detector yields significant outperformance over state-of-the-art methods on the challenging AI-TODv2 benchmark. The proposed ADAS-GPM method exhibits good results, clearly demonstrating its validity and potential.& COPY; 2023 Elsevier B.V. All rights reserved.
引用
收藏
页数:14
相关论文
共 91 条
[1]  
Adelson E.H., 1984, Pyramid Methods in Image Processing
[2]   Finding Tiny Faces in the Wild with Generative Adversarial Network [J].
Bai, Yancheng ;
Zhang, Yongqiang ;
Ding, Mingli ;
Ghanem, Bernard .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :21-30
[3]   Inside-Outside Net: Detecting Objects in Context with Skip Pooling and Recurrent Neural Networks [J].
Bell, Sean ;
Zitnick, C. Lawrence ;
Bala, Kavita ;
Girshick, Ross .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :2874-2883
[4]  
Bhattacharyya A., 1943, Bull. Calcutta Math. Soc., V35, P99, DOI DOI 10.1038/157869B0
[5]  
Bochkovskiy A, 2020, Arxiv, DOI arXiv:2004.10934
[6]   A full data augmentation pipeline for small object detection based on generative adversarial networks [J].
Bosquet, Brais ;
Cores, Daniel ;
Seidenari, Lorenzo ;
Brea, Victor M. ;
Mucientes, Manuel ;
Del Bimbo, Alberto .
PATTERN RECOGNITION, 2023, 133
[7]   Cascade R-CNN: High Quality Object Detection and Instance Segmentation [J].
Cai, Zhaowei ;
Vasconcelos, Nuno .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2021, 43 (05) :1483-1498
[8]   Many-Objective Deployment Optimization for a Drone-Assisted Camera Network [J].
Cao, Bin ;
Li, Meng ;
Liu, Xin ;
Zhao, Jianwei ;
Cao, Wenxi ;
Lv, Zhihan .
IEEE TRANSACTIONS ON NETWORK SCIENCE AND ENGINEERING, 2021, 8 (04) :2756-2764
[9]   Large-Scale Many-Objective Deployment Optimization of Edge Servers [J].
Cao, Bin ;
Fan, Shanshan ;
Zhao, Jianwei ;
Tian, Shan ;
Zheng, Zihao ;
Yan, Yanlong ;
Yang, Peng .
IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2021, 22 (06) :3841-3849
[10]   Feature-Fused SSD: Fast Detection for Small Objects [J].
Cao, Guimei ;
Xie, Xuemei ;
Yang, Wenzhe ;
Liao, Quan ;
Shi, Guangming ;
Wu, Jinjian .
NINTH INTERNATIONAL CONFERENCE ON GRAPHIC AND IMAGE PROCESSING (ICGIP 2017), 2018, 10615