Scale-Balanced Real-Time Object Detection With Varying Input-Image Resolution

被引:9
|
作者
Yan, Longbin [1 ]
Qin, Yunxiao [2 ]
Chen, Jie [1 ]
机构
[1] Northwestern Polytech Univ, Sch Marine Sci & Technol, Xian 710072, Peoples R China
[2] Commun Univ China, Neurosci & Intelligent Media Inst, Beijing 100024, Peoples R China
关键词
Feature extraction; Detectors; Head; Image resolution; Task analysis; Semantics; Object detection; Deep convolution neural network (CNN); object detection; multi-scale features fusion;
D O I
10.1109/TCSVT.2022.3198329
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Current object-detection methods for small-scale objects are often marred by poor performance. Using relatively high-resolution input images can be considered a remedy for this issue, but it usually leads to performance degeneration for large-scale objects. We define this problem as the imbalance of detection performance for multi-scale objects when the resolution of input images varies. In addition, the use of high-resolution images results in significant computational resource consumption and inference-speed impairment. In this paper, we propose a friendly varying-resolution object-detection method for multi-scale objects. We analyze in detail the reasons leading to the performance degradation in the detection of large-scale objects with increasing input-image resolution, and propose a novel lightweight bidirectional feature-flow module to enhance the performance of multi-scale object detection in high-resolution images, especially for large-scale objects. The proposed approach can also ease the problems of computational resource consumption and inference-speed impairment caused by high-resolution images. Additionally, a decoupled detection head is designed to further improve performance by separating classification and regression sub-tasks, and an adaptive feature-fusion module is designed to better fuse different feature levels. The proposed scheme alleviates the negative effects of using high-resolution input images and achieves an excellent balance between inference speed and precision. Experiments on the MS COCO dataset show that the scheme achieves 44.6 AP at 42.6 FPS and 47 AP at 26.7 FPS, showing significant advantages over the methods to which it is compared.
引用
收藏
页码:242 / 256
页数:15
相关论文
共 50 条
  • [41] Real-time multiple object tracking and anomaly detection
    Han, M
    Gong, YH
    STORAGE AND RETRIEVAL METHODS AND APPLICATIONS FOR MULTIMEDIA 2005, 2005, 5682 : 173 - 182
  • [42] Real-Time Object Detection for Visually Challenged People
    Vaidya, Sunit
    Shah, Naisha
    Shah, Niti
    Shankarmani, Radha
    PROCEEDINGS OF THE INTERNATIONAL CONFERENCE ON INTELLIGENT COMPUTING AND CONTROL SYSTEMS (ICICCS 2020), 2020, : 311 - 316
  • [43] YoloOW: A Spatial Scale Adaptive Real-Time Object Detection Neural Network for Open Water Search and Rescue From UAV Aerial Imagery
    Xu, Jianhao
    Fan, Xiangtao
    Jian, Hongdeng
    Xu, Chen
    Bei, Weijia
    Ge, Qifeng
    Zhao, Teng
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62
  • [44] Real-time Object Detection with FPGA Using CenterNet
    Solovyev, Roman A.
    Telpukhov, Dmitry, V
    Romanova, IrMa I.
    Kustov, Alexander G.
    Mkrtchan, Ilya A.
    PROCEEDINGS OF THE 2021 IEEE CONFERENCE OF RUSSIAN YOUNG RESEARCHERS IN ELECTRICAL AND ELECTRONIC ENGINEERING (ELCONRUS), 2021, : 2029 - 2034
  • [45] SACINet: Semantic-Aware Cross-Modal Interaction Network for Real-Time 3D Object Detection
    Yang, Ying
    Yin, Hui
    Chong, Ai-Xin
    Wan, Jin
    Liu, Qing-Yi
    IEEE TRANSACTIONS ON INTELLIGENT VEHICLES, 2024, 9 (02): : 3917 - 3927
  • [46] DESIGN OF HIGH-PERFORMANCE UNIFIED IMAGE SCALER CIRCUIT FOR REAL-TIME OBJECT DETECTION
    Kim, Soojin
    Kim, Hojin
    Lee, Seonyoung
    Cho, Kyeongsoon
    2013 INTERNATIONAL CONFERENCE ON ELECTRONICS, COMPUTER AND COMPUTATION (ICECCO), 2013, : 378 - 381
  • [47] Real-Time Vehicle Object Detection Method Based on Multi-Scale Feature Fusion
    Guo, Keyou
    Li, Xue
    Zhang, Mo
    Bao, Qichao
    Yang, Min
    IEEE Access, 2021, 9 : 115126 - 115134
  • [48] Real-Time Vehicle Object Detection Method Based on Multi-Scale Feature Fusion
    Guo, Keyou
    Li, Xue
    Zhang, Mo
    Bao, Qichao
    Yang, Min
    IEEE ACCESS, 2021, 9 : 115126 - 115134
  • [49] R-YOLOv5: A Lightweight Rotational Object Detection Algorithm for Real-Time Detection of Vehicles in Dense Scenes
    Li, Zhengwei
    Pang, Chengxin
    Dong, Chenhang
    Zeng, Xinhua
    IEEE ACCESS, 2023, 11 : 61546 - 61559
  • [50] A RGB-D Based Real-Time Multiple Object Detection and Ranging System for Autonomous Driving
    Yang, Jiachen
    Wang, Chenguang
    Wang, Huihui
    Li, Qiang
    IEEE SENSORS JOURNAL, 2020, 20 (20) : 11959 - 11966