Scale-Balanced Real-Time Object Detection With Varying Input-Image Resolution

被引:9
|
作者
Yan, Longbin [1 ]
Qin, Yunxiao [2 ]
Chen, Jie [1 ]
机构
[1] Northwestern Polytech Univ, Sch Marine Sci & Technol, Xian 710072, Peoples R China
[2] Commun Univ China, Neurosci & Intelligent Media Inst, Beijing 100024, Peoples R China
关键词
Feature extraction; Detectors; Head; Image resolution; Task analysis; Semantics; Object detection; Deep convolution neural network (CNN); object detection; multi-scale features fusion;
D O I
10.1109/TCSVT.2022.3198329
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Current object-detection methods for small-scale objects are often marred by poor performance. Using relatively high-resolution input images can be considered a remedy for this issue, but it usually leads to performance degeneration for large-scale objects. We define this problem as the imbalance of detection performance for multi-scale objects when the resolution of input images varies. In addition, the use of high-resolution images results in significant computational resource consumption and inference-speed impairment. In this paper, we propose a friendly varying-resolution object-detection method for multi-scale objects. We analyze in detail the reasons leading to the performance degradation in the detection of large-scale objects with increasing input-image resolution, and propose a novel lightweight bidirectional feature-flow module to enhance the performance of multi-scale object detection in high-resolution images, especially for large-scale objects. The proposed approach can also ease the problems of computational resource consumption and inference-speed impairment caused by high-resolution images. Additionally, a decoupled detection head is designed to further improve performance by separating classification and regression sub-tasks, and an adaptive feature-fusion module is designed to better fuse different feature levels. The proposed scheme alleviates the negative effects of using high-resolution input images and achieves an excellent balance between inference speed and precision. Experiments on the MS COCO dataset show that the scheme achieves 44.6 AP at 42.6 FPS and 47 AP at 26.7 FPS, showing significant advantages over the methods to which it is compared.
引用
收藏
页码:242 / 256
页数:15
相关论文
共 50 条
  • [31] Real-time moving object detection algorithm on high-resolution videos using GPUs
    Kumar, Praveen
    Singhal, Ayush
    Mehta, Sanyam
    Mittal, Ankush
    JOURNAL OF REAL-TIME IMAGE PROCESSING, 2016, 11 (01) : 93 - 109
  • [32] An Edge-based Real-Time Object Detection
    Ahmadinia, Ali
    Shah, Jaabaal
    2022 21ST IEEE INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND APPLICATIONS, ICMLA, 2022, : 465 - 470
  • [33] Evolutionary channel pruning for real-time object detection
    Yang, Changcai
    Lin, Zhijie
    Lan, Ziyang
    Chen, Riqing
    Wei, Lifang
    Liu, Yizhang
    KNOWLEDGE-BASED SYSTEMS, 2024, 287
  • [34] Risk-aware Real-time Object Detection
    Santana, Misael Alpizar
    Calinescu, Radu
    Paterson, Colin
    2022 18TH EUROPEAN DEPENDABLE COMPUTING CONFERENCE (EDCC 2022), 2022, : 105 - 108
  • [35] An Efficient Real-Time FPGA Implementation for Object Detection
    Zhao, Jin
    Huang, Xinming
    Massoud, Yehia
    2014 IEEE 12TH INTERNATIONAL NEW CIRCUITS AND SYSTEMS CONFERENCE (NEWCAS), 2014, : 313 - 316
  • [36] An Intelligent Real-Time Object Detection System on Drones
    Chen, Chao
    Min, Hongrui
    Peng, Yi
    Yang, Yongkui
    Wang, Zheng
    APPLIED SCIENCES-BASEL, 2022, 12 (20):
  • [37] Near Real-time Object Detection in RGBD Data
    Haensch, Ronny
    Kaiser, Stefan
    Helwich, Olaf
    PROCEEDINGS OF THE 12TH INTERNATIONAL JOINT CONFERENCE ON COMPUTER VISION, IMAGING AND COMPUTER GRAPHICS THEORY AND APPLICATIONS (VISIGRAPP 2017), VOL 5, 2017, : 179 - 186
  • [38] Improve Real-time Object Detection with Feature Enhancement
    Wei, Wendian
    Hu, Yu
    PROCEEDINGS OF 2019 IEEE 8TH JOINT INTERNATIONAL INFORMATION TECHNOLOGY AND ARTIFICIAL INTELLIGENCE CONFERENCE (ITAIC 2019), 2019, : 235 - 238
  • [39] Towards Real-Time Object Detection on Embedded Systems
    Mao, Huizi
    Yao, Song
    Tang, Tianqi
    Li, Boxun
    Yao, Jun
    Wang, Yu
    IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTING, 2018, 6 (03) : 417 - 431
  • [40] Performance Evaluation of Real-Time Object Detection Algorithms
    Srisuk, Sanun
    Suwannapong, Chanwit
    Kitisriworapan, Songrit
    Kaewsong, Apiwut
    Ongkittikul, Surachai
    2019 7TH INTERNATIONAL ELECTRICAL ENGINEERING CONGRESS (IEECON 2019), 2019,