OAF-Net: An Occlusion-Aware Anchor-Free Network for Pedestrian Detection in a Crowd

被引:18
作者
Li, Qiming [1 ,2 ]
Su, Yijing [1 ,2 ]
Gao, Yin [1 ,2 ]
Xie, Feng [3 ]
Li, Jun [1 ,2 ]
机构
[1] Chinese Acad Sci, Quanzhou Inst Equipment Mfg, Haixi Inst, Lab Robot & Intelligent Syst, Quanzhou 362216, Fujian, Peoples R China
[2] Fujian Sci & Technol, Innovat Lab Optoelect Informat China, Fuzhou 350108, Fujian, Peoples R China
[3] Inst Automat & Commun, Dept Traff & Assistance, D-39106 Magdeburg, Germany
基金
中国国家自然科学基金;
关键词
Detectors; Training; Feature extraction; Proposals; Avalanche photodiodes; Head; Benchmark testing; Pedestrian detection; occlusion-aware; anchor-free; crowd scenes; VEHICLE;
D O I
10.1109/TITS.2022.3171250
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
Although pedestrian detection has achieved promising performance with the development of deep learning techniques, it remains a great challenge to detect heavily occluded pedestrians in crowd scenes. Therefore, to make the anchor-free network pay more attention to learning the hard examples of occluded pedestrians, we propose a simple but effective Occlusion-aware Anchor-Free Network (namely OAF-Net) for pedestrian detection in crowd scenes. Specifically, we first design a novel occlusion-aware detection head, which includes three separate center prediction branches combining with the scale and offset prediction branches. In the detection head of OAF-Net, occluded pedestrian instances are assigned to the most suitable center prediction branch according to the occlusion level of human body. To optimize the center prediction, we accordingly propose a novel weighted Focal Loss where pedestrian instances are assigned with different weights according to their visibility ratios, so that the occluded pedestrians are up-weighted during the training process. Our OAF-Net is able to model different occlusion levels of pedestrian instances effectively, and can be optimized towards catching a high-level understanding of the hard training samples of occluded pedestrians. Experiments on the challenging CityPersons, Caltech, and CrowdHuman benchmarks sufficiently validate the efficacy of our OAF-Net for pedestrian detection in crowd scenes.
引用
收藏
页码:21291 / 21300
页数:10
相关论文
共 77 条
  • [1] Modeling pedestrian-cyclist interactions in shared space using inverse reinforcement learning
    Alsaleh, Rushdi
    Sayed, Tarek
    [J]. TRANSPORTATION RESEARCH PART F-TRAFFIC PSYCHOLOGY AND BEHAVIOUR, 2020, 70 : 37 - 57
  • [2] [Anonymous], 2016, EUROPEAN C COMPUTER, DOI [DOI 10.1007/978-3-319-46493-0_22, DOI 10.1007/978-3-319-46493-022]
  • [3] [Anonymous], 2018, ARXIV180508688
  • [4] Soft-NMS - Improving Object Detection With One Line of Code
    Bodla, Navaneeth
    Singh, Bharat
    Chellappa, Rama
    Davis, Larry S.
    [J]. 2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, : 5562 - 5570
  • [5] Pedestrian Detection with Autoregressive Network Phases
    Brazil, Garrick
    Liu, Xiaoming
    [J]. 2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 7224 - 7233
  • [6] A New Approach to Urban Pedestrian Detection for Automatic Braking
    Broggi, Alberto
    Cerri, Pietro
    Ghidoni, Stefano
    Grisleri, Paolo
    Jung, Ho Gi
    [J]. IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2009, 10 (04) : 594 - 605
  • [7] Pedestrian Models for Autonomous Driving Part I: Low-Level Models, From Sensing to Tracking
    Camara, Fanta
    Bellotto, Nicola
    Cosar, Serhan
    Nathanael, Dimitris
    Althoff, Matthias
    Wu, Jingyuan
    Ruenz, Johannes
    Dietrich, Andre
    Fox, Charles W.
    [J]. IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2021, 22 (10) : 6131 - 6151
  • [8] Pedestrian Counting With Back-Propagated Information and Target Drift Remedy
    Chen, Ke
    Zhang, Zhaoxiang
    [J]. IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2017, 47 (04): : 639 - 647
  • [9] Deep Neural Network Based Vehicle and Pedestrian Detection for Autonomous Driving: A Survey
    Chen, Long
    Lin, Shaobo
    Lu, Xiankai
    Cao, Dongpu
    Wu, Hangbin
    Guo, Chi
    Liu, Chun
    Wang, Fei-Yue
    [J]. IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2021, 22 (06) : 3234 - 3246
  • [10] Beyond triplet loss: a deep quadruplet network for person re-identification
    Chen, Weihua
    Chen, Xiaotang
    Zhang, Jianguo
    Huang, Kaiqi
    [J]. 30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, : 1320 - 1329