Correlation-and-Correction Fusion Attention Network for Occluded Pedestrian Detection

被引:5
|
作者
Zou, Fengmin [1 ]
Li, Xu [1 ]
Xu, Qimin [1 ]
Sun, Zhengliang [2 ]
Zhu, Jianxiao [1 ]
机构
[1] Southeast Univ, Sch Instrument Sci & Engn, Nanjing 210096, Peoples R China
[2] Minist Publ Secur, Traff Management Res Inst, Wuxi 214151, Peoples R China
基金
中国国家自然科学基金;
关键词
Feature extraction; Correlation; Sensors; Proposals; Fuses; Detectors; Head; Attention mechanism; crowded scenes; feature enhancement; fusion; pedestrian detection; DEEP FEATURES;
D O I
10.1109/JSEN.2023.3242082
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
As a significant issue in computer vision, pedestrian detection has achieved certain achievements with the support of deep learning. However, pedestrian detection in congested scenes still encounters the challenging problem of feature loss and obfuscation. To address the issue, we propose a pedestrian detection network based on a correlation-and-correction fusion attention mechanism. First, a multimask correction attention module is proposed, which generates visible part masks of pedestrians, enhancing the visible region's features and correcting the false one. Besides, the module preserves the features of multiclass pedestrians by generating multiple masks. Then, we fuse a correlation channel attention module to enhance the correlation of various pedestrians' body features. Next, we studied three fusion methods of correlation and correction attention mechanisms and found that the serial connection of "correlation first and correction behind" works best. Finally, we extend our method to multiclass pedestrian detection in congested scenes. Experimental results on the CityPersons, Caltech, and CrowdHuman datasets demonstrate the effectiveness of our method. On the CityPersons dataset where more than 70% of pedestrians are occluded, our method outperforms the baseline method by 1.12% on the heavy occlusion subset and surpasses many outstanding methods.
引用
收藏
页码:6061 / 6073
页数:13
相关论文
共 50 条
  • [1] Key points and visible part fusion attention network for occluded pedestrian detection in traffic environments
    Liu, Peiyu
    Ma, Yixuan
    OPTOELECTRONICS LETTERS, 2024, 20 (07) : 430 - 436
  • [2] Key points and visible part fusion attention network for occluded pedestrian detection in traffic environments
    LIU Peiyu
    MA Yixuan
    Optoelectronics Letters, 2024, 20 (07) : 430 - 436
  • [3] Attention guided neural network models for occluded pedestrian detection
    Zou, Tengtao
    Yang, Shangming
    Zhang, Yun
    Ye, Mao
    PATTERN RECOGNITION LETTERS, 2020, 131 : 91 - 97
  • [4] Mask-Guided Attention Network for Occluded Pedestrian Detection
    Pang, Yanwei
    Xie, Jin
    Khan, Muhammad Haris
    Anwer, Rao Muhammad
    Khan, Fahad Shahbaz
    Shao, Ling
    2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 4966 - 4974
  • [5] Occluded Pedestrian Detection Techniques by Deformable Attention-Guided Network (DAGN)
    Xie, Han
    Zheng, Wenqi
    Shin, Hyunchul
    APPLIED SCIENCES-BASEL, 2021, 11 (13):
  • [6] Occluded Pedestrian Detection Algorithm Based on Attention Mechanism
    Zou Ziyin
    Gai Shaoyan
    Da Feipeng
    Li Yu
    ACTA OPTICA SINICA, 2021, 41 (15)
  • [7] Occluded Pedestrian Detection Through Guided Attention in CNNs
    Zhang, Shanshan
    Yang, Jian
    Schiele, Bernt
    2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, : 6995 - 7003
  • [8] Feature Calibration Network for Occluded Pedestrian Detection
    Zhang, Tianliang
    Ye, Qixiang
    Zhang, Baochang
    Liu, Jianzhuang
    Zhang, Xiaopeng
    Tian, Qi
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2022, 23 (05) : 4151 - 4163
  • [9] PARTS BASED ATTENTION FOR HIGHLY OCCLUDED PEDESTRIAN DETECTION WITH TRANSFORMERS
    Shastry, K. N. Ajay
    Chaudhari, Jayesh
    Thapar, Daksh
    Nigam, Aditya
    Arora, Chetan
    2023 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2023, : 3085 - 3089
  • [10] Pedestrian Detection based on Deep Fusion Network using Feature Correlation
    Lee, Yongwoo
    Bui, Toan Duc
    Shin, Jitae
    2018 ASIA-PACIFIC SIGNAL AND INFORMATION PROCESSING ASSOCIATION ANNUAL SUMMIT AND CONFERENCE (APSIPA ASC), 2018, : 694 - 699