Spiking Neural Networks for Object Detection Based on Integrating Neuronal Variants and Self-Attention Mechanisms

被引:0
作者
Li, Weixuan [1 ]
Zhao, Jinxiu [1 ]
Su, Li [1 ]
Jiang, Na [1 ]
Hu, Quan [2 ]
机构
[1] Capital Normal Univ, Sch Informat Engn, Beijing 100048, Peoples R China
[2] Beijing Inst Technol, Sch Aerosp Engn, Beijing 100081, Peoples R China
来源
APPLIED SCIENCES-BASEL | 2024年 / 14卷 / 20期
基金
北京市自然科学基金; 中国国家自然科学基金;
关键词
object detection; spiking neural networks; neuronal variants; attention mechanism; MODEL;
D O I
10.3390/app14209607
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
Thanks to their event-driven asynchronous computing capabilities and low power consumption advantages, spiking neural networks (SNNs) show significant potential for computer vision tasks, especially in object detection. However, effective training methods and optimization mechanisms for SNNs remain underexplored. This study proposes two high accuracy SNNs for object detection, AMS_YOLO and AMSpiking_VGG, integrating neuronal variants and attention mechanisms. To enhance these proposed networks, we explore the impact of incorporating different neuronal variants.The results show that the optimization in the SNN's structure with neuronal variants outperforms that in the attention mechanism for object detection. Compared to the state-of-the-art in the current SNNs, AMS_YOLO improved by 6.7% in accuracy on the static dataset COCO2017, and AMS_Spiking has improved by 11.4% on the dynamic dataset GEN1.
引用
收藏
页数:13
相关论文
共 50 条
  • [1] Adaptive Feature Self-Attention in Spiking Neural Networks for Hyperspectral Classification
    Li, Heng
    Tu, Bing
    Liu, Bo
    Li, Jun
    Plaza, Antonio
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2025, 63
  • [2] 3D Object Detection Based on Voxel Self-Attention Auxiliary Networks
    Cao, Jie
    Peng, Yiqiang
    Fan, Likang
    Wang, Longfei
    LASER & OPTOELECTRONICS PROGRESS, 2024, 61 (24)
  • [3] Sampling Equivariant Self-Attention Networks for Object Detection in Aerial Images
    Yang, Guo-Ye
    Li, Xiang-Li
    Xiao, Zi-Kai
    Mu, Tai-Jiang
    Martin, Ralph R.
    Hu, Shi-Min
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2023, 32 : 6413 - 6425
  • [4] Rethinking Self-Attention for Multispectral Object Detection
    Hu, Sijie
    Bonardi, Fabien
    Bouchafa, Samia
    Prendinger, Helmut
    Sidibe, Desire
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2024, 25 (11) : 16300 - 16311
  • [5] YOLO-SA: An Efficient Object Detection Model Based on Self-attention Mechanism
    Li, Ang
    Song, Xiangyu
    Sun, ShiJie
    Zhang, Zhaoyang
    Cai, Taotao
    Song, Huansheng
    WEB AND BIG DATA, PT IV, APWEB-WAIM 2023, 2024, 14334 : 1 - 15
  • [6] Object Detection Algorithm Based on Context Information and Self-Attention Mechanism
    Liang, Hong
    Zhou, Hui
    Zhang, Qian
    Wu, Ting
    SYMMETRY-BASEL, 2022, 14 (05):
  • [7] Object Detection with Spiking Neural Networks on Automotive Event Data
    Cordone, Loic
    Miramond, Benoit
    Thierion, Philippe
    2022 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2022,
  • [8] Event-Based Spiking Neural Networks for Object Detection: A Review of Datasets, Architectures, Learning Rules, and Implementation
    Iaboni, Craig
    Abichandani, Pramod
    IEEE ACCESS, 2024, 12 : 180532 - 180596
  • [9] Progressive Domain Adaptive Object Detection Based on Self-Attention in Foggy Weather
    Lin, Meng
    Zhou, Gang
    Yang, Yawei
    Shi, Jun
    IEEJ TRANSACTIONS ON ELECTRICAL AND ELECTRONIC ENGINEERING, 2023, 18 (12) : 1923 - 1931
  • [10] Object Detection Model Based on Scene-Level Region Proposal Self-Attention
    Quan, Yu
    Li, Zhixin
    Zhang, Canlong
    Ma, Huifang
    2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, : 954 - 961