Spiking Neural Networks for Object Detection Based on Integrating Neuronal Variants and Self-Attention Mechanisms

被引:1
作者
Li, Weixuan [1 ]
Zhao, Jinxiu [1 ]
Su, Li [1 ]
Jiang, Na [1 ]
Hu, Quan [2 ]
机构
[1] Capital Normal Univ, Sch Informat Engn, Beijing 100048, Peoples R China
[2] Beijing Inst Technol, Sch Aerosp Engn, Beijing 100081, Peoples R China
来源
APPLIED SCIENCES-BASEL | 2024年 / 14卷 / 20期
基金
中国国家自然科学基金; 北京市自然科学基金;
关键词
object detection; spiking neural networks; neuronal variants; attention mechanism; MODEL;
D O I
10.3390/app14209607
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
Thanks to their event-driven asynchronous computing capabilities and low power consumption advantages, spiking neural networks (SNNs) show significant potential for computer vision tasks, especially in object detection. However, effective training methods and optimization mechanisms for SNNs remain underexplored. This study proposes two high accuracy SNNs for object detection, AMS_YOLO and AMSpiking_VGG, integrating neuronal variants and attention mechanisms. To enhance these proposed networks, we explore the impact of incorporating different neuronal variants.The results show that the optimization in the SNN's structure with neuronal variants outperforms that in the attention mechanism for object detection. Compared to the state-of-the-art in the current SNNs, AMS_YOLO improved by 6.7% in accuracy on the static dataset COCO2017, and AMS_Spiking has improved by 11.4% on the dynamic dataset GEN1.
引用
收藏
页数:13
相关论文
共 50 条
[21]   Deep Directly-Trained Spiking Neural Networks for Object Detection [J].
Su, Qiaoyi ;
Chou, Yuhong ;
Hu, Yifan ;
Li, Jianing ;
Mei, Shijie ;
Zhang, Ziyang ;
Li, Guoqi .
2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION, ICCV, 2023, :6532-6542
[22]   Tensor decomposition based attention module for spiking neural networks [J].
Deng, Haoyu ;
Zhu, Ruijie ;
Qiu, Xuerui ;
Duan, Yule ;
Zhang, Malu ;
Deng, Liang-Jian .
KNOWLEDGE-BASED SYSTEMS, 2024, 295
[23]   Dual-Mode Serial Night Road Object Detection Model Based on Depthwise Separable and Self-Attention Mechanism [J].
Yang, Qin ;
Ma, Yahong ;
Li, Linsen ;
Zhao, Zeyu .
IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2024, 73 :1-9
[24]   Visual vs internal attention mechanisms in deep neural networks for image classification and object detection [J].
Obeso, Abraham Montoya ;
Benois-Pineau, Jenny ;
Vazquez, Mireya Sarai Garcia ;
Acosta, Alejandro Alvaro Ramirez .
PATTERN RECOGNITION, 2022, 123
[25]   Spiking Neural Network for Object Detection Based on Dual Error [J].
Liu, Wei ;
Li, Wenjuan ;
Gao, Jin ;
Li, Liang .
JOURNAL OF ELECTRONICS & INFORMATION TECHNOLOGY, 2023, 45 (12) :4469-4476
[26]   Improving Object Detection Quality by Incorporating Global Contexts via Self-Attention [J].
Lee, Donghyeon ;
Kim, Joonyoung ;
Jung, Kyomin .
ELECTRONICS, 2021, 10 (01) :1-15
[27]   STCA-SNN: self-attention-based temporal-channel joint attention for spiking neural networks [J].
Wu, Xiyan ;
Song, Yong ;
Zhou, Ya ;
Jiang, Yurong ;
Bai, Yashuo ;
Li, Xinyi ;
Yang, Xin .
FRONTIERS IN NEUROSCIENCE, 2023, 17
[28]   Convolutional Recurrent Neural Networks with a Self-Attention Mechanism for Personnel Performance Prediction [J].
Xue, Xia ;
Feng, Jun ;
Gao, Yi ;
Liu, Meng ;
Zhang, Wenyu ;
Sun, Xia ;
Zhao, Aiqi ;
Guo, Shouxi .
ENTROPY, 2019, 21 (12)
[29]   An Investigation on Spiking Neural Networks Based on the Izhikevich Neuronal Model: Spiking Processing and Hardware Approach [J].
Alkabaa, Abdulaziz S. ;
Taylan, Osman ;
Yilmaz, Mustafa Tahsin ;
Nazemi, Ehsan ;
Kalmoun, El Mostafa .
MATHEMATICS, 2022, 10 (04)
[30]   A Lightweight Object Detector Based on Spatial-Coordinate Self-Attention for UAV Aerial Images [J].
Liu, Chen ;
Yang, Degang ;
Tang, Liu ;
Zhou, Xun ;
Deng, Yi .
REMOTE SENSING, 2023, 15 (01)