SpikiLi: A Spiking Simulation of LiDAR based Real-time Object Detection for Autonomous Driving

被引:1
作者
Mohapatra, Sambit [1 ]
Mesquida, Thomas [2 ]
Hodaei, Mona [1 ]
Yogamani, Senthil [3 ]
Gotzig, Heinrich [1 ]
Maeder, Patrick [4 ]
机构
[1] Valeo, Erlangen, Germany
[2] CEA List, Paris, France
[3] Valeo, Tuam, Ireland
[4] TU Ilmenau, Ilmenau, Germany
来源
2022 8TH INTERNATIONAL CONFERENCE ON EVENT-BASED CONTROL, COMMUNICATION AND SIGNAL PROCESSING (EBCCSP 2022) | 2022年
关键词
Spiking Neural Networks; LiDAR; Object Detection; Neuromorphic Computing; Event Based Signal Processing; NETWORKS; VISION;
D O I
10.1109/EBCCSP56922.2022.9845647
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Spiking Neural Networks are a recent and new neural network design approach that promises tremendous improvements in power efficiency, computation efficiency, and processing latency. They do so by using asynchronous spike-based data flow, event-based signal generation, processing, and modifying the neuron model to resemble biological neurons closely. While some initial works have shown significant initial evidence of applicability to common deep learning tasks, their applications in complex real-world tasks have been relatively low. In this work, we first illustrate the applicability of spiking neural networks to a complex deep learning task, namely LiDAR based 3D object detection for automated driving. Secondly, we make a step-by-step demonstration of simulating spiking behavior using a pre-trained Convolutional Neural Network. We closely model essential aspects of spiking neural networks in simulation and achieve equivalent run-time and accuracy on a GPU. We expect significant improvements in power efficiency when the model is implemented on neuromorphic hardware.
引用
收藏
页数:5
相关论文
共 63 条
[1]   The impulses produced by sensory nerve endings. Part I. [J].
Adrian, ED .
JOURNAL OF PHYSIOLOGY-LONDON, 1926, 61 (01) :49-72
[2]   True North: Design and Tool Flow of a 65 mW 1 Million Neuron Programmable Neurosynaptic Chip [J].
Akopyan, Filipp ;
Sawada, Jun ;
Cassidy, Andrew ;
Alvarez-Icaza, Rodrigo ;
Arthur, John ;
Merolla, Paul ;
Imam, Nabil ;
Nakamura, Yutaka ;
Datta, Pallab ;
Nam, Gi-Joon ;
Taba, Brian ;
Beakes, Michael ;
Brezzo, Bernard ;
Kuang, Jente B. ;
Manohar, Rajit ;
Risk, William P. ;
Jackson, Bryan ;
Modha, Dharmendra S. .
IEEE TRANSACTIONS ON COMPUTER-AIDED DESIGN OF INTEGRATED CIRCUITS AND SYSTEMS, 2015, 34 (10) :1537-1557
[3]  
[Anonymous], 1988, P 1988 CONNECTIONIST
[4]  
Butts DA, 2007, NATURE, V449, P92, DOI [10.1038/nature06105, 10.1038/natureO6105]
[5]   Asynchronous Convolutional Networks for Object Detection in Neuromorphic Cameras [J].
Cannici, Marco ;
Ciccone, Marco ;
Romanoni, Andrea ;
Matteucci, Matteo .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW 2019), 2019, :1656-1665
[6]  
Cheke R., 2022, ELECT IMAGING AUTONO
[7]  
Chennupati S, 2019, Arxiv, DOI arXiv:1901.05808
[8]  
Dahal A., 2021, Electronic Imaging
[9]  
Dahal A, 2022, Arxiv, DOI arXiv:2105.12763
[10]   TiledSoilingNet: Tile-level Soiling Detection on Automotive Surround-view Cameras Using Coverage Metric [J].
Das, Arindam ;
Krizek, Pavel ;
Sistu, Ganesh ;
Buerger, Fabian ;
Madasamy, Sankaralingam ;
Uricar, Michal ;
Kumar, Varun Ravi ;
Yogamani, Senthil .
2020 IEEE 23RD INTERNATIONAL CONFERENCE ON INTELLIGENT TRANSPORTATION SYSTEMS (ITSC), 2020,