Event-based Extraction of Navigation Features from Unsupervised Learning of Optic Flow Patterns

被引:1
|
作者
Fricker, Paul [1 ,2 ]
Chauhan, Tushar [1 ]
Hurter, Christophe [2 ]
Cottereau, Benoit [1 ]
机构
[1] CNRS, Ctr Rech Cerveau & Cognit, UMR5549, Toulouse, France
[2] Ecole Natl Aviat Civile, Toulouse, France
来源
PROCEEDINGS OF THE 17TH INTERNATIONAL JOINT CONFERENCE ON COMPUTER VISION, IMAGING AND COMPUTER GRAPHICS THEORY AND APPLICATIONS (VISAPP), VOL 5 | 2022年
关键词
Optic Flow; Spiking Neural Network; Unsupervised Learning; STDP; VISION SENSORS; SPIKE; NEURONS; POWER;
D O I
10.5220/0010836200003124
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We developed a Spiking Neural Network composed of two layers that processes event-based data captured by a dynamic vision sensor during navigation conditions. The training of the network was performed using a biologically plausible and unsupervised learning rule, Spike-Timing-Dependent Plasticity. With such an approach, neurons in the network naturally become selective to different components of optic flow, and a simple classifier is able to predict self-motion properties from the neural population output spiking activity. Our network has a simple architecture and a restricted number of neurons. Therefore, it is easy to implement on a neuromorphic chip and could be used for embedded applications necessitating low energy consumption.
引用
收藏
页码:702 / 710
页数:9
相关论文
共 50 条
  • [1] Event-Based, Timescale Invariant Unsupervised Online Deep Learning With STDP
    Thiele, Johannes C.
    Bichler, Olivier
    Dupret, Antoine
    FRONTIERS IN COMPUTATIONAL NEUROSCIENCE, 2018, 12
  • [2] Unsupervised Learning of Dense Optical Flow, Depth and Egomotion with Event-Based Sensors
    Ye, Chengxi
    Mitrokhin, Anton
    Fermuller, Cornelia
    Yorke, James A.
    Aloimonos, Yiannis
    2020 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2020, : 5831 - 5838
  • [3] Unsupervised Learning of Spatio-Temporal Receptive Fields from an Event-Based Vision Sensor
    Barbier, Thomas
    Teuliere, Celine
    Triesch, Jochen
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING, ICANN 2020, PT II, 2020, 12397 : 622 - 633
  • [4] Unsupervised Event-Based Optical Flow Using Motion Compensation
    Zhu, Alex Zihao
    Yuan, Liangzhe
    Chaney, Kenneth
    Daniilidis, Kostas
    COMPUTER VISION - ECCV 2018 WORKSHOPS, PT VI, 2019, 11134 : 711 - 714
  • [5] Representation learning using event-based STDP
    Tavanaei, Amirhossein
    Masquelier, Timothee
    Maida, Anthony
    NEURAL NETWORKS, 2018, 105 : 294 - 303
  • [6] Time-series event-based prediction: An unsupervised learning framework based on genetic programming
    Kattan, Ahmed
    Fatima, Shaheen
    Arif, Muhammad
    INFORMATION SCIENCES, 2015, 301 : 99 - 123
  • [7] SPEED: Spiking Neural Network With Event-Driven Unsupervised Learning and Near-Real-Time Inference for Event-Based Vision
    She, Xueyuan
    Mukhopadhyay, Saibal
    IEEE SENSORS JOURNAL, 2021, 21 (18) : 20578 - 20588
  • [8] On event-based optical flow detection
    Brosch, Tobias
    Tschechne, Stephan
    Neumann, Heiko
    FRONTIERS IN NEUROSCIENCE, 2015, 9
  • [9] Optical flow estimation from event-based cameras and spiking neural networks
    Cuadrado, Javier
    Rancon, Ulysse
    Cottereau, Benoit R.
    Barranco, Francisco
    Masquelier, Timothee
    FRONTIERS IN NEUROSCIENCE, 2023, 17
  • [10] Unsupervised Learning of a Hierarchical Spiking Neural Network for Optical Flow Estimation: From Events to Global Motion Perception
    Paredes-Valles, Federico
    Scheper, Kirk Y. W.
    de Croon, Guido C. H. E.
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2020, 42 (08) : 2051 - 2064