Event-based Extraction of Navigation Features from Unsupervised Learning of Optic Flow Patterns

被引:1
|
作者
Fricker, Paul [1 ,2 ]
Chauhan, Tushar [1 ]
Hurter, Christophe [2 ]
Cottereau, Benoit [1 ]
机构
[1] CNRS, Ctr Rech Cerveau & Cognit, UMR5549, Toulouse, France
[2] Ecole Natl Aviat Civile, Toulouse, France
来源
PROCEEDINGS OF THE 17TH INTERNATIONAL JOINT CONFERENCE ON COMPUTER VISION, IMAGING AND COMPUTER GRAPHICS THEORY AND APPLICATIONS (VISAPP), VOL 5 | 2022年
关键词
Optic Flow; Spiking Neural Network; Unsupervised Learning; STDP; VISION SENSORS; SPIKE; NEURONS; POWER;
D O I
10.5220/0010836200003124
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We developed a Spiking Neural Network composed of two layers that processes event-based data captured by a dynamic vision sensor during navigation conditions. The training of the network was performed using a biologically plausible and unsupervised learning rule, Spike-Timing-Dependent Plasticity. With such an approach, neurons in the network naturally become selective to different components of optic flow, and a simple classifier is able to predict self-motion properties from the neural population output spiking activity. Our network has a simple architecture and a restricted number of neurons. Therefore, it is easy to implement on a neuromorphic chip and could be used for embedded applications necessitating low energy consumption.
引用
收藏
页码:702 / 710
页数:9
相关论文
共 50 条
  • [31] Occlusion Aware Unsupervised Learning of Optical Flow from Video
    Li, Jianfeng
    Zhao, Junqiao
    Song, Shuangfu
    Feng, Tiantian
    THIRTEENTH INTERNATIONAL CONFERENCE ON MACHINE VISION (ICMV 2020), 2021, 11605
  • [32] Spiking Optical Flow for Event-Based Sensors Using IBM's TrueNorth Neurosynaptic System
    Haessig, Germain
    Cassidy, Andrew
    Alvarez, Rodrigo
    Benosman, Ryad
    Orchard, Garrick
    IEEE TRANSACTIONS ON BIOMEDICAL CIRCUITS AND SYSTEMS, 2018, 12 (04) : 860 - 870
  • [33] ETLP: event-based three-factor local plasticity for online learning with neuromorphic hardware
    Quintana, Fernando M.
    Perez-Pena, Fernando
    Galindo, Pedro L.
    Neftci, Emre O.
    Chicca, Elisabetta
    Khacef, Lyes
    NEUROMORPHIC COMPUTING AND ENGINEERING, 2024, 4 (03):
  • [34] Toward Hardware Spiking Neural Networks with Mixed-Signal Event-Based Learning Rules
    Lewden, Pierre
    Vincent, Adrien F.
    Meyer, Charly
    Tomas, Jean
    Saighi, Sylvain
    2020 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2020,
  • [35] Spike Time based Unsupervised Learning of Receptive Fields for Event-Driven Vision
    Akolkar, Himanshu
    Panzeri, Stefano
    Bartolozzi, Chiara
    2015 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), 2015, : 4258 - 4264
  • [36] Model-Based Learning of Local Image Features for Unsupervised Texture Segmentation
    Kiechle, Martin
    Storath, Martin
    Weinmann, Andreas
    Kleinsteuber, Martin
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2018, 27 (04) : 1994 - 2007
  • [37] Unsupervised Learning of Monocular Depth and Ego-Motion with Optical Flow Features and Multiple Constraints
    Zhao, Baigan
    Huang, Yingping
    Ci, Wenyan
    Hu, Xing
    SENSORS, 2022, 22 (04)
  • [38] Combined optic-flow and stereo-based navigation of urban canyons for a UAV
    Hrabar, S
    Sukhatme, GS
    Corke, P
    Usher, K
    Roberts, J
    2005 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS, VOLS 1-4, 2005, : 302 - 309
  • [39] Guidelines for practical navigation systems based on wide-field-integration of optic flow
    Kobayashi, Naoto
    Bando, Mai
    Hokamoto, Shinji
    Kubo, Daisuke
    ASIAN JOURNAL OF CONTROL, 2021, 23 (05) : 2381 - 2392
  • [40] Cognitive navigation based on nonuniform gabor space sampling, unsupervised growing networks, and reinforcement learning
    Arleo, A
    Smeraldi, F
    Gerstner, W
    IEEE TRANSACTIONS ON NEURAL NETWORKS, 2004, 15 (03): : 639 - 652