Event-based Extraction of Navigation Features from Unsupervised Learning of Optic Flow Patterns

被引:1
|
作者
Fricker, Paul [1 ,2 ]
Chauhan, Tushar [1 ]
Hurter, Christophe [2 ]
Cottereau, Benoit [1 ]
机构
[1] CNRS, Ctr Rech Cerveau & Cognit, UMR5549, Toulouse, France
[2] Ecole Natl Aviat Civile, Toulouse, France
来源
PROCEEDINGS OF THE 17TH INTERNATIONAL JOINT CONFERENCE ON COMPUTER VISION, IMAGING AND COMPUTER GRAPHICS THEORY AND APPLICATIONS (VISAPP), VOL 5 | 2022年
关键词
Optic Flow; Spiking Neural Network; Unsupervised Learning; STDP; VISION SENSORS; SPIKE; NEURONS; POWER;
D O I
10.5220/0010836200003124
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We developed a Spiking Neural Network composed of two layers that processes event-based data captured by a dynamic vision sensor during navigation conditions. The training of the network was performed using a biologically plausible and unsupervised learning rule, Spike-Timing-Dependent Plasticity. With such an approach, neurons in the network naturally become selective to different components of optic flow, and a simple classifier is able to predict self-motion properties from the neural population output spiking activity. Our network has a simple architecture and a restricted number of neurons. Therefore, it is easy to implement on a neuromorphic chip and could be used for embedded applications necessitating low energy consumption.
引用
收藏
页码:702 / 710
页数:9
相关论文
共 50 条
  • [41] Unsupervised Learning of Deep-Learned Features from Breast Cancer Images
    Lee, Sanghoon
    Farley, Colton
    Shim, Simon
    Yoo, Wook-Sung
    Zhao, Yanjun
    Choi, Wookjin
    2020 IEEE 20TH INTERNATIONAL CONFERENCE ON BIOINFORMATICS AND BIOENGINEERING (BIBE 2020), 2020, : 740 - 745
  • [42] Unsupervised Learning of Optical Flow With Non-Occlusion From Geometry
    Wang, Guangming
    Ren, Shuaiqi
    Wang, Hesheng
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2022, 23 (11) : 20850 - 20859
  • [43] Unsupervised learning for feature projection: Extracting patterns from multidimensional building measurements
    Xiao, Chunze
    Khayatian, Fazel
    Dall'O, Giuliano
    ENERGY AND BUILDINGS, 2020, 224 (224)
  • [44] Learning novel mappings from optic flow to the control of action
    Fajen, Brett R.
    JOURNAL OF VISION, 2008, 8 (11):
  • [45] Event-Based Optical Flow Estimation with Spatio-Temporal Backpropagation Trained Spiking Neural Network
    Zhang, Yisa
    Lv, Hengyi
    Zhao, Yuchen
    Feng, Yang
    Liu, Hailong
    Bi, Guoling
    MICROMACHINES, 2023, 14 (01)
  • [46] Inter-spectral contrast learning based unsupervised feature extraction for hyperspectral images
    Hang R.
    Li C.
    Liu Q.
    Cehui Xuebao/Acta Geodaetica et Cartographica Sinica, 2023, 52 (07): : 1164 - 1174
  • [47] MREIFlow: Unsupervised dense and time-continuous optical flow estimation from and event data
    Hu, Jianlang
    Guo, Chi
    Luo, Yarong
    Mao, Zihao
    INFORMATION FUSION, 2025, 113
  • [48] Unsupervised Tensor Based Feature Extraction From Multivariate Time Series
    Matsue, Kiyotaka
    Sugiyama, Mahito
    IEEE ACCESS, 2023, 11 : 116277 - 116295
  • [49] Unsupervised phase learning and extraction from quasiperiodic multidimensional time-series data
    Jatesiktat, Prayook
    Lim, Guan Ming
    Kuah, Christopher Wee Keong
    Ang, Wei Tech
    APPLIED SOFT COMPUTING, 2020, 93
  • [50] All-In-One Hardware Devices with Event-Based Vision Sensor Arrays for Image Sensing, Computing, and Learning
    Zhang, Sen
    Xiao, Pingdan
    Hong, Xitong
    Hong, Ruohao
    Liu, Chang
    Tian, Qianlei
    Su, Wanhan
    Ma, Chao
    Liu, Xingqiang
    Li, Kenli
    Ho, Johnny C.
    Lv, Yawei
    Hong, Qinghui
    Liao, Lei
    Zou, Xuming
    ADVANCED FUNCTIONAL MATERIALS, 2023, 33 (44)