Bio-Inspired Stereo Vision Calibration for Dynamic Vision Sensors

被引:29
作者
Dominguez-Morales, Manuel J. [1 ]
Jimenez-Fernandez, Angel [1 ]
Jimenez-Moreno, Gabriel [1 ]
Conde, Cristina [2 ]
Cabello, Enrique [2 ]
Linares-Barranco, Alejandro [1 ]
机构
[1] Univ Seville, ETS Ingn Informat, Robot & Comp Technol Lab RTC, E-41012 Seville, Spain
[2] Rey Juan Carlos Univ, Face Recognit & Artificial Vis Grp FRAV, Madrid 28933, Spain
关键词
Neuromorphic engineering; dynamic vision sensor; bio-inspired systems; stereo vision; calibration; CAMERA CALIBRATION; 3D RECONSTRUCTION; MULTIPLE OBJECTS; MODELS; TRACKING; FLOW;
D O I
10.1109/ACCESS.2019.2943160
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Many advances have been made in the field of computer vision. Several recent research trends have focused on mimicking human vision by using a stereo vision system. In multi-camera systems, a calibration process is usually implemented to improve the results accuracy. However, these systems generate a large amount of data to be processed; therefore, a powerful computer is required and, in many cases, this cannot be done in real time. Neuromorphic Engineering attempts to create bio-inspired systems that mimic the information processing that takes place in the human brain. This information is encoded using pulses (or spikes) and the generated systems are much simpler (in computational operations and resources), which allows them to perform similar tasks with much lower power consumption, thus these processes can be developed over specialized hardware with real-time processing. In this work, a bio-inspired stereo-vision system is presented, where a calibration mechanism for this system is implemented and evaluated using several tests. The result is a novel calibration technique for a neuromorphic stereo vision system, implemented over specialized hardware (FPGA - Field-Programmable Gate Array), which allows obtaining reduced latencies on hardware implementation for stand-alone systems, and working in real time.
引用
收藏
页码:138415 / 138425
页数:11
相关论文
共 58 条
[1]  
Ahmed M. T., 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision, P463, DOI 10.1109/ICCV.1999.791257
[2]   True North: Design and Tool Flow of a 65 mW 1 Million Neuron Programmable Neurosynaptic Chip [J].
Akopyan, Filipp ;
Sawada, Jun ;
Cassidy, Andrew ;
Alvarez-Icaza, Rodrigo ;
Arthur, John ;
Merolla, Paul ;
Imam, Nabil ;
Nakamura, Yutaka ;
Datta, Pallab ;
Nam, Gi-Joon ;
Taba, Brian ;
Beakes, Michael ;
Brezzo, Bernard ;
Kuang, Jente B. ;
Manohar, Rajit ;
Risk, William P. ;
Jackson, Bryan ;
Modha, Dharmendra S. .
IEEE TRANSACTIONS ON COMPUTER-AIDED DESIGN OF INTEGRATED CIRCUITS AND SYSTEMS, 2015, 34 (10) :1537-1557
[3]   A Low Power, High Throughput, Fully Event-Based Stereo System [J].
Andreopoulos, Alexander ;
Kashyap, Hirak J. ;
Nayak, Tapan K. ;
Amir, Arnon ;
Flickner, Myron D. .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :7532-7542
[4]  
[Anonymous], 1991, THESIS
[5]   3D Reconstruction and Restoration Monitoring of Sculptural Artworks by a Multi-Sensor Framework [J].
Barone, Sandro ;
Paoli, Alessandro ;
Razionale, Armando Viviano .
SENSORS, 2012, 12 (12) :16785-16801
[6]   Iterative multistep explicit camera calibration [J].
Batista, J ;
Araújo, H ;
de Almeida, AT .
IEEE TRANSACTIONS ON ROBOTICS AND AUTOMATION, 1999, 15 (05) :897-917
[7]   A 5 meps $100 USB2.0 address-event monitor-sequencer interface [J].
Berner, R. ;
Delbruck, T. ;
Civit-Balcells, A. ;
Linares-Barranco, A. .
2007 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS, VOLS 1-11, 2007, :2451-+
[8]  
Black J, 2002, IEEE WORKSHOP ON MOTION AND VIDEO COMPUTING (MOTION 2002), PROCEEDINGS, P169, DOI 10.1109/MOTION.2002.1182230
[9]   Event-Driven Stereo Visual Tracking Algorithm to Solve Object Occlusion [J].
Camunas-Mesa, Luis A. ;
Serrano-Gotarredona, Teresa ;
Ieng, Sio-Hoi ;
Benosman, Ryad ;
Linares-Barranco, Bernabe .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2018, 29 (09) :4223-4237
[10]   A Configurable Event-Driven Convolutional Node with Rate Saturation Mechanism for Modular ConvNet Systems Implementation [J].
Camunas-Mesa, Luis A. ;
Dominguez-Cordero, Yaisel L. ;
Linares-Barranco, Alejandro ;
Serrano-Gotarredona, Teresa ;
Linares-Barranco, Bernabe .
FRONTIERS IN NEUROSCIENCE, 2018, 12