A Novel Visible Light Positioning System With Event-Based Neuromorphic Vision Sensor

被引:33
|
作者
Chen, Guang [1 ,2 ]
Chen, Wenkai [3 ]
Yang, Qianyi [1 ]
Xu, Zhongcong [1 ]
Yang, Longyu [1 ]
Conradt, Jorg [4 ]
Knoll, Alois [2 ]
机构
[1] Tongji Univ, Sch Automot Studies, Shanghai 201804, Peoples R China
[2] Tech Univ Munich, Chair Robot Artificial Intelligence & Real Time S, D-85748 Munich, Germany
[3] Shanghai Jiao Tong Univ, Sch Mech Engn, Shanghai 200240, Peoples R China
[4] KTH Royal Inst Technol, S-10044 Stockholm, Sweden
关键词
Cameras; Light emitting diodes; Sensors; Radar tracking; Receivers; Satellite broadcasting; Visible light communication; Indoor localization; event camera; visible lighting positioning; GM-PHD filter; TRACKING; MIXTURE; LOCALIZATION;
D O I
10.1109/JSEN.2020.2990752
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
With the advanced development of image processing technology, visible light positioning (VLP) system based on image sensors has attracted more and more attention. However, as a commonly used light receiver, traditional CMOS camera has limited dynamic range and high latency, which is susceptible to various lighting and environmental factors. Moreover, high computational cost from image processing is unavoidable for most of visible light positioning systems. In our work, a novel VLP system using an event-based neuromorphic vision sensor (event camera) as the light receiver is proposed. Due to the low latency and microsecond-level temporal resolution of the event camera, our VLP system is able to identify multiple high-frequency flickering LEDs in asynchronous events simultaneously leaving out the need for data association and traditional image processing methods. A multi-LED fusion method is applied and a high positioning accuracy of 3cm is achieved when the height between LEDs and the event camera is within 1m.
引用
收藏
页码:10211 / 10219
页数:9
相关论文
共 50 条
  • [1] A Novel Illumination-Robust Hand Gesture Recognition System With Event-Based Neuromorphic Vision Sensor
    Chen, Guang
    Xu, Zhongcong
    Li, Zhijun
    Tang, Huajin
    Qu, Sanqing
    Ren, Kejia
    Knoll, Alois
    IEEE TRANSACTIONS ON AUTOMATION SCIENCE AND ENGINEERING, 2021, 18 (02) : 508 - 520
  • [2] Event-based Image Processing using a Neuromorphic Vision Sensor
    Garcia Franco, Jesus Armando
    del Valle Padilla, Juan Luis
    Ortega Cisneros, Susana
    2013 IEEE INTERNATIONAL AUTUMN MEETING ON POWER, ELECTRONICS AND COMPUTING (ROPEC), 2013,
  • [3] NeuroBiometric: An Eye Blink Based Biometric Authentication System Using an Event-Based Neuromorphic Vision Sensor
    Guang Chen
    Fa Wang
    Xiaoding Yuan
    Zhijun Li
    Zichen Liang
    Alois Knoll
    IEEE/CAAJournalofAutomaticaSinica, 2021, 8 (01) : 206 - 218
  • [4] NeuroBiometric: An Eye Blink Based Biometric Authentication System Using an Event-Based Neuromorphic Vision Sensor
    Chen, Guang
    Wang, Fa
    Yuan, Xiaoding
    Li, Zhijun
    Liang, Zichen
    Knoll, Alois
    IEEE-CAA JOURNAL OF AUTOMATICA SINICA, 2021, 8 (01) : 206 - 218
  • [5] Event-Based Robotic Grasping Detection With Neuromorphic Vision Sensor and Event-Grasping Dataset
    Li, Bin
    Cao, Hu
    Qu, Zhongnan
    Hu, Yingbai
    Wang, Zhenke
    Liang, Zichen
    FRONTIERS IN NEUROROBOTICS, 2020, 14 (14):
  • [6] Neuromorphic vision: From sensors to event-based algorithms
    Lakshmi, Annamalai
    Chakraborty, Anirban
    Thakur, Chetan S.
    WILEY INTERDISCIPLINARY REVIEWS-DATA MINING AND KNOWLEDGE DISCOVERY, 2019, 9 (04)
  • [7] A Novel Sensor Fusion Based Indoor Visible Light Positioning System
    Zhang, Ran
    Zhong, Wen-De
    Wu, Dehao
    Qian Kemao
    2016 IEEE GLOBECOM WORKSHOPS (GC WKSHPS), 2016,
  • [8] Mixed Event-Frame Vision System for Daytime Preceding Vehicle Taillight Signal Measurement Using Event-Based Neuromorphic Vision Sensor
    Liu, Zhengfa
    Chen, Guang
    Wu, Ya
    Du, Jiatong
    Conradt, Jorg
    Knoll, Alois
    JOURNAL OF ADVANCED TRANSPORTATION, 2022, 2022
  • [9] EDDD: Event-Based Drowsiness Driving Detection Through Facial Motion Analysis With Neuromorphic Vision Sensor
    Chen, Guang
    Hong, Lin
    Dong, Jinhu
    Liu, Peigen
    Conradt, Joerg
    Knoll, Alois
    IEEE SENSORS JOURNAL, 2020, 20 (11) : 6170 - 6181
  • [10] Identifying Light Interference in Event-Based Vision
    Shi, Chenyang
    Li, Yuzhen
    Song, Ningfang
    Wei, Boyi
    Zhang, Yibo
    Li, Wenzhuo
    Jin, Jing
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34 (06) : 4800 - 4816