Multi-functional Smart E-Glasses for Vision-Based Indoor Navigation

被引：1
作者：
Xu, Jiaqi [1 ]
Xia, Haisheng [1 ,2 ]
Liu, Yueyue [3 ]
Li, Zhijun [1 ,2 ]
机构：
[1] Univ Sci & Technol China, Dept Automat, Hefei 230026, Peoples R China
[2] Hefei Comprehens Natl Sci Ctr, Inst Artificial Intelligence, Hefei, Peoples R China
[3] South China Univ Technol, Coll Automat Sci & Engn, Guangzhou 510641, Peoples R China
来源：
2021 6TH IEEE INTERNATIONAL CONFERENCE ON ADVANCED ROBOTICS AND MECHATRONICS (ICARM 2021) | 2021年
基金：
中国博士后科学基金;
关键词：
SLAM; object detection; wearable vision-based system; SYSTEM; ROBOT;
D O I：
10.1109/ICARM52023.2021.9536084
中图分类号：
TP [自动化技术、计算机技术];
学科分类号：
0812 ;
摘要：
Wearable sensing and feedback device could provide useful information for the people with visual impairments. In this paper, we develop a real-time, multifunctional electronic eyeglasses (E-Glasses) for vision-based indoor navigation. Our proposed E-glasses has two main functions, which are indoor navigation through navigation algorithm, and object of interest detection through deep learning technology. The safe motion trajectory and the object information are summarized and feedback will be given to the people with visual impairments. The system can run at 39 fps and achieve mean average precision of 84.77% in the test set of images we collected. Detailed experiments of "Navigation" and "Find the target" had an overall success rate above 91%, demonstrating the feasibility of E-Glasses.
引用
收藏
页码：267 / 272
页数：6
相关论文
共 22 条
  • [1] Baskaran H, 2019, 2019 IEEE 4TH INTERNATIONAL CONFERENCE ON COMPUTER AND COMMUNICATION SYSTEMS (ICCCS 2019), P730, DOI 10.1109/CCOMS.2019.8821635
  • [2] Enhancing perception for the visually impaired with deep learning techniques and low-cost wearable sensors
    Bauer, Zuria
    Dominguez, Alejandro
    Cruz, Edmanuel
    Gomez-Donoso, Francisco
    Orts-Escolano, Sergio
    Cazorla, Miguel
    [J]. PATTERN RECOGNITION LETTERS, 2020, 137 : 27 - 36
  • [3] YOLOv4-5D: An Effective and Efficient Object Detector for Autonomous Driving
    Cai, Yingfeng
    Luan, Tianyu
    Gao, Hongbo
    Wang, Hai
    Chen, Long
    Li, Yicheng
    Sotelo, Miguel Angel
    Li, Zhixiong
    [J]. IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2021, 70
  • [4] Cosgun A, 2014, IEEE INT CONF ROBOT, P6350, DOI 10.1109/ICRA.2014.6907796
  • [5] A Deep-learning-based Floor Detection System for the Visually Impaired
    Delahoz, Yueng
    Labrador, Miguel A.
    [J]. 2017 IEEE 15TH INTL CONF ON DEPENDABLE, AUTONOMIC AND SECURE COMPUTING, 15TH INTL CONF ON PERVASIVE INTELLIGENCE AND COMPUTING, 3RD INTL CONF ON BIG DATA INTELLIGENCE AND COMPUTING AND CYBER SCIENCE AND TECHNOLOGY CONGRESS(DASC/PICOM/DATACOM/CYBERSCI, 2017, : 883 - 888
  • [6] The Pascal Visual Object Classes (VOC) Challenge
    Everingham, Mark
    Van Gool, Luc
    Williams, Christopher K. I.
    Winn, John
    Zisserman, Andrew
    [J]. INTERNATIONAL JOURNAL OF COMPUTER VISION, 2010, 88 (02) : 303 - 338
  • [7] Searching for MobileNetV3
    Howard, Andrew
    Sandler, Mark
    Chu, Grace
    Chen, Liang-Chieh
    Chen, Bo
    Tan, Mingxing
    Wang, Weijun
    Zhu, Yukun
    Pang, Ruoming
    Vasudevan, Vijay
    Le, Quoc V.
    Adam, Hartwig
    [J]. 2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 1314 - 1324
  • [8] Hsueh-Cheng Wang, 2017, 2017 IEEE International Conference on Robotics and Automation (ICRA), P6533, DOI 10.1109/ICRA.2017.7989772
  • [9] Cubemap-Based Perception-Driven Blind Quality Assessment for 360-degree Images
    Jiang, Hao
    Jiang, Gangyi
    Yu, Mei
    Zhang, Yun
    Yang, You
    Peng, Zongju
    Chen, Fen
    Zhang, Qingbo
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 : 2364 - 2377
  • [10] Wearable RGBD Indoor Navigation System for the Blind
    Lee, Young Hoon
    Medioni, Gerard
    [J]. COMPUTER VISION - ECCV 2014 WORKSHOPS, PT III, 2015, 8927 : 493 - 508
123