Multi-functional Smart E-Glasses for Vision-Based Indoor Navigation

被引：1
作者：
Xu, Jiaqi [1 ]
Xia, Haisheng [1 ,2 ]
Liu, Yueyue [3 ]
Li, Zhijun [1 ,2 ]
机构：
[1] Univ Sci & Technol China, Dept Automat, Hefei 230026, Peoples R China
[2] Hefei Comprehens Natl Sci Ctr, Inst Artificial Intelligence, Hefei, Peoples R China
[3] South China Univ Technol, Coll Automat Sci & Engn, Guangzhou 510641, Peoples R China
来源：
2021 6TH IEEE INTERNATIONAL CONFERENCE ON ADVANCED ROBOTICS AND MECHATRONICS (ICARM 2021) | 2021年
基金：
中国博士后科学基金;
关键词：
SLAM; object detection; wearable vision-based system; SYSTEM; ROBOT;
D O I：
10.1109/ICARM52023.2021.9536084
中图分类号：
TP [自动化技术、计算机技术];
学科分类号：
0812 ;
摘要：
Wearable sensing and feedback device could provide useful information for the people with visual impairments. In this paper, we develop a real-time, multifunctional electronic eyeglasses (E-Glasses) for vision-based indoor navigation. Our proposed E-glasses has two main functions, which are indoor navigation through navigation algorithm, and object of interest detection through deep learning technology. The safe motion trajectory and the object information are summarized and feedback will be given to the people with visual impairments. The system can run at 39 fps and achieve mean average precision of 84.77% in the test set of images we collected. Detailed experiments of "Navigation" and "Find the target" had an overall success rate above 91%, demonstrating the feasibility of E-Glasses.
引用
收藏
页码：267 / 272
页数：6
相关论文
共 22 条
  • [11] Development of a Human-Robot Hybrid Intelligent System Based on Brain Teleoperation and Deep Learning SLAM
    Li, Jianlong
    Li, Zhijun
    Feng, Ying
    Liu, Yiliang
    Shi, Guangming
    [J]. IEEE TRANSACTIONS ON AUTOMATION SCIENCE AND ENGINEERING, 2019, 16 (04) : 1664 - 1674
  • [12] Deep Reinforcement Learning Based Multi-Objective Integrated Automatic Generation Control for Multiple Continuous Power Disturbances
    Li, Jiawen
    Yu, Tao
    [J]. IEEE ACCESS, 2020, 8 : 156839 - 156850
  • [13] Simple Smartphone-Based Guiding System for Visually Impaired People
    Lin, Bor-Shing
    Lee, Cheng-Che
    Chiang, Pei-Ying
    [J]. SENSORS, 2017, 17 (06)
  • [14] Focal Loss for Dense Object Detection
    Lin, Tsung-Yi
    Goyal, Priya
    Girshick, Ross
    He, Kaiming
    Dollar, Piotr
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2020, 42 (02) : 318 - 327
  • [15] Microsoft COCO: Common Objects in Context
    Lin, Tsung-Yi
    Maire, Michael
    Belongie, Serge
    Hays, James
    Perona, Pietro
    Ramanan, Deva
    Dollar, Piotr
    Zitnick, C. Lawrence
    [J]. COMPUTER VISION - ECCV 2014, PT V, 2014, 8693 : 740 - 755
  • [16] ORB-SLAM2: An Open-Source SLAM System for Monocular, Stereo, and RGB-D Cameras
    Mur-Artal, Raul
    Tardos, Juan D.
    [J]. IEEE TRANSACTIONS ON ROBOTICS, 2017, 33 (05) : 1255 - 1262
  • [17] Poggi M, 2016, 2016 IEEE SYMPOSIUM ON COMPUTERS AND COMMUNICATION (ISCC), P208, DOI 10.1109/ISCC.2016.7543741
  • [18] You Only Look Once: Unified, Real-Time Object Detection
    Redmon, Joseph
    Divvala, Santosh
    Girshick, Ross
    Farhadi, Ali
    [J]. 2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, : 779 - 788
  • [19] Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
    Ren, Shaoqing
    He, Kaiming
    Girshick, Ross
    Sun, Jian
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2017, 39 (06) : 1137 - 1149
  • [20] "Controlled Slip" Energy Harvesting While Walking
    Xia, Haisheng
    Chen, Daniel K. Y.
    Zhu, Xiangyang
    Shull, Peter B.
    [J]. IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2020, 28 (02) : 437 - 443
123