Staircase detection to guide visually impaired people: A hybrid approach

被引：15
作者：
Habib A. [1 ]
Islam Md.M. [1 ]
Kabir M.N. [2 ]
Mredul M.B. [1 ]
Hasan M. [1 ]
机构：
[1] Department of Computer Science and Engineering, Khulna University of Engineering and Technology, Khulna
[2] Faculty of Computing, University Malaysia Pahang, Gambang, Kuantan
来源：
Revue d'Intelligence Artificielle | 2019年 / 33卷 / 05期
关键词：
Computer vision; Faster R-CNN; Sensors; Staircase detection; Visually impaired people;
D O I：
10.18280/ria.330501
中图分类号：
学科分类号：
摘要：
Eyes and other visionary organs are essential to human physiology, due to their ability to receive and process subtle details to the brain. However, some individuals are unable to visually perceive things in the surroundings. These visually impaired people face various hinderances in the daily life, and cannot navigate themselves without guidance. To help them navigate around the surroundings, this paper develops a hybrid system for the detection of staircase and the ground, using a pre-trained model and an ultrasonic sensor. The proposed system consists of an ultrasonic sensor, an R-GBD camera, a raspberry pi and a buzzer fixed on a walking stick. During the detection process, staircase images are captured by an RGB-D camera and then compared with pre-trained template images. Finally, our system was applied to detect different staircase images under various conditions (e.g. dark and noise), and found to achieve an average accuracy of 98.73%. This research provides an effective aid to the visually impaired. © 2019 International Information and Engineering Technology Association. All rights reserved.
引用
收藏
页码：327 / 334
页数：7
相关论文
共 28 条
  • [1] Bourne R.R., Flaxman S.R., Braithwaite T., Cicinelli M.V., Das A., Jonas J.B., Keeffe J., Kempen J.H., Leasher J., Limburg H., Naidoo K., Pesudovs K., Resnikoff S., Silvester A., Stevens G.A., Tahhan N., Wong T.Y., Taylor H.R., Magnitude, temporal trends, and projections of the global prevalence of blindness and distance and near vision impairment: A systematic review and meta-analysis, The Lancet Global Health, 5, 9, pp. e888-e897, (2017)
  • [2] Islam M.M., Sadi M.S., Zamli K.Z., Ahmed M.M., Developing walking assistants for visually impaired people: A review, IEEE Sensors Journal, 19, 8, pp. 2814-2828, (2019)
  • [3] Tapu R., Mocanu B., Zaharia T., Wearable assistive devices for visually impaired: A state of the art survey, Pattern Recognition Letters, (2018)
  • [4] Bauer Z., Dominguez A., Cruz E., Gomez-Donoso F., Orts-Escolano S., Cazorla M., Enhancing perception for the visually impaired with deep learning techniques and low-cost wearable sensors, Pattern Recognition Letters, (2019)
  • [5] Real S., Araujo A., Navigation systems for the blind and visually impaired: Past work, challenges, and open problems, Sensors, 19, 15, (2019)
  • [6] Cardillo E., Caddemi A., Insight on electronic travel AIDS for visually impaired people: A review on the electromagnetic technology, Electronics, 8, 11, (2019)
  • [7] Anthierens C., Groux D., Hugel V., Sensory navigation guide for visually impaired sea kayakers, Journal of Field Robotics, 35, 5, pp. 732-747, (2018)
  • [8] Abdulkader S.N., Atia A., Mostafa M.S.M., Brain computer interfacing: Applications and challenges, Egyptian Informatics Journal, 16, 2, pp. 213-230, (2015)
  • [9] Meshram V.V., Patil K., Meshram V.A., Shu F.C., An astute assistive device for mobility and object recognition for visually impaired people, IEEE Transactions on Human-Machine Systems, 49, 5, pp. 449-460, (2019)
  • [10] Rahman M.M., Islam M.M., Ahmmed S., Blindshoe”: An electronic guidance system for the visually impaired people, Journal of Telecommunication, Electronic and Computer Engineering (JTEC), 11, 2, pp. 49-54, (2019)
123