A novel edge intelligence-based solution for safer footpath navigation of visually impaired using computer vision

被引:0
作者
Chowdhury, Rashik Iram [1 ]
Anjom, Jareen [1 ]
Hossain, Md. Ishan Arefin [1 ]
机构
[1] North South Univ, Dept Elect & Comp Engn, Bashundhara R-A 1229, Dhaka, Bangladesh
关键词
Visually impaired; Footpath navigation; Edge intelligence; YOLOv8; Computer vision; Object detection;
D O I
10.1016/j.jksuci.2024.102191
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Navigating through a tactile paved footpath surrounded by various sizes of static and dynamic obstacles is one of the biggest impediments visually impaired people face, especially in Dhaka, Bangladesh. This problem is important to address, considering the number of accidents in such densely populated footpaths. We propose a novel deep-edge solution using Computer Vision to make people aware of the obstacles in the vicinity and reduce the necessity of a walking cane. This study introduces a diverse novel tactile footpath dataset of Dhaka covering different city areas. Additionally, existing state-of-the-art deep neural networks for object detection have been fine-tuned and investigated using this dataset. A heuristic-based breadth-first navigation algorithm (HBFN) is developed to provide navigation directions that are safe and obstacle-free, which is then deployed in a smartphone application that automatically captures images of the footpath ahead to provide real-time navigation guidance delivered by speech. The findings from this study demonstrate the effectiveness of the object detection model, YOLOv8s, which outperformed other benchmark models on this dataset, achieving a high mAP of 0.974 and an F1 score of 0.934. The model's performance is analyzed after quantization, reducing its size by 49.53% while retaining 98.97% of the original mAP.
引用
收藏
页数:14
相关论文
共 33 条
[1]  
Afrin S., 2018, Special paving for the vision-impaired people
[2]  
[Anonymous], 2022, IEEE J. Mag. | IEEE Xplore
[3]  
[Anonymous], 2024, The fred hollows foundation
[4]  
AtikurRahman M.d., 2021, Comput. Methods Programs Biomed. Update, V01, DOI [10.1016/j.cmpbup.2021.100015, DOI 10.1016/J.CMPBUP.2021.100015]
[5]  
Bochkovskiy A, 2020, Arxiv, DOI arXiv:2004.10934
[6]  
Bulla C., 2022, Advances in Intelligent Systems and Computing, V1380, DOI [10.1007/978-981-16-1740-9_12, DOI 10.1007/978-981-16-1740-9_12]
[7]  
Bundy A., 1984, CATALOGUE ARTIFICIAL, P13, DOI [DOI 10.1007/978-3-642-96868-625, DOI 10.1007/978-3-642-96868-6_25]
[8]   On the Performance of One-Stage and Two-Stage Object Detectors in Autonomous Vehicles Using Camera Data [J].
Carranza-Garcia, Manuel ;
Torres-Mateo, Jesus ;
Lara-Benitez, Pedro ;
Garcia-Gutierrez, Jorge .
REMOTE SENSING, 2021, 13 (01) :1-23
[9]  
DAngelo G., 2022, Effectiveness of video-classification in android malware detection through API-streams and CNN-LSTM autoencoders, DOI [10.1007/978-981-16-9576-613, DOI 10.1007/978-981-16-9576-613]
[10]  
DAngelo G., 2023, An association rules-based approach for anomaly detection on CAN-bus, DOI [10.1007/978-3-031-37108-012, DOI 10.1007/978-3-031-37108-012]