Detecting Traversable Area and Water Hazards for the Visually Impaired with a pRGB-D Sensor

被引:29
作者
Yang, Kailun [1 ]
Wang, Kaiwei [1 ]
Cheng, Ruiqi [1 ]
Hu, Weijian [1 ]
Huang, Xiao [1 ]
Bai, Jian [1 ]
机构
[1] Zhejiang Univ, Coll Opt Sci & Engn, Hangzhou 310027, Peoples R China
关键词
traversable area detection; water hazard detection; RGB-D sensor; polarized stereo; ZED; visually impaired people; STEREO; ASSISTANCE;
D O I
10.3390/s17081890
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
The use of RGB-Depth (RGB-D) sensors for assisting visually impaired people (VIP) has been widely reported as they offer portability, function-diversity and cost-effectiveness. However, polarization cues to assist traversability awareness without precautions against stepping into water areas are weak. In this paper, a polarized RGB-Depth (pRGB-D) framework is proposed to detect traversable area and water hazards simultaneously with polarization-color-depth-attitude information to enhance safety during navigation. The approach has been tested on a pRGB-D dataset, which is built for tuning parameters and evaluating the performance. Moreover, the approach has been integrated into a wearable prototype which generates a stereo sound feedback to guide visually impaired people (VIP) follow the prioritized direction to avoid obstacles and water hazards. Furthermore, a preliminary study with ten blindfolded participants suggests its effectivity and reliability.
引用
收藏
页数:20
相关论文
共 59 条
[1]   Navigation Assistance for the Visually Impaired Using RGB-D Sensor With Range Expansion [J].
Aladren, A. ;
Lopez-Nicolas, G. ;
Puig, Luis ;
Guerrero, Josechu J. .
IEEE SYSTEMS JOURNAL, 2016, 10 (03) :922-932
[2]  
Alcantarilla PF, 2012, IEEE INT CONF ROBOT, P1290, DOI 10.1109/ICRA.2012.6224690
[3]  
[Anonymous], P 13 INT C ADV MOB C
[4]  
[Anonymous], P 28 ANN INT C IEEE, DOI DOI 10.1109/IEMBS.2006.259473
[5]  
[Anonymous], 3D TRACKING WATER HA
[6]  
[Anonymous], P 2007 ICCV WORKSH D
[7]  
[Anonymous], 2016, ELCVIA ELECT LETT CO
[8]  
[Anonymous], RES NOTES INF SCI
[9]  
[Anonymous], 2013, VIS IMP BLINDN
[10]  
[Anonymous], P IET INT C BIOM IM