Indoor objects detection and recognition for an ICT mobility assistance of visually impaired people

被引:37
作者
Afif, Mouna [1 ]
Ayachi, Riadh [1 ]
Pissaloux, Edwige [2 ,3 ]
Said, Yahia [1 ,4 ]
Atri, Mohamed [5 ]
机构
[1] Univ Monastir, Fac Sci Monastir, Lab Elect & Microelect EuE, Monastir, Tunisia
[2] Univ Rouen Normandy Rouen, LITIS Lab, Rouen, France
[3] Univ Rouen Normandy Rouen, CNRS FR 3638, Rouen, France
[4] Northern Border Univ, Coll Engn, Elect Engn Dept, Ar Ar, Saudi Arabia
[5] King Khalid Univ, Coll Comp Sci, Abha, Saudi Arabia
关键词
Indoor object detection and recognition; Deep convolutional neural networks (DCNN); Visually impaired people (VIP) mobility; Indoor navigation;
D O I
10.1007/s11042-020-09662-3
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Indoor object detection in real scene presents a challenging computer vision task; it is also a key component of an ICT autonomous displacement assistance of Visually Impaired People (VIP). To handle this challenge, a DCNN (Deep Convolutional Neural Networks) for indoor object detection and a new indoor dataset are proposed. The novel DCNN design is based on a pre-trained DCNN called YOLO v3. In order to train and test the proposed DCNN, a new dataset for indoor objects was created. The images of the new dataset present large variety of objects, of indoor illuminations and of indoor architectural structures potentially unsafe for a VIP independent mobility. The dataset contains about 8000 images and presents 16 indoor object categories. Experimental results prove the high performance of the proposed indoor object detection as its recognition rate (a mean average precision) is 73,19%.
引用
收藏
页码:31645 / 31662
页数:18
相关论文
共 43 条
  • [1] Afif M, 2019, ARTIF INTELL ADV, V1, P52, DOI 10.30564/aia.v1i1.925
  • [2] [Anonymous], 2017, IEEE I CONF COMP VIS, DOI DOI 10.1109/ICCV.2017.322
  • [3] [Anonymous], 2017, J PHYS AGENTS, DOI DOI 10.3389/FIMMU.2017.00125
  • [4] [Anonymous], 2018, P ICRC 2018 2018 3, DOI DOI 10.1145/3265639.3265671
  • [5] [Anonymous], 2014, INT C ED SOC SCIENC
  • [6] Ayachi Riadh, 2020, Proceedings of the 8th International Conference on Sciences of Electronics, Technologies of Information and Telecommunications (SETIT18). Smart Innovation, Systems and Technologies (SIST 146), P234, DOI 10.1007/978-3-030-21005-2_23
  • [7] Object Detection to Assist Visually Impaired People: A Deep Neural Network Adventure
    Bashiri, Fereshteh S.
    LaRose, Eric
    Badger, Jonathan C.
    D'Souza, Roshan M.
    Yu, Zeyun
    Peissig, Peggy
    [J]. ADVANCES IN VISUAL COMPUTING, ISVC 2018, 2018, 11241 : 500 - 510
  • [8] MCIndoor20000: A fully-labeled image dataset to advance indoor objects detection
    Bashiri, Fereshteh S.
    LaRose, Eric
    Peissig, Peggy
    Tafti, Ahmad P.
    [J]. DATA IN BRIEF, 2018, 17 : 71 - 75
  • [9] Large-Scale Machine Learning with Stochastic Gradient Descent
    Bottou, Leon
    [J]. COMPSTAT'2010: 19TH INTERNATIONAL CONFERENCE ON COMPUTATIONAL STATISTICS, 2010, : 177 - 186
  • [10] Chae HW, 2016, INT CONF UBIQ ROBOT, P405, DOI 10.1109/URAI.2016.7734070