IoT-Driven Optimal Lightweight RetinaNet-Based Object Detection for Visually Impaired People

被引:0
|
作者
Alduhayyem M. [1 ]
Alnfiai M.M. [2 ,3 ]
Almalki N. [4 ]
Al-Wesabi F.N. [5 ]
Hilal A.M. [6 ]
Hamza M.A. [6 ]
机构
[1] Department of Computer Science, College of Sciences and Humanities-Aflaj, Prince Sattam bin Abdulaziz University
[2] King Salman Center for Disability Research, Al-Hayā‐tim, Riyadh
[3] Department of Information Technology, College of Computers and Information Technology, Taif University, P.O. Box 11099, Taif
[4] Department of Special Education, College of Education, King Saud University, Riyadh
[5] Department of Computer Science, College of Science & Arts, King Khaled University, Ar-Riyad
[6] Department of Computer and Self Development, Preparatory Year Deanship, Prince Sattam bin Abdulaziz University, AlKharj
来源
Computer Systems Science and Engineering | 2023年 / 46卷 / 01期
关键词
computer vision; deep learning; long short-term memory; object detection; transient search optimization; Visually impaired people;
D O I
10.32604/csse.2023.034067
中图分类号
学科分类号
摘要
Visual impairment is one of the major problems among people of all age groups across the globe. Visually Impaired Persons (VIPs) require help from others to carry out their day-to-day tasks. Since they experience several problems in their daily lives, technical intervention can help them resolve the challenges. In this background, an automatic object detection tool is the need of the hour to empower VIPs with safe navigation. The recent advances in the Internet of Things (IoT) and Deep Learning (DL) techniques make it possible. The current study proposes IoT-assisted Transient Search Optimization with a Lightweight RetinaNet-based object detection (TSOLWR-ODVIP) model to help VIPs. The primary aim of the presented TSOLWR-ODVIP technique is to identify different objects surrounding VIPs and to convey the information via audio message to them. For data acquisition, IoT devices are used in this study. Then, the Lightweight RetinaNet (LWR) model is applied to detect objects accurately. Next, the TSO algorithm is employed for fine-tuning the hyperparameters involved in the LWR model. Finally, the Long Short-Term Memory (LSTM) model is exploited for classifying objects. The performance of the proposed TSOLWR-ODVIP technique was evaluated using a set of objects, and the results were examined under distinct aspects. The comparison study outcomes confirmed that the TSOLWR-ODVIP model could effectually detect and classify the objects, enhancing the quality of life of VIPs. © 2023 CRL Publishing. All rights reserved.
引用
收藏
页码:475 / 489
页数:14
相关论文
共 30 条
  • [21] An IoT Machine Learning-Based Mobile Sensors Unit for Visually Impaired People
    Dhou, Salam
    Alnabulsi, Ahmad
    Al-Ali, A. R.
    Arshi, Mariam
    Darwish, Fatima
    Almaazmi, Sara
    Alameeri, Reem
    SENSORS, 2022, 22 (14)
  • [22] Smart Assistive System for Visually Impaired People Obstruction Avoidance Through Object Detection and Classification
    Masud, Usman
    Saeed, Tareq
    Malaikah, Hunida M.
    Ul Islam, Fezan
    Abbas, Ghulam
    IEEE ACCESS, 2022, 10 : 13428 - 13441
  • [23] Fixed DO Solfege Based Object Detection and Positional Analysis for the Visually Impaired
    Kalra, Siddharth
    Jain, Sarika
    Agarwal, Amit
    2017 6TH INTERNATIONAL CONFERENCE ON RELIABILITY, INFOCOM TECHNOLOGIES AND OPTIMIZATION (TRENDS AND FUTURE DIRECTIONS) (ICRITO), 2017, : 594 - 598
  • [24] A 68-mw 2.2 Tops/w Low Bit Width and Multiplierless DCNN Object Detection Processor for Visually Impaired People
    Chen, Xiaobai
    Xu, Jinglong
    Yu, Zhiyi
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2019, 29 (11) : 3444 - 3453
  • [25] A Mobile-Based Obstacle Detection Method: Application to the Assistance of Visually Impaired People
    Alshehri, Manal Abdulaziz
    Jarraya, Salma Kammoun
    Ben-Abdallah, Hanene
    NEURAL INFORMATION PROCESSING, ICONIP 2016, PT IV, 2016, 9950 : 555 - 564
  • [26] Interactive Sound Generation to Aid Visually Impaired People via Object Detection Using Touch Screen Sensor
    Kurniati, Tias
    Yang, Chuan-Kai
    Chen, Tzer-Shyong
    Chung, Yu-Fang
    Huang, Yu-Min
    Chen, Chih-Cheng
    SENSORS AND MATERIALS, 2021, 33 (11) : 4057 - 4068
  • [27] Scene perception system for visually impaired based on object detection and classification using multimodal deep convolutional neural network
    Kaur, Baljit
    Bhattacharya, Jhilik
    JOURNAL OF ELECTRONIC IMAGING, 2019, 28 (01)
  • [28] Validation of a development methodology and tool for IoT-based systems through a case study for visually impaired people
    Guerrero-Ulloa, Gleiston
    Fernandez-loor, Ariel
    Moreira, Francisco
    Novais, Paulo
    Rodriguez-Dominguez, Carlos
    Hornos, Miguel J.
    INTERNET OF THINGS, 2023, 23
  • [29] Automatic Object Detection Algorithm-Based Braille Image Generation System for the Recognition of Real-Life Obstacles for Visually Impaired People
    Lee, Dayeon
    Cho, Jinsoo
    SENSORS, 2022, 22 (04)
  • [30] Stereo Image Based Object Localization Framework for Visually Impaired People Using Edge Orientation Histogram and Co-occurrence Matrices
    Fuangkaew, Supakit
    Patanukhom, Karn
    2015 1ST INTERNATIONAL CONFERENCE ON INDUSTRIAL NETWORKS AND INTELLIGENT SYSTEMS (INISCOM), 2015, : 113 - 121