Vision Sense: Real-Time Object Detection And Audio Feedback System For Visually Impaired Individuals

被引:0
|
作者
Chinni, Naga Praneeth Kumar [1 ]
Kaamaala, Sai Pranav Reddy [1 ]
Vardhan, Bhasham Vishva [1 ]
Kishan, Adari Uday [1 ]
Richards, Vasimalla Sunny [1 ]
Vardhan, Ramadasu Nooka Harsh [1 ]
Puneet [1 ]
机构
[1] Lovely Profess Univ, Comp Sci & Engn, Jalandhar, Punjab, India
来源
2024 2ND WORLD CONFERENCE ON COMMUNICATION & COMPUTING, WCONF 2024 | 2024年
关键词
YOLO model; COCO dataset; object detection; visually impaired assistance; real-time processing; audio feedback; computer vision; assistive technology;
D O I
10.1109/WCONF61366.2024.10692302
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
This project introduces a transformative object detection system designed to enhance the navigational capabilities of visually impaired individuals through the application of advanced computer vision technologies. Utilizing the You Only Look Once (YOLO) model, paired with the Comprehensive Object Collection (COCO) dataset, this system provides real-time, accurate object detection and classification. The core functionality of the application allows for the processing of both static images and live video feeds, enabling blind users to receive auditory announcements of nearby objects, thereby assisting with spatial awareness and environmental interaction. The system leverages a pre-trained YOLO model to ensure robust detection performance, achieving a peak detection accuracy of 99%. By delivering object labels and bounding box coordinates audibly, the application serves as a critical tool in improving the daily independence and quality of life for people with visual impairments. This project not only highlights the potential of deep learning in assistive technologies but also underscores the importance of adaptive solutions in inclusive technology development.
引用
收藏
页数:6
相关论文
共 50 条
  • [1] Real-time Machine Vision System for the Visually Impaired
    Krishna A.N.
    Chaitra Y.L.
    Bharadwaj A.M.
    Abbas K.T.
    Abraham A.
    Prasad A.S.
    SN Computer Science, 5 (4)
  • [2] Real-time Object Detection for Visually Impaired with Optimal Combination of Scores
    Nijhawan, Siddharth Sagar
    Kumar, Aditi
    Bhardwaj, Shubham
    Nijhawan, Geeta
    PROCEEDINGS OF THE 2019 6TH INTERNATIONAL CONFERENCE ON COMPUTING FOR SUSTAINABLE GLOBAL DEVELOPMENT (INDIACOM), 2019, : 307 - 311
  • [3] Real-Time Object Detection for Visually Challenged People
    Vaidya, Sunit
    Shah, Naisha
    Shah, Niti
    Shankarmani, Radha
    PROCEEDINGS OF THE INTERNATIONAL CONFERENCE ON INTELLIGENT COMPUTING AND CONTROL SYSTEMS (ICICCS 2020), 2020, : 311 - 316
  • [4] Vision System with 3D Audio Feedback to assist Navigation for Visually Impaired
    Krishna, Aakash G. S.
    Pon, Vijay Nirmal
    Rai, Saumya
    Baskar, A.
    INTERNATIONAL CONFERENCE ON COMPUTATIONAL INTELLIGENCE AND DATA SCIENCE, 2020, 167 : 235 - 243
  • [5] Object detection with vision based system: A secondary aid for visually impaired and blind people
    Rahman, S
    Hassan, QK
    6TH WORLD MULTICONFERENCE ON SYSTEMICS, CYBERNETICS AND INFORMATICS, VOL IX, PROCEEDINGS: IMAGE, ACOUSTIC, SPEECH AND SIGNAL PROCESSING II, 2002, : 188 - 193
  • [6] A Real-Time Detection of Indian Traffic Signs for Visually Impaired People
    Madake, Jyoti
    Badade, Mahesh
    Barve, Mrunal
    Bhatlawande, Shripad
    Shilaskar, Swati
    INTELLIGENT SYSTEMS AND APPLICATIONS, ICISA 2022, 2023, 959 : 237 - 247
  • [7] A real-time image captioning framework using computer vision to help the visually impaired
    Safiya, K. M.
    Pandian, R.
    MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 83 (20) : 59413 - 59438
  • [8] Enhanced lightweight infrared object detection algorithm for assistive navigation in visually impaired individuals
    Bai, Zhimin
    Yang, Yang
    Wang, Jian
    Li, Zhengyang
    Wang, Jiajun
    Liu, Chunxin
    IET IMAGE PROCESSING, 2024, 18 (14) : 4824 - 4842
  • [9] Vision Connect: A Smartphone Based Object Detection for Visually Impaired People
    Ramalingam, Devakunchari
    Tiwari, Swapnil
    Seth, Harsh
    COMPUTATIONAL VISION AND BIO-INSPIRED COMPUTING, 2020, 1108 : 863 - 870
  • [10] Towards a Real-Time System for Finding and Reading Signs for Visually Impaired Users
    Shen, Huiying
    Coughlan, James M.
    COMPUTERS HELPING PEOPLE WITH SPECIAL NEEDS, PT II, 2012, 7383 : 41 - 47