Multimodal Integration of an Enhanced Novel Pulmonary Auscultation Real-Time Diagnostic System

被引:0
|
作者
Abhishek, S. [1 ]
Ananthapadmanabhan, A. J. [1 ]
Anjali, T. [1 ]
Reyma, S. [1 ]
Perathur, Arvind [2 ]
Barouch Bentov, Rina [3 ]
机构
[1] Amrita Vishwa Vidyapeetham, Amrita Sch Comp, Amritapuri 690525, India
[2] Amrita Inst Med Sci, Dept Pulm Med, Kochi 682041, India
[3] Stanford Univ, Dept Competit Med, Sch Med, Stanford, CA 94305 USA
关键词
Accuracy; Lung; Medical diagnostic imaging; Pulmonary diseases; Data models; Convolutional neural networks; Real-time systems; Respiratory system; Multisensory integration; Hybrid power systems; Predictive models;
D O I
10.1109/MMUL.2024.3422022
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Respiratory illnesses pose a significant threat to life worldwide, necessitating prompt identification and effective intervention. Conventional organ examination methods are restrained by certain shortcomings that lead to inconsistent diagnosis. This research addresses the global threat of respiratory illnesses by introducing a unique hybrid convolutional neural network (CNN)-gated recurrent unit (GRU) architecture deployed on a Raspberry Pi for real-time classification of respiratory auditory cues, leveraging the power of sound in diagnostics. By overcoming the limitations of conventional examination methods, the system was able to achieve an impressive accuracy of 98% in distinguishing unusual auscultations. The system incorporated multimedia elements, particularly sound with CNNs to extract spatial attributes, and GRUs for the comprehension of temporal context. The utilization of an instinctual online interface, complemented by visualizations, dynamic sound patterns, and interactive elements, eased direct communication with medical professionals. The multimedia-centered approach focused particularly on respiratory sound indicates a landmark of respiratory diagnostics that is poised to enhance health-care outcomes globally.
引用
收藏
页码:18 / 43
页数:26
相关论文
共 50 条
  • [1] Real-Time Driver and Traffic Data Integration for Enhanced Road Safety
    Huang, Yufei
    Jiang, Shan
    Jafari, Mohsen
    Jin, Peter J.
    IEEE TRANSACTIONS ON COMPUTATIONAL SOCIAL SYSTEMS, 2024, 11 (06): : 7711 - 7722
  • [2] Real-Time Diagnostic Technique for AI-Enabled System
    Itsuji, Hiroaki
    Uezono, Takumi
    Toba, Tadanobu
    Kundu, Subrata Kumar
    IEEE OPEN JOURNAL OF INTELLIGENT TRANSPORTATION SYSTEMS, 2024, 5 : 483 - 494
  • [3] An Automated Computerized Auscultation and Diagnostic System for Pulmonary Diseases
    Abbas, Ali
    Fahim, Atef
    JOURNAL OF MEDICAL SYSTEMS, 2010, 34 (06) : 1149 - 1155
  • [4] Multiagent Sensor Integration and Knowledge Distillation System for Real-Time Autonomous Vehicle Navigation
    Hijji, Mohammad
    Ullah, Kaleem
    Alwakeel, Mohammed
    Alwakeel, Ahmed
    Aradah, Fahad
    Cheikh, Faouzi Alaya
    Sajjad, Muhammad
    Muhammad, Khan
    IEEE SYSTEMS JOURNAL, 2025,
  • [5] An Automated Computerized Auscultation and Diagnostic System for Pulmonary Diseases
    Ali Abbas
    Atef Fahim
    Journal of Medical Systems, 2010, 34 : 1149 - 1155
  • [6] System Integration for Real-time Mobile Manipulation
    Oftadeh, Reza
    Aref, Mohammad M.
    Ghabcheloo, Reza
    Mattila, Jouni
    INTERNATIONAL JOURNAL OF ADVANCED ROBOTIC SYSTEMS, 2014, 11
  • [7] Enhanced Classification System for Real-Time Embedded Vision Applications
    Khelifi, Ramzi
    Nini, Brahim
    Berkane, Mohamed
    IEEE ACCESS, 2024, 12 : 162311 - 162326
  • [8] Diagnostic Data Integration Using Deep Neural Networks for Real-Time Plasma Analysis
    Garola, A. Rigoni
    Cavazzana, R.
    Gobbin, M.
    Delogu, R. S.
    Manduchi, G.
    Taliercio, C.
    Luchetta, A.
    IEEE TRANSACTIONS ON NUCLEAR SCIENCE, 2021, 68 (08) : 2165 - 2172
  • [9] SynapNet: A Complementary Learning System Inspired Algorithm With Real-Time Application in Multimodal Perception
    Kushawaha, Nilay
    Fruzzetti, Lorenzo
    Donato, Enrico
    Falotico, Egidio
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024,
  • [10] CMRDF: A Real-Time Food Alerting System Based on Multimodal Data
    Zhou, Pengfei
    Bai, Cong
    Xia, Jie
    Chen, Shengyong
    IEEE INTERNET OF THINGS JOURNAL, 2022, 9 (09) : 6335 - 6349