Development of a Collaborative Robotic Platform for Autonomous Auscultation

被引:9
作者
Lopes, Daniel [1 ]
Coelho, Luis [1 ,2 ]
Silva, Manuel F. [1 ,3 ]
机构
[1] Inst Super Engn Porto, Inst Politecn Porto, Rua Dr Antonio Bernardino Almeida 431, P-4249015 Porto, Portugal
[2] Inst Super Engn Porto, Inst Politecn Porto, Ctr Engn Innovat & Ind Technol, P-4249015 Porto, Portugal
[3] INESC TEC, Rua Dr Roberto Frias, P-4200465 Porto, Portugal
来源
APPLIED SCIENCES-BASEL | 2023年 / 13卷 / 03期
关键词
autonomous auscultation; MobileNetV2-UNet; healthcare; computer vision; auscultation points; medical robotics; vision robotics;
D O I
10.3390/app13031604
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
Listening to internal body sounds, or auscultation, is one of the most popular diagnostic techniques in medicine. In addition to being simple, non-invasive, and low-cost, the information it offers, in real time, is essential for clinical decision-making. This process, usually done by a doctor in the presence of the patient, currently presents three challenges: procedure duration, participants' safety, and the patient's privacy. In this article we tackle these by proposing a new autonomous robotic auscultation system. With the patient prepared for the examination, a 3D computer vision sub-system is able to identify the auscultation points and translate them into spatial coordinates. The robotic arm is then responsible for taking the stethoscope surface into contact with the patient's skin surface at the various auscultation points. The proposed solution was evaluated to perform a simulated pulmonary auscultation in six patients (with distinct height, weight, and skin color). The obtained results showed that the vision subsystem was able to correctly identify 100% of the auscultation points, with uncontrolled lighting conditions, and the positioning subsystem was able to accurately position the gripper on the corresponding positions on the human body. Patients reported no discomfort during auscultation using the described automated procedure.
引用
收藏
页数:21
相关论文
共 39 条
[1]   Experiences and expectations of collaborative robots in industry and academia: barriers and development needs [J].
Aaltonena, Iina ;
Salmia, Timo .
29TH INTERNATIONAL CONFERENCE ON FLEXIBLE AUTOMATION AND INTELLIGENT MANUFACTURING (FAIM 2019): BEYOND INDUSTRY 4.0: INDUSTRIAL ADVANCES, ENGINEERING EDUCATION AND INTELLIGENT MANUFACTURING, 2019, 38 :1151-1158
[2]   A comprehensive review of COVID-19 detection techniques: From laboratory systems to wearable devices [J].
Alyafei, Khalid ;
Ahmed, Rashid ;
Abir, Farhan Fuad ;
Chowdhury, Muhammad E. H. ;
Naji, Khalid Kamal .
COMPUTERS IN BIOLOGY AND MEDICINE, 2022, 149
[3]  
[Anonymous], OAK-D-DepthAI Hardware Documentation 1.0.0 documentation
[4]  
[Anonymous], GITHUB DEPTHAI EXPT
[5]  
[Anonymous], 2022, UR3e Technical Specification
[6]   Towards Rehabilitation Robotics: Off-the-Shelf BCI Control of Anthropomorphic Robotic Arms [J].
Athanasiou, Alkinoos ;
Xygonakis, Ioannis ;
Pandria, Niki ;
Kartsidis, Panagiotis ;
Arfaras, George ;
Kavazidi, Kyriaki Rafailia ;
Foroglou, Nicolas ;
Astaras, Alexander ;
Bamidis, Panagiotis D. .
BIOMED RESEARCH INTERNATIONAL, 2017, 2017
[7]   Automatic Classification of Normal-Abnormal Heart Sounds Using Convolution Neural Network and Long-Short Term Memory [J].
Chen, Ding ;
Xuan, Weipeng ;
Gu, Yexing ;
Liu, Fuhai ;
Chen, Jinkai ;
Xia, Shudong ;
Jin, Hao ;
Dong, Shurong ;
Luo, Jikui .
ELECTRONICS, 2022, 11 (08)
[8]   A decade retrospective of medical robotics research from 2010 to 2020 [J].
Dupont, Pierre E. ;
Nelson, Bradley J. ;
Goldfarb, Michael ;
Hannaford, Blake ;
Menciassi, Arianna ;
O'Malley, Marcia K. ;
Simaan, Nabil ;
Valdastri, Pietro ;
Yang, Guang-Zhong .
SCIENCE ROBOTICS, 2021, 6 (60)
[9]   Cobot programming for collaborative industrial tasks: An overview [J].
El Zaatari, Shirine ;
Marei, Mohamed ;
Li, Weidong ;
Usman, Zahid .
ROBOTICS AND AUTONOMOUS SYSTEMS, 2019, 116 :162-180
[10]  
Ferlay J, 2010, BREAST CANCER EPIDEMIOLOGY, P1, DOI 10.1007/978-1-4419-0685-4_1