Machine Learning in Robotic Ultrasound Imaging: Challenges and Perspectives

被引:4
作者
Bi, Yuan [1 ]
Jiang, Zhongliang [1 ]
Duelmer, Felix [1 ]
Huang, Dianye [1 ]
Navab, Nassir [1 ]
机构
[1] Tech Univ Munich, Comp Aided Med Procedures, Munich, Germany
关键词
deep learning; segmentation; registration; ultrasound image analysis; ultrasound simulation; reinforcement learning; learning from demonstration; ultrasound physics; ethics and regulations; medical robotics; DATA AUGMENTATION; CONFIDENCE MAPS; SYSTEM; SEGMENTATION; FORCE; LOCALIZATION; REGISTRATION; SIMULATION; DOMAINS; IMAGES;
D O I
10.1146/annurev-control-091523-100042
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This article reviews recent advances in intelligent robotic ultrasound imaging systems. We begin by presenting the commonly employed robotic mechanisms and control techniques in robotic ultrasound imaging, along with their clinical applications. Subsequently, we focus on the deployment of machine learning techniques in the development of robotic sonographers, emphasizing crucial developments aimed at enhancing the intelligence of these systems. The methods for achieving autonomous action reasoning are categorized into two sets of approaches: those relying on implicit environmental data interpretation and those using explicit interpretation. Throughout this exploration, we also discuss practical challenges, including those related to the scarcity of medical data, the need for a deeper understanding of the physical aspects involved, and effective data representation approaches. We conclude by highlighting the open problems in the field and analyzing different possible perspectives on how the community could move forward in this research area.
引用
收藏
页码:335 / 357
页数:23
相关论文
共 149 条
[101]   The First Global Ontological Standard for Ethically Driven Robotics and Automation Systems [J].
Prestes, Edson ;
Houghtaling, Michael A. ;
Goncalves, Paulo J. S. ;
Fabiano, Nicola ;
Ulgen, Ozlem ;
Fiorini, Sandro Rama ;
Murahwi, Zvikomborero ;
Olszewska, Joanna Isabelle ;
Haidegger, Tamas .
IEEE ROBOTICS & AUTOMATION MAGAZINE, 2021, 28 (04) :120-124
[102]   Deep Kernel and Image Quality Estimators for Optimizing Robotic Ultrasound Controller using Bayesian Optimization [J].
Raina, Deepak ;
Chandrashekhara, S. H. ;
Voyles, Richard ;
Wachs, Juan ;
Saha, Subir Kumar .
2023 INTERNATIONAL SYMPOSIUM ON MEDICAL ROBOTICS, ISMR, 2023,
[103]   DISA: DIfferentiable Similarity Approximation for Universal Multimodal Registration [J].
Ronchetti, Matteo ;
Wein, Wolfgang ;
Navab, Nassir ;
Zettinig, Oliver ;
Prevost, Raphael .
MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION, MICCAI 2023, PT X, 2023, 14229 :761-770
[104]   U-Net: Convolutional Networks for Biomedical Image Segmentation [J].
Ronneberger, Olaf ;
Fischer, Philipp ;
Brox, Thomas .
MEDICAL IMAGE COMPUTING AND COMPUTER-ASSISTED INTERVENTION, PT III, 2015, 9351 :234-241
[105]  
Salcudean SE, 1999, LECT NOTES COMPUT SC, V1679, P1062
[106]   Patient-specific 3D Ultrasound Simulation Based on Convolutional Ray-tracing and Appearance Optimization [J].
Salehi, Mehrdad ;
Ahmadi, Seyed-Ahmad ;
Prevost, Raphael ;
Navab, Nassir ;
Wein, Wolfgang .
MEDICAL IMAGE COMPUTING AND COMPUTER-ASSISTED INTERVENTION - MICCAI 2015, PT II, 2015, 9350 :510-518
[107]   Computed-Torque Control for Robotic-Assisted Tele-Echography Based on Perceived Stiffness Estimation [J].
Santos, Luis ;
Cortesao, Rui .
IEEE TRANSACTIONS ON AUTOMATION SCIENCE AND ENGINEERING, 2018, 15 (03) :1337-1354
[108]   Knowledge-guided synthetic medical image adversarial augmentation for ultrasonography thyroid nodule classification [J].
Shi, Guohua ;
Wang, Jiawen ;
Qiang, Yan ;
Yang, Xiaotang ;
Zhao, Juanjuan ;
Hao, Rui ;
Yang, Wenkai ;
Du, Qianqian ;
Kazihise, Ntikurako Guy-Fernand .
COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE, 2020, 196 (196)
[109]   Heart Position Estimation based on Bone Distribution toward Autonomous Robotic Fetal Ultrasonography [J].
Shida, Yuuki ;
Tsumura, Ryosuke ;
Watanabe, Takabumi ;
Iwata, Hiroyasu .
2021 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA 2021), 2021, :11393-11399
[110]  
Shubert J, 2017, IEEE INT ULTRA SYM