Machine Learning in Robotic Ultrasound Imaging: Challenges and Perspectives

被引:4
作者
Bi, Yuan [1 ]
Jiang, Zhongliang [1 ]
Duelmer, Felix [1 ]
Huang, Dianye [1 ]
Navab, Nassir [1 ]
机构
[1] Tech Univ Munich, Comp Aided Med Procedures, Munich, Germany
关键词
deep learning; segmentation; registration; ultrasound image analysis; ultrasound simulation; reinforcement learning; learning from demonstration; ultrasound physics; ethics and regulations; medical robotics; DATA AUGMENTATION; CONFIDENCE MAPS; SYSTEM; SEGMENTATION; FORCE; LOCALIZATION; REGISTRATION; SIMULATION; DOMAINS; IMAGES;
D O I
10.1146/annurev-control-091523-100042
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This article reviews recent advances in intelligent robotic ultrasound imaging systems. We begin by presenting the commonly employed robotic mechanisms and control techniques in robotic ultrasound imaging, along with their clinical applications. Subsequently, we focus on the deployment of machine learning techniques in the development of robotic sonographers, emphasizing crucial developments aimed at enhancing the intelligence of these systems. The methods for achieving autonomous action reasoning are categorized into two sets of approaches: those relying on implicit environmental data interpretation and those using explicit interpretation. Throughout this exploration, we also discuss practical challenges, including those related to the scarcity of medical data, the need for a deeper understanding of the physical aspects involved, and effective data representation approaches. We conclude by highlighting the open problems in the field and analyzing different possible perspectives on how the community could move forward in this research area.
引用
收藏
页码:335 / 357
页数:23
相关论文
共 149 条
[91]  
Napoli ME, 2018, P IEEE RAS-EMBS INT, P1266, DOI 10.1109/BIOROB.2018.8487186
[92]   Personalized, relevance-based Multimodal Robotic Imaging and augmented reality for Computer Assisted Interventions [J].
Navab, Nassir ;
Hennersperger, Christoph ;
Frisch, Benjamin ;
Furst, Bernhard .
MEDICAL IMAGE ANALYSIS, 2016, 33 :64-71
[93]   Doppler Image-Based Weakly-Supervised Vascular Ultrasound Segmentation with Transformer [J].
Ning, Guochen ;
Liang, Hanying ;
Chen, Fang ;
Zhang, Xinran ;
Liao, Hongen .
2023 IEEE 20TH INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING, ISBI, 2023,
[94]   Autonomous Robotic Ultrasound Vascular Imaging System With Decoupled Control Strategy for External-Vision-Free Environments [J].
Ning, Guochen ;
Liang, Hanying ;
Zhang, Xinran ;
Liao, Hongen .
IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING, 2023, 70 (11) :3166-3177
[95]   Autonomic Robotic Ultrasound Imaging System Based on Reinforcement Learning [J].
Ning, Guochen ;
Zhang, Xinran ;
Liao, Hongen .
IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING, 2021, 68 (09) :2787-2797
[96]   Echocardiography Segmentation With Enforced Temporal Consistency [J].
Painchaud, Nathan ;
Duchateau, Nicolas ;
Bernard, Olivier ;
Jodoin, Pierre-Marc .
IEEE TRANSACTIONS ON MEDICAL IMAGING, 2022, 41 (10) :2867-2878
[97]   Cardiac Segmentation With Strong Anatomical Guarantees [J].
Painchaud, Nathan ;
Skandarani, Youssef ;
Judge, Thierry ;
Bernard, Olivier ;
Lalande, Alain ;
Jodoin, Pierre-Marc .
IEEE TRANSACTIONS ON MEDICAL IMAGING, 2020, 39 (11) :3703-3713
[98]   Semi-supervise d GAN-base d Radiomics Model for Data Augmentation in Breast Ultrasound Mass Classification [J].
Pang, Ting ;
Wong, Jeannie Hsiu Ding ;
Ng, Wei Lin ;
Chan, Chee Seng .
COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE, 2021, 203
[99]  
Peng X, 2019, PR MACH LEARN RES, V97
[100]   Adaptive Augmentation of Medical Data Using Independently Conditional Variational Auto-Encoders [J].
Pesteie, Mehran ;
Abolmaesumi, Purang ;
Rohling, Robert N. .
IEEE TRANSACTIONS ON MEDICAL IMAGING, 2019, 38 (12) :2807-2820