Machine Learning in Robotic Ultrasound Imaging: Challenges and Perspectives

被引:4
作者
Bi, Yuan [1 ]
Jiang, Zhongliang [1 ]
Duelmer, Felix [1 ]
Huang, Dianye [1 ]
Navab, Nassir [1 ]
机构
[1] Tech Univ Munich, Comp Aided Med Procedures, Munich, Germany
关键词
deep learning; segmentation; registration; ultrasound image analysis; ultrasound simulation; reinforcement learning; learning from demonstration; ultrasound physics; ethics and regulations; medical robotics; DATA AUGMENTATION; CONFIDENCE MAPS; SYSTEM; SEGMENTATION; FORCE; LOCALIZATION; REGISTRATION; SIMULATION; DOMAINS; IMAGES;
D O I
10.1146/annurev-control-091523-100042
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This article reviews recent advances in intelligent robotic ultrasound imaging systems. We begin by presenting the commonly employed robotic mechanisms and control techniques in robotic ultrasound imaging, along with their clinical applications. Subsequently, we focus on the deployment of machine learning techniques in the development of robotic sonographers, emphasizing crucial developments aimed at enhancing the intelligence of these systems. The methods for achieving autonomous action reasoning are categorized into two sets of approaches: those relying on implicit environmental data interpretation and those using explicit interpretation. Throughout this exploration, we also discuss practical challenges, including those related to the scarcity of medical data, the need for a deeper understanding of the physical aspects involved, and effective data representation approaches. We conclude by highlighting the open problems in the field and analyzing different possible perspectives on how the community could move forward in this research area.
引用
收藏
页码:335 / 357
页数:23
相关论文
共 149 条
[1]   Event-Triggered Adaptive Hybrid Position-Force Control for Robot-Assisted Ultrasonic Examination System [J].
Abbas, Mohamed ;
Al Issa, Sami ;
Dwivedy, Santosha K. .
JOURNAL OF INTELLIGENT & ROBOTIC SYSTEMS, 2021, 102 (04)
[2]  
Abbeel P., 2004, TWENTYFIRST INT C MA, DOI DOI 10.1145/1015330.1015430
[3]   Robot-assisted Breast Ultrasound Scanning Using Geometrical Analysis of the Seroma and Image Segmentation [J].
Akbari, Mojtaba ;
Carriere, Jay ;
Sloboda, Ron ;
Meyer, Tyler ;
Usmani, Nawaid ;
Husain, Siraj ;
Tavakoli, Mandi .
2021 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2021, :3784-3791
[4]   Robotic Ultrasound Scanning With Real-Time Image-Based Force Adjustment: Quick Response for Enabling Physical Distancing During the COVID-19 Pandemic [J].
Akbari, Mojtaba ;
Carriere, Jay ;
Meyer, Tyler ;
Sloboda, Ron ;
Husain, Siraj ;
Usmani, Nawaid ;
Tavakoli, Mahdi .
FRONTIERS IN ROBOTICS AND AI, 2021, 8
[5]   Autonomy in Surgical Robotics [J].
Attanasio, Aleks ;
Scaglioni, Bruno ;
De Momi, Elena ;
Fiorini, Paolo ;
Valdastri, Pietro .
ANNUAL REVIEW OF CONTROL, ROBOTICS, AND AUTONOMOUS SYSTEMS, VOL 4, 2021, 2021, 4 :651-679
[6]   A Novel Ultrasound Robot With Force/Torque Measurement and Control for Safe and Efficient Scanning [J].
Bao, Xianqiang ;
Wang, Shuangyi ;
Zheng, Lingling ;
Housden, Richard James ;
Hajnal, Joseph V. ;
Rhode, Kawal .
IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2023, 72
[7]   SonoNet: Real-Time Detection and Localisation of Fetal Standard Scan Planes in Freehand Ultrasound [J].
Baumgartner, Christian F. ;
Kamnitsas, Konstantinos ;
Matthew, Jacqueline ;
Fletcher, Tara P. ;
Smith, Sandra ;
Koch, Lisa M. ;
Kainz, Bernhard ;
Rueckert, Daniel .
IEEE TRANSACTIONS ON MEDICAL IMAGING, 2017, 36 (11) :2204-2215
[8]  
Belghazi MI, 2018, PR MACH LEARN RES, V80
[9]   MI-SegNet: Mutual Information-Based US Segmentation for Unseen Domain Generalization [J].
Bi, Yuan ;
Jiang, Zhongliang ;
Clarenbach, Ricarda ;
Ghotbi, Reza ;
Karlas, Angelos ;
Navab, Nassir .
MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION, MICCAI 2023, PT IV, 2023, 14223 :130-140
[10]   VesNet-RL: Simulation-Based Reinforcement Learning for Real-World US Probe Navigation [J].
Bi, Yuan ;
Jiang, Zhongliang ;
Gao, Yuan ;
Wendler, Thomas ;
Karlas, Angelos ;
Navab, Nassir .
IEEE ROBOTICS AND AUTOMATION LETTERS, 2022, 7 (03) :6638-6645