DopUS-Net: Quality-Aware Robotic Ultrasound Imaging Based on Doppler Signal

被引:9
作者
Jiang, Zhongliang [1 ]
Duelmer, Felix [1 ]
Navab, Nassir [1 ]
机构
[1] Tech Univ Munich TUM, Chair Comp Aided Med Procedures & Augmented Real C, D-85748 Garching, Germany
关键词
Robotic ultrasound; vessel segmentation; ultra-sound segmentation; 3D visualization; RECONSTRUCTION; SEGMENTATION; DOMAINS; SYSTEM;
D O I
10.1109/TASE.2023.3277331
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Medical ultrasound (US) is widely used to evaluate and stage vascular diseases, in particular for the preliminary screening program, due to the advantage of being radiation-free. However, automatic segmentation of small tubular structures (e.g., the ulnar artery) from cross-sectional US images is still challenging. To address this challenge, this paper proposes the DopUS-Net and a vessel re-identification module that leverage the Doppler effect to enhance the final segmentation result. Firstly, the DopUS-Net combines the Doppler images with B-mode images to increase the segmentation accuracy and robustness of small blood vessels. It incorporates two encoders to exploit the maximum potential of the Doppler signal and recurrent neural network modules to preserve sequential information. Input to the first encoder is a two-channel duplex image representing the combination of the grey-scale Doppler and B-mode images to ensure anatomical spatial correctness. The second encoder operates on the pure Doppler images to provide a region proposal. Secondly, benefiting from the Doppler signal, this work first introduces an online artery re-identification module to qualitatively evaluate the real-time segmentation results and automatically optimize the probe pose for enhanced Doppler images. This quality-aware module enables the closed-loop control of robotic screening to further improve the confidence and robustness of image segmentation. The experimental results demonstrate that the proposed approach with the re-identification process can significantly improve the accuracy and robustness of the segmentation results (Dice score: from 0.54 to 0.86; intersection over union: from 0.47 to 0.78).
引用
收藏
页码:3229 / 3242
页数:14
相关论文
共 54 条
  • [41] Micikevicius P., 2018, 6 INT C LEARNING REP, P1
  • [42] Ultrasound Image Segmentation: A Deeply Supervised Network With Attention to Boundaries
    Mishra, Deepak
    Chaudhury, Santanu
    Sarkar, Mukul
    Soin, Arvinder Singh
    [J]. IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING, 2019, 66 (06) : 1637 - 1648
  • [43] MODEL-BASED CORRECTION OF TISSUE COMPRESSION FOR TRACKED ULTRASOUND IN SOFT TISSUE IMAGE-GUIDED SURGERY
    Pheiffer, Thomas S.
    Thompson, Reid C.
    Rucker, Daniel C.
    Simpson, Amber L.
    Miga, Michael I.
    [J]. ULTRASOUND IN MEDICINE AND BIOLOGY, 2014, 40 (04) : 788 - 803
  • [44] Pierrot F, 1999, Med Image Anal, V3, P285, DOI 10.1016/S1361-8415(99)80025-5
  • [45] Peripheral arterial calcification: Prevalence, mechanism, detection, and clinical implications
    Rocha-Singh, Krishna J.
    Zeller, Thomas
    Jaff, Michael R.
    [J]. CATHETERIZATION AND CARDIOVASCULAR INTERVENTIONS, 2014, 83 (06) : E212 - E220
  • [46] U-Net: Convolutional Networks for Biomedical Image Segmentation
    Ronneberger, Olaf
    Fischer, Philipp
    Brox, Thomas
    [J]. MEDICAL IMAGE COMPUTING AND COMPUTER-ASSISTED INTERVENTION, PT III, 2015, 9351 : 234 - 241
  • [47] A survey on Image Data Augmentation for Deep Learning
    Shorten, Connor
    Khoshgoftaar, Taghi M.
    [J]. JOURNAL OF BIG DATA, 2019, 6 (01)
  • [48] Real-Time Automatic Artery Segmentation, Reconstruction and Registration for Ultrasound-Guided Regional Anaesthesia of the Femoral Nerve
    Smistad, Erik
    Lindseth, Frank
    [J]. IEEE TRANSACTIONS ON MEDICAL IMAGING, 2016, 35 (03) : 752 - 761
  • [49] Generalised Dice Overlap as a Deep Learning Loss Function for Highly Unbalanced Segmentations
    Sudre, Carole H.
    Li, Wenqi
    Vercauteren, Tom
    Ourselin, Sebastien
    Cardoso, M. Jorge
    [J]. DEEP LEARNING IN MEDICAL IMAGE ANALYSIS AND MULTIMODAL LEARNING FOR CLINICAL DECISION SUPPORT, 2017, 10553 : 240 - 248
  • [50] A Flexible and Fully Autonomous Breast Ultrasound Scanning System
    Tan, Jiyong
    Li, Bing
    Li, Yuanwei
    Li, Bin
    Chen, Xinxing
    Wu, Jiayi
    Luo, Baoming
    Leng, Yuquan
    Rong, Yiming
    Fu, Chenglong
    [J]. IEEE TRANSACTIONS ON AUTOMATION SCIENCE AND ENGINEERING, 2023, 20 (03) : 1920 - 1933