DopUS-Net: Quality-Aware Robotic Ultrasound Imaging Based on Doppler Signal

被引:9
作者
Jiang, Zhongliang [1 ]
Duelmer, Felix [1 ]
Navab, Nassir [1 ]
机构
[1] Tech Univ Munich TUM, Chair Comp Aided Med Procedures & Augmented Real C, D-85748 Garching, Germany
关键词
Robotic ultrasound; vessel segmentation; ultra-sound segmentation; 3D visualization; RECONSTRUCTION; SEGMENTATION; DOMAINS; SYSTEM;
D O I
10.1109/TASE.2023.3277331
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Medical ultrasound (US) is widely used to evaluate and stage vascular diseases, in particular for the preliminary screening program, due to the advantage of being radiation-free. However, automatic segmentation of small tubular structures (e.g., the ulnar artery) from cross-sectional US images is still challenging. To address this challenge, this paper proposes the DopUS-Net and a vessel re-identification module that leverage the Doppler effect to enhance the final segmentation result. Firstly, the DopUS-Net combines the Doppler images with B-mode images to increase the segmentation accuracy and robustness of small blood vessels. It incorporates two encoders to exploit the maximum potential of the Doppler signal and recurrent neural network modules to preserve sequential information. Input to the first encoder is a two-channel duplex image representing the combination of the grey-scale Doppler and B-mode images to ensure anatomical spatial correctness. The second encoder operates on the pure Doppler images to provide a region proposal. Secondly, benefiting from the Doppler signal, this work first introduces an online artery re-identification module to qualitatively evaluate the real-time segmentation results and automatically optimize the probe pose for enhanced Doppler images. This quality-aware module enables the closed-loop control of robotic screening to further improve the confidence and robustness of image segmentation. The experimental results demonstrate that the proposed approach with the re-identification process can significantly improve the accuracy and robustness of the segmentation results (Dice score: from 0.54 to 0.86; intersection over union: from 0.47 to 0.78).
引用
收藏
页码:3229 / 3242
页数:14
相关论文
共 54 条
  • [1] Image-guided control of a robot for medical ultrasound
    Abolmaesumi, P
    Salcudean, SE
    Zhu, WH
    Sirouspour, MR
    DiMaio, SP
    [J]. IEEE TRANSACTIONS ON ROBOTICS AND AUTOMATION, 2002, 18 (01): : 11 - 23
  • [2] Ballas Nicolas, 2016, ICLR
  • [3] Beniwal Sunil, 2014, Indian Heart J, V66, P506, DOI 10.1016/j.ihj.2014.08.010
  • [4] Federated disentangled representation learning for unsupervised brain anomaly detection
    Bercea, Cosmin, I
    Wiestler, Benedikt
    Rueckert, Daniel
    Albarqouni, Shadi
    [J]. NATURE MACHINE INTELLIGENCE, 2022, 4 (08) : 685 - +
  • [5] Bertels J, 2019, MICCAI 2019, DOI DOI 10.1007/978-3-030-32245-811
  • [6] Bi Y., 2023, ARXIV
  • [7] VesNet-RL: Simulation-Based Reinforcement Learning for Real-World US Probe Navigation
    Bi, Yuan
    Jiang, Zhongliang
    Gao, Yuan
    Wendler, Thomas
    Karlas, Angelos
    Navab, Nassir
    [J]. IEEE ROBOTICS AND AUTOMATION LETTERS, 2022, 7 (03) : 6638 - 6645
  • [8] Bradski G, 2000, DR DOBBS J, V25, P120
  • [9] Deep learning robotic guidance for autonomous vascular access
    Chen, Alvin I.
    Balter, Max L.
    Maguire, Timothy J.
    Yarmush, Martin L.
    [J]. NATURE MACHINE INTELLIGENCE, 2020, 2 (02) : 104 - +
  • [10] Cho K., 2014, ARXIV14061078, V1406, P1078, DOI DOI 10.3115/V1/D14-1179