Motion Estimation by Deep Learning in 2D Echocardiography: Synthetic Dataset and Validation

被引:18
|
作者
Evain, Ewan [1 ,2 ]
Sun, Yunyun [1 ]
Faraz, Khuram [1 ]
Garcia, Damien [1 ]
Saloux, Eric [3 ]
Gerber, Bernhard L. [4 ]
De Craene, Mathieu [2 ]
Bernard, Olivier [1 ]
机构
[1] Univ 1 Lyon, Inserm U1294, CNRS UMR5220, CREATIS,INSA Lyon, F-69621 Villeurbanne, France
[2] Philips Res Paris Medisys, F-92156 Suresnes, France
[3] Normandie Univ, Dept Cardiol, UNICAEN, CHU Caen Normandie,EA4650 SEILIRM, F-14000 Caen, France
[4] Clin Univ St Luc UCL, B-1200 Brussels, Belgium
关键词
Ultrasonic imaging; Myocardium; Motion estimation; Strain; Imaging; Speckle; Reverberation; Deep learning; echocardiography; motion estimation; ultrasound imaging;
D O I
10.1109/TMI.2022.3151606
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Motion estimation in echocardiography plays an important role in the characterization of cardiac function, allowing the computation of myocardial deformation indices. However, there exist limitations in clinical practice, particularly with regard to the accuracy and robustness of measurements extracted from images. We therefore propose a novel deep learning solution for motion estimation in echocardiography. Our network corresponds to a modified version of PWC-Net which achieves high performance on ultrasound sequences. In parallel, we designed a novel simulation pipeline allowing the generation of a large amount of realistic B-mode sequences. These synthetic data, together with strategies during training and inference, were used to improve the performance of our deep learning solution, which achieved an average endpoint error of 0.07 +/- 0.06 mm per frame and 1.20 +/- 0.67 mm between ED and ES on our simulated dataset. The performance of our method was further investigated on 30 patients from a publicly available clinical dataset acquired from a GE system. The method showed promise by achieving a mean absolute error of the global longitudinal strain of 2.5 +/- 2.1% and a correlation of 0.77 compared to GLS derived from manual segmentation, much better than one of the most efficient methods in the state-of-the-art (namely the FFT-Xcorr block-matching method). We finally evaluated our method on an auxiliary dataset including 30 patients from another center and acquired with a different system. Comparable results were achieved, illustrating the ability of our method to maintain high performance regardless of the echocardiographic data processed.
引用
收藏
页码:1911 / 1924
页数:14
相关论文
共 50 条
  • [1] A deep learning phase-based solution in 2D echocardiography motion estimation
    Khoubani, Sahar
    Moradi, Mohammad Hassan
    PHYSICAL AND ENGINEERING SCIENCES IN MEDICINE, 2024, 47 (04) : 1691 - 1703
  • [2] Deep Learning for Segmentation Using an Open Large-Scale Dataset in 2D Echocardiography
    Leclerc, Sarah
    Smistad, Erik
    Pedrosa, Joao
    Ostvik, Andreas
    Cervenansky, Frederic
    Espinosa, Florian
    Espeland, Torvald
    Berg, Erik Andreas Rye
    Jodoin, Pierre-Marc
    Grenier, Thomas
    Lartizien, Carole
    D'hooge, Jan
    Lovstakken, Lasse
    Bernard, Olivier
    IEEE TRANSACTIONS ON MEDICAL IMAGING, 2019, 38 (09) : 2198 - 2210
  • [3] Segmentation of Left Ventricle in 2D Echocardiography Using Deep Learning
    Azarmehr, Neda
    Ye, Xujiong
    Sacchi, Stefania
    Howard, James P.
    Francis, Darrel P.
    Zolgharni, Massoud
    MEDICAL IMAGE UNDERSTANDING AND ANALYSIS, MIUA 2019, 2020, 1065 : 497 - 504
  • [4] Enhanced motion estimation by training a deep learning optical flow algorithm on a hybrid dataset
    Pulido, Andrea
    Burman, Nitin
    Manetti, Claudia
    Queiros, Sandro
    D'hooge, Jan
    2022 IEEE INTERNATIONAL ULTRASONICS SYMPOSIUM (IEEE IUS), 2022,
  • [5] Towards deep learning methods for quantification of the right ventricle using 2D echocardiography
    Kampaktsis, Polydoros N.
    Moustakidis, Serafeim
    Siasos, Gerasimos
    Vavuranakis, Manolis
    Lebehn, Mark
    FUTURE CARDIOLOGY, 2024, 20 (7-8) : 339 - 341
  • [6] Generalizability and quality control of deep learning-based 2D echocardiography segmentation models in a large clinical dataset
    Xiaoyan Zhang
    Alvaro E. Ulloa Cerna
    Joshua V. Stough
    Yida Chen
    Brendan J. Carry
    Amro Alsaid
    Sushravya Raghunath
    David P. vanMaanen
    Brandon K. Fornwalt
    Christopher M. Haggerty
    The International Journal of Cardiovascular Imaging, 2022, 38 : 1685 - 1697
  • [7] Generalizability and quality control of deep learning-based 2D echocardiography segmentation models in a large clinical dataset
    Zhang, Xiaoyan
    Cerna, Alvaro E. Ulloa
    Stough, Joshua, V
    Chen, Yida
    Carry, Brendan J.
    Alsaid, Amro
    Raghunath, Sushravya
    VanMaanen, David P.
    Fornwalt, Brandon K.
    Haggerty, Christopher M.
    INTERNATIONAL JOURNAL OF CARDIOVASCULAR IMAGING, 2022, 38 (08) : 1685 - 1697
  • [8] Motion Estimation in Echocardiography Using Sparse Representation and Dictionary Learning
    Ouzir, Nora
    Basarab, Adrian
    Liebgott, Herve
    Harbaoui, Brahim
    Tourneret, Jean-Yves
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2018, 27 (01) : 64 - 77
  • [9] Deep Learning Based Joint PET Image Reconstruction and Motion Estimation
    Li, Tiantian
    Zhang, Mengxi
    Qi, Wenyuan
    Asma, Evren
    Qi, Jinyi
    IEEE TRANSACTIONS ON MEDICAL IMAGING, 2022, 41 (05) : 1230 - 1241
  • [10] Deep Learning Based 2D Human Pose Estimation:A Survey
    Qi Dang
    Jianqin Yin
    Bin Wang
    Wenqing Zheng
    Tsinghua Science and Technology, 2019, 24 (06) : 663 - 676