Motion Estimation by Deep Learning in 2D Echocardiography: Synthetic Dataset and Validation

被引:18
|
作者
Evain, Ewan [1 ,2 ]
Sun, Yunyun [1 ]
Faraz, Khuram [1 ]
Garcia, Damien [1 ]
Saloux, Eric [3 ]
Gerber, Bernhard L. [4 ]
De Craene, Mathieu [2 ]
Bernard, Olivier [1 ]
机构
[1] Univ 1 Lyon, Inserm U1294, CNRS UMR5220, CREATIS,INSA Lyon, F-69621 Villeurbanne, France
[2] Philips Res Paris Medisys, F-92156 Suresnes, France
[3] Normandie Univ, Dept Cardiol, UNICAEN, CHU Caen Normandie,EA4650 SEILIRM, F-14000 Caen, France
[4] Clin Univ St Luc UCL, B-1200 Brussels, Belgium
关键词
Ultrasonic imaging; Myocardium; Motion estimation; Strain; Imaging; Speckle; Reverberation; Deep learning; echocardiography; motion estimation; ultrasound imaging;
D O I
10.1109/TMI.2022.3151606
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Motion estimation in echocardiography plays an important role in the characterization of cardiac function, allowing the computation of myocardial deformation indices. However, there exist limitations in clinical practice, particularly with regard to the accuracy and robustness of measurements extracted from images. We therefore propose a novel deep learning solution for motion estimation in echocardiography. Our network corresponds to a modified version of PWC-Net which achieves high performance on ultrasound sequences. In parallel, we designed a novel simulation pipeline allowing the generation of a large amount of realistic B-mode sequences. These synthetic data, together with strategies during training and inference, were used to improve the performance of our deep learning solution, which achieved an average endpoint error of 0.07 +/- 0.06 mm per frame and 1.20 +/- 0.67 mm between ED and ES on our simulated dataset. The performance of our method was further investigated on 30 patients from a publicly available clinical dataset acquired from a GE system. The method showed promise by achieving a mean absolute error of the global longitudinal strain of 2.5 +/- 2.1% and a correlation of 0.77 compared to GLS derived from manual segmentation, much better than one of the most efficient methods in the state-of-the-art (namely the FFT-Xcorr block-matching method). We finally evaluated our method on an auxiliary dataset including 30 patients from another center and acquired with a different system. Comparable results were achieved, illustrating the ability of our method to maintain high performance regardless of the echocardiographic data processed.
引用
收藏
页码:1911 / 1924
页数:14
相关论文
共 50 条
  • [21] Aberration correction in 2D echocardiography
    Masoy, Svein-Erik
    Denarie, Bastien
    Sornes, Anders
    Holte, Espen
    Grenne, Bjornar
    Espeland, Torvald
    Berg, Erik Andreas Rye
    Rindal, Ole Marius Hoel
    Rigby, Wayne
    Bjastad, Tore
    QUANTITATIVE IMAGING IN MEDICINE AND SURGERY, 2023, 13 (07) : 4603 - 4617
  • [22] 2D Facial Expression and Movement of Motion for Pain Identification With Deep Learning Methods
    Pikulkaew, Kornprom
    Boonchieng, Waraporn
    Boonchieng, Ekkarat
    Chouvatut, Varin
    IEEE ACCESS, 2021, 9 : 109903 - 109914
  • [23] A Survey on Deep Learning-Based 2D Human Pose Estimation Models
    Salisu S.
    Mohamed A.S.A.
    Jaafar M.H.
    Pauzi A.S.B.
    Younis H.A.
    Computers, Materials and Continua, 2023, 76 (02) : 2385 - 2400
  • [24] A Survey on Deep Learning-Based 2D Human Pose Estimation Models
    Salisu, Sani
    Mohamed, A. S. A.
    Jaafar, M. H.
    Pauzi, Ainun S. B.
    Younis, Hussain A.
    CMC-COMPUTERS MATERIALS & CONTINUA, 2023, 76 (02): : 2385 - 2400
  • [25] Adaptive multi-stage 2D image motion field estimation
    Neumann, U
    You, SY
    APPLICATIONS OF DIGITAL IMAGE PROCESSING XXI, 1998, 3460 : 116 - 123
  • [26] Multi-Task Learning for Motion Analysis and Segmentation in 3D Echocardiography
    Ta, Kevinminh
    Ahn, Shawn S.
    Thorn, Stephanie L.
    Stendahl, John C.
    Zhang, Xiaoran
    Langdon, Jonathan
    Staib, Lawrence H.
    Sinusas, Albert J.
    Duncan, James S.
    IEEE TRANSACTIONS ON MEDICAL IMAGING, 2024, 43 (05) : 2010 - 2020
  • [27] SISMIK for Brain MRI: Deep-Learning-Based Motion Estimation and Model-Based Motion Correction in k-Space
    Dabrowski, Oscar
    Falcone, Jean-Luc
    Klauser, Antoine
    Songeon, Julien
    Kocher, Michel
    Chopard, Bastien
    Lazeyras, Francois
    Courvoisier, Sebastien
    IEEE TRANSACTIONS ON MEDICAL IMAGING, 2025, 44 (01) : 396 - 408
  • [28] 3DCD: A NEW DATASET FOR 2D AND 3D CHANGE DETECTION USING DEEP LEARNING TECHNIQUES
    Coletta, V
    Marsocci, V
    Ravanelli, R.
    XXIV ISPRS CONGRESS: IMAGING TODAY, FORESEEING TOMORROW, COMMISSION III, 2022, 43-B3 : 1349 - 1354
  • [29] Deep Learning with a Spatiotemporal Descriptor of Appearance and Motion Estimation for Video Anomaly Detection
    Gunale, Kishanprasad G.
    Mukherji, Prachi
    JOURNAL OF IMAGING, 2018, 4 (06):
  • [30] A mathematical model for the 3d location estimation of 2D echocardiography data
    Ahn, Chi Young
    Yun, Sangwoon
    APPLIED MATHEMATICS LETTERS, 2019, 88 : 186 - 192