Motion Estimation by Deep Learning in 2D Echocardiography: Synthetic Dataset and Validation

被引:18
作者
Evain, Ewan [1 ,2 ]
Sun, Yunyun [1 ]
Faraz, Khuram [1 ]
Garcia, Damien [1 ]
Saloux, Eric [3 ]
Gerber, Bernhard L. [4 ]
De Craene, Mathieu [2 ]
Bernard, Olivier [1 ]
机构
[1] Univ 1 Lyon, Inserm U1294, CNRS UMR5220, CREATIS,INSA Lyon, F-69621 Villeurbanne, France
[2] Philips Res Paris Medisys, F-92156 Suresnes, France
[3] Normandie Univ, Dept Cardiol, UNICAEN, CHU Caen Normandie,EA4650 SEILIRM, F-14000 Caen, France
[4] Clin Univ St Luc UCL, B-1200 Brussels, Belgium
关键词
Ultrasonic imaging; Myocardium; Motion estimation; Strain; Imaging; Speckle; Reverberation; Deep learning; echocardiography; motion estimation; ultrasound imaging;
D O I
10.1109/TMI.2022.3151606
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Motion estimation in echocardiography plays an important role in the characterization of cardiac function, allowing the computation of myocardial deformation indices. However, there exist limitations in clinical practice, particularly with regard to the accuracy and robustness of measurements extracted from images. We therefore propose a novel deep learning solution for motion estimation in echocardiography. Our network corresponds to a modified version of PWC-Net which achieves high performance on ultrasound sequences. In parallel, we designed a novel simulation pipeline allowing the generation of a large amount of realistic B-mode sequences. These synthetic data, together with strategies during training and inference, were used to improve the performance of our deep learning solution, which achieved an average endpoint error of 0.07 +/- 0.06 mm per frame and 1.20 +/- 0.67 mm between ED and ES on our simulated dataset. The performance of our method was further investigated on 30 patients from a publicly available clinical dataset acquired from a GE system. The method showed promise by achieving a mean absolute error of the global longitudinal strain of 2.5 +/- 2.1% and a correlation of 0.77 compared to GLS derived from manual segmentation, much better than one of the most efficient methods in the state-of-the-art (namely the FFT-Xcorr block-matching method). We finally evaluated our method on an auxiliary dataset including 30 patients from another center and acquired with a different system. Comparable results were achieved, illustrating the ability of our method to maintain high performance regardless of the echocardiographic data processed.
引用
收藏
页码:1911 / 1924
页数:14
相关论文
共 50 条
  • [41] GMCAD: an original Synthetic Dataset of 2D Designs along their Geometrical and Mechanical Conditions
    Almasri, Waad
    Bettebghor, Dimitri
    Adjed, Faouzi
    Ababsa, Fakhreddine
    Danglade, Florence
    3RD INTERNATIONAL CONFERENCE ON INDUSTRY 4.0 AND SMART MANUFACTURING, 2022, 200 : 337 - 347
  • [42] Fast Synthetic Dataset for Kitchen Object Segmentation in Deep Learning
    Sagues-Tanco, Ruben
    Benages-Pardo, Luis
    Lopez-Nicolas, Gonzalo
    Llorente, Sergio
    IEEE ACCESS, 2020, 8 : 220496 - 220506
  • [43] Deep learning-based automated left ventricular ejection fraction assessment using 2-D echocardiography
    Liu, Xin
    Fan, Yiting
    Li, Shuang
    Chen, Meixiang
    Li, Ming
    Hau, William Kongto
    Zhang, Heye
    Xu, Lin
    Lee, Alex Pui-Wai
    AMERICAN JOURNAL OF PHYSIOLOGY-HEART AND CIRCULATORY PHYSIOLOGY, 2021, 321 (02): : H390 - H399
  • [44] High-Frame-Rate Contrast-Enhanced Echocardiography Using Diverging Waves: 2-D Motion Estimation and Compensation
    Nie, Luzhen
    Cowell, David M. J.
    Carpenter, Thomas M.
    McLaughlan, James R.
    Cubukcu, Arzu A.
    Freear, Steven
    IEEE TRANSACTIONS ON ULTRASONICS FERROELECTRICS AND FREQUENCY CONTROL, 2019, 66 (02) : 359 - 371
  • [45] Forceps Motion Estimation in Laparoscopic Surgery using Deep Learning for Robotic Camera Control
    Minamoto, Masahiko
    Umetani, Yamato
    Hori, Shigeki
    Miyazaki, Tetsuro
    Kawashima, Kenji
    2021 IEEE INTERNATIONAL CONFERENCE ON MECHATRONICS AND AUTOMATION (IEEE ICMA 2021), 2021, : 448 - 453
  • [46] Deep motion estimation through adversarial learning for gait recognition
    Yue, Yuanhao
    Shi, Laixiang
    Zheng, Zheng
    Chen, Long
    Wang, Zhongyuan
    Zou, Qin
    PATTERN RECOGNITION LETTERS, 2024, 184 : 232 - 237
  • [47] On learning deep domain-invariant features from 2D synthetic images for industrial visual inspection
    Abubakr, Abdelrahman G.
    Jovancevic, Igor
    Mokhtari, Nour Islam
    Ben Abdallah, Hamdi
    Orteu, Jean-Jose
    FIFTEENTH INTERNATIONAL CONFERENCE ON QUALITY CONTROL BY ARTIFICIAL VISION, 2021, 11794
  • [48] 2D Amplitude-Modulation Frequency-Modulation - based Method for Motion Estimation
    Murray, Victor
    Rodriguez, Paul
    Noriega, Maria
    Dasso, Alvaro
    Pattichis, Marios S.
    2015 IEEE 6TH LATIN AMERICAN SYMPOSIUM ON CIRCUITS & SYSTEMS (LASCAS), 2015,
  • [49] 3D Reconstruction and Estimation from Single-view 2D Image by Deep Learning A Survey
    Shan, Yongfeng
    Liang, Christy Jie
    Xu, Min
    2024 IEEE CONFERENCE ON ARTIFICIAL INTELLIGENCE, CAI 2024, 2024, : 1 - 7
  • [50] 2D Instantaneous Frequency-based Method for Motion Estimation using Total Variation
    Murray, Victor
    Rodriguez, Paul
    Pattichis, Marios S.
    2014 IEEE GLOBAL CONFERENCE ON SIGNAL AND INFORMATION PROCESSING (GLOBALSIP), 2014, : 1009 - 1013