Heterogeneous Virtual Population of Simulated CMR Images for Improving the Generalization of Cardiac Segmentation Algorithms

被引:3
作者
Al Khalil, Yasmina [1 ]
Amirrajab, Sina [1 ]
Lorenz, Cristian [2 ]
Weese, Juergen [2 ]
Breeuwer, Marcel [1 ,3 ]
机构
[1] Eindhoven Univ Technol, Eindhoven, Netherlands
[2] Philips Res Labs, Hamburg, Germany
[3] Philips Healthcare, MR R&D Clin Sci, Best, Netherlands
来源
SIMULATION AND SYNTHESIS IN MEDICAL IMAGING, SASHIMI 2020 | 2020年 / 12417卷
关键词
Image simulation; Transfer learning; Virtual population; Cardiac magnetic resonance imaging; Cardiac segmentation; RELAXATION;
D O I
10.1007/978-3-030-59520-3_8
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Simulating a large set of medical images with variability in anatomical representation and image appearance has the potential to provide solutions for addressing the scarcity of properly annotated data in medical image analysis research. However, due to the complexity of modeling the imaging procedure and lack of accuracy and flexibility in anatomical models, available solutions in this area are limited. In this paper, we investigate the feasibility of simulating diversified cardiac magnetic resonance (CMR) images on virtual male and female subjects of the eXtended Cardiac and Torso phantoms (XCAT) with variable anatomical representation. Taking advantage of the flexibility of the XCAT phantoms, we create virtual subjects comprising different body sizes, heart volumes, and orientations to account for natural variability among patients. To resemble inherent image quality and contrast variability in data, we vary acquisition parameters together with MR tissue properties to simulate diverse-looking images. The database includes 3240 CMR images of 30 male and 30 female subjects. To assess the usefulness of such data, we train a segmentation model with the simulated images and fine-tune it on a small subset of real data. Our experiment results show that we can reduce the number of real data by almost 80% while retaining the accuracy of the prediction using models pre-trained on simulated images, as well as achieve a better performance in terms of generalization to varying contrast. Thus, our simulated database serves as a promising solution to address the current challenges in medical imaging and could aid the inclusion of automated solutions in clinical routines.
引用
收藏
页码:68 / 79
页数:12
相关论文
共 15 条
[1]  
Abbasi-Sureshjani S., 2020, Medical Imaging with Deep Learning
[2]  
Abraham N, 2019, I S BIOMED IMAGING, P683, DOI 10.1109/ISBI.2019.8759329
[3]   Deep Learning Techniques for Automatic MRI Cardiac Multi-Structures Segmentation and Diagnosis: Is the Problem Solved? [J].
Bernard, Olivier ;
Lalande, Alain ;
Zotti, Clement ;
Cervenansky, Frederick ;
Yang, Xin ;
Heng, Pheng-Ann ;
Cetin, Irem ;
Lekadir, Karim ;
Camara, Oscar ;
Gonzalez Ballester, Miguel Angel ;
Sanroma, Gerard ;
Napel, Sandy ;
Petersen, Steffen ;
Tziritas, Georgios ;
Grinias, Elias ;
Khened, Mahendra ;
Kollerathu, Varghese Alex ;
Krishnamurthi, Ganapathy ;
Rohe, Marc-Michel ;
Pennec, Xavier ;
Sermesant, Maxime ;
Isensee, Fabian ;
Jaeger, Paul ;
Maier-Hein, Klaus H. ;
Full, Peter M. ;
Wolf, Ivo ;
Engelhardt, Sandy ;
Baumgartner, Christian F. ;
Koch, Lisa M. ;
Wolterink, Jelmer M. ;
Isgum, Ivana ;
Jang, Yeonggul ;
Hong, Yoonmi ;
Patravali, Jay ;
Jain, Shubham ;
Humbert, Olivier ;
Jodoin, Pierre-Marc .
IEEE TRANSACTIONS ON MEDICAL IMAGING, 2018, 37 (11) :2514-2525
[4]   What are normal relaxation times of tissues at 3 T? [J].
Bojorquez, Jorge Zavala ;
Bricq, Stephanie ;
Acquitter, Clement ;
Brunotte, Francois ;
Walker, Paul M. ;
Lalande, Alain .
MAGNETIC RESONANCE IMAGING, 2017, 35 :69-80
[5]  
Chartsias Agisilaos, 2017, Simulation and Synthesis in Medical Imaging. Second International Workshop, SASHIMI 2017. Held in Conjunction with MICCAI 2017. Proceedings: LNCS 10557, P3, DOI 10.1007/978-3-319-68127-6_1
[6]   Simulation and Synthesis in Medical Imaging [J].
Frangi, Alejandro F. ;
Tsaftaris, Sotirios A. ;
Prince, Jerry L. .
IEEE TRANSACTIONS ON MEDICAL IMAGING, 2018, 37 (03) :673-679
[7]   Generative Adversarial Networks [J].
Goodfellow, Ian ;
Pouget-Abadie, Jean ;
Mirza, Mehdi ;
Xu, Bing ;
Warde-Farley, David ;
Ozair, Sherjil ;
Courville, Aaron ;
Bengio, Yoshua .
COMMUNICATIONS OF THE ACM, 2020, 63 (11) :139-144
[8]   Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification [J].
He, Kaiming ;
Zhang, Xiangyu ;
Ren, Shaoqing ;
Sun, Jian .
2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2015, :1026-1034
[9]   3D Medical Image Synthesis by Factorised Representation and Deformable Model Learning [J].
Joyce, Thomas ;
Kozerke, Sebastian .
SIMULATION AND SYNTHESIS IN MEDICAL IMAGING, SASHIMI 2019, 2019, 11827 :110-119
[10]  
Razzak MI, 2018, L N COMPUT VIS BIOME, V26, P323, DOI 10.1007/978-3-319-65981-7_12