Generating anthropomorphic phantoms using fully unsupervised deformable image registration with convolutional neural networks

被引:29
作者
Chen, Junyu [1 ,2 ]
Li, Ye [1 ,2 ]
Du, Yong [2 ]
Frey, Eric C. [1 ,2 ]
机构
[1] Johns Hopkins Univ, Dept Elect & Comp Engn, Baltimore, MD 21287 USA
[2] Johns Hopkins Med Inst, Russell H Morgan Dept Radiol & Radiol Sci, Baltimore, MD 21287 USA
关键词
computerized Phantom; convolutional Neural Networks; deep Neural Networks; image Registration; medical Image Simulation; MONTE-CARLO; LEARNING FRAMEWORK; CT; RECONSTRUCTION; REGULARIZATION; SIMULATION; SPECT; MAXIMIZATION; ALIGNMENT; SCATTER;
D O I
10.1002/mp.14545
中图分类号
R8 [特种医学]; R445 [影像诊断学];
学科分类号
1002 ; 100207 ; 1009 ;
摘要
Purpose: Computerized phantoms have been widely used in nuclear medicine imaging for imaging system optimization and validation. Although the existing computerized phantoms can model anatomical variations through organ and phantom scaling, they do not provide a way to fully reproduce the anatomical variations and details seen in humans. In this work, we present a novel registration-based method for creating highly anatomically detailed computerized phantoms. We experimentally show substantially improved image similarity of the generated phantom to a patient image. Methods: We propose a deep-learning-based unsupervised registration method to generate a highly anatomically detailed computerized phantom by warping an XCAT phantom to a patient computed tomography (CT) scan. We implemented and evaluated the proposed method using the NURBS-based XCAT phantom and a publicly available low-dose CT dataset from TCIA. A rigorous tradeoff analysis between image similarity and deformation regularization was conducted to select the loss function and regularization term for the proposed method. A novel SSIM-based unsupervised objective function was proposed. Finally, ablation studies were conducted to evaluate the performance of the proposed method (using the optimal regularization and loss function) and the current state-of-the-art unsupervised registration methods. Results: The proposed method outperformed the state-of-the-art registration methods, such as SyN and VoxelMorph, by more than 8%, measured by the SSIM and less than 30%, by the MSE. The phantom generated by the proposed method was highly detailed and was almost identical in appearance to a patient image. Conclusions: A deep-learning-based unsupervised registration method was developed to create anthropomorphic phantoms with anatomies labels that can be used as the basis for modeling organ properties. Experimental results demonstrate the effectiveness of the proposed method. The resulting anthropomorphic phantom is highly realistic. Combined with realistic simulations of the image formation process, the generated phantoms could serve in many applications of medical imaging research. (C) 2020 American Association of Physicists in Medicine
引用
收藏
页码:6366 / 6380
页数:15
相关论文
共 70 条
[1]  
Abadi M, 2016, PROCEEDINGS OF OSDI'16: 12TH USENIX SYMPOSIUM ON OPERATING SYSTEMS DESIGN AND IMPLEMENTATION, P265
[2]   Contourlet-based active contour model for PET image segmentation [J].
Abdoli, M. ;
Dierckx, R. A. J. O. ;
Zaidi, H. .
MEDICAL PHYSICS, 2013, 40 (08)
[3]  
[Anonymous], 1989, Theory of statistical inference and information
[4]  
[Anonymous], Nature Switzerland
[5]  
[Anonymous], 2015, Tech. Rep.
[6]   A fast diffeomorphic image registration algorithm [J].
Ashburner, John .
NEUROIMAGE, 2007, 38 (01) :95-113
[7]   Symmetric diffeomorphic image registration with cross-correlation: Evaluating automated labeling of elderly and neurodegenerative brain [J].
Avants, B. B. ;
Epstein, C. L. ;
Grossman, M. ;
Gee, J. C. .
MEDICAL IMAGE ANALYSIS, 2008, 12 (01) :26-41
[8]  
Avants BB., 2009, HeanetIe, V10, P1, DOI DOI 10.1007/S12021-011-9109-Y
[9]   VoxelMorph: A Learning Framework for Deformable Medical Image Registration [J].
Balakrishnan, Guha ;
Zhao, Amy ;
Sabuncu, Mert R. ;
Guttag, John ;
Dalca, Adrian, V .
IEEE TRANSACTIONS ON MEDICAL IMAGING, 2019, 38 (08) :1788-1800
[10]   An Unsupervised Learning Model for Deformable Medical Image Registration [J].
Balakrishnan, Guha ;
Zhao, Amy ;
Sabuncu, Mert R. ;
Guttag, John ;
Dalca, Adrian V. .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :9252-9260