Research on a 3D Lung Computed Tomography Image Registration Method Based on Unsupervised Learning

被引:0
作者
Jiang S. [1 ]
Zhang H. [1 ]
Yang Z. [1 ]
Zhang G. [1 ]
机构
[1] School of Mechanical Engineering, Tianjin University, Tianjin
来源
Tianjin Daxue Xuebao (Ziran Kexue yu Gongcheng Jishu Ban)/Journal of Tianjin University Science and Technology | 2022年 / 55卷 / 03期
基金
中国国家自然科学基金;
关键词
Convolution neural network; Data augmentation; Deformable registration; Jacobian regula-rization; Unsupervised learning;
D O I
10.11784/tdxbz202010040
中图分类号
学科分类号
摘要
Deformable registration of 3D lung CT images is crucial in medical image registration. However, nonlinear deformation and large-scale displacement of lung tissues caused by respiratory motion pose great challenges in the deformable registration of 3D lung CT images. Thus, we present a fast end-to-end registration method based on unsupervised learning. We opti-mized the classic U-Net model and added Inception modules between skip connections. The Inception module aims to capture and merge information at different spatial scales for generating a high-precision dense displacement vector field. To ensure a smooth displacement vector field, we introduced the Jacobian regularization term into the loss function to directly penalize the singularity of the displacement field during training. The existing publicly available datasets cannot implement model training. To address over-fitting caused by limited data resources and to expand the training data, we proposed a data augmentation method based on a 3D thin plate spline transform. Moreover, 6060 CT scans will be generated based on the EMPIRE10 dataset, which contains 60 original CT scans to meet the requirement of convolution neural network training. Regarding the DIR-Lab 4DCT dataset, we achieved a target registration error of 2.09mm, an optimal Dice score of 0.987, and almost no folding voxels in comparison with the experimental results obtained using the deep learning method Voxelmorph and registration packages, such as advanced normalization tools (ANTs) and Elastix. © 2022, Editorial Board of Journal of Tianjin University(Science and Technology). All right reserved.
引用
收藏
页码:247 / 254
页数:7
相关论文
共 16 条
[1]  
Kaus M R, Brock K K, Pekar V, Et al., Assessment of a model-based deformable image registration approach for radiation therapy planning, International Journal of Radiation Oncology Biology Physics, 68, 2, pp. 572-580, (2007)
[2]  
Yu Z H, Lin S H, Balter P, Et al., A comparison of tumor motion characteristics between early stage and locally advanced stage lung cancers, Radiotherapy & Oncology, 104, 1, pp. 33-38, (2012)
[3]  
Avants B B, Epstein C L, Grossman M, Et al., Symmetric diffeomorphic image registration with cross-correlation: Evaluating automated labeling of elderly and neurodegenerative brain, Medical Image Analysis, 12, 1, pp. 26-41, (2008)
[4]  
Thirion J P., Image matching as diffusion process: An analogy with Maxwell's demons, Medical Image Analysis, 2, 3, pp. 243-260, (1998)
[5]  
Fan J, Cao X, Yap P T, Et al., BIRNet: Brain image registration using dual-supervised fully convolutional networks, Medical Image Analysis, 54, 1, pp. 193-206, (2018)
[6]  
Hu Yipeng, Marc M, Eli G, Et al., Label-driven weakly-supervised learning for multimodal deformable image registration
[7]  
Miao S, Wang Z J, Liao R., A CNN regression approach for real-time 2D/3D registration, IEEE Transactions on Medical Imaging, 35, 5, pp. 1352-1363, (2016)
[8]  
Balakrishnan G, Zhao A, Sabuncu M R, Et al., VoxelMorph: A learning framework for deformable medical image registration, IEEE Transactions on Medical Imaging, 38, 8, pp. 1788-1800, (2019)
[9]  
Zhao S, Dong Y, Chang E, Et al., Recursive cascaded networks for unsupervised medical image registration, IEEE/CVF International Conference on Computer Vision, pp. 10599-10609, (2019)
[10]  
Max J, Karen S, Andrew Z, Et al., Spatial transformer networks