Deformable registration of lateral cephalogram and cone-beam computed tomography image

被引:8
作者
Zhang, Yungeng [1 ]
Qin, Haifang [1 ]
Li, Peixin [1 ]
Pei, Yuru [1 ]
Guo, Yuke [2 ]
Xu, Tianmin [3 ]
Zha, Hongbin [1 ]
机构
[1] Peking Univ, Dept Machine Intelligence, Key Lab Machine Percept MOE, Beijing, Peoples R China
[2] Luoyang Inst Sci & Technol, Luoyang, Peoples R China
[3] Peking Univ, Stomatol Hosp, Sch Stomatol, Beijing, Peoples R China
基金
中国国家自然科学基金; 北京市自然科学基金;
关键词
coarse-to-fine registration; deformable 2D-3D registration; deformation field encoding; iterative feedback; X-RAY; RIGID REGISTRATION; MUTUAL INFORMATION; PROXIMAL FEMUR; RECONSTRUCTION; VOLUMES; CASCADE;
D O I
10.1002/mp.15214
中图分类号
R8 [特种医学]; R445 [影像诊断学];
学科分类号
1002 ; 100207 ; 1009 ;
摘要
Purpose: This study aimed to design and evaluate a novel method for the registration of 2D lateral cephalograms and 3D craniofacial cone-beam computed tomography (CBCT) images, providing patient-specific 3D structures from a 2D lateral cephalogram without additional radiation exposure. Methods: We developed a cross-modal deformable registration model based on a deep convolutional neural network. Our approach took advantage of a low-dimensional deformation field encoding and an iterative feedback scheme to infer coarse-to-fine volumetric deformations. In particular, we constructed a statistical subspace of deformation fields and parameterized the nonlinear mapping function from an image pair, consisting of the target 2D lateral cephalogram and the reference volumetric CBCT, to a latent encoding of the deformation field. Instead of the one-shot registration by the learned mapping function, a feedback scheme was introduced to progressively update the reference volumetric image and to infer coarse-to-fine deformations fields, accounting for the shape variations of anatomical structures. A total of 220 clinically obtained CBCTs were used to train and validate the proposed model, among which 120 CBCTs were used to generate a training dataset with 24k paired synthetic lateral cephalograms and CBCTs. The proposed approach was evaluated on the deformable 2D-3D registration of clinically obtained lateral cephalograms and CBCTs from growing and adult orthodontic patients. Results: Strong structural consistencies were observed between the deformed CBCT and the target lateral cephalogram in all criteria. The proposed method achieved state-of-the-art performances with the mean contour deviation of 0.41 +/- 0.12 mm on the anterior cranial base, 0.48 +/- 0.17 mm on the mandible, and 0.35 +/- 0.08 mm on the maxilla, respectively. The mean surface mesh ranged from 0.78 to 0.97 mm on various craniofacial structures, and the LREs ranged from 0.83 to 1.24 mm on the growing datasets regarding 14 landmarks. The proposed iterative feedback scheme handled the structural details and improved the registration. The resultant deformed volumetric image was consistent with the target lateral cephalogram in both 2D projective planes and 3D volumetric space regarding the multicategory craniofacial structures. Conclusions: The results suggest that the deep learning-based 2D-3D registration model enables the deformable alignment of 2D lateral cephalograms and CBCTs and estimates patient-specific 3D craniofacial structures.
引用
收藏
页码:6901 / 6915
页数:15
相关论文
共 57 条
[1]  
[Anonymous], 2010, 2010 IEEE Computer society conference on computer vision and pattern recognition, DOI DOI 10.1109/CVPR.2010.5539906
[2]  
[Anonymous], 2013, BMVC
[3]  
Bahrami Khosro, 2017, Med Image Comput Comput Assist Interv, V10433, P764, DOI 10.1007/978-3-319-66182-7_87
[4]   2D-3D shape reconstruction of the distal femur from stereo X-ray imaging using statistical shape models [J].
Baka, N. ;
Kaptein, B. L. ;
de Bruijne, M. ;
van Walsum, T. ;
Giphart, J. E. ;
Niessen, W. J. ;
Lelieveldt, B. P. F. .
MEDICAL IMAGE ANALYSIS, 2011, 15 (06) :840-850
[5]  
Chen H, 2016, AAAI CONF ARTIF INTE, P1160
[6]   2D/3D image registration using regression learning [J].
Chou, Chen-Rui ;
Frederick, Brandon ;
Mageras, Gig ;
Chang, Sha ;
Pizer, Stephen .
COMPUTER VISION AND IMAGE UNDERSTANDING, 2013, 117 (09) :1095-1106
[7]  
Cui Z, 2014, LECT NOTES COMPUT SC, V8693, P49, DOI 10.1007/978-3-319-10602-1_4
[8]   Instance-aware Semantic Segmentation via Multi-task Network Cascades [J].
Dai, Jifeng ;
He, Kaiming ;
Sun, Jian .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :3150-3158
[9]   3D-2D image registration for target localization in spine surgery: investigation of similarity metrics providing robustness to content mismatch [J].
De Silva, T. ;
Uneri, A. ;
Ketcha, M. D. ;
Reaungamornrat, S. ;
Kleinszig, G. ;
Vogt, S. ;
Aygun, N. ;
Lo, S-F ;
Wolinsky, J-P ;
Siewerdsen, J. H. .
PHYSICS IN MEDICINE AND BIOLOGY, 2016, 61 (08) :3009-3025
[10]   A deep learning framework for unsupervised affine and deformable image registration [J].
de Vos, Bob D. ;
Berendsen, Floris F. ;
Viergever, Max A. ;
Sokooti, Hessam ;
Staring, Marius ;
Isgum, Ivana .
MEDICAL IMAGE ANALYSIS, 2019, 52 :128-143