Hybrid unsupervised paradigm based deformable image fusion for 4D CT lung image modality

被引:11
作者
Iqbal, Muhammad Zafar [1 ]
Razzak, Imran [1 ]
Qayyum, Abdul [2 ]
Nguyen, Thanh Thi [3 ]
Tanveer, M. [4 ]
Sowmya, Arcot [1 ]
机构
[1] Univ New South Wales, Sch Comp Sci & Engn, Sydney, Australia
[2] Imperial Coll London, Natl Heart & Lung Inst, London, England
[3] Monash Univ, Fac Informat Technol, Melbourne, Australia
[4] Indian Inst Technol Indore, Dept Math, Indore, India
关键词
Deep learning; Image fusion; Lung 4D CT; Multi resolution; Deformation; Image registration; NONRIGID REGISTRATION; FRAMEWORK; ALGORITHM; MOTION;
D O I
10.1016/j.inffus.2023.102061
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Deformable image registration plays a critical role in various clinical applications (e.g., image fusion, atlas creation, and tumors targeting). In radiation therapy, especially in the context of fast registration of computed tomography (CT) lung image modalities, it is used to determine the geometric transformation by relating the anatomic points in two images. The main challenge lies in effectively addressing the nonlinear large and small deformation between the inspiration and expiration phases. In this work, we propose an unsupervised hybrid paradigm-based registration network (HPRN) for the registration of 4D CT lung images without relying on ground truth data. The proposed HPRN exhibits effective learning of multi-scale and multi-resolution features, leading to the computation of a more accurate Deformation Vector Field (DVF). Furthermore, we incorporate the regularization, image similarity and Jacobian determinant loss functions, which results in improving capability in dealing with complex large and small deformations. We evaluate the effectiveness of the proposed model on the publicly accessible DIRLab 4DCT lung image dataset, which shows the effectiveness of the proposed framework by achieving better Target Registration Error (2.04 +/- 1.42 mm) compared to other state-of-the-art unsupervised image registration algorithms.
引用
收藏
页数:10
相关论文
共 70 条
[1]   A fast diffeomorphic image registration algorithm [J].
Ashburner, John .
NEUROIMAGE, 2007, 38 (01) :95-113
[2]   An Unsupervised Learning Model for Deformable Medical Image Registration [J].
Balakrishnan, Guha ;
Zhao, Amy ;
Sabuncu, Mert R. ;
Guttag, John ;
Dalca, Adrian V. .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :9252-9260
[3]   BRIEF: Binary Robust Independent Elementary Features [J].
Calonder, Michael ;
Lepetit, Vincent ;
Strecha, Christoph ;
Fua, Pascal .
COMPUTER VISION-ECCV 2010, PT IV, 2010, 6314 :778-792
[4]   Deformable Image Registration Using a Cue-Aware Deep Regression Network [J].
Cao, Xiaohuan ;
Yang, Jianhua ;
Zhang, Jun ;
Wang, Qian ;
Yap, Pew-Thian ;
Shen, Dinggang .
IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING, 2018, 65 (09) :1900-1911
[5]  
Cao Xiaohuan, 2017, Med Image Comput Comput Assist Interv, V10433, P300, DOI 10.1007/978-3-319-66182-7_35
[6]   A framework for evaluation of deformable image registration spatial accuracy using large landmark point sets [J].
Castillo, Richard ;
Castillo, Edward ;
Guerra, Rudy ;
Johnson, Valen E. ;
McPhail, Travis ;
Garg, Amit K. ;
Guerrero, Thomas .
PHYSICS IN MEDICINE AND BIOLOGY, 2009, 54 (07) :1849-1870
[7]   Multi-contrast large deformation diffeomorphic metric mapping for diffusion tensor imaging [J].
Ceritoglu, Can ;
Oishi, Kenichi ;
Li, Xin ;
Chou, Ming-Chung ;
Younes, Laurent ;
Albert, Marilyn ;
Lyketsos, Constantine ;
van Zijl, Peter C. M. ;
Miller, Michael I. ;
Mori, Susumu .
NEUROIMAGE, 2009, 47 (02) :618-627
[8]   Deformable registration of lung 3DCT images using an unsupervised heterogeneous multi-resolution neural network [J].
Chang, Qing ;
Zhang, Jieming .
MEDICAL & BIOLOGICAL ENGINEERING & COMPUTING, 2023, 61 (09) :2353-2365
[9]  
Commowick O, 2012, 2012 9TH IEEE INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING (ISBI), P700, DOI 10.1109/ISBI.2012.6235644
[10]   Unsupervised Learning for Fast Probabilistic Diffeomorphic Registration [J].
Dalca, Adrian V. ;
Balakrishnan, Guha ;
Guttag, John ;
Sabuncu, Mert R. .
MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2018, PT I, 2018, 11070 :729-738