DuSFE: Dual-Channel Squeeze-Fusion-Excitation co-attention for cross-modality registration of cardiac SPECT and CT

被引:13
作者
Chen, Xiongchao [1 ]
Zhou, Bo [1 ]
Xie, Huidong [1 ]
Guo, Xueqi [1 ]
Zhang, Jiazhen [2 ]
Duncan, James S. [1 ,2 ]
Miller, Edward J. [1 ,2 ,3 ]
Sinusas, Albert J. [1 ,2 ,3 ]
Onofrey, John A. [1 ,2 ]
Liu, Chi [1 ,2 ]
机构
[1] Yale Univ, Dept Biomed Engn, New Haven, CT 06520 USA
[2] Yale Sch Med, Dept Radiol & Biomed Imaging, New Haven, CT USA
[3] Yale Univ, Dept Internal Med, New Haven, CT USA
基金
美国国家卫生研究院;
关键词
Cardiac SPECT; CT; Cross modality image registration; Attenuation Correction; Deep learning; ATTENUATION CORRECTION; MISALIGNMENT; MISREGISTRATION; TRANSMISSION; MRI; PET;
D O I
10.1016/j.media.2023.102840
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Myocardial perfusion imaging (MPI) using single-photon emission computed tomography (SPECT) is widely applied for the diagnosis of cardiovascular diseases. Attenuation maps (mu-maps) derived from computed tomography (CT) are utilized for attenuation correction (AC) to improve the diagnostic accuracy of cardiac SPECT. However, in clinical practice, SPECT and CT scans are acquired sequentially, potentially inducing misregistration between the two images and further producing AC artifacts. Conventional intensity-based registration methods show poor performance in the cross-modality registration of SPECT and CT-derived mu-maps since the two imaging modalities might present totally different intensity patterns. Deep learning has shown great potential in medical imaging registration. However, existing deep learning strategies for medical image registration encoded the input images by simply concatenating the feature maps of different convolutional layers, which might not fully extract or fuse the input information. In addition, deep-learning -based cross-modality registration of cardiac SPECT and CT-derived mu-maps has not been investigated before. In this paper, we propose a novel Dual-Channel Squeeze-Fusion-Excitation (DuSFE) co-attention module for the cross-modality rigid registration of cardiac SPECT and CT-derived mu-maps. DuSFE is designed based on the co-attention mechanism of two cross-connected input data streams. The channel-wise or spatial features of SPECT and mu-maps are jointly encoded, fused, and recalibrated in the DuSFE module. DuSFE can be flexibly embedded at multiple convolutional layers to enable gradual feature fusion in different spatial dimensions. Our studies using clinical patient MPI studies demonstrated that the DuSFE-embedded neural network generated significantly lower registration errors and more accurate AC SPECT images than existing methods. We also showed that the DuSFE-embedded network did not over-correct or degrade the registration performance of motion-free cases. The source code of this work is available at https://github.com/XiongchaoChen/DuSFE_ CrossRegistration.
引用
收藏
页数:14
相关论文
共 56 条
[1]   SPECT and PET in ischemic heart failure [J].
Angelidis, George ;
Giamouzis, Gregory ;
Karagiannis, Georgios ;
Butler, Javed ;
Tsougos, Ioannis ;
Valotassiou, Varvara ;
Giannakoulas, George ;
Dimakopoulos, Nikolaos ;
Xanthopoulos, Andrew ;
Skoularigis, John ;
Triposkiadis, Filippos ;
Georgoulias, Panagiotis .
HEART FAILURE REVIEWS, 2017, 22 (02) :243-261
[2]   VoxelMorph: A Learning Framework for Deformable Medical Image Registration [J].
Balakrishnan, Guha ;
Zhao, Amy ;
Sabuncu, Mert R. ;
Guttag, John ;
Dalca, Adrian, V .
IEEE TRANSACTIONS ON MEDICAL IMAGING, 2019, 38 (08) :1788-1800
[3]  
Barbu A, 2009, 2009 JOINT URBAN REMOTE SENSING EVENT, VOLS 1-3, P89
[4]   Automated quality control of emission-transmission misalignment for attenuation correction in myocardial perfusion imaging with SPECT-CT systems [J].
Chen, J ;
Caputlu-Wilson, SF ;
Shi, HC ;
Galt, JR ;
Faber, TL ;
Garcia, EV .
JOURNAL OF NUCLEAR CARDIOLOGY, 2006, 13 (01) :43-49
[5]  
Chen X., 2022, EUR J NUCL MED MOL I, P1
[6]  
Chen X., 2022, Journal of Nuclear Cardiology, P1
[7]  
Chen XC, 2022, LECT NOTES COMPUT SC, V13436, P46, DOI [10.1145/3549843.3549850, 10.1007/978-3-031-16446-0_5]
[8]   Comparison of Coronary CT Angiography, SPECT, PET, and Hybrid Imaging for Diagnosis of Ischemic Heart Disease Determined by Fractional Flow Reserve [J].
Danad, Ibrahim ;
Raijmakers, Pieter G. ;
Driessen, Roel S. ;
Leipsic, Jonathon ;
Raju, Rekha ;
Naoum, Chris ;
Knuuti, Juhani ;
Maki, Maija ;
Underwood, Richard S. ;
Min, James K. ;
Elmore, Kimberly ;
Stuijfzand, Wynand J. ;
van Royen, Niels ;
Tulevski, Igor I. ;
Somsen, Aernout G. ;
Huisman, Marc C. ;
van Lingen, Arthur A. ;
Heymans, Martijn W. ;
van de Ven, Peter M. ;
van Kuijk, Cornelis ;
Lammertsma, Adriaan A. ;
van Rossum, Albert C. ;
Knaapen, Paul .
JAMA CARDIOLOGY, 2017, 2 (10) :1100-1107
[9]   End-to-End Unsupervised Deformable Image Registration with a Convolutional Neural Network [J].
de Vos, Bob D. ;
Berendsen, Floris F. ;
Viergever, Max A. ;
Staring, Marius ;
Isgum, Ivana .
DEEP LEARNING IN MEDICAL IMAGE ANALYSIS AND MULTIMODAL LEARNING FOR CLINICAL DECISION SUPPORT, 2017, 10553 :204-212
[10]   Adversarial learning for mono- or multi-modal registration [J].
Fan, Jingfan ;
Cao, Xiaohuan ;
Wang, Qian ;
Yap, Pew-Thian ;
Shen, Dinggang .
MEDICAL IMAGE ANALYSIS, 2019, 58