Deformable medical image registration based on wavelet transform and linear attention

被引:0
作者
Li, Weisheng [1 ]
Gan, Kun [1 ]
Yang, Lijian [1 ]
Zhang, Yin [1 ]
机构
[1] Chongqing Univ Posts & Telecommun, Chongqing Key Lab Image Cognit, Chongqing 400065, Peoples R China
关键词
Medical image registration; Linear attention; Wavelet transform;
D O I
10.1016/j.bspc.2024.106413
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
Medical image registration, which is the process of aligning two medical images to ensure spatial consistency, is extensively utilized in surgical navigation, lesion localization, and other fields. In recent years, Transformerbased models have achieved state-of-the-art image registration results. However, these models often lose significant information during image downsampling, and the window division operation in the window attention module disrupts the integrity of the anatomical structure, which limits the model's ability to capture global features. To address these problems, this study introduces an image registration model based on the wavelet transform and linear attention. Specifically, the discrete wavelet transform is leveraged to decompose the image, to provide more features to the model and harness the rich high -frequency information achieved from the wavelet transform, to effectively mitigate the information loss arising from downsampling. Wavelet transform and linear attention are combined to propose a linear wavelet self -attention (LWSA) module. Compared with other attention modules, this unique linear attention calculation method in LWSA reduces the computational complexity and significantly expands the receptive field of the module, ensuring the integrity of the anatomical structure. Additionally, the introduction of the wavelet transform allows the model to pay differential attention to different areas, thereby improving the model's performance. The efficacy of the proposed model in registration tasks was validated through comparative experiments with other models on three publicly available brain imaging datasets.
引用
收藏
页数:14
相关论文
共 48 条
  • [11] End-to-End Unsupervised Deformable Image Registration with a Convolutional Neural Network
    de Vos, Bob D.
    Berendsen, Floris F.
    Viergever, Max A.
    Staring, Marius
    Isgum, Ivana
    [J]. DEEP LEARNING IN MEDICAL IMAGE ANALYSIS AND MULTIMODAL LEARNING FOR CLINICAL DECISION SUPPORT, 2017, 10553 : 204 - 212
  • [12] Dosovitskiy A, 2021, Arxiv, DOI arXiv:2010.11929
  • [13] Deep Wavelet Prediction for Image Super-resolution
    Guo, Tiantong
    Mousavi, Hojjat Seyed
    Vu, Tiep Huu
    Monga, Vishal
    [J]. 2017 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2017, : 1100 - 1109
  • [14] FLatten Transformer: Vision Transformer using Focused Linear Attention
    Han, Dongchen
    Pan, Xuran
    Han, Yizeng
    Song, Shiji
    Huang, Gao
    [J]. 2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION, ICCV, 2023, : 5938 - 5948
  • [15] Difficulty-aware hierarchical convolutional neural networks for deformable registration of brain MR images
    Huang, Yunzhi
    Ahmad, Sahar
    Fan, Jingfan
    Shen, Dinggang
    Yap, Pew-Thian
    [J]. MEDICAL IMAGE ANALYSIS, 2021, 67
  • [16] Katharopoulos A, 2020, PR MACH LEARN RES, V119
  • [17] CycleMorph: Cycle consistent unsupervised deformable image registration
    Kim, Boah
    Kim, Dong Hwan
    Park, Seong Ho
    Kim, Jieun
    Lee, June-Goo
    Ye, Jong Chul
    [J]. MEDICAL IMAGE ANALYSIS, 2021, 71
  • [18] Kitaev N., 2020, arXiv
  • [19] An Adaptive Region-Based Transformer for Nonrigid Medical Image Registration With a Self-Constructing Latent Graph
    Lan, Sheng
    Li, Xiu
    Guo, Zhenhua
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (11) : 16409 - 16423
  • [20] Wavelet Integrated CNNs for Noise-Robust Image Classification
    Li, Qiufu
    Shen, Linlin
    Guo, Sheng
    Lai, Zhihui
    [J]. 2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, : 7243 - 7252