3D CROSS-SCALE FEATURE TRANSFORMER NETWORK FOR BRAIN MR IMAGE SUPER-RESOLUTION

被引:4
|
作者
Zhang, Wanqi [1 ]
Wang, Lulu [1 ]
Chen, Wei [1 ]
Jia, Yuanyuan [2 ]
He, Zhongshi [1 ]
Du, Jinglong [2 ]
机构
[1] Chongqing Univ, Coll Comp Sci, Chongqing, Peoples R China
[2] Chongqing Med Univ, Coll Med Informat, Chongqing, Peoples R China
关键词
Magnetic resonance image; Cross-scale self-similarity; Super-resolution; Attention mechanism;
D O I
10.1109/ICASSP43922.2022.9746092
中图分类号
O42 [声学];
学科分类号
070206 ; 082403 ;
摘要
High-resolution (HR) magnetic resonance (MR) images could provide reliable visual information for clinical diagnosis. Recently, super-resolution (SR) methods based on convolutional neural networks (CNNs) have shown great potential in obtaining HR MR images. However, most existing CNN-based SR methods neglect the internal priors of the MR image, which hides the performance of SR. In this work, we propose a 3D cross-scale feature transformer network (CFTN) to utilize the cross-scale priors within MR features. Specifically, we stack multiple 3D residual channel attention blocks (RCABs) as the backbone. Meanwhile, we design a plug-in mutual-projection feature enhancement module (MFEM) to extract the target-scale features with HR cues, which is able to capture the global cross-scale self-similarity within features and can be flexibly inserted into any position of the backbone. Furthermore, we propose a spatial attention fusion module (SAFM) to adaptively adjust and fuse the target-scale features and upsampled features that are respectively extracted by the MFEM and the backbone. Experimental results show that our CFTN achieves a new state-of-the-art MR image SR performance.
引用
收藏
页码:1356 / 1360
页数:5
相关论文
共 50 条
  • [41] ROBUST SINGLE-IMAGE SUPER-RESOLUTION USING CROSS-SCALE SELF-SIMILARITY
    Salvador, Jordi
    Perez-Pellitero, Eduardo
    Kochale, Axel
    2014 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2014, : 2135 - 2139
  • [42] An efficient and lightweight image super-resolution with feature network
    Zang, Yongsheng
    Zhou, Dongming
    Wang, Changcheng
    Nie, Rencan
    Guo, Yanbu
    OPTIK, 2022, 255
  • [43] Residual Feature Aggregation Network for Image Super-Resolution
    Liu, Jie
    Zhang, Wenjie
    Tang, Yuting
    Tang, Jie
    Wu, Gangshan
    2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, : 2356 - 2365
  • [44] Feature Preserving and Enhancing Network for Image Super-Resolution
    Su, Minglan
    Li, Xinchi
    Xu, Jiaoyang
    Yang, Mingchuan
    Zhang, Chaoying
    IEEE ACCESS, 2023, 11 : 132867 - 132877
  • [45] Feature Fusion Attention Network for Image Super-resolution
    Zhou D.-W.
    Ma L.-Y.
    Tian J.-Y.
    Sun X.-X.
    Zidonghua Xuebao/Acta Automatica Sinica, 2022, 48 (09): : 2233 - 2241
  • [46] Depth Map Super-Resolution Reconstruction Based on Deeply Supervised Cross-Scale Attention Network
    Li T.
    Dong X.-C.
    Lin H.-W.
    Tien Tzu Hsueh Pao/Acta Electronica Sinica, 2023, 51 (01): : 128 - 138
  • [47] HYPERSPECTRAL IMAGE SUPER-RESOLUTION BASED ON MULTI-SCALE WAVELET 3D CONVOLUTIONAL NEURAL NETWORK
    Yang, Jingxiang
    Zhao, Yong-Qiang
    Chan, Jonathan Cheung-Wai
    2019 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS 2019), 2019, : 2770 - 2773
  • [48] Cross-Scale Reference-Based Light Field Super-Resolution
    Zhao, Mandan
    Wu, Gaochang
    Li, Yipeng
    Hao, Xiangyang
    Fang, Lu
    Liu, Yebin
    IEEE TRANSACTIONS ON COMPUTATIONAL IMAGING, 2018, 4 (03) : 406 - 418
  • [49] Accelerated Super-resolution MR Image Reconstruction via a 3D Densely Connected Deep Convolutional Neural Network
    Du, Jinglong
    Wang, Lulu
    Gholipour, Ali
    He, Zhongshi
    Jia, Yuanyuan
    PROCEEDINGS 2018 IEEE INTERNATIONAL CONFERENCE ON BIOINFORMATICS AND BIOMEDICINE (BIBM), 2018, : 349 - 355
  • [50] Complementary Transformer Network for cross-scale single image denoising
    Zhang, Min
    Liu, Xun
    Liu, Hanbo
    Hu, Jian
    ALEXANDRIA ENGINEERING JOURNAL, 2024, 109 : 1 - 10