Flexible Alignment Super-Resolution Network for Multi-Contrast Magnetic Resonance Imaging

被引:5
作者
Liu, Yiming [1 ]
Zhang, Mengxi [2 ]
Jiang, Bo [3 ]
Hou, Bo [3 ]
Liu, Dan [3 ]
Chen, Jie [4 ]
Lian, Heqing [1 ]
机构
[1] Xiao Ying AI Lab, Beijing 100085, Peoples R China
[2] Tianjin Univ, Sch Elect & Informat Engn, Tianjin 300072, Peoples R China
[3] Peking Union Med Coll Hosp, Beijing 100730, Peoples R China
[4] Peking Univ, Sch Elect Engn & Comp Sci, Beijing 100871, Peoples R China
关键词
Superresolution; Magnetic resonance imaging; Semantics; Feature extraction; Hafnium; Task analysis; Image reconstruction; Feature alignment; feature fusion; magnetic resonance imaging; reference-based image super-resolution; MRI; SINGLE;
D O I
10.1109/TMM.2023.3330085
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Super-resolution is essential in improving the image quality of Magnetic Resonance Imaging (MRI). Existing MRI Super-Resolution methods leverage multi-contrast MRI and achieve satisfied effects. However, these methods perform alignment by calculating the similarity of single-scale semantic features between reference images and low-resolution images, which causes misalignment and limits the performance of MRI Super-Resolution. To tackle this problem, we propose the Flexible Alignment Super-resolution Network (FASR-Net) for multi-contrast MRI Super-resolution, which explores the interaction of multi-scale features. To this end, we first use the feature extractor to generate multi-scale features, including hierarchical features and semantic pyramid features. Subsequently, we introduce the Hierarchical-Feature Alignment (HF) module and the Semantic-Pyramid-Feature Alignment (SF) module to align hierarchical features and semantic pyramid features, respectively. Finally, the Cross-Hierarchical Progressive Fusion (CHPF) module fuses these aligned features at different scales, which further improves the model's performance. Extensive experiments on FastMRI and IXI datasets show that FASR-net achieves the most competitive results over state-of-the-art approaches.
引用
收藏
页码:5159 / 5169
页数:11
相关论文
共 38 条
  • [1] brain-development, 2007, IXI
  • [2] Reference-Based Image Super-Resolution with Deformable Attention Transformer
    Cao, Jiezhang
    Liang, Jingyun
    Zhang, Kai
    Li, Yawei
    Zhang, Yulun
    Wang, Wenguan
    Van Gool, Luc
    [J]. COMPUTER VISION - ECCV 2022, PT XVIII, 2022, 13678 : 325 - 342
  • [3] Cross Parallax Attention Network for Stereo Image Super-Resolution
    Chen, Canqiang
    Qing, Chunmei
    Xu, Xiangmin
    Dickinson, Patrick
    [J]. IEEE TRANSACTIONS ON MULTIMEDIA, 2022, 24 : 202 - 216
  • [4] Accuracy of 3-T MRI using susceptibility-weighted imaging to detect meniscal tears of the knee
    Chen, Wei
    Zhao, Jun
    Wen, Yaming
    Xie, Bin
    Zhou, Xuanling
    Guo, Lin
    Yang, Liu
    Wang, Jian
    Dai, Yongming
    Zhou, Daiquan
    [J]. KNEE SURGERY SPORTS TRAUMATOLOGY ARTHROSCOPY, 2015, 23 (01) : 198 - 204
  • [5] Deformable Convolutional Networks
    Dai, Jifeng
    Qi, Haozhi
    Xiong, Yuwen
    Li, Yi
    Zhang, Guodong
    Hu, Han
    Wei, Yichen
    [J]. 2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, : 764 - 773
  • [6] Second-order Attention Network for Single Image Super-Resolution
    Dai, Tao
    Cai, Jianrui
    Zhang, Yongbing
    Xia, Shu-Tao
    Zhang, Lei
    [J]. 2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 11057 - 11066
  • [7] Image Super-Resolution Using Deep Convolutional Networks
    Dong, Chao
    Loy, Chen Change
    He, Kaiming
    Tang, Xiaoou
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2016, 38 (02) : 295 - 307
  • [8] Multi-contrast MRI Super-Resolution via a Multi-stage Integration Network
    Feng, Chun-Mei
    Fu, Huazhu
    Yuan, Shuhao
    Xu, Yong
    [J]. MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2021, PT VI, 2021, 12906 : 140 - 149
  • [9] Image Super-Resolution Using Knowledge Distillation
    Gao, Qinquan
    Zhao, Yan
    Li, Gen
    Tong, Tong
    [J]. COMPUTER VISION - ACCV 2018, PT II, 2019, 11362 : 527 - 541
  • [10] Implicit Diffusion Models for Continuous Super-Resolution
    Gao, Sicheng
    Liu, Xuhui
    Zeng, Bohan
    Xu, Sheng
    Li, Yanjing
    Luo, Xiaoyan
    Liu, Jianzhuang
    Zhen, Xiantong
    Zhang, Baochang
    [J]. 2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 10021 - 10030