Flexible Alignment Super-Resolution Network for Multi-Contrast Magnetic Resonance Imaging

被引:6
作者
Liu, Yiming [1 ]
Zhang, Mengxi [2 ]
Jiang, Bo [3 ]
Hou, Bo [3 ]
Liu, Dan [3 ]
Chen, Jie [4 ]
Lian, Heqing [1 ]
机构
[1] Xiao Ying AI Lab, Beijing 100085, Peoples R China
[2] Tianjin Univ, Sch Elect & Informat Engn, Tianjin 300072, Peoples R China
[3] Peking Union Med Coll Hosp, Beijing 100730, Peoples R China
[4] Peking Univ, Sch Elect Engn & Comp Sci, Beijing 100871, Peoples R China
关键词
Superresolution; Magnetic resonance imaging; Semantics; Feature extraction; Hafnium; Task analysis; Image reconstruction; Feature alignment; feature fusion; magnetic resonance imaging; reference-based image super-resolution; MRI; SINGLE;
D O I
10.1109/TMM.2023.3330085
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Super-resolution is essential in improving the image quality of Magnetic Resonance Imaging (MRI). Existing MRI Super-Resolution methods leverage multi-contrast MRI and achieve satisfied effects. However, these methods perform alignment by calculating the similarity of single-scale semantic features between reference images and low-resolution images, which causes misalignment and limits the performance of MRI Super-Resolution. To tackle this problem, we propose the Flexible Alignment Super-resolution Network (FASR-Net) for multi-contrast MRI Super-resolution, which explores the interaction of multi-scale features. To this end, we first use the feature extractor to generate multi-scale features, including hierarchical features and semantic pyramid features. Subsequently, we introduce the Hierarchical-Feature Alignment (HF) module and the Semantic-Pyramid-Feature Alignment (SF) module to align hierarchical features and semantic pyramid features, respectively. Finally, the Cross-Hierarchical Progressive Fusion (CHPF) module fuses these aligned features at different scales, which further improves the model's performance. Extensive experiments on FastMRI and IXI datasets show that FASR-net achieves the most competitive results over state-of-the-art approaches.
引用
收藏
页码:5159 / 5169
页数:11
相关论文
共 38 条
[21]   Transformer for Single Image Super-Resolution [J].
Lu, Zhisheng ;
Li, Juncheng ;
Liu, Hong ;
Huang, Chaoyan ;
Zhang, Linlin ;
Zeng, Tieyong .
2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, CVPRW 2022, 2022, :456-465
[22]   Deep Multi-scale Convolutional Neural Network for Dynamic Scene Deblurring [J].
Nah, Seungjun ;
Kim, Tae Hyun ;
Lee, Kyoung Mu .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :257-265
[23]   Super-resolution methods in MRI: Can they improve the trade-off between resolution, signal-to-noise ratio, and acquisition time? [J].
Plenge, Esben ;
Poot, Dirk H. J. ;
Bernsen, Monique ;
Kotek, Gyula ;
Houston, Gavin ;
Wielopolski, Piotr ;
van der Weerd, Louise ;
Niessen, Wiro J. ;
Meijering, Erik .
MAGNETIC RESONANCE IN MEDICINE, 2012, 68 (06) :1983-1993
[24]   Image Super-Resolution via Iterative Refinement [J].
Saharia, Chitwan ;
Ho, Jonathan ;
Chan, William ;
Salimans, Tim ;
Fleet, David J. ;
Norouzi, Mohammad .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (04) :4713-4726
[25]   Robust Reference-based Super-Resolution with Similarity-Aware Deformable Convolution [J].
Shim, Gyumin ;
Park, Jinsun ;
Kweon, In So .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2020), 2020, :8422-8431
[26]  
Simonyan K, 2015, Arxiv, DOI [arXiv:1409.1556, DOI 10.48550/ARXIV.1409.1556, 10.3390/s21082852]
[27]  
Sun J, 2015, PROC CVPR IEEE, P769, DOI 10.1109/CVPR.2015.7298677
[28]   Super-resolution in magnetic resonance imaging: A review [J].
Van Reeth, Eric ;
Tham, Ivan W. K. ;
Tan, Cher Heng ;
Poh, Chueh Loo .
CONCEPTS IN MAGNETIC RESONANCE PART A, 2012, 40A (06) :306-325
[29]   ESRGAN: Enhanced Super-Resolution Generative Adversarial Networks [J].
Wang, Xintao ;
Yu, Ke ;
Wu, Shixiang ;
Gu, Jinjin ;
Liu, Yihao ;
Dong, Chao ;
Qiao, Yu ;
Loy, Chen Change .
COMPUTER VISION - ECCV 2018 WORKSHOPS, PT V, 2019, 11133 :63-79
[30]   Fine-Grained Attention and Feature-Sharing Generative Adversarial Networks for Single Image Super-Resolution [J].
Yan, Yitong ;
Liu, Chuangchuang ;
Chen, Changyou ;
Sun, Xianfang ;
Jin, Longcun ;
Peng, Xinyi ;
Zhou, Xiang .
IEEE TRANSACTIONS ON MULTIMEDIA, 2022, 24 :1473-1487