Multi-scale Super-Resolution Magnetic Resonance Spectroscopic Imaging with Adjustable Sharpness

被引:5
作者
Dong, Siyuan [1 ]
Hangel, Gilbert [2 ]
Bogner, Wolfgang [2 ]
Widhalm, Georg [3 ]
Roessler, Karl [3 ]
Trattnig, Siegfried [2 ]
You, Chenyu [1 ]
de Graaf, Robin [4 ]
Onofrey, John A. [4 ]
Duncan, James S. [1 ,4 ]
机构
[1] Yale Univ, Elect Engn, New Haven, CT 06520 USA
[2] Med Univ Vienna, Biomed Imaging & Image Guided Therapy, Highfield MR Ctr, Vienna, Austria
[3] Med Univ Vienna, Neurosurg, Vienna, Austria
[4] Yale Univ, Radiol & Biomed Imaging, New Haven, CT USA
来源
MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION, MICCAI 2022, PT VI | 2022年 / 13436卷
关键词
Brain MRSI; Super-resolution; Network conditioning; NETWORK;
D O I
10.1007/978-3-031-16446-0_39
中图分类号
TB8 [摄影技术];
学科分类号
0804 ;
摘要
Magnetic Resonance Spectroscopic Imaging (MRSI) is a valuable tool for studying metabolic activities in the human body, but the current applications are limited to low spatial resolutions. The existing deep learning-based MRSI super-resolution methods require training a separate network for each upscaling factor, which is time-consuming and memory inefficient. We tackle this multi-scale super-resolution problem using a Filter Scaling strategy that modulates the convolution filters based on the upscaling factor, such that a single network can be used for various upscaling factors. Observing that each metabolite has distinct spatial characteristics, we also modulate the network based on the specific metabolite. Furthermore, our network is conditioned on the weight of adversarial loss so that the perceptual sharpness of the super-resolved metabolic maps can be adjusted within a single network. We incorporate these network conditionings using a novel MultiConditional Module. The experiments were carried out on a H-1-MRSI dataset from 15 high-grade glioma patients. Results indicate that the proposed network achieves the best performance among several multiscale super-resolution methods and can provide super-resolved metabolic maps with adjustable sharpness. Our code is available at https://github. com/dsy199610/Multiscale-SR-MRSI-adjustable-sharpness.
引用
收藏
页码:410 / 420
页数:11
相关论文
共 34 条
  • [1] Latent Filter Scaling for Multimodal Unsupervised Image-to-Image Translation
    Alharbi, Yazeed
    Smith, Neil
    Wonka, Peter
    [J]. 2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 1458 - 1466
  • [2] Accelerated MR spectroscopic imaging-a review of current and emerging techniques
    Bogner, Wolfgang
    Otazo, Ricardo
    Henning, Anke
    [J]. NMR IN BIOMEDICINE, 2021, 34 (05)
  • [3] Extracellular pH mapping of liver cancer on a clinical 3T MRI scanner
    Coman, Daniel
    Peters, Dana C.
    Walsh, John J.
    Savic, Lynn J.
    Huber, Steffen
    Sinusas, Albert J.
    Lin, MingDe
    Chapiro, Julius
    Constable, R. Todd
    Rothman, Douglas L.
    Duncan, James S.
    Hyder, Fahmeed
    [J]. MAGNETIC RESONANCE IN MEDICINE, 2020, 83 (05) : 1553 - 1564
  • [4] Deuterium metabolic imaging (DMI) for MRI-based 3D mapping of metabolism in vivo
    De Feyter, Henk M.
    Behar, Kevin L.
    Corbin, Zachary A.
    Fulbright, Robert K.
    Brown, Peter B.
    McIntyre, Scott
    Nixon, Terence W.
    Rothman, Douglas L.
    de Graaf, Robin A.
    [J]. SCIENCE ADVANCES, 2018, 4 (08):
  • [5] de Graaf RA, 2019, IN VIVO NMR SPECTROS
  • [6] Dense Multi-path U-Net for Ischemic Stroke Lesion Segmentation in Multiple Image Modalities
    Dolz, Jose
    Ayed, Ismail Ben
    Desrosiers, Christian
    [J]. BRAINLESION: GLIOMA, MULTIPLE SCLEROSIS, STROKE AND TRAUMATIC BRAIN INJURIES, BRAINLES 2018, PT I, 2019, 11383 : 271 - 282
  • [7] Dong S., 2022, arXiv
  • [8] Dong S., 2020, P 28 ANN M ISMRM
  • [9] High-Resolution Magnetic Resonance Spectroscopic Imaging using a Multi-Encoder Attention U-Net with Structural and Adversarial Loss
    Dong, Siyuan
    Hangel, Gilbert
    Bogner, Wolfgang
    Trattnig, Siegfried
    Roessler, Karl
    Widhalm, Georg
    De Feyter, Henk M.
    de Graaf, Robin A.
    Duncan, James S.
    [J]. 2021 43RD ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE & BIOLOGY SOCIETY (EMBC), 2021, : 2891 - 2895
  • [10] Gulrajani I, 2017, Arxiv, DOI arXiv:1704.00028