DEEP REINFORCEMENT LEARNING BASED UNROLLING NETWORK FOR MRI RECONSTRUCTION

被引:1
|
作者
Wang, Chong [1 ]
Zhang, Rongkai [1 ]
Maliakal, Gabriel [2 ]
Ravishankar, Saiprasad [2 ,3 ]
Wen, Bihan [1 ]
机构
[1] Nanyang Technol Univ, Sch Elect Elect Engn, Singapore, Singapore
[2] Michigan State Univ, Dept Computat Math,Sci & Engn, E Lansing, MI 48824 USA
[3] Michigan State Univ, Dept Biomed Engn, E Lansing, MI USA
关键词
Deep unrolling; compressed sensing; deep reinforcement learning; magnetic resonance imaging; image reconstruction;
D O I
10.1109/ISBI53787.2023.10230611
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Compressed sensing (CS) has been popular in magnetic resonance imaging (MRI) and accelerates the measurement acquisition process by undersampling data in k-space while exploiting sparsity and incoherence to achieve accurate reconstructions. Deep learning methods have recently demonstrated superior performance for MRI reconstruction from undersampled data. However, most of the methods rely on complex models to achieve promising results via deterministic optimization. Alternatively, very recent works utilize deep reinforcement learning (DRL) to restore high-quality images, where a policy is learned to select appropriate actions or tools to progressively refine corrupted images with a simple network model. However, the model capability of DRL-based approaches is, to some extent, limited due to its finite action space. Moreover, most of these DRL methods are physics-free, while it is well-known that the prior concerning the physical forward model is extremely crucial for solving ill-posed inverse problems such as in CS-MRI. Motivated by these challenges, we propose a novel DRL-based unrolling framework by integrating model priors into the intrinsic iterative process of DRL strategy for MRI reconstruction. Thus the capability of the DRL model is significantly enhanced by exploiting the merits of the unrolling scheme with almost no additional computational cost. Extensive experiments demonstrate that our proposed DRL-based unrolling framework achieves superior MRI reconstruction performance compared with the previous baselines.
引用
收藏
页数:5
相关论文
共 50 条
  • [1] Learning Unrolling-Based Neural Network for Magnetic Resonance Imaging Reconstruction
    Yan, Qiunv
    Liu, Li
    Mei, Lanyin
    IMAGE ANALYSIS AND PROCESSING, ICIAP 2022, PT I, 2022, 13231 : 124 - 136
  • [2] DEEP LEARNING FOR MRI RECONSTRUCTION USING A NOVEL PROJECTION BASED CASCADED NETWORK
    Kocanaogullari, Deniz
    Eksioglu, Ender M.
    2019 IEEE 29TH INTERNATIONAL WORKSHOP ON MACHINE LEARNING FOR SIGNAL PROCESSING (MLSP), 2019,
  • [3] PtychoDV: Vision Transformer-Based Deep Unrolling Network for Ptychographic Image Reconstruction
    Gan, Weijie
    Zhai, Qiuchen
    Mccann, Michael T.
    Cardona, Cristina Garcia
    Kamilov, Ulugbek S.
    Wohlberg, Brendt
    IEEE OPEN JOURNAL OF SIGNAL PROCESSING, 2024, 5 : 539 - 547
  • [4] Deep learning based MRI reconstruction with transformer
    Wu, Zhengliang
    Liao, Weibin
    Yan, Chao
    Zhao, Mangsuo
    Liu, Guowen
    Ma, Ning
    Li, Xuesong
    COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE, 2023, 233
  • [5] DLGAN: Undersampled MRI reconstruction using Deep Learning based Generative Adversarial Network
    Noor, Rida
    Wahid, Abdul
    Bazai, Sibghat Ullah
    Khan, Asad
    Fang, Meie
    Syam, M. S.
    Bhatti, Uzair Aslam
    Ghadi, Yazeed Yasin
    BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2024, 93
  • [6] A deep unrolling network inspired by total variation for compressed sensing MRI
    Zhang, Xiaohua
    Lian, Qiusheng
    Yang, Yuchi
    Su, Yueming
    DIGITAL SIGNAL PROCESSING, 2020, 107
  • [7] Deep learning-based Intraoperative MRI reconstruction
    Ottesen, Jon Andre
    Storas, Tryggve
    Vatnehol, Svein Are Sirirud
    Lovland, Grethe
    Vik-Mo, Einar Osland
    Schellhorn, Till
    Skogen, Karoline
    Larsson, Christopher
    Bjornerud, Atle
    Groote-Eindbaas, Inge Rasmus
    Caan, Matthan W. A.
    EUROPEAN RADIOLOGY EXPERIMENTAL, 2025, 9 (01)
  • [8] Deep Shutter Unrolling Network
    Liu, Peidong
    Cui, Zhaopeng
    Larsson, Viktor
    Pollefeys, Marc
    2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, : 5940 - 5948
  • [9] A Dual Deep Network Based Secure Deep Reinforcement Learning Method
    Zhu F.
    Wu W.
    Fu Y.-C.
    Liu Q.
    Jisuanji Xuebao/Chinese Journal of Computers, 2019, 42 (08): : 1812 - 1826
  • [10] Secure wireless network system based on deep reinforcement learning network
    Yan, Xiaolong
    Feng, Yingying
    OPTIK, 2022, 271