CONVOLUTIONAL ANALYSIS OPERATOR LEARNING BY END-TO-END TRAINING OF ITERATIVE NEURAL NETWORKS

被引:0
|
作者
Kofler, Andreas [1 ,2 ]
Wald, Christian [3 ]
Schaeffter, Tobias [1 ,2 ,4 ,5 ]
Haltmeier, Markus [6 ]
Kolbitsch, Christoph [1 ,2 ,4 ]
机构
[1] Phys Tech Bundesanstalt, Berlin, Germany
[2] Phys Tech Bundesanstalt, Braunschweig, Germany
[3] Charite Univ Med Berlin, Dept Radiol, Berlin, Germany
[4] Kings Coll London, Sch Imaging Sci & Biomed Engn, London, England
[5] Tech Univ Berlin, Dept Biomed Engn, Berlin, Germany
[6] Univ Innsbruck, Dept Math, Innsbruck, Austria
关键词
Iterative Neural Networks; Sparsity; Analysis Operator; Compressed Sensing; Cardiac Cine MRI;
D O I
10.1109/ISBI52829.2022.9761621
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
The concept of sparsity has been extensively applied for regularization in image reconstruction. Typically, sparsifying transforms are either pre-trained on ground-truth images or adaptively trained during the reconstruction. Thereby, learning algorithms are designed to minimize some target function which encodes the desired properties of the transform. However, this procedure ignores the subsequently employed reconstruction algorithm as well as the physical model which is responsible for the image formation process. Iterative neural networks - which contain the physical model - can overcome these issues. In this work, we demonstrate how convolutional sparsifying filters can be efficiently learned by end-to-end training of iterative neural networks. We evaluated our approach on a non-Cartesian 2D cardiac cine MRI example and show that the obtained filters are better suitable for the corresponding reconstruction algorithm than the ones obtained by decoupled pre-training.
引用
收藏
页数:5
相关论文
共 50 条
  • [1] Convolutional Dictionary Learning by End-To-End Training of Iterative Neural Networks
    Kofler, Andreas
    Wald, Christian
    Schaeffter, Tobias
    Haltmeier, Markus
    Kolbitsch, Christoph
    2022 30TH EUROPEAN SIGNAL PROCESSING CONFERENCE (EUSIPCO 2022), 2022, : 1213 - 1217
  • [2] Training End-to-End Unrolled Iterative Neural Networks for SPECT Image Reconstruction
    Li, Zongyu
    Dewaraja, Yuni K.
    Fessler, Jeffrey A.
    IEEE TRANSACTIONS ON RADIATION AND PLASMA MEDICAL SCIENCES, 2023, 7 (04) : 410 - 420
  • [3] Leukocyte Segmentation via End-to-End Learning of Deep Convolutional Neural Networks
    Lu, Yan
    Fan, Haoyi
    Li, Zuoyong
    INTELLIGENCE SCIENCE AND BIG DATA ENGINEERING: VISUAL DATA ENGINEERING, PT I, 2019, 11935 : 191 - 200
  • [4] Handwritten Text Segmentation via End-to-End Learning of Convolutional Neural Networks
    Junho Jo
    Hyung Il Koo
    Jae Woong Soh
    Nam Ik Cho
    Multimedia Tools and Applications, 2020, 79 : 32137 - 32150
  • [5] End-to-End Text Recognition with Convolutional Neural Networks
    Wang, Tao
    Wu, David J.
    Coates, Adam
    Ng, Andrew Y.
    2012 21ST INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR 2012), 2012, : 3304 - 3308
  • [6] Handwritten Text Segmentation via End-to-End Learning of Convolutional Neural Networks
    Jo, Junho
    Koo, Hyung Il
    Soh, Jae Woong
    Cho, Nam Ik
    MULTIMEDIA TOOLS AND APPLICATIONS, 2020, 79 (43-44) : 32137 - 32150
  • [7] Training Convolutional Neural Networks and Compressed Sensing End-to-End for Microscopy Cell Detection
    Xue, Yao
    Bigras, Gilbert
    Hugh, Judith
    Ray, Nilanjan
    IEEE TRANSACTIONS ON MEDICAL IMAGING, 2019, 38 (11) : 2632 - 2641
  • [8] Streaming Convolutional Neural Networks for End-to-End Learning With Multi-Megapixel Images
    Pinckaers, Hans
    van Ginneken, Bram
    Litjens, Geert
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2022, 44 (03) : 1581 - 1590
  • [9] An End-to-End Compression Framework Based on Convolutional Neural Networks
    Jiang, Feng
    Tao, Wen
    Liu, Shaohui
    Ren, Jie
    Guo, Xun
    Zhao, Debin
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2018, 28 (10) : 3007 - 3018
  • [10] An End-to-End Compression Framework Based on Convolutional Neural Networks
    Tao, Wen
    Jiang, Feng
    Zhang, Shengping
    Ren, Jie
    Shi, Wuzhen
    Zuo, Wangmeng
    Guo, Xun
    Zhao, Debin
    2017 DATA COMPRESSION CONFERENCE (DCC), 2017, : 463 - 463