One-Shot Learning for Deformable Medical Image Registration and Periodic Motion Tracking

被引:79
作者
Fechter, Tobias [1 ]
Baltas, Dimos [1 ]
机构
[1] Univ Freiburg, Dept Radiat Oncol, German Canc Consortium DKTK,Partner Site Freiburg, Div Med Phys,Med Ctr,Fac Med,German Canc Res Ctr, D-79106 Freiburg, Germany
关键词
Three-dimensional displays; Strain; Image registration; Biomedical imaging; Training; Tracking; Registers; Machine learning; motion compensation and analysis; neural network; registration; FRAMEWORK;
D O I
10.1109/TMI.2020.2972616
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Deformable image registration is a very important field of research in medical imaging. Recently multiple deep learning approaches were published in this area showing promising results. However, drawbacks of deep learning methods are the need for a large amount of training datasets and their inability to register unseen images different from the training datasets. One shot learning comes without the need of large training datasets and has already been proven to be applicable to 3D data. In this work we present a one shot registration approach for periodic motion tracking in 3D and 4D datasets. When applied to a 3D dataset the algorithm calculates the inverse of the registration vector field simultaneously. For registration we employed a U-Net combined with a coarse to fine approach and a differential spatial transformer module. The algorithm was thoroughly tested with multiple 4D and 3D datasets publicly available. The results show that the presented approach is able to track periodic motion and to yield a competitive registration accuracy. Possible applications are the use as a stand-alone algorithm for 3D and 4D motion tracking or in the beginning of studies until enough datasets for a separate training phase are available.
引用
收藏
页码:2506 / 2517
页数:12
相关论文
共 41 条
[1]  
[Anonymous], 1957, Kongelige Danske Videnskabernes Selskab
[2]   Four-dimensional deformable image registration using trajectory modeling [J].
Castillo, Edward ;
Castillo, Richard ;
Martinez, Josue ;
Shenoy, Maithili ;
Guerrero, Thomas .
PHYSICS IN MEDICINE AND BIOLOGY, 2010, 55 (01) :305-327
[3]   A framework for evaluation of deformable image registration spatial accuracy using large landmark point sets [J].
Castillo, Richard ;
Castillo, Edward ;
Guerra, Rudy ;
Johnson, Valen E. ;
McPhail, Travis ;
Garg, Amit K. ;
Guerrero, Thomas .
PHYSICS IN MEDICINE AND BIOLOGY, 2009, 54 (07) :1849-1870
[4]  
Connelly K, 2009, Evaluation framework for algorithms segmenting short axis cardiacMRI
[5]   Unsupervised Learning for Fast Probabilistic Diffeomorphic Registration [J].
Dalca, Adrian V. ;
Balakrishnan, Guha ;
Guttag, John ;
Sabuncu, Mert R. .
MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2018, PT I, 2018, 11070 :729-738
[6]   A deep learning framework for unsupervised affine and deformable image registration [J].
de Vos, Bob D. ;
Berendsen, Floris F. ;
Viergever, Max A. ;
Sokooti, Hessam ;
Staring, Marius ;
Isgum, Ivana .
MEDICAL IMAGE ANALYSIS, 2019, 52 :128-143
[7]   End-to-End Unsupervised Deformable Image Registration with a Convolutional Neural Network [J].
de Vos, Bob D. ;
Berendsen, Floris F. ;
Viergever, Max A. ;
Staring, Marius ;
Isgum, Ivana .
DEEP LEARNING IN MEDICAL IMAGE ANALYSIS AND MULTIMODAL LEARNING FOR CLINICAL DECISION SUPPORT, 2017, 10553 :204-212
[8]  
Dumoulin V, 2018, Arxiv, DOI [arXiv:1603.07285, 10.48550/arXiv.1603.07285]
[9]  
Eppenhof K. A. J., 2018, MED IMAGING 2018 IMA, V10574, P192
[10]   Pulmonary CT Registration Through Supervised Learning With Convolutional Neural Networks [J].
Eppenhof, Koen A. J. ;
Pluim, Josien P. W. .
IEEE TRANSACTIONS ON MEDICAL IMAGING, 2019, 38 (05) :1097-1105