An Unsupervised Learning Approach to 3D Rectal MRI Volume Registration

被引:0
作者
Ho, Chi-Jui [1 ]
Duong, Soan T. M. [2 ,3 ]
Wang, Yiqian [1 ]
Nguyen, Chanh D. Tr. [2 ,4 ]
Bui, Bieu Q. [5 ]
Truong, Steven Q. H. [2 ]
Nguyen, Truong Q. [1 ]
An, Cheolhong [1 ]
机构
[1] Univ Calif San Diego, Dept Elect & Comp Engn, La Jolla, CA 92093 USA
[2] Vinbrain JSC, Hanoi 11619, Vietnam
[3] Quy Don Tech Univ, Dept Comp Sci, Hanoi 11917, Vietnam
[4] Vin Univ, Coll Engn & Comp Sci, Hanoi 12406, Vietnam
[5] 108 Cent Mil Hosp, Dept Radiotherapy & Radiosurg, Hanoi 11610, Vietnam
来源
IEEE ACCESS | 2022年 / 10卷
关键词
Three-dimensional displays; Feature extraction; Magnetic resonance imaging; Tumors; Cancer; Image registration; Biomedical imaging; Convolutional neural networks; Unsupervised learning; Deep learning; Neural networks; image registration; rectal cancer; deep learning; convolutional neural network; IMAGE REGISTRATION; FRAMEWORK; CANCER; MODEL;
D O I
10.1109/ACCESS.2022.3199379
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Accurate alignment of multi-session medical imaging is essential to the analysis of disease progression. By comparing the magnetic resonance imaging (MRI) data captured before and after a course of neoadjuvant chemoradiation (nCRT) treatment, physicians are able to evaluate the tumor response for further treatment of the disease. However, rectal MRI data captured in multi-session are often misaligned and not guaranteed to have one-to-one correspondence, making it challenging for physicians to observe the treatment response of tumor. To address this issue, we propose an unsupervised learning based volume registration framework, which enables accurate alignment even under a high degree of deformation between multi-session rectal data. Moreover, it works without the assumption of one-to-one correspondence between multi-session data, and hence is a general solution to rectal MRI volume registration. The experimental results show that the proposed registration framework accurately aligns rectal cancer images and outperforms other state-of-the-art methods in medical image registration. By providing accurate registration, it can potentially increase the efficiency and reduce the workload for physicians to evaluate the rectal tumor response to nCRT.
引用
收藏
页码:87650 / 87660
页数:11
相关论文
共 50 条
[41]   A MULTIPLE DECODER CNN FOR INVERSE CONSISTENT 3D IMAGE REGISTRATION [J].
Nazib, Abdullah ;
Fookes, Clinton ;
Salvado, Olivier ;
Perrin, Dimitri .
2021 IEEE 18TH INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING (ISBI), 2021, :904-907
[42]   Automatic 3D MRI-Ultrasound Registration for Image Guided Arthroscopy [J].
Kompella, Gayatri ;
Singarayan, Jeevakala ;
Antico, Maria ;
Sasazawa, Fumio ;
Yu, Takeda ;
Ram, Keerthi ;
Pandey, Ajay K. ;
Fontanarosa, Davide ;
Sivaprakasam, Mohanasankar .
APPLIED SCIENCES-BASEL, 2022, 12 (11)
[43]   Registration of 3D Ultrasound Computer Tomography and MRI for evaluation of tissue correspondences [J].
Hopp, T. ;
Dapp, R. ;
Zapf, M. ;
Kretzek, E. ;
Gemmeke, H. ;
Ruiter, N. V. .
MEDICAL IMAGING 2015: ULTRASONIC IMAGING AND TOMOGRAPHY, 2015, 9419
[44]   LEVERAGING 3D INFORMATION IN UNSUPERVISED BRAIN MRI SEGMENTATION [J].
Lambert, Benjamin ;
Louis, Maxime ;
Doyle, Senan ;
Forbes, Florence ;
Dojat, Michel ;
Tucholka, Alan .
2021 IEEE 18TH INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING (ISBI), 2021, :187-190
[45]   Deep Learning Approach for Generating MRA Images From 3D Quantitative Synthetic MRI Without Additional Scans [J].
Fujita, Shohei ;
Hagiwara, Akifumi ;
Otsuka, Yujiro ;
Hori, Masaaki ;
Takei, Naoyuki ;
Hwang, Ken-Pin ;
Irie, Ryusuke ;
Andica, Christina ;
Kamagata, Koji ;
Akashi, Toshiaki ;
Kumamaru, Kanako Kunishima ;
Suzuki, Michimasa ;
Wada, Akihiko ;
Abe, Osamu ;
Aoki, Shigeki .
INVESTIGATIVE RADIOLOGY, 2020, 55 (04) :249-256
[46]   Fast and Robust 3D Correspondence Matching and Its Application to Volume Registration [J].
Tajima, Yuichiro ;
Fudano, Kinya ;
Ito, Koichi ;
Aoki, Takafumi .
IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS, 2013, E96D (04) :826-835
[47]   Learning inverse consistent 3D groupwise registration with deforming autoencoders [J].
Siebert, Hanna ;
Rajamani, Kumar T. ;
Heinrich, Mattias P. .
MEDICAL IMAGING 2021: IMAGE PROCESSING, 2021, 11596
[48]   Learning an Attention Model for Robust 2-D/3-D Registration Using Point-To-Plane Correspondences [J].
Schaffert, Roman ;
Wang, Jian ;
Fischer, Peter ;
Borsdorf, Anja ;
Maier, Andreas .
IEEE TRANSACTIONS ON MEDICAL IMAGING, 2020, 39 (10) :3159-3174
[49]   Real-Time 2D-3D Deformable Registration with Deep Learning and Application to Lung Radiotherapy Targeting [J].
Foote, Markus D. ;
Zimmerman, Blake E. ;
Sawant, Amit ;
Joshi, Sarang C. .
INFORMATION PROCESSING IN MEDICAL IMAGING, IPMI 2019, 2019, 11492 :265-276
[50]   Spatial registration of temporally separated whole breast 3D ultrasound images [J].
Narayanasamy, Ganesh ;
LeCarpentier, Gerald L. ;
Roubidoux, Marilyn ;
Fowlkes, J. Brian ;
Schott, Anne F. ;
Carson, Paul L. .
MEDICAL PHYSICS, 2009, 36 (09) :4288-4300