Information-Based Disentangled Representation Learning for Unsupervised MR Harmonization

被引:26
作者
Zuo, Lianrui [1 ,2 ]
Dewey, Blake E. [1 ]
Carass, Aaron [1 ]
Liu, Yihao [1 ]
He, Yufan [1 ]
Calabresi, Peter A. [3 ]
Prince, Jerry L. [1 ]
机构
[1] Johns Hopkins Univ, Dept Elect & Comp Engn, Baltimore, MD 21218 USA
[2] NIA, Lab Behav Neurosci, NIH, Baltimore, MD 20892 USA
[3] Johns Hopkins Sch Med, Dept Neurol, Baltimore, MD 21287 USA
来源
INFORMATION PROCESSING IN MEDICAL IMAGING, IPMI 2021 | 2021年 / 12729卷
关键词
Harmonization; Unsupervised; Image to image translation; Disentangle; Synthesis;
D O I
10.1007/978-3-030-78191-0_27
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Accuracy and consistency are two key factors in computer-assisted magnetic resonance (MR) image analysis. However, contrast variation from site to site caused by lack of standardization in MR acquisition impedes consistent measurements. In recent years, image harmonization approaches have been proposed to compensate for contrast variation in MR images. Current harmonization approaches either require cross-site traveling subjects for supervised training or heavily rely on site-specific harmonization models to encourage harmonization accuracy. These requirements potentially limit the application of current harmonization methods in large-scale multi-site studies. In this work, we propose an unsupervised MR harmonization framework, CALAMITI (Contrast Anatomy Learning and Analysis for MR Intensity Translation and Integration), based on information bottleneck theory. CALAMITI learns a disentangled latent space using a unified structure for multi-site harmonization without the need for traveling subjects. Our model is also able to adapt itself to harmonize MR images from a new site with fine tuning solely on images from the new site. Both qualitative and quantitative results show that the proposed method achieves superior performance compared with other unsupervised harmonization approaches.
引用
收藏
页码:346 / 359
页数:14
相关论文
共 27 条
[1]  
Alemi Alex, 2017, P 5 INT C LEARN REPR
[2]  
[Anonymous], IXI Brain Development Dataset
[3]  
BROWN R. W., 2014, MAGNETIC RESONANCE I, DOI 10.1002/9781118633953
[4]  
Burgess C. P., 2017, Advances in neural information processing systems
[5]  
Dai B, 2018, PR MACH LEARN RES, V80
[6]  
Dewey Blake E., 2020, Medical Image Computing and Computer Assisted Intervention - MICCAI 2020. 23rd International Conference. Proceedings. Lecture Notes in Computer Science (LNCS 12267), P720, DOI 10.1007/978-3-030-59728-3_70
[7]   DeepHarmony: A deep learning approach to contrast harmonization across scanner changes [J].
Dewey, Blake E. ;
Zhao, Can ;
Reinhold, Jacob C. ;
Carass, Aaron ;
Fitzgerald, Kathryn C. ;
Sotirchos, Elias S. ;
Saidha, Shiv ;
Oh, Jiwon ;
Pham, Dzung L. ;
Calabresi, Peter A. ;
van Zijl, Peter C. M. ;
Prince, Jerry L. .
MAGNETIC RESONANCE IMAGING, 2019, 64 :160-170
[8]   Generative Adversarial Networks [J].
Goodfellow, Ian ;
Pouget-Abadie, Jean ;
Mirza, Mehdi ;
Xu, Bing ;
Warde-Farley, David ;
Ozair, Sherjil ;
Courville, Aaron ;
Bengio, Yoshua .
COMMUNICATIONS OF THE ACM, 2020, 63 (11) :139-144
[9]   Multimodal Unsupervised Image-to-Image Translation [J].
Huang, Xun ;
Liu, Ming-Yu ;
Belongie, Serge ;
Kautz, Jan .
COMPUTER VISION - ECCV 2018, PT III, 2018, 11207 :179-196
[10]   Perceptual Losses for Real-Time Style Transfer and Super-Resolution [J].
Johnson, Justin ;
Alahi, Alexandre ;
Li Fei-Fei .
COMPUTER VISION - ECCV 2016, PT II, 2016, 9906 :694-711