Multi-category domain-dependent feature-based medical image translation

被引:3
作者
Lu, Ning [1 ]
Chen, Yizhou [2 ]
机构
[1] Guangdong Polytech Sci & Technol, Zhuhai, Guangdong, Peoples R China
[2] Zhejiang Univ Technol, Coll Comp Sci & Technol, Hangzhou, Peoples R China
关键词
Medical image; Cross-domain image translation; Feature consistency loss; Multi-view learning; NEURAL-NETWORK;
D O I
10.1007/s00371-023-03096-2
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
The challenge of inaccurate information containment in synthetic images during the process of cross-domain medical image translation could be resolved by using a common strategy of integrating the loss of the feature consistency of the real/synthetic image as a penalty factor into the loss function of the translator. However, the existing methods are capable of using only the "domain-independent" feature of the image when the aligned images are scarcity, which results in the under-utilization of the image information. In the present study, a novel feature consistency loss computing and integration method based on the "domain-dependent" features was proposed, and a multi-category feature consistency-cross-domain image translation (MFC-CIT) model was constructed. The present study is the first to utilize the image feature information related to image domain in the process of cross-domain medical image translation. In the proposed method, the MFC module was first trained on the basis of supervised learning on a limited number of paired real images. Next, cross-domain image translation training based on unsupervised learning was performed on unpaired datasets by the CIT module, and this process was constrained by the loss of feature consistency of the real/synthetic image obtained in the MFC module. The experimental results on two datasets demonstrate that the proposed method effectively improves the translation accuracy of synthetic images.
引用
收藏
页码:4519 / 4538
页数:20
相关论文
共 49 条
[1]  
Andrew G., 2013, PROC INT C MACH LEAR
[2]   MedGAN: Medical image translation using GANs [J].
Armanious, Karim ;
Jiang, Chenming ;
Fischer, Marc ;
Kuestner, Thomas ;
Nikolaou, Konstantin ;
Gatidis, Sergios ;
Yang, Bin .
COMPUTERIZED MEDICAL IMAGING AND GRAPHICS, 2020, 79
[3]   Feature-attention module for context-aware image-to-image translation [J].
Bai, Jing ;
Chen, Ran ;
Liu, Min .
VISUAL COMPUTER, 2020, 36 (10-12) :2145-2159
[4]   A survey on deep multimodal learning for computer vision: advances, trends, applications, and datasets [J].
Bayoudh, Khaled ;
Knani, Raja ;
Hamdaoui, Faycal ;
Mtibaa, Abdellatif .
VISUAL COMPUTER, 2022, 38 (08) :2939-2970
[5]   Adversarial Stain Transfer for Histopathology Image Analysis [J].
BenTaieb, Aicha ;
Hamarneh, Ghassan .
IEEE TRANSACTIONS ON MEDICAL IMAGING, 2018, 37 (03) :792-802
[6]   MR to CT synthesis with multicenter data in the pelvic area using a conditional generative adversarial network [J].
Boni, Kevin N. D. Brou ;
Klein, John ;
Vanquin, Ludovic ;
Wagner, Antoine ;
Lacornerie, Thomas ;
Pasquier, David ;
Reynaert, Nick .
PHYSICS IN MEDICINE AND BIOLOGY, 2020, 65 (07)
[7]   Iterative framework for the joint segmentation and CT synthesis of MR images: application to MRI-only radiotherapy treatment planning [J].
Burgos, Ninon ;
Guerreiro, Filipa ;
McClelland, Jamie ;
Presles, Benoit ;
Modat, Marc ;
Nill, Simeon ;
Dearnaley, David ;
deSouza, Nandita ;
Oelfke, Uwe ;
Knopf, Antje-Christin ;
Ourselin, Sebastien ;
Cardoso, M. Jorge .
PHYSICS IN MEDICINE AND BIOLOGY, 2017, 62 (11) :4237-4253
[8]   Towards cross-modal organ translation and segmentation: A cycle and shape-consistent generative adversarial network [J].
Cai, Jinzheng ;
Zhang, Zizhao ;
Cui, Lei ;
Zheng, Yefeng ;
Yang, Lin .
MEDICAL IMAGE ANALYSIS, 2019, 52 :174-184
[9]   Multimodal MR Synthesis via Modality-Invariant Latent Representation [J].
Chartsias, Agisilaos ;
Joyce, Thomas ;
Giuffrida, Mario Valerio ;
Tsaftaris, Sotirios A. .
IEEE TRANSACTIONS ON MEDICAL IMAGING, 2018, 37 (03) :803-814
[10]  
Chen Y., 2022, COMPUT METHODS PROG