Generative Adversarial Network for Trimodal Medical Image Fusion Using Primitive Relationship Reasoning

被引:3
作者
Huang, Jingxue [1 ]
Li, Xiaosong [1 ]
Tan, Haishu [1 ]
Cheng, Xiaoqi [2 ]
机构
[1] Foshan Univ, Sch Phys & Optoelect Engn, Foshan 528225, Peoples R China
[2] Foshan Univ, Guangdong Prov Key Lab Ind Intelligent Inspect Tec, Foshan 528000, Peoples R China
基金
中国国家自然科学基金;
关键词
Medical diagnostic imaging; Feature extraction; Cognition; Image fusion; Computational modeling; Task analysis; Magnetic resonance imaging; Generative adversarial network; trimodal medical image fusion; primitive relationship reasoning; QUALITY ASSESSMENT; FRAMEWORK;
D O I
10.1109/JBHI.2024.3426664
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Medical image fusion has become a hot biomedical image processing technology in recent years. The technology coalesces useful information from different modal medical images onto an informative single fused image to provide reasonable and effective medical assistance. Currently, research has mainly focused on dual-modal medical image fusion, and little attention has been paid on trimodal medical image fusion, which has greater application requirements and clinical significance. For this, the study proposes an end-to-end generative adversarial network for trimodal medical image fusion. Utilizing a multi-scale squeeze and excitation reasoning attention network, the proposed method generates an energy map for each source image, facilitating efficient trimodal medical image fusion under the guidance of an energy ratio fusion strategy. To obtain the global semantic information, we introduced squeeze and excitation reasoning attention blocks and enhanced the global feature by primitive relationship reasoning. Through extensive fusion experiments, we demonstrate that our method yields superior visual results and objective evaluation metric scores compared to state-of-the-art fusion methods. Furthermore, the proposed method also obtained the best accuracy in the glioma segmentation experiment.
引用
收藏
页码:5729 / 5741
页数:13
相关论文
共 61 条
[61]   Local Graph Fusion of Multi-view MR Images for Knee Osteoarthritis Diagnosis [J].
Zhuang, Zixu ;
Wang, Sheng ;
Si, Liping ;
Xuan, Kai ;
Xue, Zhong ;
Shen, Dinggang ;
Zhang, Lichi ;
Yao, Weiwu ;
Wang, Qian .
MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION, MICCAI 2022, PT III, 2022, 13433 :554-563