Improved Multi-modal Image Fusion with Attention and Dense Networks: Visual and Quantitative Evaluation

被引:0
作者
Banerjee, Ankan [1 ]
Patra, Dipti [1 ]
Roy, Pradipta [2 ]
机构
[1] Natl Inst Technol, Rourkela, India
[2] DRDO, Integrated Test Range, Candipur, India
来源
COMPUTER VISION AND IMAGE PROCESSING, CVIP 2023, PT III | 2024年 / 2011卷
关键词
image fusion; attention; human perception; Convolutional Block Attention Module;
D O I
10.1007/978-3-031-58535-7_20
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This article introduces a novel multi-modal image fusion approach based on Convolutional Block Attention Module and dense networks to enhance human perceptual quality and information content in the fused images. The proposed model preserves the edges of the infrared images and enhances the contrast of the visible image as a pre-processing part. Consequently, the use of Convolutional Block Attention Module has resulted in the extraction of more refined features from the source images. The visual results demonstrate that the fused images produced by the proposed method are visually superior to those generated by most standard fusion techniques. To substantiate the findings, quantitative analysis is conducted using various metrics. The proposed method exhibits the best Naturalness Image Quality Evaluator and Chen-Varshney metric values, which are human perception-based parameters. Moreover, the fused images exhibit the highest Standard Deviation value, signifying enhanced contrast. These results justify the proposed multi-modal image fusion technique outperforms standard methods both qualitatively and quantitatively, resulting in superior fused images with improved human perception quality.
引用
收藏
页码:237 / 248
页数:12
相关论文
共 50 条
[21]   Multi-Modal Image Fusion Based on Matrix Product State of Tensor [J].
Lu, Yixiang ;
Wang, Rui ;
Gao, Qingwei ;
Sun, Dong ;
Zhu, De .
FRONTIERS IN NEUROROBOTICS, 2021, 15
[22]   An Ensemble Learning Approach for Multi-Modal Medical Image Fusion using Deep Convolutional Neural Networks [J].
Maseleno, Andino ;
Kavitha, D. ;
Ashok, Koudegai ;
Ansari, Mohammed Saleh Al ;
Satheesh, Nimmati ;
Reddy, R. Vijaya Kumar .
INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2023, 14 (08) :758-769
[23]   Local extreme map guided multi-modal brain image fusion [J].
Zhang, Yu ;
Xiang, Wenhao ;
Zhang, Shunli ;
Shen, Jianjun ;
Wei, Ran ;
Bai, Xiangzhi ;
Zhang, Li ;
Zhang, Qing .
FRONTIERS IN NEUROSCIENCE, 2022, 16
[24]   Multi-modal Image Fusion for Multispectral Super-resolution in Microscopy [J].
Dey, Neel ;
Li, Shijie ;
Bermond, Katharina ;
Heintzmann, Rainer ;
Curcio, Christine A. ;
Ach, Thomas ;
Gerig, Guido .
MEDICAL IMAGING 2019: IMAGE PROCESSING, 2019, 10949
[25]   Multi-Modal Retinal Image Classification With Modality-Specific Attention Network [J].
He, Xingxin ;
Deng, Ying ;
Fang, Leyuan ;
Peng, Qinghua .
IEEE TRANSACTIONS ON MEDICAL IMAGING, 2021, 40 (06) :1591-1602
[26]   Utilizing Deep Convolutional Neural Networks and Non-Negative Matrix Factorization for Multi-Modal Image Fusion [J].
Das, Nripendra Narayan ;
Govindasamy, Santhakumar ;
Godla, Sanjiv Rao ;
El-Ebiary, Yousef A. Baker ;
Thenmozhi, E. .
INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2023, 14 (09) :597-606
[27]   Multi-Modal Medical Image Fusion With Geometric Algebra Based Sparse Representation [J].
Li, Yanping ;
Fang, Nian ;
Wang, Haiquan ;
Wang, Rui .
FRONTIERS IN GENETICS, 2022, 13
[28]   Gradient structural similarity based gradient filtering for multi-modal image fusion [J].
Fu, Zhizhong ;
Zhao, Yufei ;
Xu, Yuwei ;
Xu, Lijuan ;
Xu, Jin .
INFORMATION FUSION, 2020, 53 (251-268) :251-268
[29]   Probing Synergistic High-Order Interaction for Multi-Modal Image Fusion [J].
Zhou, Man ;
Zheng, Naishan ;
He, Xuanhua ;
Hong, Danfeng ;
Chanussot, Jocelyn .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2025, 47 (02) :840-857
[30]   Multi-modal medical image fusion by Laplacian pyramid and adaptive sparse representation [J].
Wang, Zhaobin ;
Cui, Zijing ;
Zhu, Ying .
COMPUTERS IN BIOLOGY AND MEDICINE, 2020, 123