NOSMFuse: An infrared and visible image fusion approach based on norm optimization and slime mold architecture

被引:7
作者
Hao, Shuai [1 ]
He, Tian [1 ]
Ma, Xu [1 ]
An, Beiyi [1 ]
Wen, Hu [2 ]
Wang, Feng [3 ]
机构
[1] Xian Univ Sci & Technol, Coll Elect & Control Engn, Xian 710054, Peoples R China
[2] Xian Univ Sci & Technol, Coll Safety & Engn, Xian 710054, Peoples R China
[3] Weinan Normal Univ, Sch Phys & Elect Engn, Weinan 71400, Peoples R China
基金
中国博士后科学基金; 中国国家自然科学基金;
关键词
Image fusion; Infrared and visible images; Norm optimization; Slime mold architecture; SPARSE REPRESENTATION; MULTISCALE TRANSFORM; QUALITY ASSESSMENT; DECOMPOSITION; NETWORK; NEST;
D O I
10.1007/s10489-022-03591-4
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In existing infrared and visible image fusion algorithms, it is usually difficult to maintain a good balance of meaningful information between two source images, which easily leads to the omission of important fractional information in a particular source image. To address this issue, a novel fusion algorithm based on norm optimization and slime mold architecture, called NOSMFuse, is proposed. First, an interactive information decomposition method based on mutually guided image filtering is devised and utilized to obtain the corresponding base and detail layers. Subsequently, the differentiation feature extraction operator is formulated and employed to fuse the base layers. In addition, we design a norm optimization-based fusion strategy for the detail layers and a loss function that considers both the intensity fidelity and the gradient constraint. Finally, to further balance the useful information of the base and detail layers contained in the fusion image, we propose a slime mold architecture based image reconstruction method that generates fusion results through adaptive optimization. The experimental results show that the proposed NOSMFuse is superior to 12 other state-of-art fusion algorithms, both qualitatively and quantitatively.
引用
收藏
页码:5388 / 5401
页数:14
相关论文
共 45 条
[21]   Noise-robust image fusion with low-rank sparse decomposition guided by external patch prior [J].
Li, Huafeng ;
He, Xiaoge ;
Yu, Zhengtao ;
Luo, Jiebo .
INFORMATION SCIENCES, 2020, 523 :14-37
[22]   RFN-Nest: An end-to-end residual fusion network for infrared and visible images [J].
Li, Hui ;
Wu, Xiao-Jun ;
Kittler, Josef .
INFORMATION FUSION, 2021, 73 :72-86
[23]   NestFuse: An Infrared and Visible Image Fusion Architecture Based on Nest Connection and Spatial/Channel Attention Models [J].
Li, Hui ;
Wu, Xiao-Jun ;
Durrani, Tariq .
IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2020, 69 (12) :9645-9656
[24]   MDLatLRR: A Novel Decomposition Method for Infrared and Visible Image Fusion [J].
Li, Hui ;
Wu, Xiao-Jun ;
Kittler, Josef .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 :4733-4746
[25]   DenseFuse: A Fusion Approach to Infrared and Visible Images [J].
Li, Hui ;
Wu, Xiao-Jun .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2019, 28 (05) :2614-2623
[26]   Slime mould algorithm: A new method for stochastic optimization [J].
Li, Shimin ;
Chen, Huiling ;
Wang, Mingjing ;
Heidari, Ali Asghar ;
Mirjalili, Seyedali .
FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2020, 111 :300-323
[27]   No-reference image quality assessment based on spatial and spectral entropies [J].
Liu, Lixiong ;
Liu, Bao ;
Huang, Hua ;
Bovik, Alan Conrad .
SIGNAL PROCESSING-IMAGE COMMUNICATION, 2014, 29 (08) :856-863
[28]   Image Fusion With Convolutional Sparse Representation [J].
Liu, Yu ;
Chen, Xun ;
Ward, Rabab K. ;
Wang, Z. Jane .
IEEE SIGNAL PROCESSING LETTERS, 2016, 23 (12) :1882-1886
[29]  
Ma J., 2021, IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, V70, P1, DOI DOI 10.1109/TIM.2021.3075747
[30]   DDcGAN: A Dual-Discriminator Conditional Generative Adversarial Network for Multi-Resolution Image Fusion [J].
Ma, Jiayi ;
Xu, Han ;
Jiang, Junjun ;
Mei, Xiaoguang ;
Zhang, Xiao-Ping .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 :4980-4995