NOSMFuse: An infrared and visible image fusion approach based on norm optimization and slime mold architecture

被引:7
作者
Hao, Shuai [1 ]
He, Tian [1 ]
Ma, Xu [1 ]
An, Beiyi [1 ]
Wen, Hu [2 ]
Wang, Feng [3 ]
机构
[1] Xian Univ Sci & Technol, Coll Elect & Control Engn, Xian 710054, Peoples R China
[2] Xian Univ Sci & Technol, Coll Safety & Engn, Xian 710054, Peoples R China
[3] Weinan Normal Univ, Sch Phys & Elect Engn, Weinan 71400, Peoples R China
基金
中国博士后科学基金; 中国国家自然科学基金;
关键词
Image fusion; Infrared and visible images; Norm optimization; Slime mold architecture; SPARSE REPRESENTATION; MULTISCALE TRANSFORM; QUALITY ASSESSMENT; DECOMPOSITION; NETWORK; NEST;
D O I
10.1007/s10489-022-03591-4
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In existing infrared and visible image fusion algorithms, it is usually difficult to maintain a good balance of meaningful information between two source images, which easily leads to the omission of important fractional information in a particular source image. To address this issue, a novel fusion algorithm based on norm optimization and slime mold architecture, called NOSMFuse, is proposed. First, an interactive information decomposition method based on mutually guided image filtering is devised and utilized to obtain the corresponding base and detail layers. Subsequently, the differentiation feature extraction operator is formulated and employed to fuse the base layers. In addition, we design a norm optimization-based fusion strategy for the detail layers and a loss function that considers both the intensity fidelity and the gradient constraint. Finally, to further balance the useful information of the base and detail layers contained in the fusion image, we propose a slime mold architecture based image reconstruction method that generates fusion results through adaptive optimization. The experimental results show that the proposed NOSMFuse is superior to 12 other state-of-art fusion algorithms, both qualitatively and quantitatively.
引用
收藏
页码:5388 / 5401
页数:14
相关论文
共 45 条
[1]  
AJAFERNANDEZ S, 2006, INT C IEEE ENG MED B, P4053
[2]   A generative model method for unsupervised multispectral image fusion in remote sensing [J].
Azarang, Arian ;
Kehtarnavaz, Nasser .
SIGNAL IMAGE AND VIDEO PROCESSING, 2022, 16 (01) :63-71
[3]  
Bakari A., 2018, Asian Res. J. Math., V8, P1
[4]   Multi-scale Guided Image and Video Fusion: A Fast and Efficient Approach [J].
Bavirisetti, Durga Prasad ;
Xiao, Gang ;
Zhao, Junhao ;
Dhuli, Ravindra ;
Liu, Gang .
CIRCUITS SYSTEMS AND SIGNAL PROCESSING, 2019, 38 (12) :5576-5605
[5]  
Bavirisetti DP, 2017, 2017 20TH INTERNATIONAL CONFERENCE ON INFORMATION FUSION (FUSION), P701
[6]   Two-scale image fusion of visible and infrared images using saliency detection [J].
Bavirisetti, Durga Prasad ;
Dhuli, Ravindra .
INFRARED PHYSICS & TECHNOLOGY, 2016, 76 :52-64
[7]   Fusion of Infrared and Visible Sensor Images Based on Anisotropic Diffusion and Karhunen-Loeve Transform [J].
Bavirisetti, Durga Prasad ;
Dhuli, Ravindra .
IEEE SENSORS JOURNAL, 2016, 16 (01) :203-209
[8]   Weighted sparse representation multi-scale transform fusion algorithm for high dynamic range imaging with a low-light dual-channel camera [J].
Chen, Guo ;
Li, Li ;
Jin, Weiqi ;
Zhu, Jin ;
Shi, Feng .
OPTICS EXPRESS, 2019, 27 (08) :10564-10579
[9]   Multi-modal medical image fusion based on equilibrium optimizer algorithm and local energy functions [J].
Dinh, Phu-Hung .
APPLIED INTELLIGENCE, 2021, 51 (11) :8416-8431
[10]   Three-layer medical image fusion with tensor-based features [J].
Du, Jiao ;
Li, Weisheng ;
Tan, Hengliang .
INFORMATION SCIENCES, 2020, 525 :93-108