Exploring the Terrain: An Investigation into Deep Learning-Based Fusion Strategies for Integrating Infrared and Visible Imagery

被引:0
作者
Bhatambarekar, Priyanka [1 ]
Phade, Gayatri [2 ]
机构
[1] Sandip Inst Technol & Res Ctr Nashik, Elect & Telecommun Engn, Nasik, Maharashtra, India
[2] Sandip Inst Technol & Res Ctr Nashik, Elect & Telecommun Engn, Nasik, Maharashtra, India
关键词
Image Fusion; Deep Learning (DL); Convolutional Neural Networks (CNN); Generative Adversarial Networks (GAN);
D O I
暂无
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Infrared and visible image fusion technologies influence distinct image features acquired from distinct sensors, preserving complementary information from input images throughout the process of fusion, and utilizing redundant data to enhance the quality of the resulting fused image. Recently, deep learning methods (DL) have been employed by numerous researchers to investigate image fusion, revealing that the application of DL significantly enhances the efficiency of the model and the quality of fusion outcomes. Nevertheless, it is very important to note that DL can be implemented in various branches, and currently, a comprehensive investigation of deep learningbased methods in image fusion is in process.The paper aims to provide an exhaustive review of the evolution of image fusion algorithms grounded in deep learning over the years. Precisely, this paper undertakes a particular exploration of the fusion techniques applied to infrared and visible images through deep learning methodologies. The investigation includes a qualitative and quantitative comparison of extant fusion algorithms using established quality indicators, along with a thorough discussion of diverse fusion approaches. The current research status concerning infrared and visible image fusion is presented, with a forward-looking perspective on potential future directions. This research makes an effort to contribute valuable insights into various image fusion methods developed in recent years, thereby laying a solid foundation for subsequent research goings-on in this domain.
引用
收藏
页码:2316 / 2327
页数:12
相关论文
共 36 条
[1]   A Novel Method of Multimodal Medical Image Fusion Based on Hybrid Approach of NSCT and DTCWT [J].
Alseelawi, Nawar ;
Hazim, Hussein Tuama ;
ALRikabi, Haider Th Salim .
INTERNATIONAL JOURNAL OF ONLINE AND BIOMEDICAL ENGINEERING, 2022, 18 (03) :114-133
[2]   RoboFly: An Insect-Sized Robot With Simplified Fabrication That Is Capable of Flight, Ground, and Water Surface Locomotion [J].
Chukewad, Yogesh M. ;
James, Johannes ;
Singh, Avinash ;
Fuller, Sawyer .
IEEE TRANSACTIONS ON ROBOTICS, 2021, 37 (06) :2025-2040
[3]  
Corbata Lisa, A Fusion Method Based on Deep Learning and Case-Based Reasoning which Improves the Resulting Medical Image Segmentations, V20
[4]  
Deb Suman, 2012, Application of Image Fusion for Enhancing the Quality of an Image, P215
[5]   From Multi-Scale Decomposition to Non-Multi-Scale Decomposition Methods: A Comprehensive Survey of Image Fusion Techniques and Its Applications [J].
Dogra, Ayush ;
Goyal, Bhawna ;
Agrawal, Sunil .
IEEE ACCESS, 2017, 5 :16040-16067
[6]   Medical Image Registration via Similarity Measure based on Convolutional Neural Network [J].
Dong, Li ;
Lin, Yongzheng ;
Pang, Yishen .
PROCEEDINGS OF 2020 5TH INTERNATIONAL CONFERENCE ON CLOUD COMPUTING AND ARTIFICIAL INTELLIGENCE: TECHNOLOGIES AND APPLICATIONS (CLOUDTECH'20), 2020, :1-5
[7]  
Elmasry Shrouk A., 2020, Review of Different Image FusionTechniques: Comparative Study
[8]   A novel perceptual two layer image fusion using deep learning for imbalanced COVID-19 dataset [J].
Elzeki, Omar M. ;
Abd Elfattah, Mohamed ;
Salem, Hanaa ;
Hassanien, Aboul Ella ;
Shams, Mahmoud .
PEERJ COMPUTER SCIENCE, 2021,
[9]  
Fuchao Zhao, 2020, Procedia Computer Science, V174, P609, DOI 10.1016/j.procs.2020.06.132
[10]  
Gang Xiao, 2020, Image Fusion