Optimizing Nighttime Infrared and Visible Image Fusion for Long-haul Tactile Internet

被引:9
作者
Song, Wenhao [1 ]
Gao, Mingliang [1 ]
Li, Qilei [2 ]
Guo, Xiangyu [1 ]
Wang, Zenghui [1 ]
Jeon, Gwanggil [1 ,3 ]
机构
[1] Shandong Univ Technol, Sch Elect & Elect Engn, Zibo 255000, Peoples R China
[2] Queen Mary Univ London, Sch Elect Engn & Comp Sci, London E1 4NS, England
[3] Incheon Natl Univ, Dept Embedded Syst Engn, Incheon 22012, South Korea
基金
中国国家自然科学基金;
关键词
Feature extraction; Lighting; Image fusion; Task analysis; Image reconstruction; Image color analysis; Reflectivity; Long-haul tactile Internet; deep learning; image fusion; transformer; Retinex theory; ENHANCEMENT; NETWORK; NEST;
D O I
10.1109/TCE.2024.3367667
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In the domain of infrared and visible image fusion, the majority of existing methods are designed for infrared and visible images with normal illumination conditions. However, these methods may not effectively address the challenges presented by long-haul transmission scenarios in the Tactile Internet. To meet the requirements of nighttime infrared and visible image fusion in long-haul network architectures for the tactile internet, an illumination component adjusting network (ICANet) is built. Firstly, an illumination adjustment denoising subnetwork (IADSubNet) is designed to enhance the illumination component of nighttime visible images and simultaneously eliminate noise. Secondly, a local-global perception fusion subnetwork (LGPFSubNet) is built to dynamically extract and fuse both global and local information of the source images. Furthermore, we leverage a mutual consistency loss to generate fused images that are both visually appealing and rich in information. This ensures the fidelity and consistency of the fused images during long-distance transmission. Comprehensive experimental results demonstrate that the proposed method outperforms state-of-the-art (SOTA) methods quantitatively and qualitatively, and prove that it has potential for high performance in the long-haul transmission scenarios of tactile Internet. Meanwhile, the fused images generated by the ICANet significantly enhance object detection tasks. It is a critical aspect for many tactile Internet applications dependent on real-time and accurate object recognition.
引用
收藏
页码:4277 / 4286
页数:10
相关论文
共 53 条
[1]   A novel image fusion framework for night-vision navigation and surveillance [J].
Bhatnagar, Gaurav ;
Liu, Zheng .
SIGNAL IMAGE AND VIDEO PROCESSING, 2015, 9 :165-175
[2]  
Das S, 2000, TRANSPORT RES REC, P40
[3]  
Di W., 2022, PROC INT JOINT C ART, P1
[4]   SaReGAN: a salient regional generative adversarial network for visible and infrared image fusion [J].
Gao, Mingliang ;
Zhou, Yi'nan ;
Zhai, Wenzhe ;
Zeng, Shuai ;
Li, Qilei .
MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 83 (22) :61659-61671
[5]   Zero-Reference Deep Curve Estimation for Low-Light Image Enhancement [J].
Guo, Chunle ;
Li, Chongyi ;
Guo, Jichang ;
Loy, Chen Change ;
Hou, Junhui ;
Kwong, Sam ;
Cong, Runmin .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, :1777-1786
[6]   LIME: Low-Light Image Enhancement via Illumination Map Estimation [J].
Guo, Xiaojie ;
Li, Yu ;
Ling, Haibin .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2017, 26 (02) :982-993
[7]   Low-Light Image Enhancement With Semi-Decoupled Decomposition [J].
Hao, Shijie ;
Han, Xu ;
Guo, Yanrong ;
Xu, Xin ;
Wang, Meng .
IEEE TRANSACTIONS ON MULTIMEDIA, 2020, 22 (12) :3025-3038
[8]   Multi-level image fusion and enhancement for target detection [J].
He, Weiji ;
Feng, Weiyi ;
Peng, Yiyue ;
Chen, Qian ;
Gu, Guohua ;
Miao, Zhuang .
OPTIK, 2015, 126 (11-12) :1203-1208
[9]   LLVIP: A Visible-infrared Paired Dataset for Low-light Vision [J].
Jia, Xinyu ;
Zhu, Chuang ;
Li, Minzhen ;
Tang, Wenqi ;
Zhou, Wenli .
2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW 2021), 2021, :3489-3497
[10]   SEDRFuse: A Symmetric Encoder-Decoder With Residual Block Network for Infrared and Visible Image Fusion [J].
Jian, Lihua ;
Yang, Xiaomin ;
Liu, Zheng ;
Jeon, Gwanggil ;
Gao, Mingliang ;
Chisholm, David .
IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2021, 70