Low-illumination traffic object detection using the saliency region of infrared image masking on infrared-visible fusion image

被引:5
|
作者
Yue, Guoqi [1 ]
Li, Zuoyong [2 ]
Tao, Yanyun [1 ,3 ,4 ]
Jin, Tianhu [1 ]
机构
[1] Soochow Univ, Inst Rail Transportat, Suzhou, Peoples R China
[2] Minjiang Univ, Fujian Prov Key Lab Informat Proc & Intelligent C, Fuzhou, Peoples R China
[3] Shanghai Jiao Tong Univ, Minist Educ, Key Lab Syst Control & Informat Proc, Shanghai, Peoples R China
[4] Nanjing Univ, State Key Lab Novel Software Technol, Nanjing, Peoples R China
关键词
traffic object detection; visible image; saliency extraction; fusion image; PEDESTRIAN DETECTION; TRANSFORM;
D O I
10.1117/1.JEI.31.3.033029
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Performing high-accuracy object detection under low-illumination conditions is a difficult task. The fusion of infrared (IR) and visible images can provide a great reference value for human observation or other computer vision tasks. Therefore, we propose an image fusion-based method to detect objects under poor lighting conditions. It mainly proposes a whole set of process improvements to enable the detection of medium-sized and small objects in poorly illuminated images with high-accuracy. First, the saliency detection of the IR image extracts the salient area in the image to obtain the main objects. Second, the IR and visible-light images undergo multiscale decomposition and fusion to obtain the background information of the visible-light image. Finally, the salient area is dot-multiplied with the fused image, so it can remove unnecessary background information and interference information while acquiring the main objects. Then, the ablation experiment is used to detect the objects. Experimental results demonstrate the effectiveness and robustness of the method. Moreover, lower false detection efficiency and better detection accuracy were obtained, especially in the detection of objects under poor lighting conditions. (C) 2022 SPIE and IS&T
引用
收藏
页数:17
相关论文
共 50 条
  • [1] An interactively reinforced paradigm for joint infrared-visible image fusion and saliency object detection
    Wang, Di
    Liu, Jinyuan
    Liu, Risheng
    Fan, Xin
    INFORMATION FUSION, 2023, 98
  • [2] Infrared and Visible Image Fusion based on Saliency Detection and Infrared Target Segment
    Li, Jun
    Song, Minghui
    Peng, Yuanxi
    2ND INTERNATIONAL CONFERENCE ON COMPUTER ENGINEERING, INFORMATION SCIENCE AND INTERNET TECHNOLOGY, CII 2017, 2017, : 21 - 30
  • [3] Visible and infrared image fusion based on visual saliency detection
    Tan, Xizi
    Guo, Liqiang
    2020 19TH INTERNATIONAL SYMPOSIUM ON DISTRIBUTED COMPUTING AND APPLICATIONS FOR BUSINESS ENGINEERING AND SCIENCE (DCABES 2020), 2020, : 134 - 137
  • [4] INFRARED AND VISIBLE IMAGE FUSION USING SALIENCY DETECTION BASED ON SHEARLET TRANSFORM
    Fei, Chun
    Zhang, Ping
    Tian, Ming
    Wang, Xiaowei
    Wu, Jiang
    2016 13TH INTERNATIONAL COMPUTER CONFERENCE ON WAVELET ACTIVE MEDIA TECHNOLOGY AND INFORMATION PROCESSING (ICCWAMTIP), 2016, : 273 - 276
  • [5] Infrared and Visible Image Fusion Using Modified PCNN and Visual Saliency Detection
    Ding, Zhaisheng
    Zhou, Dongming
    Nie, Rencan
    Hou, Ruichao
    Liu, Yanyu
    2018 INTERNATIONAL CONFERENCE ON IMAGE AND VIDEO PROCESSING, AND ARTIFICIAL INTELLIGENCE, 2018, 10836
  • [6] A Contrastive Learning Approach for Infrared-Visible Image Fusion
    Gupta, Ashish Kumar
    Barnwal, Meghna
    Mishra, Deepak
    PATTERN RECOGNITION AND MACHINE INTELLIGENCE, PREMI 2023, 2023, 14301 : 199 - 208
  • [7] Infrared-visible image fusion method based on sparse and prior joint saliency detection and LatLRR-FPDE
    Li, Yonghua
    Liu, Gang
    Bavirisetti, Durga Prasad
    Gu, Xinjie
    Zhou, Xihong
    DIGITAL SIGNAL PROCESSING, 2023, 134
  • [8] Two-scale image fusion of visible and infrared images using saliency detection
    Bavirisetti, Durga Prasad
    Dhuli, Ravindra
    INFRARED PHYSICS & TECHNOLOGY, 2016, 76 : 52 - 64
  • [9] Object Detection in Visible and Infrared missile borne fusion image
    Xue, Song
    Liu, Yongfeng
    Xu, Chao
    Li, Jun
    2022 INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, COMPUTER VISION AND MACHINE LEARNING (ICICML), 2022, : 19 - 23
  • [10] PFCFuse: A Poolformer and CNN Fusion Network for Infrared-Visible Image Fusion
    Hu, Xinyu
    Liu, Yang
    Yang, Feng
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2024, 73