Semantic Segmentation Algorithm of Night Images Based on Attention Mechanism

被引:1
|
作者
Xie, Xiaona [1 ]
Xu, Zhiyong [1 ]
Jiang, Tao [1 ]
Yuan, JianYing [1 ]
Chang, Zhengwei [2 ]
Zhang, Linghao [2 ]
机构
[1] Chengdu Univ Informat Technol, Chengdu, Sichuan, Peoples R China
[2] State Grid Sichuan Elect Power Res Inst, Chengdu, Sichuan, Peoples R China
关键词
Semantic segmentation; thermal infrared images; visible light images; channel spatial attention mechanism; feature fusion; NETWORK;
D O I
10.1142/S0218126623502638
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
At present, there are many semantic segmentation algorithms with excellent performance for intelligent driving vehicles, but most of them only work well on scenes with good illumination. In order to solve the problem of scene segmentation under low illumination, this paper proposes a novel semantic segmentation algorithm that combines visible and infrared images. In this algorithm, two parallel encoders are designed as the input of the images, and the decoder divides the fused images output from the encoder. The model is based on ResNet algorithm, and the residual attention module is used in each branch to mine and enhance the spatial features of multilevel channels to extract images information. Experiments are carried out on publicly available thermal infrared and visible datasets. The results show that the algorithm proposed in this paper is superior to the algorithm using only visible images in semantic segmentation of traffic environment.
引用
收藏
页数:20
相关论文
共 50 条
  • [41] Lightweight Semantic Segmentation Network based on Attention Feature Fusion
    Kuang, Xianyan
    Liu, Ping
    Chen, Yixi
    Zhang, Jianhua
    ENGINEERING LETTERS, 2023, 31 (04) : 1584 - 1591
  • [42] Semantic segmentation of remote sensing images combined with attention mechanism and feature enhancement U-Net
    Jiang, Jionghui
    Feng, Xi'an
    Ye, QiLei
    Hu, Zhongyi
    Gu, Zhiyang
    Huang, Hui
    INTERNATIONAL JOURNAL OF REMOTE SENSING, 2023, 44 (19) : 6219 - 6232
  • [43] An Attention based Method for Video Semantic Segmentation
    Huang, Yuan
    Huang, Qian
    Huang, Shuai
    Li, Yanping
    TWELFTH INTERNATIONAL CONFERENCE ON DIGITAL IMAGE PROCESSING (ICDIP 2020), 2020, 11519
  • [44] A Lightweight Aerial Power Line Segmentation Algorithm Based on Attention Mechanism
    Han, Gujing
    Zhang, Min
    Li, Qiang
    Liu, Xia
    Li, Tao
    Zhao, Liu
    Liu, Kaipei
    Qin, Liang
    MACHINES, 2022, 10 (10)
  • [45] Semantic Segmentation Network Based on Integral Attention
    Xiong, Siqi
    PROCEEDINGS OF 2024 INTERNATIONAL CONFERENCE ON COMPUTER AND MULTIMEDIA TECHNOLOGY, ICCMT 2024, 2024, : 285 - 288
  • [46] Semantic segmentation model of cotton roots in-situ image based on attention mechanism
    Kang, Jia
    Liu, Liantao
    Zhang, Fucheng
    Shen, Chen
    Wang, Nan
    Shao, Limin
    COMPUTERS AND ELECTRONICS IN AGRICULTURE, 2021, 189
  • [47] Semantic Segmentation of Remote Sensing Image Based on Regional Self-Attention Mechanism
    Zhao, Danpei
    Wang, Chenxu
    Gao, Yue
    Shi, Zhenwei
    Xie, Fengying
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19
  • [48] The Lightweight Fracture Segmentation Algorithm for Logging Images Based on Fully 3D Attention Mechanism and Deformable Convolution
    Yang, Qishun
    Zhang, Liyan
    Xi, Zihan
    Qian, Yu
    Li, Ang
    APPLIED SCIENCES-BASEL, 2024, 14 (22):
  • [49] Modeling and Optimization of Semantic Segmentation for Track Bed Foreign Object Based on Attention Mechanism
    Song, Haoran
    Wang, Shengchun
    Gu, Zichen
    Dai, Peng
    Du, Xinyu
    Cheng, Yu
    IEEE ACCESS, 2021, 9 : 86646 - 86656
  • [50] Weed Semantic Segmentation Network Combining Hybrid Attention Mechanism
    Li, Bo
    Ding, Yanhong
    Xue, Yuming
    2024 5TH INTERNATIONAL CONFERENCE ON COMPUTER ENGINEERING AND APPLICATION, ICCEA 2024, 2024, : 620 - 624