Semantic Segmentation Algorithm of Night Images Based on Attention Mechanism

被引:1
|
作者
Xie, Xiaona [1 ]
Xu, Zhiyong [1 ]
Jiang, Tao [1 ]
Yuan, JianYing [1 ]
Chang, Zhengwei [2 ]
Zhang, Linghao [2 ]
机构
[1] Chengdu Univ Informat Technol, Chengdu, Sichuan, Peoples R China
[2] State Grid Sichuan Elect Power Res Inst, Chengdu, Sichuan, Peoples R China
关键词
Semantic segmentation; thermal infrared images; visible light images; channel spatial attention mechanism; feature fusion; NETWORK;
D O I
10.1142/S0218126623502638
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
At present, there are many semantic segmentation algorithms with excellent performance for intelligent driving vehicles, but most of them only work well on scenes with good illumination. In order to solve the problem of scene segmentation under low illumination, this paper proposes a novel semantic segmentation algorithm that combines visible and infrared images. In this algorithm, two parallel encoders are designed as the input of the images, and the decoder divides the fused images output from the encoder. The model is based on ResNet algorithm, and the residual attention module is used in each branch to mine and enhance the spatial features of multilevel channels to extract images information. Experiments are carried out on publicly available thermal infrared and visible datasets. The results show that the algorithm proposed in this paper is superior to the algorithm using only visible images in semantic segmentation of traffic environment.
引用
收藏
页数:20
相关论文
共 50 条
  • [21] ARTSeg: Employing Attention for Thermal Images Semantic Segmentation
    Munir, Farzeen
    Azam, Shoaib
    Fatima, Unse
    Jeon, Moongu
    PATTERN RECOGNITION, ACPR 2021, PT I, 2022, 13188 : 366 - 378
  • [22] Semantic Segmentation of Remote Sensing Images Based on Filtered Hybrid Attention Mechanisms
    Ge, Sunan
    Liu, Daihua
    Shi, Xin
    Zhao, Xueqing
    Wang, Xinying
    Fan, Jianchao
    ENGINEERING LETTERS, 2025, 33 (01) : 80 - 89
  • [23] A semantic segmentation algorithm for fashion images based on modified mask RCNN
    Wentao He
    Jing’an Wang
    Lei Wang
    Ruru Pan
    Weidong Gao
    Multimedia Tools and Applications, 2023, 82 : 28427 - 28444
  • [24] Semantic segmentation algorithm for pantograph based on multi-scale strip pooling attention mechanism and application research
    Shi, Renjie
    Li, Liming
    Zheng, Shubin
    Mao, Yizhou
    An, Xiaoxue
    AIP ADVANCES, 2024, 14 (09)
  • [25] A semantic segmentation algorithm for fashion images based on modified mask RCNN
    He, Wentao
    Wang, Jing'an
    Wang, Lei
    Pan, Ruru
    Gao, Weidong
    MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 82 (18) : 28427 - 28444
  • [26] Real-Time Semantic Segmentation of Point Clouds Based on an Attention Mechanism and a Sparse Tensor
    Wang, Fei
    Yang, Yujie
    Wu, Zhao
    Zhou, Jingchun
    Zhang, Weishi
    APPLIED SCIENCES-BASEL, 2023, 13 (05):
  • [27] An Effective Semantic Segmentation Network With Multipath Attention for Industrial Meter Pointer Images
    Tan, Dayu
    Wang, Jinlong
    Su, Yansen
    Zhang, Zhijun
    Peng, Xin
    Zheng, Chunhou
    Zhong, Weimin
    IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2024, 20 (12) : 13537 - 13546
  • [28] AAFormer: Attention-Attended Transformer for Semantic Segmentation of Remote Sensing Images
    Li, Xin
    Xu, Feng
    Li, Linyang
    Xu, Nan
    Liu, Fan
    Yuan, Chi
    Chen, Ziqi
    Lyu, Xin
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2024, 21 : 1 - 5
  • [29] Swin-CDSA: The Semantic Segmentation of Remote Sensing Images Based on Cascaded Depthwise Convolution and Spatial Attention Mechanism
    Kang, Yuhan
    Ji, Jian
    Xu, Hekai
    Yang, Yong
    Chen, Peng
    Zhao, Hui
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2024, 21
  • [30] Multiple-Attention Mechanism Network for Semantic Segmentation
    Wang, Dongli
    Xiang, Shengliang
    Zhou, Yan
    Mu, Jinzhen
    Zhou, Haibin
    Irampaye, Richard
    SENSORS, 2022, 22 (12)