A Real-Time Road Scene Semantic Segmentation Model Based on Spatial Context Learning

被引:0
|
作者
Xiao, Xiaomei [1 ]
Tang, Jialiang [1 ]
Lu, Xiaoyan [1 ]
Feng, Zhengyong [1 ]
Li, Yi [2 ]
机构
[1] China West Normal Univ, Elect Informat Proc Engn Technol Res Ctr, Sch Elect Informat Engn, Nanchong 637009, Peoples R China
[2] Chengdu Normal Univ, Coll Phys & Engn Technol, Chengdu 611130, Peoples R China
来源
IEEE ACCESS | 2024年 / 12卷
关键词
Feature extraction; Semantics; Semantic segmentation; Accuracy; Computational modeling; Real-time systems; Training; Context modeling; Attention mechanisms; Encoding; Real-time semantic segmentation; spatial context guidance; feature attention; feature alignment; NETWORK;
D O I
10.1109/ACCESS.2024.3503676
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
To address the issues of high computational complexity and insufficient aggregation of global and local information in existing image segmentation methods, this paper proposes an efficient segmentation model based on Spatial Context Learning, named SCLSeg. The main idea is to aggregate local regions into higher-level semantic regions in a learnable manner. The proposed Spatial Context Guided Feature Alignment module (SC-FA) learns aligned features from image-level to local regions, exploring and integrating contextual information. During training, a multi-scale strategy is used to group semantic regions, and a Channel Aggregation Block (CAB) is designed to dynamically capture semantic groups through a mechanism of feature separation and fusion, thereby aggregating multi-level pixel features to generate the final segmentation results. We further introduce a boundary loss to optimize the accuracy of segmentation edges. To meet real-time processing requirements, a series of lightweight strategies and simplified structures are adopted to reduce computational costs, including lightweight encoding, channel compression, and simplified neck. Our method achieves good performance on the Cityscapes and Camvid datasets, specifically achieving 76.45% mIoU & 237 FPS on the Cityscapes test set, and 73.95% mIoU & 300.4 FPS on the CamVid test set.
引用
收藏
页码:178495 / 178506
页数:12
相关论文
共 50 条
  • [1] Context and Spatial Feature Calibration for Real-Time Semantic Segmentation
    Li, Kaige
    Geng, Qichuan
    Wan, Maoxian
    Cao, Xiaochun
    Zhou, Zhong
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2023, 32 : 5465 - 5477
  • [2] Real-time road scene segmentation based on knowledge distillation Real-time road semantic segmentation
    Li, Wenting
    Yang, Huicheng
    Hu, Yaocong
    Lin, Yuanyuan
    Shuai, Zhen
    PROCEEDINGS OF 2023 7TH INTERNATIONAL CONFERENCE ON ELECTRONIC INFORMATION TECHNOLOGY AND COMPUTER ENGINEERING, EITCE 2023, 2023, : 429 - 433
  • [3] Real-Time Semantic Segmentation via Spatial-Detail Guided Context Propagation
    Hao, Shijie
    Zhou, Yuan
    Guo, Yanrong
    Hong, Richang
    Cheng, Jun
    Wang, Meng
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2022,
  • [4] Parallel Complement Network for Real-Time Semantic Segmentation of Road Scenes
    Lv, Qingxuan
    Sun, Xin
    Chen, Changrui
    Dong, Junyu
    Zhou, Huiyu
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2022, 23 (05) : 4432 - 4444
  • [5] EMSFomer: Efficient Multi-Scale Transformer for Real-Time Semantic Segmentation
    Xia, Zhengyu
    Kim, Joohee
    IEEE ACCESS, 2025, 13 : 18239 - 18252
  • [6] Real-Time Semantic Segmentation With Fast Attention
    Hu, Ping
    Perazzi, Federico
    Heilbron, Fabian Caba
    Wang, Oliver
    Lin, Zhe
    Saenko, Kate
    Sclaroff, Stan
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2021, 6 (01) : 263 - 270
  • [7] Lightweight Context-Aware Network Using Partial-Channel Transformation for Real-Time Semantic Segmentation
    Shi, Min
    Lin, Shaowen
    Yi, Qingming
    Weng, Jian
    Luo, Aiwen
    Zhou, Yicong
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2024, 25 (07) : 7401 - 7416
  • [8] LCFNets: Compensation Strategy for Real-Time Semantic Segmentation of Autonomous Driving
    Yang, Lu
    Bai, Yiwen
    Ren, Fenglei
    Bi, Chongke
    Zhang, Ronghui
    IEEE TRANSACTIONS ON INTELLIGENT VEHICLES, 2024, 9 (04): : 4715 - 4729
  • [9] Real-Time Driving Scene Semantic Segmentation
    Wang, Wenfu
    Fu, Yongjian
    Pan, Zhijie
    Li, Xi
    Zhuang, Yueting
    IEEE ACCESS, 2020, 8 : 36776 - 36788
  • [10] Bilateral network with dual-guided attention for real-time semantic segmentation of road scene
    Liao, Liang
    Wan, Liang
    Liu, Mingsheng
    Li, Shusheng
    JOURNAL OF ELECTRONIC IMAGING, 2024, 33 (06)