Semi-Supervised Drivable Road Segmentation with Expanded Feature Cross-Consistency

被引:0
作者
Ma, Shangchen [1 ]
Song, Chunlin [1 ]
机构
[1] Tongji Univ, Coll Elect & Informat Engn, Shanghai 201804, Peoples R China
来源
APPLIED SCIENCES-BASEL | 2023年 / 13卷 / 21期
关键词
drivable area segmentation; semi-supervised; semantic segmentation; deep learning; convolutional neural networks; feature cross-consistency;
D O I
10.3390/app132112036
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
Drivable road segmentation aims to sense the surrounding environment to keep vehicles within safe road boundaries, which is fundamental in Advance Driver-Assistance Systems (ADASs). Existing deep learning-based supervised methods are able to achieve good performance in this field with large amounts of human-labeled training data. However, the process of collecting sufficient fine human-labeled data is extremely time-consuming and expensive. To fill this gap, in this paper, we innovatively propose a general yet effective semi-supervised method for drivable road segmentation with lower labeled-data dependency, high accuracy, and high real-time performance. Specifically, a main encoder and a main decoder are trained in the supervised mode with labeled data generating pseudo labels for the unsupervised training. Then, we innovatively set up both auxiliary encoders and auxiliary decoders in our model that yield feature representations and predictions based on the unlabeled data subjected to different elaborated perturbations. Both auxiliary encoders and decoders can leverage information in unlabeled data by enforcing consistency between predictions of the main modules and those perturbed versions from auxiliary modules. Experimental results on two public datasets (Cityspace and CamVid) verify that our proposed algorithm can almost reach the same performance with high FPS as a fully supervised method with 100% labeled data with only utilizing 40% labeled data in the field of drivable road segmentation. In addition, our semi-supervised algorithm has a good potential to be generalized to all models with an encoder-decoder structure.
引用
收藏
页数:19
相关论文
共 51 条
[31]  
Paszke A, 2016, Arxiv, DOI arXiv:1606.02147
[32]   DLT-Net: Joint Detection of Drivable Areas, Lane Lines, and Traffic Objects [J].
Qian, Yeqiang ;
Dolan, John M. ;
Yang, Ming .
IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2020, 21 (11) :4670-4679
[33]  
Reis FAL, 2019, IEEE IJCNN
[34]  
Romera E, 2017, IEEE INT VEH SYM, P1789, DOI 10.1109/IVS.2017.7995966
[35]   U-Net: Convolutional Networks for Biomedical Image Segmentation [J].
Ronneberger, Olaf ;
Fischer, Philipp ;
Brox, Thomas .
MEDICAL IMAGE COMPUTING AND COMPUTER-ASSISTED INTERVENTION, PT III, 2015, 9351 :234-241
[36]  
Scheck T., 2020, P 12 INT C MACH VIS, P12
[37]   Semantic Segmentation for Free Space and Lane Based on Grid-Based Interest Point Detection [J].
Shao, Mei-En ;
Haq, Muhamad Amirul ;
Gao, De-Qin ;
Chondro, Peter ;
Ruan, Shanq-Jang .
IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2022, 23 (07) :8498-8512
[38]   Fully Convolutional Networks for Semantic Segmentation [J].
Shelhamer, Evan ;
Long, Jonathan ;
Darrell, Trevor .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2017, 39 (04) :640-651
[39]   Reverse and Boundary Attention Network for Road Segmentation [J].
Sun, Jee-Young ;
Kim, Seung-Wook ;
Lee, Sang-Won ;
Kim, Ye-Won ;
Ko, Sung-Jea .
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW), 2019, :876-885
[40]  
Vu D., 2022, arXiv