Domain Adaptation Semantic Segmentation for Urban Scene Combining Self-ensembling and Adversarial Learning

被引:0
作者
Zhang G. [1 ]
Lu F. [1 ]
Long B. [1 ]
Miao J. [1 ]
机构
[1] Institute of Computer Vision, Nanchang Hangkong University, Nanchang
来源
Moshi Shibie yu Rengong Zhineng/Pattern Recognition and Artificial Intelligence | 2021年 / 34卷 / 01期
基金
中国国家自然科学基金;
关键词
Adversarial Learning; Domain Adaptation; Self-ensembling; Semantic Segmentation; Urban Scene;
D O I
10.16451/j.cnki.issn1003-6059.202101006
中图分类号
学科分类号
摘要
Aiming at the problem of high cost of urban scene label acquisition, an algorithm of domain adaptation semantic segmentation for urban scene combining self-ensembling and adversarial learning is proposed. For the inter-domain gap between source and target domains, the method of style transfer is employed to transfer the source domain into a new dataset with the style of target domain. For the problem of intra-domain gap in the target domain, the self-ensembling method is introduced and a teacher network is constructed. The teacher network is utilized to supervise and guide the student network through consistency constraints on the target domain segmentation map to reduce the intra-domain gap of the target domain and improve the segmentation accuracy. The self-training method is exploited to obtain the pseudo label of the target domain and add the pseudo label into the adversarial learning method to retrain the network and further improve the segmentation ability. Experiments on segmentation datasets verify the effectiveness of the proposed algorithm. © 2021, Science Press. All right reserved.
引用
收藏
页码:58 / 67
页数:9
相关论文
共 28 条
[1]  
WANG Z Y, NI X Y, SHANG Z D., Autonomous Driving Semantic Segmentation with Convolution Neural Networks, Optics and Precision Engineering, 27, 11, pp. 2429-2438, (2019)
[2]  
SHELHAMER E, LONG J, DARRELL T., Fully Convolutional Networks for Semantic Segmentation, IEEE Transactions on Pattern Ana- lysis and Machine Intelligence, 39, 4, pp. 640-651, (2017)
[3]  
LIN G S, MILAN A, SHEN C H, Et al., RefineNet: Multi-path Refinement Networks for High-Resolution Semantic Segmentation, Proc of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 1925-1934, (2017)
[4]  
RONNEBERGER O, FISCHER P, BROX T., U-Net: Convolutional Networks for Biomedical Image Segmentation, Proc of the International Conference on Medical Image Computing and Computer Assisted Intervention, pp. 234-241, (2015)
[5]  
CHEN L C, PAPANDREOU G, KOKKINOS I, Et al., Semantic Image Segmentation with Deep Convolutional Nets and Fully Connected CRFs
[6]  
CHEN L C, PAPANDREOU G, KOKKINOS I, Et al., DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs, IEEE Transactions on Pa-ttern Analysis and Machine Intelligence, 40, 4, pp. 834-848, (2018)
[7]  
CHEN L C, PAPANDREOU G, SCHROFF F, Et al., Rethinking Atrous Convolution for Semantic Image Segmentation
[8]  
FU J, LIU J, TIAN H J, Et al., Dual Attention Network for Scene Segmentation, Proc of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 3146-3154, (2019)
[9]  
CORDTS M, OMRAN M, RAMOS S., The Cityscapes Dataset for Semantic Urban Scene Understanding, Proc of the IEEE Confe-rence on Computer Vision and Pattern Recognition, pp. 3213-3223, (2016)
[10]  
RICHTER S R, VINEET V, ROTH S, Et al., Playing for Data: Ground Truth from Computer Games, Proc of the European Conference on Computer Vision, pp. 102-118, (2016)