Shape robustness in style enhanced cross domain semantic segmentation

被引:8
作者
Zhu, Siyu [1 ,3 ]
Tian, Yingjie [2 ,3 ,4 ]
机构
[1] Univ Chinese Acad Sci, Sch Comp Sci & Technol, 19A Yuquan Rd, Beijing 100049, Peoples R China
[2] Univ Chinese Acad Sci, Sch Econ & Management, 80 Zhongguancun East St, Beijing 100190, Peoples R China
[3] Chinese Acad Sci, Res Ctr Fictitious Econ & Data Sci, 80 Zhongguancun East St, Beijing 100190, Peoples R China
[4] Chinese Acad Sci, Key Lab Big Data Min & Knowledge Management, 80 Zhongguancun East St, Beijing 100190, Peoples R China
基金
中国国家自然科学基金;
关键词
Domain adaptation; Semantic segmentation; Transfer learning;
D O I
10.1016/j.patcog.2022.109143
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper focuses on domain adaptation method based on style transfer. Previous methods based on style transfer pay attention to the transformation of texture features between domains and maintain semantic consistency to the greatest extent. However, these methods have different effects on domain gaps in different types of categories. The categories with large texture difference and small structure difference can be improved better. For the categories with small texture difference and large structure difference, it causes negative transfer. In this paper, a shape robustness enhanced domain adaptive segmentation algorithm is proposed. Firstly, we adopt adjustable style transfer methods to enhance the style diversity of source domain images. Next, we differentiated different types of image features to weaken the negative transfer in the process of adversarial training. The results of this paper on general data sets GTA5 and SYNTHIA are better than other style transfer methods. Further experiments show that we improve the shape robustness of style enhancement method in domain adaptive segmentation task. (c) 2022 Elsevier Ltd. All rights reserved.
引用
收藏
页数:10
相关论文
共 39 条
[1]  
Bagherinezhad H, 2018, Arxiv, DOI arXiv:1805.02641
[2]   Large-Scale Machine Learning with Stochastic Gradient Descent [J].
Bottou, Leon .
COMPSTAT'2010: 19TH INTERNATIONAL CONFERENCE ON COMPUTATIONAL STATISTICS, 2010, :177-186
[3]   DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs [J].
Chen, Liang-Chieh ;
Papandreou, George ;
Kokkinos, Iasonas ;
Murphy, Kevin ;
Yuille, Alan L. .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2018, 40 (04) :834-848
[4]  
Cheng LC, 2021, PROCEEDINGS OF THE THIRTIETH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, IJCAI 2021, P629
[5]   The Cityscapes Dataset for Semantic Urban Scene Understanding [J].
Cordts, Marius ;
Omran, Mohamed ;
Ramos, Sebastian ;
Rehfeld, Timo ;
Enzweiler, Markus ;
Benenson, Rodrigo ;
Franke, Uwe ;
Roth, Stefan ;
Schiele, Bernt .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :3213-3223
[6]  
Deng J, 2009, PROC CVPR IEEE, P248, DOI 10.1109/CVPRW.2009.5206848
[7]   Domain Stylization: A Fast Covariance Matching Framework Towards Domain Adaptation [J].
Dundar, Aysegul ;
Liu, Ming-Yu ;
Yu, Zhiding ;
Wang, Ting-Chun ;
Zedlewski, John ;
Kautz, Jan .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2021, 43 (07) :2360-2372
[8]   Mutual-Complementing Framework for Nuclei Detection and Segmentation in Pathology Image [J].
Feng, Zunlei ;
Wang, Zhonghua ;
Wang, Xinchao ;
Mao, Yining ;
Li, Thomas ;
Lei, Jie ;
Wang, Yuexuan ;
Song, Mingli .
2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, :4016-4025
[9]  
Feng ZL, 2021, AAAI CONF ARTIF INTE, V35, P1325
[10]  
Feng ZL, 2021, AAAI CONF ARTIF INTE, V35, P1334