Shape robustness in style enhanced cross domain semantic segmentation

被引:8
作者
Zhu, Siyu [1 ,3 ]
Tian, Yingjie [2 ,3 ,4 ]
机构
[1] Univ Chinese Acad Sci, Sch Comp Sci & Technol, 19A Yuquan Rd, Beijing 100049, Peoples R China
[2] Univ Chinese Acad Sci, Sch Econ & Management, 80 Zhongguancun East St, Beijing 100190, Peoples R China
[3] Chinese Acad Sci, Res Ctr Fictitious Econ & Data Sci, 80 Zhongguancun East St, Beijing 100190, Peoples R China
[4] Chinese Acad Sci, Key Lab Big Data Min & Knowledge Management, 80 Zhongguancun East St, Beijing 100190, Peoples R China
基金
中国国家自然科学基金;
关键词
Domain adaptation; Semantic segmentation; Transfer learning;
D O I
10.1016/j.patcog.2022.109143
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper focuses on domain adaptation method based on style transfer. Previous methods based on style transfer pay attention to the transformation of texture features between domains and maintain semantic consistency to the greatest extent. However, these methods have different effects on domain gaps in different types of categories. The categories with large texture difference and small structure difference can be improved better. For the categories with small texture difference and large structure difference, it causes negative transfer. In this paper, a shape robustness enhanced domain adaptive segmentation algorithm is proposed. Firstly, we adopt adjustable style transfer methods to enhance the style diversity of source domain images. Next, we differentiated different types of image features to weaken the negative transfer in the process of adversarial training. The results of this paper on general data sets GTA5 and SYNTHIA are better than other style transfer methods. Further experiments show that we improve the shape robustness of style enhancement method in domain adaptive segmentation task. (c) 2022 Elsevier Ltd. All rights reserved.
引用
收藏
页数:10
相关论文
共 39 条
[11]   Image Style Transfer Using Convolutional Neural Networks [J].
Gatys, Leon A. ;
Ecker, Alexander S. ;
Bethge, Matthias .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :2414-2423
[12]  
Geirhos R., 2019, INT C LEARNING REPRE
[13]   Deep Residual Learning for Image Recognition [J].
He, Kaiming ;
Zhang, Xiangyu ;
Ren, Shaoqing ;
Sun, Jian .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :770-778
[14]   Knowledge Distillation with Adversarial Samples Supporting Decision Boundary [J].
Heo, Byeongho ;
Lee, Minsik ;
Yun, Sangdoo ;
Choi, Jin Young .
THIRTY-THIRD AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FIRST INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE / NINTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2019, :3771-3778
[15]  
Hoffman J, 2018, PR MACH LEARN RES, V80
[16]   Arbitrary Style Transfer in Real-time with Adaptive Instance Normalization [J].
Huang, Xun ;
Belongie, Serge .
2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, :1510-1519
[17]  
Jing YC, 2020, AAAI CONF ARTIF INTE, V34, P4369
[18]   Stroke Controllable Fast Style Transfer with Adaptive Receptive Fields [J].
Jing, Yongcheng ;
Liu, Yang ;
Yang, Yezhou ;
Feng, Zunlei ;
Yu, Yizhou ;
Tao, Dacheng ;
Song, Mingli .
COMPUTER VISION - ECCV 2018, PT XIII, 2018, 11217 :244-260
[19]   Learning Texture Invariant Representation for Domain Adaptation of Semantic Segmentation [J].
Kim, Myeongjin ;
Byun, Hyeran .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2020), 2020, :12972-12981
[20]  
Kingma D. P., 3 INT C LEARNING REP, P1