Exact Feature Distribution Matching for Arbitrary Style Transfer and Domain Generalization

被引:129
作者
Zhang, Yabin [1 ]
Li, Minghan [1 ]
Li, Ruihuang [1 ]
Jia, Kui [2 ]
Zhang, Lei [1 ]
机构
[1] Hong Kong Polytech Univ, Hong Kong, Peoples R China
[2] South China Univ Technol, Guangzhou, Peoples R China
来源
2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR) | 2022年
关键词
D O I
10.1109/CVPR52688.2022.00787
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Arbitrary style transfer (AST) and domain generalization (DG) are important yet challenging visual learning tasks, which can be cast as a feature distribution matching problem. With the assumption of Gaussian feature distribution, conventional feature distribution matching methods usually match the mean and standard deviation of features. However, the feature distributions of real-world data are usually much more complicated than Gaussian, which cannot be accurately matched by using only the first-order and second-order statistics, while it is computationally prohibitive to use high-order statistics for distribution matching. In this work, we, for the first time to our best knowledge, propose to perform Exact Feature Distribution Matching (EFDM) by exactly matching the empirical Cumulative Distribution Functions (eCDFs) of image features, which could be implemented by applying the Exact Histogram Matching (EHM) in the image feature space. Particularly, a fast EHM algorithm, named Sort-Matching, is employed to perform EFDM in a plug-and-play manner with minimal cost. The effectiveness of our proposed EFDM method is verified on a variety of AST and DG tasks, demonstrating new state-of-the-art results. Codes are available at https://github.com/YBZh/EFDM.
引用
收藏
页码:8025 / 8035
页数:11
相关论文
共 72 条
[71]   Omni-Scale Feature Learning for Person Re-Identification [J].
Zhou, Kaiyang ;
Yang, Yongxin ;
Cavallaro, Andrea ;
Xiang, Tao .
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, :3701-3711
[72]  
Zhou Kaiyang, 2021, ICLR, V1