Who is closer: A computational method for domain gap evaluation

被引:8
作者
Liu, Xiaobin [1 ]
Zhang, Shiliang [1 ]
机构
[1] Peking Univ, Dept Comp Sci, Beijing 100871, Peoples R China
基金
北京市自然科学基金;
关键词
Domain gap evaluation; CNN; Domain adaptive learning; DISTANCE;
D O I
10.1016/j.patcog.2021.108293
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Domain gaps between different datasets limit the generalization ability of CNN models. Precise evaluation on the domain gap has potential to assist the promotion of CNN generalization ability. This paper pro -poses a computational framework to evaluate gaps between different domains, e.g., judging which one of source domains is closer to the target domain. Our model is based on the observation that, given a well-trained classifier on the source domain, the entropy of its classification scores of the output layer can be used as an indicator of the domain gap. For instance, smaller domain gap generally corresponds to smaller entropy of classification scores. To further boost the discriminative power in distinguishing domain gaps, a novel training strategy is proposed to supervise the model to produce smaller entropy on one source domain and larger entropy on other source domains. This supervision leads to an efficient and discriminative domain gap evaluation model. Extensive experiments on multiple datasets including faces, vehicles, fashions, and persons, etc . show that our method can reasonably measure domain gaps. We further conduct experiments on domain adaptive person ReID task and our method is adopted to pre-trained model selection, pre-trained model fusion, source dataset fusion, and source dataset selection. As shown in the experiments, our method substantially boosts the ReID accuracy. To the best of our knowl-edge, this is an original work focusing on computational domain gap evaluation. Our code is available at https://github.com/liu-xb/DomainGapEvaluation . (c) 2021 Published by Elsevier Ltd.
引用
收藏
页数:11
相关论文
共 60 条
  • [1] TASK2VEC: Task Embedding for Meta-Learning
    Achille, Alessandro
    Lam, Michael
    Tewari, Rahul
    Ravichandran, Avinash
    Maji, Subhransu
    Fowlkes, Charless
    Soatto, Stefano
    Perona, Pietro
    [J]. 2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 6439 - 6448
  • [2] Carlucci Fabio M, 2019, P IEEE CVF C COMP VI, P2229
  • [3] A Graph Embedding Framework for Maximum Mean Discrepancy-Based Domain Adaptation Algorithms
    Chen, Yiming
    Song, Shiji
    Li, Shuang
    Wu, Cheng
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 : 199 - 213
  • [4] Deep conditional adaptation networks and label correlation transfer for unsupervised domain adaptation
    Chen, Yu
    Yang, Chunling
    Zhang, Yan
    Li, Yuze
    [J]. PATTERN RECOGNITION, 2020, 98
  • [6] COHEN D, 2018, ACM SIGIR
  • [7] Deng J, 2009, PROC CVPR IEEE, P248, DOI 10.1109/CVPRW.2009.5206848
  • [8] DeVries T, 2018, Learning confidence for out-of-distribution detection in neural networks
  • [9] Self-similarity Grouping: A Simple Unsupervised Cross Domain Adaptation Approach for Person Re-identification
    Fu, Yang
    Wei, Yunchao
    Wang, Guanshuo
    Zhou, Yuqian
    Shi, Honghui
    Huang, Thomas S.
    [J]. 2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 6111 - 6120
  • [10] Ganin Y, 2016, J MACH LEARN RES, V17