Improving Cross-Resolution Face Matching Using Ensemble-Based Co-Transfer Learning

被引:48
作者
Bhatt, Himanshu S. [1 ]
Singh, Richa [1 ]
Vatsa, Mayank [1 ]
Ratha, Nalini K. [2 ]
机构
[1] Indraprastha Inst Informat Technol, New Delhi 110020, India
[2] IBM Thomas J Watson Res Ctr, Yorktown Hts, NY 10598 USA
关键词
Face recognition; cross resolution; transfer learning; co-training; co-transfer learning; RECOGNITION; SUPERRESOLUTION;
D O I
10.1109/TIP.2014.2362658
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Face recognition algorithms are generally trained for matching high-resolution images and they perform well for similar resolution test data. However, the performance of such systems degrades when a low-resolution face image captured in unconstrained settings, such as videos from cameras in a surveillance scenario, are matched with high-resolution gallery images. The primary challenge, here, is to extract discriminating features from limited biometric content in low-resolution images and match it to information rich high-resolution face images. The problem of cross-resolution face matching is further alleviated when there is limited labeled positive data for training face recognition algorithms. In this paper, the problem of cross-resolution face matching is addressed where low-resolution images are matched with high-resolution gallery. A co-transfer learning framework is proposed, which is a cross-pollination of transfer learning and co-training paradigms and is applied for cross-resolution face matching. The transfer learning component transfers the knowledge that is learnt while matching high-resolution face images during training to match low-resolution probe images with high-resolution gallery during testing. On the other hand, co-training component facilitates this transfer of knowledge by assigning pseudolabels to unlabeled probe instances in the target domain. Amalgamation of these two paradigms in the proposed ensemble framework enhances the performance of cross-resolution face recognition. Experiments on multiple face databases show the efficacy of the proposed algorithm and compare with some existing algorithms and a commercial system. In addition, several high profile real-world cases have been used to demonstrate the usefulness of the proposed approach in addressing the tough challenges.
引用
收藏
页码:5654 / 5669
页数:16
相关论文
共 63 条
  • [1] Abney S, 2002, 40TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, PROCEEDINGS OF THE CONFERENCE, P360
  • [2] Training Hierarchical Feed-Forward Visual Recognition Models Using Transfer Learning from Pseudo-Tasks
    Ahmed, Amr
    Yu, Kai
    Xu, Wei
    Gong, Yihong
    Xing, Eric
    [J]. COMPUTER VISION - ECCV 2008, PT III, PROCEEDINGS, 2008, 5304 : 69 - +
  • [3] Ahonen T, 2008, ICPR2009, P1, DOI DOI 10.1109/ICPR.2008.4761847
  • [4] [Anonymous], 2010, P 27 INT C MACHINE
  • [5] [Anonymous], P 19 IEEE INT C IM P
  • [6] [Anonymous], 2011, P INT JOINT C BIOMET
  • [7] [Anonymous], 2008, P 2008 IEEE C COMP V
  • [8] [Anonymous], 2013, P IEEE 6 INT C BIOM
  • [9] [Anonymous], P 2000 NEUR INF PROC
  • [10] [Anonymous], 2007, PROC IEEE INT C COMP