Locality-Aware Channel-Wise Dropout for Occluded Face Recognition

被引:15
作者
He, Mingjie [1 ,2 ]
Zhang, Jie [1 ,2 ]
Shan, Shiguang [1 ,2 ,3 ,4 ]
Liu, Xiao [5 ]
Wu, Zhongqin [5 ]
Chen, Xilin [1 ,2 ]
机构
[1] Chinese Acad Sci, Key Lab Intelligent Informat Proc, Inst Comp Technol, Beijing 100190, Peoples R China
[2] Univ Chinese Acad Sci, Sch Comp Sci & Technol, Beijing 100049, Peoples R China
[3] CAS Ctr Excellence Brain Sci & Intelligence Techn, Shanghai 200031, Peoples R China
[4] Peng Cheng Lab, Shenzhen 518055, Peoples R China
[5] Tomorrow Adv Life Educ Grp TAL, Beijing 100080, Peoples R China
基金
中国国家自然科学基金;
关键词
Face recognition; Feature extraction; Liquid crystal displays; Robustness; Neurons; Image reconstruction; Dictionaries; Occluded face recognition; locality-aware channel-wise dropout; spatial attention module; ROBUST; OCCLUSION; REPRESENTATION; CLASSIFICATION;
D O I
10.1109/TIP.2021.3132827
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Face recognition remains a challenging task in unconstrained scenarios, especially when faces are partially occluded. To improve the robustness against occlusion, augmenting the training images with artificial occlusions has been proved as a useful approach. However, these artificial occlusions are commonly generated by adding a black rectangle or several object templates including sunglasses, scarfs and phones, which cannot well simulate the realistic occlusions. In this paper, based on the argument that the occlusion essentially damages a group of neurons, we propose a novel and elegant occlusion-simulation method via dropping the activations of a group of neurons in some elaborately selected channel. Specifically, we first employ a spatial regularization to encourage each feature channel to respond to local and different face regions. Then, the locality-aware channel-wise dropout (LCD) is designed to simulate occlusions by dropping out a few feature channels. The proposed LCD can encourage its succeeding layers to minimize the intra-class feature variance caused by occlusions, thus leading to improved robustness against occlusion. In addition, we design an auxiliary spatial attention module by learning a channel-wise attention vector to reweight the feature channels, which improves the contributions of non-occluded regions. Extensive experiments on various benchmarks show that the proposed method outperforms state-of-the-art methods with a remarkable improvement.
引用
收藏
页码:788 / 798
页数:11
相关论文
共 70 条
[1]  
Abadi M, 2016, PROCEEDINGS OF OSDI'16: 12TH USENIX SYMPOSIUM ON OPERATING SYSTEMS DESIGN AND IMPLEMENTATION, P265
[2]   Robust Principal Component Analysis? [J].
Candes, Emmanuel J. ;
Li, Xiaodong ;
Ma, Yi ;
Wright, John .
JOURNAL OF THE ACM, 2011, 58 (03)
[3]   Robust Deep Auto-encoder for Occluded Face Recognition [J].
Cheng, Lele ;
Wang, Jinjun ;
Gong, Yihong ;
Hou, Qiqi .
MM'15: PROCEEDINGS OF THE 2015 ACM MULTIMEDIA CONFERENCE, 2015, :1099-1102
[4]   ArcFace: Additive Angular Margin Loss for Deep Face Recognition [J].
Deng, Jiankang ;
Guo, Jia ;
Xue, Niannan ;
Zafeiriou, Stefanos .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :4685-4694
[5]   Marginal Loss for Deep Face Recognition [J].
Deng, Jiankang ;
Zhou, Yuxiang ;
Zafeiriou, Stefanos .
2017 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2017, :2006-2014
[6]  
DeVries T., 2017, arXiv
[7]  
Ding F., 2020, P 28 ACM INT C MULT, P2281
[8]   Low-Rank Laplacian-Uniform Mixed Model for Robust Face Recognition [J].
Dong, Jiayu ;
Zheng, Huicheng ;
Lian, Lina .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :11889-11898
[9]   UniformFace: Learning Deep Equidistributed Representation for Face Recognition [J].
Duan, Yueqi ;
Lu, Jiwen ;
Zhou, Jie .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :3410-3419
[10]   Combining reconstructive and discriminative subspace methods for robust classification and regression by subsampling [J].
Fidler, S ;
Skocaj, D ;
Leonardis, A .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2006, 28 (03) :337-350