Local and global feature attention fusion network for face recognition

被引:2
作者
Wang, Yu [1 ]
Wei, Wei [1 ]
机构
[1] Huazhong Univ Sci & Technol, Sch Comp Sci & Technol, Cognit Comp & Intelligent Informat Proc CCIIP Lab, Wuhan, Peoples R China
基金
中国国家自然科学基金;
关键词
Low-quality face recognition; Feature fusion;
D O I
10.1016/j.patcog.2024.111227
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Recognition of low-quality face images remains a challenge due to invisible or deformation in partial facial regions. For low-quality images dominated by missing partial facial regions, local region similarity contributes more to face recognition (FR). Conversely, incases dominated by local face deformation, excessive attention to local regions may lead to misjudgments, while global features exhibit better robustness. However, most of the existing FR methods neglect the bias in feature quality of low-quality images introduced by different factors. To address this issue, we propose a Local and Global Feature Attention Fusion (LGAF) network based on feature quality. The network adaptively allocates attention between local and global features according to feature quality and obtains more discriminative and high-quality face features through local and global information complementarity. In addition, to effectively obtain fine-grained information at various scales and increase the separability of facial features in high-dimensional space, we introduce a Multi-Head Multi-Scale Local Feature Extraction (MHMS) module. Experimental results demonstrate that the LGAF achieves the best average performance on 4 validation sets (CFP-FP, CPLFW, AgeDB, and CALFW), and the performance on TinyFace and SCFace outperforms the state-of-the-art methods (SoTA).
引用
收藏
页数:11
相关论文
共 41 条
[1]   Self-restrained triplet loss for accurate masked face recognition [J].
Boutros, Fadi ;
Damer, Naser ;
Kirchbuchner, Florian ;
Kuijper, Arjan .
PATTERN RECOGNITION, 2022, 124
[2]   Low-Resolution Face Recognition [J].
Cheng, Zhiyi ;
Zhu, Xiatian ;
Gong, Shaogang .
COMPUTER VISION - ACCV 2018, PT III, 2019, 11363 :605-621
[3]   Attentional Feature Fusion [J].
Dai, Yimian ;
Gieseke, Fabian ;
Oehmcke, Stefan ;
Wu, Yiquan ;
Barnard, Kobus .
2021 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION WACV 2021, 2021, :3559-3568
[4]   TransFace: Calibrating Transformer Training for Face Recognition from a Data-Centric Perspective [J].
Dan, Jun ;
Liu, Yang ;
Xie, Haoyu ;
Deng, Jiankang ;
Xie, Haoran ;
Xie, Xuansong ;
Sun, Baigui .
2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2023), 2023, :20585-20596
[5]   ArcFace: Additive Angular Margin Loss for Deep Face Recognition [J].
Deng, Jiankang ;
Guo, Jia ;
Xue, Niannan ;
Zafeiriou, Stefanos .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :4685-4694
[6]   Variational Prototype Learning for Deep Face Recognition [J].
Deng, Jiankang ;
Guo, Jia ;
Yang, Jing ;
Lattas, Alexandros ;
Zafeiriou, Stefanos .
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, :11901-11910
[7]   SCface - surveillance cameras face database [J].
Grgic, Mislav ;
Delac, Kresimir ;
Grgic, Sonja .
MULTIMEDIA TOOLS AND APPLICATIONS, 2011, 51 (03) :863-879
[8]   Multi-PIE [J].
Gross, Ralph ;
Matthews, Iain ;
Cohn, Jeffrey ;
Kanade, Takeo ;
Baker, Simon .
IMAGE AND VISION COMPUTING, 2010, 28 (05) :807-813
[9]   MS-Celeb-1M: A Dataset and Benchmark for Large-Scale Face Recognition [J].
Guo, Yandong ;
Zhang, Lei ;
Hu, Yuxiao ;
He, Xiaodong ;
Gao, Jianfeng .
COMPUTER VISION - ECCV 2016, PT III, 2016, 9907 :87-102
[10]   Deep Residual Learning for Image Recognition [J].
He, Kaiming ;
Zhang, Xiangyu ;
Ren, Shaoqing ;
Sun, Jian .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :770-778