EIFNet: An Explicit and Implicit Feature Fusion Network for Finger Vein Verification

被引:23
作者
Song, Yizhuo [1 ]
Zhao, Pengyang [1 ]
Yang, Wenming [1 ]
Liao, Qingmin [1 ]
Zhou, Jie [2 ]
机构
[1] Tsinghua Univ, Shenzhen Int Grad Sch, Dept Elect Engn, Shenzhen 518055, Peoples R China
[2] Tsinghua Univ, Dept Automat, Beijing 100084, Peoples R China
基金
中国国家自然科学基金;
关键词
Veins; Feature extraction; Fingers; Convolution; Deep learning; Data mining; Image recognition; Finger vein verification; deep learning; feature extraction; vein pattern extraction; feature fusion; DEEP REPRESENTATION; FEATURE-EXTRACTION; RECOGNITION; PATTERNS;
D O I
10.1109/TCSVT.2022.3224203
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Finger vein recognition has received more attention in recent years due to its high security and promising development potential. However, extracting complete vein patterns and obtaining features from the original images suffer from the low contrast of finger vein images, which dramatically restrains the performance of finger vein recognition algorithms. Inspired by this motivation, we propose an explicit and implicit feature fusion Network (EIFNet) for finger vein verification. It can extract more comprehensive and discriminative features by complementarily fusing the features extracted from binary vein masks and gray original images. We design a feature fusion module (FFM) acting as a bridge between mask feature extraction module (MFEM) and contextual feature extraction module (CFEM) to achieve the optimal fusion of features. To obtain more accurate vein masks, we develop a novel finger vein pattern extraction method and provide the first finger vein segmentation dataset THUFVS. We solve the difficulty of building finger vein segmentation datasets in a simple but effective way, and develop a complete process encompassing dataset creation, data augmentation refinement and network design, which refers to the Mask Generation Module (MGM), for the deep learning based finger vein pattern extraction method. Experimental results demonstrate the superior verification performance of EIFNet on three widely used datasets compared with other existing methods.
引用
收藏
页码:2520 / 2532
页数:13
相关论文
共 61 条
[1]   Fusion of Band Limited Phase Only Correlation and Width Centroid Contour Distance for finger based biometrics [J].
Asaari, Mohd Shahrinie Mohd ;
Suandi, Shahrel A. ;
Rosdi, Bakhtiar Affendi .
EXPERT SYSTEMS WITH APPLICATIONS, 2014, 41 (07) :3367-3382
[2]  
Beining Huang, 2010, Proceedings of the 2010 20th International Conference on Pattern Recognition (ICPR 2010), P1269, DOI 10.1109/ICPR.2010.316
[3]  
Chauhan NK, 2018, 2018 INTERNATIONAL CONFERENCE ON COMPUTING, POWER AND COMMUNICATION TECHNOLOGIES (GUCON), P340
[4]  
Daugman J, 2009, ESSENTIAL GUIDE TO IMAGE PROCESSING, 2ND EDITION, P715, DOI 10.1016/B978-0-12-374457-9.00025-1
[5]   Cross-Domain Palmprint Recognition via Regularized Adversarial Domain Adaptive Hashing [J].
Du, Xuefeng ;
Zhong, Dexing ;
Shao, Huikai .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2021, 31 (06) :2372-2385
[6]   A novel finger vein verification system based on two-stream convolutional network learning [J].
Fang, Yuxun ;
Wu, Qiuxia ;
Kang, Wenxiong .
NEUROCOMPUTING, 2018, 290 :100-107
[7]  
Hadsell R., 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06), V2, P1735
[8]  
Han M., 1997, CHIN J CLIN ANATOMY, V15, P39
[9]   Convolutional Neural Network-Based Finger-Vein Recognition Using NIR Image Sensors [J].
Hong, Hyung Gil ;
Lee, Min Beom ;
Park, Kang Ryoung .
SENSORS, 2017, 17 (06)
[10]   ArcVein-Arccosine Center Loss for Finger Vein Verification [J].
Hou, Borui ;
Yan, Ruqiang .
IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2021, 70