EIFNet: An Explicit and Implicit Feature Fusion Network for Finger Vein Verification

被引:23
作者
Song, Yizhuo [1 ]
Zhao, Pengyang [1 ]
Yang, Wenming [1 ]
Liao, Qingmin [1 ]
Zhou, Jie [2 ]
机构
[1] Tsinghua Univ, Shenzhen Int Grad Sch, Dept Elect Engn, Shenzhen 518055, Peoples R China
[2] Tsinghua Univ, Dept Automat, Beijing 100084, Peoples R China
基金
中国国家自然科学基金;
关键词
Veins; Feature extraction; Fingers; Convolution; Deep learning; Data mining; Image recognition; Finger vein verification; deep learning; feature extraction; vein pattern extraction; feature fusion; DEEP REPRESENTATION; FEATURE-EXTRACTION; RECOGNITION; PATTERNS;
D O I
10.1109/TCSVT.2022.3224203
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Finger vein recognition has received more attention in recent years due to its high security and promising development potential. However, extracting complete vein patterns and obtaining features from the original images suffer from the low contrast of finger vein images, which dramatically restrains the performance of finger vein recognition algorithms. Inspired by this motivation, we propose an explicit and implicit feature fusion Network (EIFNet) for finger vein verification. It can extract more comprehensive and discriminative features by complementarily fusing the features extracted from binary vein masks and gray original images. We design a feature fusion module (FFM) acting as a bridge between mask feature extraction module (MFEM) and contextual feature extraction module (CFEM) to achieve the optimal fusion of features. To obtain more accurate vein masks, we develop a novel finger vein pattern extraction method and provide the first finger vein segmentation dataset THUFVS. We solve the difficulty of building finger vein segmentation datasets in a simple but effective way, and develop a complete process encompassing dataset creation, data augmentation refinement and network design, which refers to the Mask Generation Module (MGM), for the deep learning based finger vein pattern extraction method. Experimental results demonstrate the superior verification performance of EIFNet on three widely used datasets compared with other existing methods.
引用
收藏
页码:2520 / 2532
页数:13
相关论文
共 61 条
[11]   Convolutional Autoencoder Model for Finger-Vein Verification [J].
Hou, Borui ;
Yan, Ruqiang .
IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2020, 69 (05) :2067-2074
[12]   On-line fingerprint verification [J].
Jain, A ;
Hong, L ;
Bolle, R .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 1997, 19 (04) :302-314
[13]  
Jalilian E, 2018, IEEE INT WORKS INFOR
[14]  
Jialiang Peng, 2012, 2012 Eighth International Conference on Intelligent Information Hiding and Multimedia Signal Processing (IIH-MSP), P45, DOI 10.1109/IIH-MSP.2012.17
[15]  
Joon Hwan Choi, 2009, Proceedings of the SPIE - The International Society for Optical Engineering, V7251, DOI 10.1117/12.810458
[16]   Study of a Full-View 3D Finger Vein Verification Technique [J].
Kang, Wenxiong ;
Liu, Hongda ;
Luo, Wei ;
Deng, Feiqi .
IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY, 2020, 15 :1175-1189
[17]  
Kim HG, 2012, LECT NOTES COMPUT SC, V7432, P21, DOI 10.1007/978-3-642-33191-6_3
[18]  
King DB, 2015, ACS SYM SER, V1214, P1, DOI 10.1021/bk-2015-1214.ch001
[19]   Finger Vein Pulsation-Based Biometric Recognition [J].
Krishnan, Arya ;
Thomas, Tony ;
Mishra, Deepak .
IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY, 2021, 16 :5034-5044
[20]   Human Identification Using Finger Images [J].
Kumar, Ajay ;
Zhou, Yingbo .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2012, 21 (04) :2228-2244