Trans-FD: Transformer-Based Representation Interaction for Face De-Morphing

被引:2
作者
Long, Min [1 ]
Duan, Qiangqiang [2 ]
Zhang, Le-Bing [3 ]
Peng, Fei [4 ]
Zhang, Dengyong [2 ]
机构
[1] Guangzhou Univ, Sch Elect & Commun Engn, Guangzhou 510006, Guangdong, Peoples R China
[2] Changsha Univ Sci & Technol, Sch Comp & Commun Engn, Changsha 410114, Peoples R China
[3] Huaihua Univ, Sch Comp & Artificial Intelligence, Huaihua 418000, Peoples R China
[4] Guangzhou Univ, Inst Artificial Intelligence & Blockchain, Guangzhou 510006, Peoples R China
来源
IEEE TRANSACTIONS ON BIOMETRICS, BEHAVIOR, AND IDENTITY SCIENCE | 2024年 / 6卷 / 03期
基金
中国国家自然科学基金;
关键词
Faces; Feature extraction; Image restoration; Face recognition; Transformers; Generators; Training; Face de-morphing; face morphing attack; face recognition; transformer; NETWORK;
D O I
10.1109/TBIOM.2024.3390056
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Face morphing attacks aim to deceive face recognition systems by using a facial image that contains multiple biometric information. It has been demonstrated to pose a significant threat to commercial face recognition systems and human experts. Although a large number of face morphing detection methods have been proposed in recent years to enhance the security of face recognition systems, little attention has been paid to restoring the identity of the accomplice from a morphed image. In this paper, Trans-FD, a novel model that uses Transformer representation interaction to restore the identity of the accomplice, is proposed. To effectively separate the identity of an accomplice, Trans-FD applies Transformer to perform representation interaction in the separation network. Additionally, it utilizes CNN encoders to extract multi-scale features, and it establishes skip connections between the encoder and generator through the Transformer-based separation network to provide detailed information for the generator. Experiments demonstrate that Trans-FD can effectively restore the accomplice's face and outperforms previous works in terms of restoration accuracy and image quality.
引用
收藏
页码:385 / 397
页数:13
相关论文
共 47 条
[1]  
[Anonymous], "Face++ compare API
[2]  
[Anonymous], 2020, dlib C++ Library
[3]  
Banerjee S., 2022, P IEEE INT JOINT C B
[4]   Conditional Identity Disentanglement for Differential Face Morph Detection [J].
Banerjee, Sudipta ;
Ross, Arun .
2021 INTERNATIONAL JOINT CONFERENCE ON BIOMETRICS (IJCB 2021), 2021,
[5]   Automated Artifact Retouching in Morphed Images With Attention Maps [J].
Borghi, Guido ;
Franco, Annalisa ;
Graffieti, Gabriele ;
Maltoni, Davide .
IEEE ACCESS, 2021, 9 :136561-136579
[6]  
Damer Naser, 2019, Pattern Recognition. 40th German Conference, GCPR 2018. Proceedings: Lecture Notes in Computer Science (LNCS 11269), P518, DOI 10.1007/978-3-030-12939-2_36
[7]  
Damer N., 2018, P IEEE 9 INT C BIOM, P1
[8]   PW-MAD: Pixel-Wise Supervision for Generalized Face Morphing Attack Detection [J].
Damer, Naser ;
Spiller, Noemie ;
Fang, Meiling ;
Boutros, Fadi ;
Kirchbuchner, Florian ;
Kuijper, Arjan .
ADVANCES IN VISUAL COMPUTING (ISVC 2021), PT I, 2021, 13017 :291-304
[9]  
Dawson J., 2021, P IEEE INT JOINT C B, P8
[10]  
Debiasi L, 2018, INT CONF BIOMETR THE