Writer-independent signature verification; Evaluation of robotic and generative adversarial attacks

被引:14
作者
Bird, Jordan J.
Naser, Abdallah
Lotfi, Ahmad
机构
关键词
Offline signature verification; Writer-independent signature verification; Robotic adversarial attacks; Generative adversarial networks;
D O I
10.1016/j.ins.2023.03.029
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Forgery of a signature with the aim of deception is a serious crime. Machine learning is often employed to detect real and forged signatures. In this study, we present results which argue that robotic arms and generative models can overcome these systems and mount false-acceptance attacks. Convolutional neural networks and data augmentation strategies are tuned, producing a model of 87.12% accuracy for the verification of 2,640 human signatures. Two approaches are used to successfully attack the model with false-acceptance of forgeries. Robotic arms (Line-us and iDraw) physically copy real signatures on paper, and a conditional Generative Adversarial Network (GAN) is trained to generate signatures based on the binary class of 'genuine' and 'forged'. The 87.12% error margin is overcome by all approaches; prevalence of successful attacks is 32% for iDraw 2.0, 24% for Line-us, and 40% for the GAN. Fine-tuning with examples show that false-acceptance is preventable. We find attack success reduced by 24% for iDraw, 12% for Line-us, and 36% for the GAN. Results show exclusive behaviours between human and robotic forgers, suggesting training wholly on human forgeries can be attacked by robots, thus we argue in favour of fine-tuning systems with robotic forgeries to reduce their prevalence.
引用
收藏
页码:170 / 181
页数:12
相关论文
共 47 条
[1]   A multi-biometric iris recognition system based on a deep learning approach [J].
Al-Waisy, Alaa S. ;
Qahwaji, Rami ;
Ipson, Stanley ;
Al-Fahdawi, Shumoos ;
Nagem, Tarek A. M. .
PATTERN ANALYSIS AND APPLICATIONS, 2018, 21 (03) :783-802
[2]  
Alonso-Fernandez Fernando, 2009, 2009 10th International Conference on Document Analysis and Recognition (ICDAR), P728, DOI 10.1109/ICDAR.2009.261
[3]  
Bakhti W., 2019, 2019 11 INT C QUALIT, P1
[4]  
Bird JJ, 2020, IEEE INT CONF AUTON, P146, DOI [10.1109/icarsc49921.2020.9096166, 10.1109/ICARSC49921.2020.9096166]
[5]  
Boles A, 2017, 2017 12TH SYSTEM OF SYSTEMS ENGINEERING CONFERENCE (SOSE), DOI 10.26879/695
[6]  
Buccafurri G., 2009, P 2 INT C SECURITY I, P278
[7]  
Cowley D., 1983, J CRIM LAW CRIM, V47, P61
[8]   Robotic Arm Motion for Verifying Signatures [J].
Diaz, Moises ;
Ferrer, Miguel A. ;
Quintana, Jose J. .
PROCEEDINGS 2018 16TH INTERNATIONAL CONFERENCE ON FRONTIERS IN HANDWRITING RECOGNITION (ICFHR), 2018, :157-162
[9]   Anthropomorphic Features for On-Line Signatures [J].
Diaz, Moises ;
Ferrer, Miguel A. ;
Quintana, Jose J. .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2019, 41 (12) :2807-2819
[10]   Distinguishing Characteristics of Robotic Writing [J].
Dumitra, Aurora ;
Guzowski, Anna ;
Jean, Alynka ;
Shaw, Melvin ;
Warmbier, Grace ;
Zippo, Patricia .
JOURNAL OF FORENSIC SCIENCES, 2019, 64 (02) :468-474