The Human-Biometric-Sensor Interaction Evaluation Method: Biometric Performance and Usability Measurements

被引:32
作者
Kukula, Eric P. [1 ]
Sutton, Mathias J.
Elliott, Stephen J. [1 ]
机构
[1] Purdue Univ, Dept Ind Technol, Biometr Stand Performance & Assurance Lab, W Lafayette, IN 47907 USA
关键词
Biometrics; error rates; human-biometric-sensor interaction (HBSI); measurement; testing and reporting; usability;
D O I
10.1109/TIM.2009.2037878
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
This paper discusses the human-biometric-sensor interaction (HBSI) evaluation method that uses ergonomics, usability, and sample quality criteria as explanatory variables for the overall biometric system performance. The HBSI method was proposed because of questions regarding the thoroughness of traditional system-level performance evaluation metrics such as the failure-to-acquire (FTA) rate, the failure-to-enroll (FTE) rate, the false-accept rate (FAR), and the false-reject rate (FRR). Data were collected from 85 individuals over three visits that accounted for 25 867 user interactions with three swipe-based fingerprint sensors. The results in this paper revealed that traditional biometric evaluations that focus on system-level metrics are not providing sufficient reporting details regarding the user interaction with the devices. In this paper, the systemic FTA rate of 14.38% was shown to be segmented into three metrics: false interaction (FI), failure to detect (FTD), and concealed interaction (CI). The results show that the FI accounted for 69.05% of the systemic FTA presentations, FTD accounted for 30.71%, and CI accounted for 0.24%. Overall, the HBSI evaluation method and framework for biometric interactions provided new metrics that improve the analysis capabilities for biometric performance evaluations as it links system feedback to the human-sensor interaction, enabling researchers, system designers, and implementers to understand if the issues are the result of the system, the user, both the system and the user, or some other extraneous factor.
引用
收藏
页码:784 / 791
页数:8
相关论文
共 23 条
[1]  
[Anonymous], 1998, 9241 ISO
[2]  
[Anonymous], 2006, E HDB STAT METHODS
[3]  
*BSPA LAB, 2009, HUM BIOM SENS INT
[4]  
CLARKE K, 1994, NEW STATESMAN SOC, V7, P4
[5]  
Coventry L, 2003, CONTEMPORARY ERGONOMICS 2003, P247
[6]  
Coventry L., 2003, Proceedings of the SIGCHI conference on Human factors in computing systems, P153, DOI DOI 10.1145/642637.642639
[7]  
ELLIOTT S, 2010, P SPIE S SPIE DEF SE
[8]  
Elliott S., 2004, P INT WORKSH BIOM TE
[9]  
Elliott SJ, 2007, SER MACH PERCEPT ART, V67, P339
[10]  
*ISO IEC, 2007, 1979532007 ISOIEC