Automated person categorization for video surveillance using soft biometrics

被引:14
作者
Demirkus, Meltem [1 ]
Garg, Kshitiz [1 ]
Guler, Sadiye [1 ]
机构
[1] McGill Univ, Elect & Comp Eng Dept, Montreal, PQ H3A 2A7, Canada
来源
BIOMETRIC TECHNOLOGY FOR HUMAN IDENTIFICATION VII | 2010年 / 7667卷
关键词
soft biometry; video surveillance; gender ethnicity; person categorization; person detection and tracking; face detection; session soft biometry; camera hand-off; GENDER;
D O I
10.1117/12.851424
中图分类号
Q [生物科学];
学科分类号
07 ; 0710 ; 09 ;
摘要
We present a prototype video tracking and person categorization system that uses face and person soft biometric features to tag people while tracking them in multiple camera views. Our approach takes advantage of temporal aspect of video by extracting and accumulating feasible soft biometric features for each person in every frame to build a dynamic soft biometric feature list for each tracked person in surveillance videos. We developed algorithms for extracting face soft biometric features to achieve gender and ethnicity classification and session soft biometric features to aid in camera hand-off in surveillance videos with low resolution and uncontrolled illumination. To train and test our face soft biometry algorithms, we collected over 1500 face images from both genders and three ethnicity groups with various sizes, poses and illumination. These soft biometric feature extractors and classifiers are implemented on our existing video content extraction platform to enhance video surveillance tasks. Our algorithms achieved promising results for gender and ethnicity classification, and tracked person re-identification for camera hand-off on low to good quality surveillance and broadcast videos. By utilizing the proposed system, a high level description of extracted person's soft biometric data can be stored to use later for different purposes, such as to provide categorical information of people, to create database partitions to accelerate searches in responding to user queries, and to track people between cameras.
引用
收藏
页数:12
相关论文
共 25 条
[1]  
[Anonymous], 2005, PROC CVPR IEEE
[2]  
[Anonymous], COLOR FERET FACE DAT
[3]  
[Anonymous], ROBOTICA
[4]  
BARAM M, 2007, ABC NEWS 0710
[5]  
BARCZAK ALC, 2005, SIGNAL IMAGE PROCESS
[6]  
BILESCHI S, 2007, IMAGE REPRESENTATION
[7]   LIBSVM: A Library for Support Vector Machines [J].
Chang, Chih-Chung ;
Lin, Chih-Jen .
ACM TRANSACTIONS ON INTELLIGENT SYSTEMS AND TECHNOLOGY, 2011, 2 (03)
[8]   Mixture of experts for classification of gender, ethnic origin, and pose of human faces [J].
Gutta, S ;
Huang, JRJ ;
Jonathon, P ;
Wechsler, H .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 2000, 11 (04) :948-960
[9]  
HUANG Y, 2008, IEEE INT C COMP VIS
[10]  
JAIN AK, 2004, P SPIE INT S DEF SEC