A rejection-based method for event detection in video

被引:8
作者
Osadchy, M [1 ]
Keren, D [1 ]
机构
[1] Univ Haifa, Dept Comp Sci, IL-31905 Haifa, Israel
关键词
event detection; rejectors; visual speech recognition;
D O I
10.1109/TCSVT.2004.825530
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
This paper offers a natural extension of the newly introduced "anti-face" method to event detection, in both the gray-level and feature domains. For the gray-level domain, spatio-temporal templates are created by stacking the individual frames of the video sequence, and the detection is performed on these templates. In order to recognize the motion of features in a video sequence, the spatial locations of the features are modulated in time, thus creating a one-dimensional vector which represents the event in the detection process. The following applications are presented: 1) detection of an object under three-dimensional (3-D) rotations in a video sequence simulated from the COIL database; 2) visual recognition of spoken words; and 3) recognition of two-dimensional and 3-D sketched curves. The technique is capable of detecting 3-D curves in viewing directions which substantially differ from those in the training set. The resulting detection algorithm is very fast and can successfully detect events even in very low. resolution. Also, it is capable of discriminating the desired, event from arbitrary events, and not only from those in a negative. training set. Possible applications of the techniques offered in this paper are in man-machine interaction, surveillance, and search and summarization in video databases.
引用
收藏
页码:534 / 541
页数:8
相关论文
共 29 条
[1]   Learning parameterized models of image motion [J].
Black, MJ ;
Yacoob, Y ;
Jepson, AD ;
Fleet, DJ .
1997 IEEE COMPUTER SOCIETY CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, PROCEEDINGS, 1997, :561-567
[2]   Robustly estimating changes in image appearance [J].
Black, MJ ;
Fleet, DJ ;
Yacoob, Y .
COMPUTER VISION AND IMAGE UNDERSTANDING, 2000, 78 (01) :8-31
[3]   The recognition of human movement using temporal templates [J].
Bobick, AF ;
Davis, JW .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2001, 23 (03) :257-267
[4]  
BREGLER C, 1994, INT CONF ACOUST SPEE, P669, DOI 10.1109/ICASSP.1994.389567
[5]   Learning and recognizing human dynamics in video sequences [J].
Bregler, C .
1997 IEEE COMPUTER SOCIETY CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, PROCEEDINGS, 1997, :568-574
[6]  
Carlsson S, 2000, LECT NOTES COMPUT SC, V1842, P472
[7]   Hierarchical motion history images for recognizing human motion [J].
Davis, JW .
IEEE WORKSHOP ON DETECTION AND RECOGNITION OF EVENTS IN VIDEO, PROCEEDINGS, 2001, :39-46
[8]  
ESSA IA, 1995, FIFTH INTERNATIONAL CONFERENCE ON COMPUTER VISION, PROCEEDINGS, P360, DOI 10.1109/ICCV.1995.466916
[9]   AUTOMATIC OPTICALLY-BASED RECOGNITION OF SPEECH [J].
FINN, KE ;
MONTGOMERY, AA .
PATTERN RECOGNITION LETTERS, 1988, 8 (03) :159-164
[10]   3-D model-based tracking of humans in action: A multi-view approach [J].
Gavrila, DM ;
Davis, LS .
1996 IEEE COMPUTER SOCIETY CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, PROCEEDINGS, 1996, :73-80