An adaptive video shot segmentation scheme based on dual-detection model

被引:17
作者
Jiang, Xinghao [1 ,4 ]
Sun, Tanfeng [1 ,4 ]
Liu, Jin [2 ,3 ,4 ]
Chao, Juan [1 ]
Zhang, Wensheng [3 ]
机构
[1] Shanghai Jiao Tong Univ, Sch Informat Secur Engn, Shanghai 200240, Peoples R China
[2] Wuhan Univ, Sch Comp, State Key Lab Software Engn, Wuhan 430072, Peoples R China
[3] Chinese Acad Sci, Inst Automat, Key Lab Complex Syst & Intelligence Sci, Beijing 100190, Peoples R China
[4] Key Lab Shanghai Informat Secur Management & Tech, Shanghai 200240, Peoples R China
基金
中国国家自然科学基金;
关键词
Video shot segmentation; Scale invariant feature transform; Dual-detection model; Adaptive binary search; BOUNDARY DETECTION; TEMPORAL SEGMENTATION;
D O I
10.1016/j.neucom.2011.11.037
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Efficient segmentation of the video shots is the important and foundational work for the research of video content retrieval and analysis. A video shot segmentation scheme based on a dual-detection model is proposed, which includes the pre-detection and re-detection processes. The concepts of uneven blocked color histogram difference and uneven blocked pixel value difference based on human visual features are introduced, which are used as the main descriptors of the pre-detection process to enlarge the importance of central areas and to reduce the noises of background movements and logos. And the adaptive binary search method is introduced to fast detect boundaries with a time complexity of O(log(2)n). In the re-detection round, the scale invariant feature transform is applied to re-detect boundaries so as to improve the detection precision rate. Experiments show that this algorithm can improve both the recall rate and the precision rate of video shot boundary detection, especially for gradual shot boundaries. (C) 2012 Elsevier B.V. All rights reserved.
引用
收藏
页码:102 / 111
页数:10
相关论文
共 33 条
[1]   Adaptive Edge-Oriented Shot Boundary Detection [J].
Adjeroh, Don ;
Lee, M. C. ;
Banda, N. ;
Kandaswamy, Uma .
EURASIP JOURNAL ON IMAGE AND VIDEO PROCESSING, 2009,
[2]  
Amel A. M., 2010, J TELECOMMUN, V2, P54
[3]  
[Anonymous], 2001, International Journal of Image and Graphics (IJIG), Vol, DOI DOI 10.1142/S021946780100027X
[4]   Novel automatic video cut detection technique using Gabor filtering [J].
Barbu, Tudor .
COMPUTERS & ELECTRICAL ENGINEERING, 2009, 35 (05) :712-721
[5]   Comparison of video shot boundary detection techniques [J].
Boreczky, JS ;
Rowe, LA .
STORAGE AND RETRIEVAL FOR STILL IMAGE AND VIDEO DATABASES IV, 1996, 2670 :170-179
[6]   Information theory-based shot cut/fade detection and video summarization [J].
Cerneková, Z ;
Pitas, I ;
Nikou, C .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2006, 16 (01) :82-91
[7]   Movie scene segmentation using background information [J].
Chen, Liang-Hua ;
Lai, Yu-Chun ;
Liao, Hong-Yuan Mark .
PATTERN RECOGNITION, 2008, 41 (03) :1056-1065
[8]  
Chua T.-S., 2004, PROC ACMMM, P656, DOI [10.1145/1027527.1027679, DOI 10.1145/1027527.1027679]
[9]   Video shot detection and condensed representation [J].
Cotsaces, C ;
Nikolaidis, N ;
Pitas, I .
IEEE SIGNAL PROCESSING MAGAZINE, 2006, 23 (02) :28-37
[10]   A unified framework for semantic shot classification in sports video [J].
Duan, LY ;
Xu, M ;
Tian, Q ;
Xu, CS ;
Jin, JS .
IEEE TRANSACTIONS ON MULTIMEDIA, 2005, 7 (06) :1066-1083