GRAPH-BASED MULTI-MODAL SCENE DETECTION FOR MOVIE AND TELEPLAY

被引:0
作者
Xu, Su [1 ]
Feng, Bailan [1 ]
Ding, Peng [1 ]
Xu, Bo [1 ]
机构
[1] Chinese Acad Sci, Inst Automat, Digital Content Technol Res Ctr, Beijing 100190, Peoples R China
来源
2012 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP) | 2012年
关键词
graph-modal; multi-modal; STG analysis; audio classify; SEGMENTATION;
D O I
暂无
中图分类号
O42 [声学];
学科分类号
070206 ; 082403 ;
摘要
Automatic scene detection is a fundamental step for efficient video searching and browsing. This paper presents our current work on scene detection that integrates three effective strategies into a single framework. For each video, firstly, a coherence signal is constructed by graph modal obtained from the similarity matrix in a temporal interval. Secondly, the signal is optimized by scene transition graph (STG) analysis and audio classification, in which scene clues hidden in multimedia are discovered from the video. Finally, the scene boundaries are identified by window function. In experiments, we compare the proposed scene detection method with three typical algorithms on teleplay and movies, and the results of our method, yielding an average 0.85 F-measure, is the best one.
引用
收藏
页码:1413 / 1416
页数:4
相关论文
共 10 条
[1]   Scene Detection in Videos Using Shot Clustering and Sequence Alignment [J].
Chasanis, Vasileios T. ;
Likas, Aristidis C. ;
Galatsanos, Nikolaos P. .
IEEE TRANSACTIONS ON MULTIMEDIA, 2009, 11 (01) :89-100
[2]  
Christian P., 2008, MULTIMEDIA CONTENT A, V6820, P2
[3]   Unsupervised video-shot segmentation and model-free, anchorperson detection for news video story parsing [J].
Gao, XB ;
Tang, X .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2002, 12 (09) :765-776
[4]   Joint scene classification and segmentation based on hidden Markov model [J].
Huang, JC ;
Liu, Z ;
Wang, Y .
IEEE TRANSACTIONS ON MULTIMEDIA, 2005, 7 (03) :538-550
[5]  
Li Y, 2004, 2004 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, VOL V, PROCEEDINGS, P897
[6]   Video summarization and scene detection by graph modeling [J].
Ngo, CW ;
Ma, YF ;
Zhang, HJ .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2005, 15 (02) :296-305
[7]   Detection and representation of scenes in videos [J].
Rasheed, Z ;
Shah, M .
IEEE TRANSACTIONS ON MULTIMEDIA, 2005, 7 (06) :1097-1105
[8]   Video scene detection using graph-based representations [J].
Sakarya, Ufuk ;
Telatar, Ziya .
SIGNAL PROCESSING-IMAGE COMMUNICATION, 2010, 25 (10) :774-783
[9]   Segmentation of video by clustering and graph analysis [J].
Yeung, M ;
Yeo, BL ;
Liu, B .
COMPUTER VISION AND IMAGE UNDERSTANDING, 1998, 71 (01) :94-109
[10]   Video scene segmentation using Markov chain Monte Carlo [J].
Zhai, Yun ;
Shah, Mubarak .
IEEE TRANSACTIONS ON MULTIMEDIA, 2006, 8 (04) :686-697