Cover the Violence: A Novel Deep-Learning-Based Approach Towards Violence-Detection in Movies

被引:70
作者
Khan, Samee Ullah [1 ]
Ul Haq, Ijaz [1 ]
Rho, Seungmin [2 ]
Baik, Sung Wook [1 ]
Lee, Mi Young [1 ]
机构
[1] Sejong Univ, Digital Contents Res Inst, Intelligent Media Lab, Seoul 143747, South Korea
[2] Sejong Univ, Dept Software, Seoul 143747, South Korea
来源
APPLIED SCIENCES-BASEL | 2019年 / 9卷 / 22期
基金
新加坡国家研究基金会;
关键词
violence-detection; deep learning; video analytics; scene understanding; CONVOLUTIONAL NEURAL-NETWORKS; AUDIO;
D O I
10.3390/app9224963
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
Movies have become one of the major sources of entertainment in the current era, which are based on diverse ideas. Action movies have received the most attention in last few years, which contain violent scenes, because it is one of the undesirable features for some individuals that is used to create charm and fantasy. However, these violent scenes have had a negative impact on kids, and they are not comfortable even for mature age people. The best way to stop under aged people from watching violent scenes in movies is to eliminate these scenes. In this paper, we proposed a violence detection scheme for movies that is comprised of three steps. First, the entire movie is segmented into shots, and then a representative frame from each shot is selected based on the level of saliency. Next, these selected frames are passed from a light-weight deep learning model, which is fine-tuned using a transfer learning approach to classify violence and non-violence shots in a movie. Finally, all the non-violence scenes are merged in a sequence to generate a violence-free movie that can be watched by children and as well violence paranoid people. The proposed model is evaluated on three violence benchmark datasets, and it is experimentally proved that the proposed scheme provides a fast and accurate detection of violent scenes in movies compared to the state-of-the-art methods.
引用
收藏
页数:11
相关论文
共 36 条
[1]  
[Anonymous], 2005, PHILLIPINE COMPUT SC
[2]  
[Anonymous], 2019, J ARTIF INTELL SYST
[3]   Spatio-temporal feature using optical flow based distribution for violence detection [J].
Ben Mabrouk, Amira ;
Zagrouba, Ezzeddine .
PATTERN RECOGNITION LETTERS, 2017, 92 :62-67
[4]   On the Influence of Shot Scale on Film Mood and Narrative Engagement in Film Viewers [J].
Benini, Sergio ;
Savardi, Mattia ;
Balint, Katalin ;
Kovacs, Andras Balint ;
Signoroni, Alberto .
IEEE TRANSACTIONS ON AFFECTIVE COMPUTING, 2022, 13 (02) :592-603
[5]  
Nievas EB, 2011, LECT NOTES COMPUT SC, V6855, P332, DOI 10.1007/978-3-642-23678-5_39
[6]  
Bilinski P, 2016, 2016 13TH IEEE INTERNATIONAL CONFERENCE ON ADVANCED VIDEO AND SIGNAL BASED SURVEILLANCE (AVSS), P30, DOI 10.1109/AVSS.2016.7738019
[7]  
Chen L, 2011, OPER THEORY ADV APPL, V211, P119, DOI 10.1007/978-3-0348-0024-2_3
[8]   VSD, a public dataset for the detection of violent scenes in movies: design, annotation, analysis and evaluation [J].
Demarty, Claire-Helene ;
Penet, Cedric ;
Soleymani, Mohammad ;
Gravier, Guillaume .
MULTIMEDIA TOOLS AND APPLICATIONS, 2015, 74 (17) :7379-7404
[9]  
Elliott C., 2019, J CULT EC
[10]   PG-13 Rated Movie Violence and Societal Violence: is there a Link? [J].
Ferguson, Christopher J. ;
Markey, Patrick .
PSYCHIATRIC QUARTERLY, 2019, 90 (02) :395-403