Cover the Violence: A Novel Deep-Learning-Based Approach Towards Violence-Detection in Movies

被引:70
作者
Khan, Samee Ullah [1 ]
Ul Haq, Ijaz [1 ]
Rho, Seungmin [2 ]
Baik, Sung Wook [1 ]
Lee, Mi Young [1 ]
机构
[1] Sejong Univ, Digital Contents Res Inst, Intelligent Media Lab, Seoul 143747, South Korea
[2] Sejong Univ, Dept Software, Seoul 143747, South Korea
来源
APPLIED SCIENCES-BASEL | 2019年 / 9卷 / 22期
基金
新加坡国家研究基金会;
关键词
violence-detection; deep learning; video analytics; scene understanding; CONVOLUTIONAL NEURAL-NETWORKS; AUDIO;
D O I
10.3390/app9224963
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
Movies have become one of the major sources of entertainment in the current era, which are based on diverse ideas. Action movies have received the most attention in last few years, which contain violent scenes, because it is one of the undesirable features for some individuals that is used to create charm and fantasy. However, these violent scenes have had a negative impact on kids, and they are not comfortable even for mature age people. The best way to stop under aged people from watching violent scenes in movies is to eliminate these scenes. In this paper, we proposed a violence detection scheme for movies that is comprised of three steps. First, the entire movie is segmented into shots, and then a representative frame from each shot is selected based on the level of saliency. Next, these selected frames are passed from a light-weight deep learning model, which is fine-tuned using a transfer learning approach to classify violence and non-violence shots in a movie. Finally, all the non-violence scenes are merged in a sequence to generate a violence-free movie that can be watched by children and as well violence paranoid people. The proposed model is evaluated on three violence benchmark datasets, and it is experimentally proved that the proposed scheme provides a fast and accurate detection of violent scenes in movies compared to the state-of-the-art methods.
引用
收藏
页数:11
相关论文
共 36 条
[21]   Anomaly Detection in Crowded Scenes [J].
Mahadevan, Vijay ;
Li, Weixin ;
Bhalodia, Viral ;
Vasconcelos, Nuno .
2010 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2010, :1975-1981
[22]   Violent Scene Detection Using Convolutional Neural Networks and Deep Audio Features [J].
Mu, Guankun ;
Cao, Haibing ;
Jin, Qin .
PATTERN RECOGNITION (CCPR 2016), PT II, 2016, 663 :451-463
[23]   Efficient CNN based summarization of surveillance videos for resource-constrained devices [J].
Muhammad, Khan ;
Hussain, Tanveer ;
Baik, Sung Wook .
PATTERN RECOGNITION LETTERS, 2020, 130 (130) :370-375
[24]  
Nayak L., 2015, THESIS
[25]  
Nguyen NT, 2005, PROC CVPR IEEE, P955
[26]   Parental Desensitization to Gun Violence in PG-13 Movies [J].
Romer, Daniel ;
Jamieson, Patrick E. ;
Jamieson, Kathleen Hall ;
Lull, Robert ;
Adebimpe, Azeez .
PEDIATRICS, 2018, 141 (06)
[27]   Fast Fight Detection [J].
Serrano Gracia, Ismael ;
Deniz Suarez, Oscar ;
Bueno Garcia, Gloria ;
Kim, Tae-Kyun .
PLOS ONE, 2015, 10 (04)
[28]  
Shafaei M., 2019, ARXIV190807819
[29]   A Novel Violent Video Detection Scheme Based on Modified 3D Convolutional Neural Networks [J].
Song, Wei ;
Zhang, Dongliang ;
Zha, Xiaobing ;
Yu, Jing ;
Zheng, Rui ;
Wang, Antai .
IEEE ACCESS, 2019, 7 :39172-39179
[30]  
Tavakoli HR, 2011, LECT NOTES COMPUT SC, V6688, P666, DOI 10.1007/978-3-642-21227-7_62