An Optimized Deep Learning Method for Video Summarization Based on the User of Interest

被引:0
|
作者
Ul Haq, Hafiz Burhan [1 ]
Suwansantisuk, Watcharapan [1 ]
Chamnongthai, Kosin [1 ]
机构
[1] King Mongkuts Univ Technol Thonburi KMUTT, Fac Engn, Dept Elect & Telecommun Engn, Bangkok 10140, Thailand
关键词
Video summarization; deep learning; user object of interest; surveillance systems; SumMe;
D O I
10.14569/IJACSA.2023.0141027
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
video is now able to play a vital role in maintaining security and protection thanks to the advancement of digital video technology. Businesses, both private and public, employ surveillance systems to monitor and track their daily operations. As a result, video generates a significant volume of data that needs to be further processed to satisfy security protocol requirements. Analyzing video requires a lot of effort and time, as well as quick equipment. The concept of a video summary was developed in order to overcome these limitations. To work past these limitations, the concept of video summarization has emerged. In this study, a deep learning-based method for customized video summarization is presented. This research enables users to produce a video summary in accordance with the User Object of Interest (UOoI), such as a car, airplane, person, bicycle, automobile, etc. Several experiments have been conducted on the two datasets, SumMe and self-created, to assess the efficiency of the proposed method. On SumMe and the self-created dataset, the overall accuracy is 98.7% and 97.5%, respectively, with a summarization rate of 93.5% and 67.3%. Furthermore, a comparison study is done to demonstrate that our proposed method is superior to other existing methods in terms of video summarization accuracy and robustness. Additionally, a graphic user interface is created to assist the user with summarizing the video using the UOoI.
引用
收藏
页码:244 / 256
页数:13
相关论文
共 50 条
  • [31] A HEVC video coding method based on deep learning
    He, Jie
    Guo, Hui
    Xu, Caixu
    BASIC & CLINICAL PHARMACOLOGY & TOXICOLOGY, 2019, 125 : 162 - 162
  • [32] A Deep Metric Learning Based Video Classification Method
    Zhi Hongxin
    Yu Hongtao
    Li Shaomei
    Gao Chao
    Wang Yanchuan
    JOURNAL OF ELECTRONICS & INFORMATION TECHNOLOGY, 2018, 40 (11) : 2562 - 2569
  • [33] Editorial to the Special Section on Optimized Image/Video Coding Based on Deep Learning
    Chen, Zhibo
    Herglotz, Christian
    Cagnazzo, Marco
    IEEE OPEN JOURNAL OF CIRCUITS AND SYSTEMS, 2021, 2 : 611 - 612
  • [34] Optimized Text Summarization method based on Fuzzy Logic
    Premakumara, Nilantha
    Shiranthika, Chamani
    Shyalika, Chathurangi
    Bandara, Surangani
    2022 2ND INTERNATIONAL CONFERENCE ON IMAGE PROCESSING AND ROBOTICS (ICIPROB), 2022,
  • [35] Automatic Video Summarization from Cricket Videos Using Deep Learning
    Emon, Solayman Hossain
    Annur, A. H. M.
    Xian, Abir Hossain
    Sultana, Kazi Mahia
    Shahriar, Shoeb Mohammad
    2020 23RD INTERNATIONAL CONFERENCE ON COMPUTER AND INFORMATION TECHNOLOGY (ICCIT 2020), 2020,
  • [36] Deep Gesture Video Generation With Learning on Regions of Interest
    Cui, Runpeng
    Cao, Zhong
    Pan, Weishen
    Zhang, Changshui
    Wang, Jianqiang
    IEEE TRANSACTIONS ON MULTIMEDIA, 2020, 22 (10) : 2551 - 2563
  • [37] Video summarization using deep learning techniques: a detailed analysis and investigation
    Saini, Parul
    Kumar, Krishan
    Kashid, Shamal
    Saini, Ashray
    Negi, Alok
    ARTIFICIAL INTELLIGENCE REVIEW, 2023, 56 (11) : 12347 - 12385
  • [38] Image Caption Generation using Deep Learning For Video Summarization Applications
    Inayathulla, Mohammed
    Karthikeyan, C.
    INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2024, 15 (01) : 565 - 572
  • [39] Video summarization using deep learning techniques: a detailed analysis and investigation
    Parul Saini
    Krishan Kumar
    Shamal Kashid
    Ashray Saini
    Alok Negi
    Artificial Intelligence Review, 2023, 56 : 12347 - 12385
  • [40] Summarization of User-Generated Sports Video by Using Deep Action Recognition Features
    Tejero-de-Pablos, Antonio
    Nakashima, Yuta
    Sato, Tomokazu
    Yokoya, Naokazu
    Linna, Marko
    Rahtu, Esa
    IEEE TRANSACTIONS ON MULTIMEDIA, 2018, 20 (08) : 2000 - 2011