Text query based summarized event searching interface system using deep learning over cloud

被引:40
作者
Kumar, Krishan [1 ]
机构
[1] Natl Inst Technol, Dept Comp Sci & Engn, Srinagar, Uttarakhand, India
关键词
Deep learning; DNA sequence; Searching; Event summarization; Local alignment; Text query; Video; VIDEO;
D O I
10.1007/s11042-020-10157-4
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In the digital era, the growth of multimedia data is increasing at a rapid pace, which demands both effective and efficient summarization techniques. Such advanced techniques are required so that the users can quickly access the video content, recorded by multiple cameras for a certain period. At present, it is very challenging to manage and search a huge amount of multiview video data, which contains the inter-views dependencies, significant illumination changes, and many low-active frames. This work highlights an efficient summarization technique to summarize and then search the events in such multi-view videos over cloud through text query. Deep learning framework is employed to extract the features of moving objects in the frames. The inter-views dependencies among multiple views of the video are captured via local alignment. Parallel Virtual Machines (VMs) in the Cloud environment have been used to process the multiple video clip independently at a time. Object tracking is applied to filter the low-active frames. Experimental Results indicate that the model successfully reduces the video content, while preserving the momentous information in the form of the events. A computing analysis also indicates that it meets the requirement of real-time applications.
引用
收藏
页码:11079 / 11094
页数:16
相关论文
共 35 条
  • [21] Bipartite Differential Neural Network for Unsupervised Image Change Detection
    Liu, Jia
    Gong, Maoguo
    Qin, A. K.
    Tan, Kay Chen
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2020, 31 (03) : 876 - 890
  • [22] Michael G, 1991, SEQUENCE ANAL PRIMER, P169
  • [23] On-Line Multi-View Video Summarization for Wireless Video Sensor Network
    Ou, Shun-Hsing
    Lee, Chia-Han
    Somayazulu, V. Srinivasa
    Chen, Yen-Kuang
    Chien, Shao-Yi
    [J]. IEEE JOURNAL OF SELECTED TOPICS IN SIGNAL PROCESSING, 2015, 9 (01) : 165 - 179
  • [24] Multi-View Surveillance Video Summarization via Joint Embedding and Sparse Optimization
    Panda, Rameswar
    Roy-Chowdhury, Amit K.
    [J]. IEEE TRANSACTIONS ON MULTIMEDIA, 2017, 19 (09) : 2010 - 2021
  • [25] Diversity-Aware Multi-Video Summarization
    Panda, Rameswar
    Mithun, Niluthpol Chowdhury
    Roy-Chowdhury, Amit K.
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2017, 26 (10) : 4712 - 4724
  • [26] Potapov D, 2014, LECT NOTES COMPUT SC, V8694, P540, DOI 10.1007/978-3-319-10599-4_35
  • [27] Rav-Acha A., 2006, P IEEE C COMP VIS PA, V1, P435
  • [28] ImageNet Large Scale Visual Recognition Challenge
    Russakovsky, Olga
    Deng, Jia
    Su, Hao
    Krause, Jonathan
    Satheesh, Sanjeev
    Ma, Sean
    Huang, Zhiheng
    Karpathy, Andrej
    Khosla, Aditya
    Bernstein, Michael
    Berg, Alexander C.
    Fei-Fei, Li
    [J]. INTERNATIONAL JOURNAL OF COMPUTER VISION, 2015, 115 (03) : 211 - 252
  • [29] A Supervised Learning Algorithm for Learning Precise Timing of Multiple Spikes in Multilayer Spiking Neural Networks
    Taherkhani, Aboozar
    Belatreche, Ammar
    Li, Yuhua
    Maguire, Liam P.
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2018, 29 (11) : 5394 - 5407
  • [30] A Unified Resource Allocation Framework for Defending Against Pollution Attacks in Wireless Network Coding Systems
    Tong, Wei
    Zhong, Sheng
    [J]. IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY, 2016, 11 (10) : 2255 - 2267