Optimized deep learning enabled lecture audio video summarization

被引:0
|
作者
Kaur, Preet Chandan [1 ]
Ragha, Leena [1 ,2 ]
机构
[1] DY PATIL Deemed Univ, Ramrao Adik Inst Technol, Comp Engn Fac, Navi Mumbai 400706, Maharashtra, India
[2] BLDEAs VP Dr PGH Coll Engn & Technol, Dept Comp Sci & Engn, Ashram Rd, Vijayapur 586103, Karnataka, India
关键词
Audio Video Summarization; Deep Residual Network; Video Shot Segmentation; E; -learning; YCbCr Space Colour Model;
D O I
10.1016/j.jvcir.2024.104309
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Video summarization plays an important role in multiple applications by compressing lengthy video content into compressed representation. The purpose is to present a fine-tuned deep model for lecture audio video summarization. Initially, the input lecture audio-visual video is taken from the dataset. Then, the video shot segmentation (slide segmentation) is done using the YCbCr space colour model. From each video shot, the audio and video within the video shot are segmented using the Honey Badger-based Bald Eagle Algorithm (HBBEA). The HBBEA is obtained by combining the Bald Eagle Search (BES) and Honey Badger Algorithm (HBA). The DRN training is executed by HBBEA to select the finest DRN weights. The relevant video frames are merged with the audio. The proposed HBBEA-based DRN outperformed with a better F1-Score of 91.9 %, Negative predictive value (NPV) of 89.6 %, Positive predictive value (PPV) of 90.7 %, Accuracy of 91.8 %, precision of 91 %, and recall of 92.8 %.
引用
收藏
页数:15
相关论文
共 50 条
  • [21] Deep Learning for Activity Recognition Using Audio and Video
    Reinolds, Francisco
    Neto, Cristiana
    Machado, Jose
    ELECTRONICS, 2022, 11 (05)
  • [22] AENet: Learning Deep Audio Features for Video Analysis
    Takahashi, Naoya
    Gygli, Michael
    Van Gool, Luc
    IEEE TRANSACTIONS ON MULTIMEDIA, 2018, 20 (03) : 513 - 524
  • [23] Visual Aids to Learning in a Second Language: Adding Redundant Video to an Audio Lecture
    Lee, Hyunjeong
    Mayer, Richard E.
    APPLIED COGNITIVE PSYCHOLOGY, 2015, 29 (03) : 445 - 454
  • [24] Automatic Video Summarization from Cricket Videos Using Deep Learning
    Emon, Solayman Hossain
    Annur, A. H. M.
    Xian, Abir Hossain
    Sultana, Kazi Mahia
    Shahriar, Shoeb Mohammad
    2020 23RD INTERNATIONAL CONFERENCE ON COMPUTER AND INFORMATION TECHNOLOGY (ICCIT 2020), 2020,
  • [25] Abstractive video lecture summarization: applications and future prospects
    Irene Benedetto
    Moreno La Quatra
    Luca Cagliero
    Lorenzo Canale
    Laura Farinetti
    Education and Information Technologies, 2024, 29 : 2951 - 2971
  • [26] Video summarization using deep learning techniques: a detailed analysis and investigation
    Saini, Parul
    Kumar, Krishan
    Kashid, Shamal
    Saini, Ashray
    Negi, Alok
    ARTIFICIAL INTELLIGENCE REVIEW, 2023, 56 (11) : 12347 - 12385
  • [27] Image Caption Generation using Deep Learning For Video Summarization Applications
    Inayathulla, Mohammed
    Karthikeyan, C.
    INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2024, 15 (01) : 565 - 572
  • [28] Egocentric Video Summarization Based on People Interaction Using Deep Learning
    Ghafoor, Humaira A.
    Javed, Ali
    Irtaza, Aun
    Dawood, Hassan
    Dawood, Hussain
    Banjar, Ameen
    MATHEMATICAL PROBLEMS IN ENGINEERING, 2018, 2018
  • [29] Video summarization using deep learning techniques: a detailed analysis and investigation
    Parul Saini
    Krishan Kumar
    Shamal Kashid
    Ashray Saini
    Alok Negi
    Artificial Intelligence Review, 2023, 56 : 12347 - 12385
  • [30] Abstractive video lecture summarization: applications and future prospects
    Benedetto, Irene
    La Quatra, Moreno
    Cagliero, Luca
    Canale, Lorenzo
    Farinetti, Laura
    EDUCATION AND INFORMATION TECHNOLOGIES, 2024, 29 (03) : 2951 - 2971