VIDEO SUMMARIZATION VIA TEMPORAL COLLABORATIVE REPRESENTATION OF ADJACENT FRAMES

被引:0
|
作者
Ma, Mingyang [1 ]
Mei, Shaohui [1 ]
Hou, Junhui [2 ]
Wan, Shuai [1 ]
Wang, Zhiyong [3 ]
机构
[1] Northwestern Polytech Univ, Sch Elect & Informat, Xian 710129, Shaanxi, Peoples R China
[2] City Univ Hong Kong, Dept Comp Sci, Hong Kong, Hong Kong, Peoples R China
[3] Univ Sydney, Sch Informat Technol, Sydney, NSW 2006, Australia
基金
中国国家自然科学基金;
关键词
video summarization; temporal collaborative representation; keyframe;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The ever increasing volume of video content demands to develop efficient and effective video summarization (VS) techniques to manage the video data. Recent developments on sparse representation have demonstrated prospective results for VS. In this paper, in consideration of visual similarity of adjacent frames, we formulates the video summarization problem with a temporal collaborative representation (TCR) model, in which the adjacent frames instead of an individual frame arc taken into consideration to avoid selecting transitional frames. In addition, a greedy iterative algorithm is designed for model optimization. Experimental results on a benchmark dataset with various types of videos demonstrate that the proposed algorithms can not only outperform the state of the art, but also reduce the probability of selecting transitional frames.
引用
收藏
页码:164 / 169
页数:6
相关论文
共 50 条
  • [31] A GAN based Video Summarization Method with Representation Loss
    Lei, Zhuo
    Yu, Qiang
    Shou, Lidan
    Li, Shengquan
    Mao, Yunqing
    PROCEEDINGS OF THE 4TH ANNUAL ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA RETRIEVAL, ICMR 2024, 2024, : 1155 - 1159
  • [32] An Unsupervised Video Summarization Method Based on Multimodal Representation
    Lei, Zhuo
    Yu, Qiang
    Shou, Lidan
    Li, Shengquan
    Mao, Yunqing
    ADVANCED INTELLIGENT COMPUTING TECHNOLOGY AND APPLICATIONS, ICIC 2023, PT V, 2023, 14090 : 171 - 180
  • [33] Patch Based Video Summarization With Block Sparse Representation
    Mei, Shaohui
    Ma, Mingyang
    Wan, Shuai
    Hou, Junhui
    Wang, Zhiyong
    Feng, David Dagan
    IEEE TRANSACTIONS ON MULTIMEDIA, 2021, 23 : 732 - 747
  • [34] SELECTING ATTENTIVE FRAMES FROM VISUALLY COHERENT VIDEO CHUNKS FOR SURVEILLANCE VIDEO SUMMARIZATION
    Wang, Wenzhong
    Zhang, Qiaoqiao
    Luo, Bin
    Tang, Jin
    Ruan, Rui
    Li, Chenglong
    2017 24TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2017, : 2408 - 2412
  • [35] Comparative Opinion Summarization via Collaborative Decoding
    Iso, Hayate
    Wang, Xiaolan
    Angelidis, Stefanos
    Suhara, Yoshihiko
    FINDINGS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2022), 2022, : 3307 - 3324
  • [36] Video-Text Representation Learning via DifferentiableWeak Temporal Alignment
    Ko, Dohwan
    Choi, Joonmyung
    Ko, Juyeon
    Noh, Shinyeong
    On, Kyoung-Woon
    Kim, Eun-Sol
    Kim, Hyunwoo J.
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 5006 - 5015
  • [37] Key Frames Extraction Based on Local Features for Efficient Video Summarization
    Gharbi, Hana
    Massaoudi, Mohamed
    Bahroun, Sahbi
    Zagrouba, Ezzeddine
    ADVANCED CONCEPTS FOR INTELLIGENT VISION SYSTEMS, ACIVS 2016, 2016, 10016 : 275 - 285
  • [38] A Novel Key-Frames Selection Framework for Comprehensive Video Summarization
    Huang, Cheng
    Wang, Hongmei
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2020, 30 (02) : 577 - 589
  • [39] Video summarization by spatial-temporal graph optimization
    Lu, S
    Lyu, MR
    King, I
    2004 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS, VOL 2, PROCEEDINGS, 2004, : 197 - 200
  • [40] Video summarization with temporal-channel visual transformer
    Tian, Xiaoyan
    Jin, Ye
    Zhang, Zhao
    Liu, Peng
    Tang, Xianglong
    PATTERN RECOGNITION, 2025, 165