Best Frame Selection in a Short Video

被引:0
作者
Ren, Jian [1 ,4 ]
Shen, Xiaohui [2 ,4 ]
Lin, Zhe [3 ]
Mech, Radomir [3 ]
机构
[1] Snap Inc, Santa Monica, CA 90405 USA
[2] ByteDance AI Lab, Beijing, Peoples R China
[3] Adobe Res, San Jose, CA USA
[4] Adobe, San Jose, CA USA
来源
2020 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV) | 2020年
关键词
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
People usually take short videos to record meaningful moments in their lives. However, selecting the most representative frame, which not only has high image visual quality but also captures video content, from a short video to share or keep is a time-consuming process for one may need to manually go through all the frames in a video to make a decision. In this paper, we introduce the problem of the best frame selection in a short video and aim to solve it automatically. Towards this end, we collect and will release a diverse large-scale short video dataset that includes 11, 000 videos shoot in our daily life. All videos are assumed to be short (e.g., a few seconds) and each video has human-annotated of the best frame. Then we introduce a deep convolutional neural network (CNN) based approach with ranking objective to automatically pick the best frame from frame sequences extracted via short videos. Additionally, we propose new evaluation metrics, especially for the best frame selection. In experiments, we show our approach outperforms various other methods significantly.
引用
收藏
页码:3201 / 3210
页数:10
相关论文
共 50 条
  • [21] Frame selection for dynamic caching adjustment in video proxy servers
    Ma, WH
    Du, DHC
    MULTIMEDIA TOOLS AND APPLICATIONS, 2004, 22 (01) : 53 - 73
  • [22] Frame selection for OCR from video stream of book flipping
    Dibyayan Chakraborty
    Partha Pratim Roy
    Rajkumar Saini
    Jose M. Alvarez
    Umapada Pal
    Multimedia Tools and Applications, 2018, 77 : 985 - 1008
  • [23] An Empirical Study of Frame Selection for Text-to-Video Retrieval
    Wu, Mengxia
    Cao, Min
    Bai, Yang
    Zeng, Ziyin
    Chen, Chen
    Nie, Liqiang
    Zhang, Min
    FINDINGS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS - EMNLP 2023, 2023, : 6821 - 6832
  • [24] Frame selection for OCR from video stream of book flipping
    Chakraborty, Dibyayan
    Roy, Partha Pratim
    Saini, Rajkumar
    Alvarez, Jose M.
    Pal, Umapada
    MULTIMEDIA TOOLS AND APPLICATIONS, 2018, 77 (01) : 985 - 1008
  • [25] Adaptive reference frame selection for generalized video signal coding
    McVeigh, JS
    Siegel, MW
    Jordan, AG
    DIGITAL VIDEO COMPRESSION: ALGORITHMS AND TECHNOLOGIES 1996, 1996, 2668 : 441 - 449
  • [26] Quality based Frame Selection for Face Clustering in News Video
    Anantharajah, Kaneswaran
    Denman, Simon
    Tjondronegoro, Dian
    Sridharan, Sridha
    Fookes, Clinton
    Guo, Xufeng
    2013 INTERNATIONAL CONFERENCE ON DIGITAL IMAGE COMPUTING: TECHNIQUES & APPLICATIONS (DICTA), 2013, : 396 - 403
  • [27] A Video Coding Scheme with Adaptive Intra-frame Selection
    Guo, Tianhao
    Guo, Dabo
    2013 INTERNATIONAL CONFERENCE ON COMPUTER SCIENCES AND APPLICATIONS (CSA), 2013, : 595 - 599
  • [28] Systematic frame selection and quality assessment for efficient video summarization
    Payal Kadam
    Deepali Vora
    Multimedia Systems, 2025, 31 (4)
  • [29] Algorithm for choosing the best frame in a video stream in the task of identity document recognition
    Aliev, M. A.
    Kunina, I. A.
    Kazbekov, A., V
    Arlazarov, V. L.
    COMPUTER OPTICS, 2021, 45 (01) : 101 - 109
  • [30] The Best Strategies to Monetize Your Short-Form Video
    Martin, Erik J.
    ECONTENT, 2015, 38 (09) : 8 - 10