Spatiotemporal saliency detection and salient region determination for H.264 videos

被引：8
|
作者：
Hu, Kang-Ting [1 ]
Leou, Jin-Jang [1 ]
Hsiao, Han-Hui [1 ]
机构：
[1] Natl Chung Cheng Univ, Dept Comp Sci & Informat Engn, Chiayi 621, Taiwan
来源：
JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION | 2013年 / 24卷 / 07期
关键词：
Spatial saliency; Temporal saliency; Phase spectrum of Fourier transform; Spatiotemporal saliency detection; Salient region determination; Gaussian filtering; Adaptive fusion; H.264; video; VISUAL-ATTENTION; MODEL; FRAMEWORK; COLOR; IMAGE;
D O I：
10.1016/j.jvcir.2013.05.001
中图分类号：
TP [自动化技术、计算机技术];
学科分类号：
0812 ;
摘要：
In this study, a spatiotemporal saliency detection and salient region determination approach for H.264 videos is proposed. After Gaussian filtering in Lab color space, the phase spectrum of Fourier transform is used to generate the spatial saliency map of each video frame. On the other hand, the motion vector fields from each H.264 compressed video bitstream are backward accumulated. After normalization and global motion compensation, the phase spectrum of Fourier transform for the moving parts is used to generate the temporal saliency map of each video frame. Then, the spatial and temporal saliency maps of each video frame are combined to obtain its spatiotemporal saliency map using adaptive fusion. Finally, a modified salient region determination scheme is used to determine salient regions (SRs) of each video frame. Based on the experimental results obtained in this study, the performance of the proposed approach is better than those of two comparison approaches. (C) 2013 Elsevier Inc. All rights reserved.
引用
收藏
页码：760 / 772
页数：13
相关论文
共 37 条
  • [21] No-Reference Video quality assessment of H.264 video streams based on semantic saliency maps
    Boujut, H.
    Benois-Pineau, J.
    Ahmed, T.
    Hadar, O.
    Bonnet, P.
    IMAGE QUALITY AND SYSTEM PERFORMANCE IX, 2012, 8293
  • [22] Complexity Reduction Algorithm for Region-of-Interest based H.264 Encoding
    Zhang, Tianruo
    Wang, Minghui
    Liu, Chen
    Goto, Satoshi
    PROCEEDINGS OF THE 2010 IEEE ASIA PACIFIC CONFERENCE ON CIRCUIT AND SYSTEM (APCCAS), 2010, : 336 - 339
  • [23] Improved error concealment of region of interest based on the H.264/AVC standard
    Luo, Zhengyi
    Song, Li
    Zheng, Shibao
    Xu, Yi
    Yang, Xiaokang
    OPTICAL ENGINEERING, 2010, 49 (04)
  • [24] Classified Region Algorithm for Fast Intermode Decision in H.264/AVC Encoder
    Bharanitharan, K.
    Liu, Bin-Da
    Yang, Jar-Ferr
    EURASIP JOURNAL ON ADVANCES IN SIGNAL PROCESSING, 2010,
  • [25] A Steganalytic Algorithm to Detect DCT-based Data Hiding Methods for H.264/AVC Videos
    Wang, Peipei
    Cao, Yun
    Zhao, Xianfeng
    Zhu, Meineng
    IH&MMSEC'17: PROCEEDINGS OF THE 2017 ACM WORKSHOP ON INFORMATION HIDING AND MULTIMEDIA SECURITY, 2017, : 123 - 133
  • [26] Bit-Stream-Based Scrambling for Regions of Interest in H.264/AVC Videos With Drift Reduction
    Unterweger, Andreas
    De Cock, Jan
    Uhl, Andreas
    2016 SIXTH INTERNATIONAL CONFERENCE ON IMAGE PROCESSING THEORY, TOOLS AND APPLICATIONS (IPTA), 2016,
  • [27] Gradient-based edge detection for motion estimation in H.264/AVC
    Paul, A.
    Wu, J.
    Yang, J. -F.
    Jeong, J.
    IET IMAGE PROCESSING, 2011, 5 (04) : 323 - 327
  • [28] A Novel Scene Cut Detection Method in H.264/AVC Compression Domain
    Gao Yu
    Zhuo Li
    Wang Suyu
    Shen Lansun
    CHINESE JOURNAL OF ELECTRONICS, 2009, 18 (04): : 695 - 699
  • [29] Perceptual quality estimation of H.264/AVC videos using reduced-reference and no-reference models
    Shahid, Muhammad
    Pandremmenou, Katerina
    Kondi, Lisimachos P.
    Rossholm, Andreas
    Lovstrom, Benny
    JOURNAL OF ELECTRONIC IMAGING, 2016, 25 (05)
  • [30] Video watermark detection in DCT domain for H.264/AVC through a hierarchical prior
    Mairgiotis, Antonis
    Ventzas, Dimitrios
    2015 23RD TELECOMMUNICATIONS FORUM TELFOR (TELFOR), 2015, : 807 - 810
1234