VIDEO RETARGETING WITH NONLINEAR SPATIAL-TEMPORAL SALIENCY FUSION

被引：14

作者：

Lu, Taoran ^{[1
]}

Yuan, Zheng ^{[1
]}

Huang, Yu ^{[2
]}

Wu, Dapeng ^{[1
]}

Yu, Heather ^{[2
]}

机构：

[1] Univ Florida, Dept ECE, Gainesville, FL 32611 USA

[2] Huawei Technologies Co Ltd, Santa Clara, CA 95054 USA

来源：

2010 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING | 2010年

关键词：

Video retargeting; saliency; nonlinear; QPFT; KLT;

D O I：

10.1109/ICIP.2010.5651644

中图分类号：

TM [电工技术]; TN [电子技术、通信技术];

学科分类号：

0808 ; 0809 ;

摘要：

Video retargeting (resolution adaptation) is a challenging problem for its highly subjective nature. In this paper, a nonlinear saliency fusing approach, that considers human perceptual characteristics for automatic video retargeting, is being proposed. First, we incorporate features from phase spectrum of quaternion Fourier Transform (PQFT) in spatial domain and global motion residual based on matched feature points by the Kanade-Lucas-Tomasi (KLT) tracker in temporal domain. In addition, under a cropping-and-scaling retargeting framework, we propose content-aware information loss metrics and a hierarchical search to find optimal cropping window parameters. Results show the success of our approach on detecting saliency regions and retargeting on images and videos.

引用

页码：1801 / 1804

页数：4