FASTER SEAM CARVING FOR VIDEO RETARGETING

被引:0
作者
Li, Chenyang [1 ]
Hu, Ruimin [1 ,2 ]
Liang, Chao [1 ,2 ]
Xiao, Chunxia [3 ]
Ruan, Weijian [1 ]
机构
[1] Wuhan Univ, Sch Comp Sci, Natl Engn Res Ctr Multimedia Software, Wuhan, Hubei, Peoples R China
[2] Collaborat Innovat Ctr Geospatial Technol, Wuhan, Hubei, Peoples R China
[3] Wuhan Univ, Sch Comp Sci, Wuhan, Hubei, Peoples R China
来源
2018 25TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP) | 2018年
基金
国家高技术研究发展计划(863计划);
关键词
video retargeting; spatio-temporal coherence; seam carving; computational complexity; FLOW;
D O I
暂无
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Video retargeting is to resize a video to a desired resolution or aspect ratio while preserving its salient content without visual distortion. The key to video retargeting is to reconcile spatio-temporal coherence of video frames, and most existing works use seam carving to achieve that by employing the dynamic programming to find optimal seams. However, these methods are too time-consuming due to high computational complexity of the dynamic programming. To this end, we propose a novel method which uses discontinuous and suboptimal seams for seam carving. Concretely, we obtain the discontinuous seams by allowing seams to move freely in homogeneous regions of the frame, which helps preserve the spatio-temporal coherence effectively. Then, the genetic algorithm is employed to find suboptimal seams, so as to reduce computational complexity. Finally, each frame can be retargeted to a new aspect ratio or size by repeatedly carving out seams. Compared to the-state-of-the-art methods, the proposed algorithm achieves comparable results at an average expense of only one third of their running time.
引用
收藏
页码:823 / 827
页数:5
相关论文
共 50 条
[31]   Improved seam carving combining with 3D saliency for image retargeting [J].
Chen, Yanxiang ;
Pan, Yifei ;
Song, Minglong ;
Wang, Meng .
NEUROCOMPUTING, 2015, 151 :645-653
[32]   Fast JND-Based Video Carving With GPU Acceleration for Real-Time Video Retargeting [J].
Chiang, Chen-Kuo ;
Wang, Shu-Fan ;
Chen, Yi-Ling ;
Lai, Shang-Hong .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2009, 19 (11) :1588-1597
[33]   AN EVALUATION CRITERION OF SALIENCY MODELS FOR VIDEO SEAM CARVING [J].
Decombas, Marc ;
Marighetto, Pierre ;
Mancas, Matei ;
Cassagne, Ioannis ;
Riche, Nicolas ;
Gosselin, Bernard. ;
Dutoit, Thierry ;
Laganiere, Robert .
2015 IEEE 17TH INTERNATIONAL WORKSHOP ON MULTIMEDIA SIGNAL PROCESSING (MMSP), 2015,
[34]   Genetic Seam Carving: A Genetic Algorithm Approach for Content-Aware Image Retargeting [J].
Oliveira, Saulo A. F. ;
Bezerra, Francisco N. ;
Rocha Neto, Ajalmar R. .
PATTERN RECOGNITION AND IMAGE ANALYSIS (IBPRIA 2015), 2015, 9117 :700-707
[35]   Multi-operator image retargeting with automatic integration of direct and indirect seam carving [J].
Luo, Siqiang ;
Zhang, Junping ;
Zhang, Qian ;
Yuan, Xiaoru .
IMAGE AND VISION COMPUTING, 2012, 30 (09) :655-667
[36]   Optimal bi-directional seam carving for compressibility-aware image retargeting [J].
Zhou, Bin ;
Wang, Xuanyin ;
Cao, Songxiao ;
Xiang, Ke ;
Zhao, Shuo .
JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2016, 41 :21-30
[37]   Continuous Seam Carving Algorithm Based on Just Noticeable Distortion Algorithm in Image Retargeting [J].
Cui Jia ;
Song Lei ;
Lu Hongju ;
Tang Mingxi ;
Qi Meng .
JOURNAL OF ELECTRONICS & INFORMATION TECHNOLOGY, 2021, 43 (04) :1014-1021
[38]   DESIRe: DISCONTINUOUS ENERGY SEAM CARVING FOR IMAGE RETARGETING VIA STRUCTURAL AND TEXTURAL ENERGY FUNCTIONALS [J].
Mishra, Akshaya ;
Scharfenberger, Christian ;
Siva, Parthipan ;
Li, Fan ;
Wong, Alexander ;
Clausi, David .
2015 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2015, :3695-3699
[39]   Seam carving modeling for semantic video coding in security applications [J].
Decombas, Marc ;
Fellah, Younous ;
Dufaux, Frederic ;
Pesquet-Popescu, Beatrice ;
Capman, Francois ;
Renan, Erwann .
APSIPA TRANSACTIONS ON SIGNAL AND INFORMATION PROCESSING, 2015, 4
[40]   DESIRe: DISCONTINUOUS ENERGY SEAM CARVING FOR IMAGE RETARGETING VIA STRUCTURAL AND TEXTURAL ENERGY FUNCTIONALS [J].
Mishra, Akshaya ;
Scharfenberger, Christian ;
Siva, Parthipan ;
Li, Fan ;
Wong, Alexander ;
Clausi, David .
2015 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2015, :3685-3689