Stereoscopic Thumbnail Creation via Efficient Stereo Saliency Detection

被引:135
作者
Wang, Wenguan [1 ]
Shen, Jianbing [1 ]
Yu, Yizhou [2 ]
Ma, Kwan-Liu [3 ]
机构
[1] Beijing Inst Technol, Sch Comp Sci, Beijing Lab Intelligent Informat Technol, Beijing 100081, Peoples R China
[2] Zhejiang Univ, Coll Comp Sci & Technol, Hangzhou 310027, Zhejiang, Peoples R China
[3] Univ Calif Davis, Dept Comp Sci, Davis, CA 95616 USA
基金
中国国家自然科学基金;
关键词
Stereoscopic thumbnails; stereo saliency; image cropping; VISUAL-ATTENTION; OBJECT DETECTION; OPTIMIZATION; MODEL;
D O I
10.1109/TVCG.2016.2600594
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
In this paper, we propose a framework for automatically producing thumbnails from stereo image pairs. It has two components focusing respectively on stereo saliency detection and stereo thumbnail generation. The first component analyzes stereo saliency through various saliency stimuli, stereoscopic perception and the relevance between two stereo views. The second component uses stereo saliency to guide stereo thumbnail generation. We develop two types of thumbnail generation methods, both changing image size automatically. The first method is called content-persistent cropping (CPC), which aims at cropping stereo images for display devices with different aspect ratios while preserving as much content as possible. The second method is an object-aware cropping method (OAC) for generating the smallest possible thumbnail pair that retains the most important content only and facilitates quick visual exploration of a stereo image database. Quantitative and qualitative experimental evaluations demonstrate promising performance of our thumbnail generation methods in comparison to state-of-the-art algorithms.
引用
收藏
页码:2014 / 2027
页数:14
相关论文
共 51 条
[1]   SLIC Superpixels Compared to State-of-the-Art Superpixel Methods [J].
Achanta, Radhakrishna ;
Shaji, Appu ;
Smith, Kevin ;
Lucchi, Aurelien ;
Fua, Pascal ;
Suesstrunk, Sabine .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2012, 34 (11) :2274-2281
[2]  
Achanta R, 2009, PROC CVPR IEEE, P1597, DOI 10.1109/CVPRW.2009.5206596
[3]   Measuring the Objectness of Image Windows [J].
Alexe, Bogdan ;
Deselaers, Thomas ;
Ferrari, Vittorio .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2012, 34 (11) :2189-2202
[4]  
[Anonymous], 2007, Computer Vision and Pattern Recognition (CVPR), IEEE Conference on
[5]  
[Anonymous], 2015, COMPUT VIS MEDIA
[6]   Seam carving for content-aware image resizing [J].
Avidan, Shai ;
Shamir, Ariel .
ACM TRANSACTIONS ON GRAPHICS, 2007, 26 (03)
[7]  
Basha T, 2011, IEEE I CONF COMP VIS, P1816, DOI 10.1109/ICCV.2011.6126448
[8]  
Borji A, 2012, PROC CVPR IEEE, P470, DOI 10.1109/CVPR.2012.6247710
[9]   Content-Aware Display Adaptation and Interactive Editing for Stereoscopic Images [J].
Chang, Che-Han ;
Liang, Chia-Kai ;
Chuang, Yung-Yu .
IEEE TRANSACTIONS ON MULTIMEDIA, 2011, 13 (04) :589-601
[10]   A visual attention model for adapting images on small displays [J].
Chen, LQ ;
Xie, X ;
Fan, X ;
Ma, WY ;
Zhang, HJ ;
Zhou, HQ .
MULTIMEDIA SYSTEMS, 2003, 9 (04) :353-364