Stereoscopic Visual Attention Guided Seam Carving for Stereoscopic Image Retargeting

被引:28
作者
Shao, Feng [1 ]
Lin, Wenchong [1 ]
Lin, Weisi [2 ]
Jiang, Gangyi [1 ]
Yu, Mei [1 ]
Fu, Randi [1 ]
机构
[1] Ningbo Univ, Fac Informat Sci & Engn, Ningbo 315211, Zhejiang, Peoples R China
[2] Nanyang Technol Univ, Sch Comp Engn, Ctr Multimedia & Network Technol, Singapore 639798, Singapore
来源
JOURNAL OF DISPLAY TECHNOLOGY | 2016年 / 12卷 / 01期
关键词
Binocular just-noticeable difference (BJND); image retargeting; seam carving; significant energy; stereoscopic visual attention (SVA); OBJECTIVE QUALITY ASSESSMENT; SALIENCY DETECTION; DISCOMFORT; MODEL;
D O I
10.1109/JDT.2015.2446973
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Stereoscopic image retargeting plays an important role in adaptive 3D stereoscopic displays. It aims to fit displays with various resolutions while preserving visually salient content and geometric consistency. We propose a stereoscopic image retargeting method based on stereoscopic visual attention guided seam carving. Firstly, stereoscopic saliency map is generated by combining 2D saliency and depth saliency maps, and significant energy map is generated by considering binocular disparity binocular and binocular just-noticeable-difference (BJND). Then, seam selection is applied to the left image based on stereoscopic saliency and energy maps, and seam replacement is performed for the occluded regions to prevent the geometry inconsistency. Finally, according to the matched left and right seams, the retargeted stereoscopic image is generated. In the experiments, subjective and objective analysis on three stereoscopic image databases shows that the proposed approach produces better seam carving results than the related existing methods.
引用
收藏
页码:22 / 30
页数:9
相关论文
共 38 条
[1]   SLIC Superpixels Compared to State-of-the-Art Superpixel Methods [J].
Achanta, Radhakrishna ;
Shaji, Appu ;
Smith, Kevin ;
Lucchi, Aurelien ;
Fua, Pascal ;
Suesstrunk, Sabine .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2012, 34 (11) :2274-2281
[2]  
[Anonymous], AS C COMP VIS
[3]  
[Anonymous], 2010, 2010 3DTV C TRUE VIS
[4]  
[Anonymous], 2020, INT TELECOMMUNICATIO
[5]  
[Anonymous], P 4 ACM C MULT SYST
[6]   Seam carving for content-aware image resizing [J].
Avidan, Shai ;
Shamir, Ariel .
ACM TRANSACTIONS ON GRAPHICS, 2007, 26 (03)
[7]   Content-Aware Display Adaptation and Interactive Editing for Stereoscopic Images [J].
Chang, Che-Han ;
Liang, Chia-Kai ;
Chuang, Yung-Yu .
IEEE TRANSACTIONS ON MULTIMEDIA, 2011, 13 (04) :589-601
[8]   Stereo Seam Carving a Geometrically Consistent Approach [J].
Dekel , Tali ;
Moses, Yael ;
Avidan, Shai .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2013, 35 (10) :2513-2525
[9]   Changing Perspective in Stereoscopic Images [J].
Du, Song-Pei ;
Hu, Shi-Min ;
Martin, Ralph R. .
IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2013, 19 (08) :1288-1297
[10]   Objective Quality Assessment for Image Retargeting Based on Structural Similarity [J].
Fang, Yuming ;
Zeng, Kai ;
Wang, Zhou ;
Lin, Weisi ;
Fang, Zhijun ;
Lin, Chia-Wen .
IEEE JOURNAL ON EMERGING AND SELECTED TOPICS IN CIRCUITS AND SYSTEMS, 2014, 4 (01) :95-105