Stereoscopic Image Stitching via Disparity-Constrained Warping and Blending

被引:19
作者
Fan, Xiaoting [1 ]
Lei, Jianjun [1 ]
Fang, Yuming [2 ]
Huang, Qingming [3 ,4 ]
Ling, Nam [5 ]
Hou, Chunping [1 ]
机构
[1] Tianjin Univ, Sch Elect & Informat Engn, Tianjin 300072, Peoples R China
[2] Jiangxi Univ Finance & Econ, Informat Management, Nanchang 330032, Jiangxi, Peoples R China
[3] Univ Chinese Acad Sci, Sch Comp Sci & Technol, Beijing 101408, Peoples R China
[4] Chinese Acad Sci, Inst Comp Technol, Key Lab Intelligent Informat Proc, Beijing 100190, Peoples R China
[5] Santa Clara Univ, Dept Comp Engn, Santa Clara, CA 95053 USA
基金
中国国家自然科学基金; 国家重点研发计划;
关键词
Stereo image processing; Distortion; Two dimensional displays; Visualization; Minimization methods; Shape; Feature extraction; Stereoscopic image; image stitching; disparity consistency; multi-constraint warping; seam-cutting and blending;
D O I
10.1109/TMM.2019.2932573
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
As a significant branch of virtual reality, stereoscopic image stitching aims to generating wide perspectives and natural-looking scenes. Existing 2D image stitching methods cannot be successfully applied to the stereoscopic images without considering the disparity consistency of stereoscopic images. To address this issue, this paper presents a stereoscopic image stitching method based on disparity-constrained warping and blending, which could avoid visual distortion and preserve disparity consistency. First, a point-line-driven homography based disparity minimization method is designed to pre-align the left and right images and reduce vertical disparity. Afterwards, a multi-constraint warping is proposed to further align the left and right images, where the initial disparity map is introduced to control the consistency of disparities. Finally, a disparity consistency seam-cutting and blending method is presented to determine the optimal seam and conduct stereoscopic image stitching. Experimental results demonstrate that the proposed method achieves competitive performance compared with other state-of-the-art methods.
引用
收藏
页码:655 / 665
页数:11
相关论文
共 48 条
  • [11] Visual Attention Prediction for Stereoscopic Video by Multi-Module Fully Convolutional Network
    Fang, Yuming
    Zhang, Chi
    Huang, Hanqin
    Lei, Jianjun
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2019, 28 (11) : 5253 - 5265
  • [12] Saliency Detection in the Compressed Domain for Adaptive Image Retargeting
    Fang, Yuming
    Chen, Zhenzhong
    Lin, Weisi
    Lin, Chia-Wen
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2012, 21 (09) : 3888 - 3901
  • [13] Efficient graph-based image segmentation
    Felzenszwalb, PF
    Huttenlocher, DP
    [J]. INTERNATIONAL JOURNAL OF COMPUTER VISION, 2004, 59 (02) : 167 - 181
  • [14] Gao JH, 2011, PROC CVPR IEEE, P49, DOI 10.1109/CVPR.2011.5995433
  • [15] Gurrieri L. E., 2013, P SOC PHOTO-OPT INS, V8648, P1
  • [16] Jiang YT, 2015, Proceedings of the Second International Symposium - Management, Innovation and Development, P42
  • [17] Joo K, 2015, IEEE IMAGE PROC, P1175, DOI 10.1109/ICIP.2015.7350985
  • [18] Shape-Preserving Object Depth Control for Stereoscopic Images
    Lei, Jianjun
    Peng, Bo
    Zhang, Changqing
    Mei, Xuguang
    Cao, Xiaochun
    Fan, Xiaoting
    Li, Xuelong
    [J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2018, 28 (12) : 3333 - 3344
  • [19] Fast Mode Decision Based on Grayscale Similarity and Inter-View Correlation for Depth Map Coding in 3D-HEVC
    Lei, Jianjun
    Duan, Jinhui
    Wu, Feng
    Ling, Nam
    Hou, Chunping
    [J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2018, 28 (03) : 706 - 718
  • [20] Depth Sensation Enhancement for Multiple Virtual View Rendering
    Lei, Jianjun
    Zhang, Cuicui
    Fang, Yuming
    Gu, Zhouye
    Ling, Nam
    Hou, Chunping
    [J]. IEEE TRANSACTIONS ON MULTIMEDIA, 2015, 17 (04) : 457 - 469