Stereoscopic Image Stitching via Disparity-Constrained Warping and Blending

被引:19
作者
Fan, Xiaoting [1 ]
Lei, Jianjun [1 ]
Fang, Yuming [2 ]
Huang, Qingming [3 ,4 ]
Ling, Nam [5 ]
Hou, Chunping [1 ]
机构
[1] Tianjin Univ, Sch Elect & Informat Engn, Tianjin 300072, Peoples R China
[2] Jiangxi Univ Finance & Econ, Informat Management, Nanchang 330032, Jiangxi, Peoples R China
[3] Univ Chinese Acad Sci, Sch Comp Sci & Technol, Beijing 101408, Peoples R China
[4] Chinese Acad Sci, Inst Comp Technol, Key Lab Intelligent Informat Proc, Beijing 100190, Peoples R China
[5] Santa Clara Univ, Dept Comp Engn, Santa Clara, CA 95053 USA
基金
中国国家自然科学基金; 国家重点研发计划;
关键词
Stereo image processing; Distortion; Two dimensional displays; Visualization; Minimization methods; Shape; Feature extraction; Stereoscopic image; image stitching; disparity consistency; multi-constraint warping; seam-cutting and blending;
D O I
10.1109/TMM.2019.2932573
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
As a significant branch of virtual reality, stereoscopic image stitching aims to generating wide perspectives and natural-looking scenes. Existing 2D image stitching methods cannot be successfully applied to the stereoscopic images without considering the disparity consistency of stereoscopic images. To address this issue, this paper presents a stereoscopic image stitching method based on disparity-constrained warping and blending, which could avoid visual distortion and preserve disparity consistency. First, a point-line-driven homography based disparity minimization method is designed to pre-align the left and right images and reduce vertical disparity. Afterwards, a multi-constraint warping is proposed to further align the left and right images, where the initial disparity map is introduced to control the consistency of disparities. Finally, a disparity consistency seam-cutting and blending method is presented to determine the optimal seam and conduct stereoscopic image stitching. Experimental results demonstrate that the proposed method achieves competitive performance compared with other state-of-the-art methods.
引用
收藏
页码:655 / 665
页数:11
相关论文
共 48 条
  • [1] Allène C, 2008, INT C PATT RECOG, P2539
  • [2] Dissecting and Reassembling Color Correction Algorithms for Image Stitching
    Bellavia, Fabio
    Colombo, Carlo
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2018, 27 (02) : 735 - 748
  • [3] Brown M, 2003, NINTH IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION, VOLS I AND II, PROCEEDINGS, P1218
  • [4] Automatic panoramic image stitching using invariant features
    Brown, Matthew
    Lowe, David G.
    [J]. INTERNATIONAL JOURNAL OF COMPUTER VISION, 2007, 74 (01) : 59 - 73
  • [5] Reliable Multiscale and Multiwindow Stereo Matching
    Buades, Antoni
    Facciolo, Gabriele
    [J]. SIAM JOURNAL ON IMAGING SCIENCES, 2015, 8 (02): : 888 - 915
  • [6] Chai Q., 2016, P IEEE INT C MULTIME, P1
  • [7] Shape-Preserving Half-Projective Warps for Image Stitching
    Chang, Che-Han
    Sato, Yoichi
    Chuang, Yung-Yu
    [J]. 2014 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2014, : 3254 - 3261
  • [8] Natural Image Stitching with the Global Similarity Prior
    Chen, Yu-Sheng
    Chuang, Yung-Yu
    [J]. COMPUTER VISION - ECCV 2016, PT V, 2016, 9909 : 186 - 201
  • [9] Dubrofsky E., 2011, P INT S VIS COMP, P202
  • [10] Eden A., 2006, P 2006 IEEE COMP SOC, P2498