Stereoscopic Image Stitching via Disparity-Constrained Warping and Blending

被引:19
作者
Fan, Xiaoting [1 ]
Lei, Jianjun [1 ]
Fang, Yuming [2 ]
Huang, Qingming [3 ,4 ]
Ling, Nam [5 ]
Hou, Chunping [1 ]
机构
[1] Tianjin Univ, Sch Elect & Informat Engn, Tianjin 300072, Peoples R China
[2] Jiangxi Univ Finance & Econ, Informat Management, Nanchang 330032, Jiangxi, Peoples R China
[3] Univ Chinese Acad Sci, Sch Comp Sci & Technol, Beijing 101408, Peoples R China
[4] Chinese Acad Sci, Inst Comp Technol, Key Lab Intelligent Informat Proc, Beijing 100190, Peoples R China
[5] Santa Clara Univ, Dept Comp Engn, Santa Clara, CA 95053 USA
基金
国家重点研发计划; 中国国家自然科学基金;
关键词
Stereo image processing; Distortion; Two dimensional displays; Visualization; Minimization methods; Shape; Feature extraction; Stereoscopic image; image stitching; disparity consistency; multi-constraint warping; seam-cutting and blending;
D O I
10.1109/TMM.2019.2932573
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
As a significant branch of virtual reality, stereoscopic image stitching aims to generating wide perspectives and natural-looking scenes. Existing 2D image stitching methods cannot be successfully applied to the stereoscopic images without considering the disparity consistency of stereoscopic images. To address this issue, this paper presents a stereoscopic image stitching method based on disparity-constrained warping and blending, which could avoid visual distortion and preserve disparity consistency. First, a point-line-driven homography based disparity minimization method is designed to pre-align the left and right images and reduce vertical disparity. Afterwards, a multi-constraint warping is proposed to further align the left and right images, where the initial disparity map is introduced to control the consistency of disparities. Finally, a disparity consistency seam-cutting and blending method is presented to determine the optimal seam and conduct stereoscopic image stitching. Experimental results demonstrate that the proposed method achieves competitive performance compared with other state-of-the-art methods.
引用
收藏
页码:655 / 665
页数:11
相关论文
共 48 条
[41]  
Xu B, 2017, IEEE IMAGE PROC, P1467, DOI 10.1109/ICIP.2017.8296525
[42]   Stereoscopic Image Stitching Based on a Hybrid Warping Model [J].
Yan, Weiqing ;
Hou, Chunping ;
Lei, Jianjun ;
Fang, Yuming ;
Gu, Zhouye ;
Ling, Nam .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2017, 27 (09) :1934-1946
[43]   Graph-Based Segmentation for RGB-D Data Using 3-D Geometry Enhanced Superpixels [J].
Yang, Jingyu ;
Gan, Ziqiao ;
Li, Kun ;
Hou, Chunping .
IEEE TRANSACTIONS ON CYBERNETICS, 2015, 45 (05) :913-926
[44]   Color-Guided Depth Recovery From RGB-D Data Using an Adaptive Autoregressive Model [J].
Yang, Jingyu ;
Ye, Xinchen ;
Li, Kun ;
Hou, Chunping ;
Wang, Yao .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2014, 23 (08) :3443-3458
[45]   A Novel Distortion Model and Lagrangian Multiplier for Depth Maps Coding [J].
Yuan, Hui ;
Kwong, Sam ;
Liu, Ju ;
Sun, Jiande .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2014, 24 (03) :443-451
[46]  
Zaragoza J., 2013, PATTERN ANAL MACHINE, P1
[47]  
Zhang F, 2015, PROC CVPR IEEE, P2002, DOI 10.1109/CVPR.2015.7298811
[48]   Parallax-tolerant Image Stitching [J].
Zhang, Fan ;
Liu, Feng .
2014 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2014, :3262-3269