Stereoscopic Image Generation From Light Field With Disparity Scaling and Super-Resolution

被引:6
作者
Yan, Tao [1 ]
Jiao, Jianbo [2 ,3 ]
Liu, Wenxi [4 ]
Lau, Rynson W. H. [5 ]
机构
[1] Jiangnan Univ, Jiangsu Key Lab Media Design & Software Technol, Wuxi 214122, Jiangsu, Peoples R China
[2] Univ Oxford, VGG, Oxford OX1 3QR, England
[3] Univ Oxford, BioMedIA Labs, Oxford OX1 3QR, England
[4] Fuzhou Univ, Coll Math & Comp Sci, Fuzhou 350108, Fujian, Peoples R China
[5] City Univ Hong Kong, Dept Comp Sci, Hong Kong, Peoples R China
基金
中国国家自然科学基金;
关键词
Stereo image processing; Spatial resolution; Image synthesis; Three-dimensional displays; Cameras; Light field image processing; stereoscopic image synthesis; disparity scaling; super-resolution; VIDEO SYNTHESIS;
D O I
10.1109/TIP.2019.2944519
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper, we propose a novel method to generate stereoscopic images from light-field images with the intended depth range and simultaneously perform image super-resolution. Subject to the small baseline of neighboring subaperture views and low spatial resolution of light-field images captured using compact commercial light-field cameras, the disparity range of any two subaperture views is usually very small. We propose a method to control the disparity range of the target stereoscopic images with linear or nonlinear disparity scaling and properly resolve the disocclusion problem with the aid of a smooth energy term previously used for texture synthesis. The left and right views of the target stereoscopic image are simultaneously generated by a unified optimization framework, which preserves content coherence between the left and right views by a coherence energy term. The disparity range of the target stereoscopic image can be larger than that of the input light field image. This benefits many light field image-based applications, e.g., displaying light field images on various stereo display devices and generating stereoscopic panoramic images from a light field image montage. An extensive experimental evaluation demonstrates the effectiveness of our method.
引用
收藏
页码:1827 / 1842
页数:16
相关论文
共 50 条
[21]   Light Field Image Super-Resolution using Selective Kernel Convolution [J].
Zhang, Yuduo ;
Van Duong, Vinh ;
Yim, Jonghoon ;
Jeon, Byeungwoo .
INTERNATIONAL WORKSHOP ON ADVANCED IMAGING TECHNOLOGY, IWAIT 2023, 2023, 12592
[22]   Light Field Image Super-Resolution via Mutual Attention Guidance [J].
Wang, Zijian ;
Lu, Yao .
IEEE ACCESS, 2021, 9 :129022-129031
[23]   Spatial-Angular Interaction for Light Field Image Super-Resolution [J].
Wang, Yingqian ;
Wang, Longguang ;
Yang, Jungang ;
An, Wei ;
Yu, Jingyi ;
Guo, Yulan .
COMPUTER VISION - ECCV 2020, PT XXIII, 2020, 12368 :290-308
[24]   Learning an epipolar shift compensation for light field image super-resolution [J].
Wang, Xinya ;
Ma, Jiayi ;
Yi, Peng ;
Tian, Xin ;
Jiang, Junjun ;
Zhang, Xiao-Ping .
INFORMATION FUSION, 2022, 79 :188-199
[25]   Disparity-constrained stereo endoscopic image super-resolution [J].
Tianyi Zhang ;
Yun Gu ;
Xiaolin Huang ;
Jie Yang ;
Guang-Zhong Yang .
International Journal of Computer Assisted Radiology and Surgery, 2022, 17 :867-875
[26]   Disparity-constrained stereo endoscopic image super-resolution [J].
Zhang, Tianyi ;
Gu, Yun ;
Huang, Xiaolin ;
Yang, Jie ;
Yang, Guang-Zhong .
INTERNATIONAL JOURNAL OF COMPUTER ASSISTED RADIOLOGY AND SURGERY, 2022, 17 (05) :867-875
[27]   Image Super-Resolution Reconstruction Based on Disparity Map and CNN [J].
Liu, Yujia ;
Xu, Xiping ;
Xu, Jiahong ;
Jiang, Zhaoguo .
IEEE ACCESS, 2018, 6 :53489-53498
[28]   Light Field Super-Resolution By Jointly Exploiting Internal and External Similarities [J].
Cheng, Zhen ;
Xiong, Zhiwei ;
Liu, Dong .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2020, 30 (08) :2604-2616
[29]   Deep Light Field Spatial Super-Resolution Using Heterogeneous Imaging [J].
Chen, Yeyao ;
Jiang, Gangyi ;
Yu, Mei ;
Xu, Haiyong ;
Ho, Yo-Sung .
IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2023, 29 (10) :4183-4197
[30]   Advances in Light Field Spatial Super-Resolution: A Comprehensive Literature Survey [J].
Lyu, Wenqi ;
Sheng, Hao ;
Ke, Wei ;
Ma, Xiao .
IEEE ACCESS, 2025, 13 :18470-18497