SPATIAL AND ANGULAR RECONSTRUCTION OF LIGHT FIELD BASED ON DEEP GENERATIVE NETWORKS

被引:0
作者
Meng, Nan [1 ]
Zeng, Tianjiao [1 ]
Lam, Edmund Y. [1 ]
机构
[1] Univ Hong Kong, Dept Elect & Elect Engn, Pokfulam, Hong Kong, Peoples R China
来源
2019 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP) | 2019年
关键词
Light field reconstruction; generative adversarial networks; computational imaging; high-dimensional convolution; deep learning; RESOLUTION;
D O I
10.1109/icip.2019.8803480
中图分类号
TB8 [摄影技术];
学科分类号
0804 ;
摘要
Light field (LF) cameras often have significant limitations in spatial and angular resolutions due to their design. Many techniques that attempt to reconstruct LF images at a higher resolution only consider either spatial or angular resolution, but not both. We propose a generative network using high-dimensional convolution to improve both aspects. Our experimental results on both synthetic and real-world data demonstrate that the proposed model outperforms existing state-of-the-art methods in terms of both peak signal-to-noise ratio (PSNR) and visual quality. The proposed method can also generate more realistic spatial details with better fidelity.
引用
收藏
页码:4659 / 4663
页数:5
相关论文
共 26 条
[1]  
Duval G, 2005, Light field photography with a hand-held plenoptic cameraD, DOI DOI 10.1145/3097571
[2]   Super Resolution of Light Field Images Using Linear Subspace Projection of Patch-Volumes [J].
Farrugia, Reuben A. ;
Galea, Christian ;
Guillemot, Christine .
IEEE JOURNAL OF SELECTED TOPICS IN SIGNAL PROCESSING, 2017, 11 (07) :1058-1071
[3]  
Goodfellow IJ, 2014, ADV NEUR IN, V27, P2672
[4]   Spatial and Angular Resolution Enhancement of Light Fields Using Convolutional Neural Networks [J].
Gul, M. Shahzeb Khan ;
Gunturk, Bahadir K. .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2018, 27 (05) :2146-2159
[5]   Learning-Based View Synthesis for Light Field Cameras [J].
Kalantari, Nima Khademi ;
Wang, Ting-Chun ;
Ramamoorthi, Ravi .
ACM TRANSACTIONS ON GRAPHICS, 2016, 35 (06)
[6]   Fast and Accurate Image Super-Resolution with Deep Laplacian Pyramid Networks [J].
Lai, Wei-Sheng ;
Huang, Jia-Bin ;
Ahuja, Narendra ;
Yang, Ming-Hsuan .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2019, 41 (11) :2599-2613
[7]   Computational photography with plenoptic camera and light field capture: tutorial [J].
Lam, Edmund Y. .
JOURNAL OF THE OPTICAL SOCIETY OF AMERICA A-OPTICS IMAGE SCIENCE AND VISION, 2015, 32 (11) :2021-2032
[8]   Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Network [J].
Ledig, Christian ;
Theis, Lucas ;
Huszar, Ferenc ;
Caballero, Jose ;
Cunningham, Andrew ;
Acosta, Alejandro ;
Aitken, Andrew ;
Tejani, Alykhan ;
Totz, Johannes ;
Wang, Zehan ;
Shi, Wenzhe .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :105-114
[9]   Computational Light Field Generation Using Deep Nonparametric Bayesian Learning [J].
Meng, Nan ;
Sun, Xing ;
So, Hayden K-H ;
Lam, Edmund Y. .
IEEE ACCESS, 2019, 7 :24990-25000
[10]  
Meng Nan, 2019, IEEE T PATTERN UNPUB