SPATIAL AND ANGULAR RECONSTRUCTION OF LIGHT FIELD BASED ON DEEP GENERATIVE NETWORKS

被引:0
作者
Meng, Nan [1 ]
Zeng, Tianjiao [1 ]
Lam, Edmund Y. [1 ]
机构
[1] Univ Hong Kong, Dept Elect & Elect Engn, Pokfulam, Hong Kong, Peoples R China
来源
2019 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP) | 2019年
关键词
Light field reconstruction; generative adversarial networks; computational imaging; high-dimensional convolution; deep learning; RESOLUTION;
D O I
10.1109/icip.2019.8803480
中图分类号
TB8 [摄影技术];
学科分类号
0804 ;
摘要
Light field (LF) cameras often have significant limitations in spatial and angular resolutions due to their design. Many techniques that attempt to reconstruct LF images at a higher resolution only consider either spatial or angular resolution, but not both. We propose a generative network using high-dimensional convolution to improve both aspects. Our experimental results on both synthetic and real-world data demonstrate that the proposed model outperforms existing state-of-the-art methods in terms of both peak signal-to-noise ratio (PSNR) and visual quality. The proposed method can also generate more realistic spatial details with better fidelity.
引用
收藏
页码:4659 / 4663
页数:5
相关论文
共 26 条
[11]  
Mitra K., 2012, P IEEE COMP SOC C CO, P22
[12]   Plenoptic Layer-Based Modeling for Image Based Rendering [J].
Pearson, James ;
Brookes, Mike ;
Dragotti, Pier Luigi .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2013, 22 (09) :3405-3419
[13]  
Prevedel R, 2014, NAT METHODS, V11, P727, DOI [10.1038/nmeth.2964, 10.1038/NMETH.2964]
[14]  
Ren ZB, 2019, ADV PHOTONICS, V1, DOI 10.1117/1.AP.1.1.016004
[15]   Learning-based nonparametric autofocusing or digital holography [J].
Ren, Zhenbo ;
Xu, Zhimin ;
Lam, Edmund Y. .
OPTICA, 2018, 5 (04) :337-344
[16]  
Simonyan K, 2015, Arxiv, DOI arXiv:1409.1556
[17]  
Sun X, 2016, IEEE IJCNN, P367, DOI 10.1109/IJCNN.2016.7727222
[18]   LFNet: A Novel Bidirectional Recurrent Convolutional Neural Network for Light-Field Image Super-Resolution [J].
Wang, Yunlong ;
Liu, Fei ;
Zhang, Kunbo ;
Hou, Guangqi ;
Sun, Zhenan ;
Tan, Tieniu .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2018, 27 (09) :4274-4286
[19]  
Wanner S., 2013, P 18 INT WORKSH VIS, P225
[20]   Variational Light Field Analysis for Disparity Estimation and Super-Resolution [J].
Wanner, Sven ;
Goldluecke, Bastian .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2014, 36 (03) :606-619