Computational Integral Imaging Reconstruction Based on Generative Adversarial Network Super-Resolution

被引:1
作者
Wu, Wei [1 ,2 ]
Wang, Shigang [1 ]
Chen, Wanzhong [1 ]
Qi, Zexin [2 ]
Zhao, Yan [1 ]
Zhong, Cheng [3 ]
Chen, Yuxin [2 ]
机构
[1] Jilin Univ, Coll Commun Engn, 5372 Nanhu Rd, Changchun 130012, Peoples R China
[2] Changchun Univ Technol, Coll Comp Sci & Engn, 2055 Yanan St, Changchun 130012, Peoples R China
[3] Changchun Univ Technol, Coll Int Educ, 2055 Yanan St, Changchun 130012, Peoples R China
来源
APPLIED SCIENCES-BASEL | 2024年 / 14卷 / 02期
基金
中国国家自然科学基金;
关键词
computational integral imaging reconstruction; deep learning; super-resolution; ELEMENTAL IMAGE; QUALITY ENHANCEMENT; CONVOLUTION; PROPERTY; REARRANGEMENT; ARRAY;
D O I
10.3390/app14020656
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
To improve acquisition efficiency and achieve super high-resolution reconstruction, a computational integral imaging reconstruction (CIIR) method based on the generative adversarial network (GAN) network is proposed. Firstly, a sparse camera array is used to generate an elemental image array of the 3D object. Then, the elemental image array is mapped to a low-resolution sparse view image. Finally, a lite GAN super-resolution network is presented to up-sample the low-resolution 3D images to high-resolution 3D images with realistic image quality. By removing batch normalization (BN) layers, reducing basic blocks, and adding intra-block operations, better image details and faster generation of super high-resolution images can be achieved. Experimental results demonstrate that the proposed method can effectively enhance the image quality, with the structural similarity (SSIM) reaching over 0.90, and can also reduce the training time by about 20%.
引用
收藏
页数:13
相关论文
共 48 条
  • [1] Optical full-depth refocusing of 3-D objects based on subdivided-elemental images and local periodic δ-functions in integral imaging
    Ai, Ling-Yu
    Dong, Xiao-Bin
    Jang, Jae-Young
    Kim, Eun-Soo
    [J]. OPTICS EXPRESS, 2016, 24 (10): : 10359 - 10375
  • [2] Refocusing-range and image-quality enhanced optical reconstruction of 3-D objects from integral images using a principal periodic δ-function array
    Ai, Lingyu
    Kim, Eun-Soo
    [J]. OPTICS COMMUNICATIONS, 2018, 410 : 871 - 883
  • [3] A Deep Journey into Super-resolution: A Survey
    Anwar, Saeed
    Khan, Salman
    Barnes, Nick
    [J]. ACM COMPUTING SURVEYS, 2020, 53 (03)
  • [4] Integral three-dimensional imaging with digital reconstruction
    Arimoto, H
    Javidi, B
    [J]. OPTICS LETTERS, 2001, 26 (03) : 157 - 159
  • [5] Balram Nikhil, 2016, Information Display, V32, P6
  • [6] Analysis of the noise in backprojection light field acquisition and its optimization
    Chen, Ni
    Ren, Zhenbo
    Li, Dayan
    Lam, Edmund Y.
    Situ, Guohai
    [J]. APPLIED OPTICS, 2017, 56 (13) : F20 - F26
  • [7] Computational Reconstruction of Three-Dimensional Integral Imaging by Rearrangement of Elemental Image Pixels
    Cho, Myungjin
    Javidi, Bahram
    [J]. JOURNAL OF DISPLAY TECHNOLOGY, 2009, 5 (1-3): : 61 - 65
  • [8] Accelerating the Super-Resolution Convolutional Neural Network
    Dong, Chao
    Loy, Chen Change
    Tang, Xiaoou
    [J]. COMPUTER VISION - ECCV 2016, PT II, 2016, 9906 : 391 - 407
  • [9] Image Super-Resolution Using Deep Convolutional Networks
    Dong, Chao
    Loy, Chen Change
    He, Kaiming
    Tang, Xiaoou
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2016, 38 (02) : 295 - 307
  • [10] The PASCAL Visual Object Classes Challenge: A Retrospective
    Everingham, Mark
    Eslami, S. M. Ali
    Van Gool, Luc
    Williams, Christopher K. I.
    Winn, John
    Zisserman, Andrew
    [J]. INTERNATIONAL JOURNAL OF COMPUTER VISION, 2015, 111 (01) : 98 - 136