High-performance full-color imaging system based on end-to-end joint optimization of computer-generated holography and metalens

被引:5
作者
Yu, Zeqing [1 ]
Zhang, Qiangbo [1 ]
Tao, Xiao [2 ]
LI, Yong [1 ,3 ]
Tao, Chenning [1 ]
Wu, Fei [3 ]
Wang, Chang [1 ,4 ]
Zheng, Zhenrong [1 ,4 ]
机构
[1] Zhejiang Univ, Coll Opt Sci & Engn, State Key Lab Modern Opt Instrumentat, Hangzhou 310027, Peoples R China
[2] Shanghai Aerosp Control Technol Inst, Shanghai 201109, Peoples R China
[3] Beijing LLVis Technol Co Ltd, Room 301, Bldg B12C, 10 Jiuxianqiao Rd, Beijing 10015, Peoples R China
[4] Jiaxing Res Inst Zhejiang Univ, Intelligent Opt & Photon Res Ctr, Jiaxing 314000, Peoples R China
关键词
METASURFACE;
D O I
10.1364/OE.470419
中图分类号
O43 [光学];
学科分类号
070207 ; 0803 ;
摘要
Metasurface has drawn extensive attention due to its capability of modulating light with a high degree of freedom through ultrathin and sub-wavelength optical elements, and metalens, as one of its important applications, promises to replace the bulky refractive optics, facilitating the imaging system light-weight and compact characteristics. Besides, computer-generated holography (CGH) is of substantial interest for three-dimensional (3D) imaging technology by virtue of its ability of restoring the whole optical wave field and re-constructing the true 3D scene. Consequently, the combination of metalens and CGH holds transformative potential in enabling the miniaturization of 3D imaging systems. However, its imaging performance is subject to the aberrations and speckle noises originating from the metalens and CGH. Inspired by recent progress that computational imaging can be applied to close the gap, a novel full-color imaging system, adopting end-to-end joint optimization of metalens and CGH for high imaging quality, is proposed in this paper. The U-net based network as the pre-processing adjusts weights to make the holographic reconstruction offset imaging defects, incorporating the imaging processing into the step of generating hologram. Optimized by deep learning, the proposed imaging system is capable of full-color imaging with high fidelity in a compact form factor, envisioned to take an essential step towards the high-performance miniaturized imaging system. (C) 2022 Optica Publishing Group under the terms of the Optica Open Access Publishing Agreement
引用
收藏
页码:40871 / 40883
页数:13
相关论文
共 44 条
  • [1] NTIRE 2017 Challenge on Single Image Super-Resolution: Dataset and Study
    Agustsson, Eirikur
    Timofte, Radu
    [J]. 2017 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2017, : 1122 - 1131
  • [2] Aberration-Free Ultrathin Flat Lenses and Axicons at Telecom Wavelengths Based on Plasmonic Metasurfaces
    Aieta, Francesco
    Genevet, Patrice
    Kats, Mikhail A.
    Yu, Nanfang
    Blanchard, Romain
    Gahurro, Zeno
    Capasso, Federico
    [J]. NANO LETTERS, 2012, 12 (09) : 4932 - 4936
  • [3] MEMS-tunable dielectric metasurface lens
    Arbabi, Ehsan
    Arbabi, Amir
    Kamali, Seyedeh Mahsa
    Horie, Yu
    Faraji-Dana, MohammadSadegh
    Faraon, Andrei
    [J]. NATURE COMMUNICATIONS, 2018, 9
  • [4] Composite functional metasurfaces for multispectral achromatic optics
    Avayu, Ori
    Almeida, Euclides
    Prior, Yehiam
    Ellenbogen, Tal
    [J]. NATURE COMMUNICATIONS, 2017, 8
  • [5] On the use of deep learning for computational imaging
    Barbastathis, George
    Ozcan, Aydogan
    Situ, Guohai
    [J]. OPTICA, 2019, 6 (08): : 921 - 943
  • [6] Deep Optics for Monocular Depth Estimation and 3D Object Detection
    Chang, Julie
    Wetzstein, Gordon
    [J]. 2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 10192 - 10201
  • [7] Hybrid optical-electronic convolutional neural networks with optimized diffractive optics for image classification
    Chang, Julie
    Sitzmann, Vincent
    Dun, Xiong
    Heidrich, Wolfgang
    Wetzstein, Gordon
    [J]. SCIENTIFIC REPORTS, 2018, 8
  • [8] A broadband achromatic metalens for focusing and imaging in the visible
    Chen, Wei Ting
    Zhu, Alexander Y.
    Sanjeev, Vyshakh
    Khorasaninejad, Mohammadreza
    Shi, Zhujun
    Lee, Eric
    Capasso, Federico
    [J]. NATURE NANOTECHNOLOGY, 2018, 13 (03) : 220 - +
  • [9] Simultaneous Achromatic and Varifocal Imaging with Quartic Metasurfaces in the Visible
    Colburn, Shane
    Majumdar, Arka
    [J]. ACS PHOTONICS, 2020, 7 (01) : 120 - 127
  • [10] Metasurface optics for full-color computational imaging
    Colburn, Shane
    Zhan, Alan
    Majumdar, Arka
    [J]. SCIENCE ADVANCES, 2018, 4 (02):