Deep learning-based super-resolution in coherent imaging systems

被引:115
|
作者
Liu, Tairan [1 ,2 ,3 ]
de Haan, Kevin [1 ,2 ,3 ]
Rivenson, Yair [1 ,2 ,3 ]
Wei, Zhensong [1 ]
Zeng, Xin [1 ]
Zhang, Yibo [1 ,2 ,3 ]
Ozcan, Aydogan [1 ,2 ,3 ,4 ]
机构
[1] Univ Calif Los Angeles, Elect & Comp Engn Dept, Los Angeles, CA 90095 USA
[2] Univ Calif Los Angeles, Bioengn Dept, Los Angeles, CA 90095 USA
[3] Univ Calif Los Angeles, Calif NanoSyst Inst CNSI, Los Angeles, CA 90095 USA
[4] Univ Calif Los Angeles, David Geffen Sch Med, Dept Surg, Los Angeles, CA 90095 USA
基金
美国国家卫生研究院; 美国国家科学基金会;
关键词
WIDE-FIELD; PIXEL SUPERRESOLUTION; DIGITAL HOLOGRAPHY; PHASE RETRIEVAL; MICROSCOPY; LOCALIZATION; RECOVERY;
D O I
10.1038/s41598-019-40554-1
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
We present a deep learning framework based on a generative adversarial network (GAN) to perform super-resolution in coherent imaging systems. We demonstrate that this framework can enhance the resolution of both pixel size-limited and diffraction-limited coherent imaging systems. The capabilities of this approach are experimentally validated by super-resolving complex-valued images acquired using a lensfree on-chip holographic microscope, the resolution of which was pixel size-limited. Using the same GAN-based approach, we also improved the resolution of a lens-based holographic imaging system that was limited in resolution by the numerical aperture of its objective lens. This deep learning-based super-resolution framework can be broadly applied to enhance the space-bandwidth product of coherent imaging systems using image data and convolutional neural networks, and provides a rapid, non-iterative method for solving inverse image reconstruction or enhancement problems in optics.
引用
收藏
页数:13
相关论文
共 50 条
  • [1] Deep learning-based super-resolution in coherent imaging systems
    Tairan Liu
    Kevin de Haan
    Yair Rivenson
    Zhensong Wei
    Xin Zeng
    Yibo Zhang
    Aydogan Ozcan
    Scientific Reports, 9
  • [2] Deep learning-based point-scanning super-resolution imaging
    Fang, Linjing
    Monroe, Fred
    Novak, Sammy Weiser
    Kirk, Lyndsey
    Schiavon, Cara R.
    Yu, Seungyoon B.
    Zhang, Tong
    Wu, Melissa
    Kastner, Kyle
    Latif, Alaa Abdel
    Lin, Zijun
    Shaw, Andrew
    Kubota, Yoshiyuki
    Mendenhall, John
    Zhang, Zhao
    Pekkurnaz, Gulcin
    Harris, Kristen
    Howard, Jeremy
    Manor, Uri
    NATURE METHODS, 2021, 18 (04) : 406 - +
  • [3] Deep Learning-Based Point-Scanning Super-Resolution Imaging
    Manor, Uri
    Fang, Linjing
    Howard, Jeremy
    Monroe, Fred
    Weiser, Sammy
    Kastner, Kyle
    Kirk, Lyndsey
    Harris, Kristen
    Pekkurnaz, Gulcin
    Yoon, Blenda
    Schiavon, Cara
    Zhang, Tong
    FASEB JOURNAL, 2020, 34
  • [4] Deep learning-based point-scanning super-resolution imaging
    Linjing Fang
    Fred Monroe
    Sammy Weiser Novak
    Lyndsey Kirk
    Cara R. Schiavon
    Seungyoon B. Yu
    Tong Zhang
    Melissa Wu
    Kyle Kastner
    Alaa Abdel Latif
    Zijun Lin
    Andrew Shaw
    Yoshiyuki Kubota
    John Mendenhall
    Zhao Zhang
    Gulcin Pekkurnaz
    Kristen Harris
    Jeremy Howard
    Uri Manor
    Nature Methods, 2021, 18 : 406 - 416
  • [5] Deep Learning-based Face Super-resolution: A Survey
    Jiang, Junjun
    Wang, Chenyang
    Liu, Xianming
    Ma, Jiayi
    ACM COMPUTING SURVEYS, 2023, 55 (01)
  • [6] Deep learning-based infrared imaging degradation model identification and super-resolution reconstruction
    Cao J.
    Ding Q.
    Zou D.
    Qin H.
    Luo H.
    Hongwai yu Jiguang Gongcheng/Infrared and Laser Engineering, 2024, 53 (05):
  • [7] Deep learning-based image super-resolution restoration for mobile infrared imaging system
    Wu, Heng
    Hao, Xinyue
    Wu, Jibiao
    Xiao, Huapan
    He, Chunhua
    Yin, Shenxin
    INFRARED PHYSICS & TECHNOLOGY, 2023, 132
  • [8] Volumetric Isosurface Rendering with Deep Learning-Based Super-Resolution
    Weiss, Sebastian
    Chu, Mengyu
    Thuerey, Nils
    Westermann, Rudiger
    IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2021, 27 (06) : 3064 - 3078
  • [9] Meta transfer learning-based super-resolution infrared imaging
    Wu, Wenhao
    Wang, Tao
    Wang, Zhuowei
    Cheng, Lianglun
    Wu, Heng
    DIGITAL SIGNAL PROCESSING, 2022, 131
  • [10] ROBUST LEARNING-BASED SUPER-RESOLUTION
    Kim, Changhyun
    Choi, Kyuha
    Lee, Ho-young
    Hwang, Kyuyoung
    Ra, Jong Beom
    2010 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, 2010, : 2017 - 2020