Machine Learning-Based View Synthesis in Fourier Lightfield Microscopy

被引:3
作者
Rostan, Julen [1 ]
Incardona, Nicolo [2 ]
Sanchez-Ortiga, Emilio [2 ]
Martinez-Corral, Manuel [2 ]
Latorre-Carmona, Pedro [1 ]
机构
[1] Univ Burgos, Dept Ingn Informat, E-09006 Burgos, Spain
[2] Univ Valencia, Dept Opt, 3D Imaging & Display Lab, E-46100 Burjassot, Spain
关键词
Fourier lightfield microscopy; view synthesis; neural radiance fields; 3D microscopy; FIELD MICROSCOPY;
D O I
10.3390/s22093487
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Current interest in Fourier lightfield microscopy is increasing, due to its ability to acquire 3D images of thick dynamic samples. This technique is based on simultaneously capturing, in a single shot, and with a monocular setup, a number of orthographic perspective views of 3D microscopic samples. An essential feature of Fourier lightfield microscopy is that the number of acquired views is low, due to the trade-off relationship existing between the number of views and their corresponding lateral resolution. Therefore, it is important to have a tool for the generation of a high number of synthesized view images, without compromising their lateral resolution. In this context we investigate here the use of a neural radiance field view synthesis method, originally developed for its use with macroscopic scenes acquired with a moving (or an array of static) digital camera(s), for its application to the images acquired with a Fourier lightfield microscope. The results obtained and presented in this paper are analyzed in terms of lateral resolution and of continuous and realistic parallax. We show that, in terms of these requirements, the proposed technique works efficiently in the case of the epi-illumination microscopy mode.
引用
收藏
页数:11
相关论文
共 29 条
[1]  
Adelson EH., 1991, COMPUTATIONAL MODELS, P3, DOI DOI 10.7551/MITPRESS/2002.003.0004
[2]  
[Anonymous], REPRESENTING SCENES
[3]   Wave optics theory and 3-D deconvolution for the light field microscope [J].
Broxton, Michael ;
Grosenick, Logan ;
Yang, Samuel ;
Cohen, Noy ;
Andalman, Aaron ;
Deisseroth, Karl ;
Levoy, Marc .
OPTICS EXPRESS, 2013, 21 (21) :25418-25439
[4]  
Christen M., 2005, THESIS U APPL SCI BA
[5]   Rapid whole brain imaging of neural activity in freely behaving larval zebrafish (Danio rerio) [J].
Cong, Lin ;
Wang, Zeguan ;
Chai, Yuming ;
Hang, Wei ;
Shang, Chunfeng ;
Yang, Wenbin ;
Bai, Lu ;
Du, Jiulin ;
Wang, Kai ;
Wen, Quan .
ELIFE, 2017, 6
[6]   Handheld and Cost-Effective Fourier Lightfield Microscope [J].
Galdon, Laura ;
Yun, Hui ;
Saavedra, Genaro ;
Garcia-Sucerquia, Jorge ;
Barreiro, Juan C. ;
Martinez-Corral, Manuel ;
Sanchez-Ortiga, Emilio .
SENSORS, 2022, 22 (04)
[7]  
Gortler S. J., 1996, Computer Graphics Proceedings. SIGGRAPH '96, P43, DOI 10.1145/237170.237200
[8]   Fourier light-field microscopy [J].
Guo, Changliang ;
Liu, Wenhao ;
Hua, Xuanwen ;
Li, Haoyu ;
Jia, Shu .
OPTICS EXPRESS, 2019, 27 (18) :25573-25594
[9]  
Hua XW, 2021, OPTICA, V8, P614, DOI [10.1364/optica.419236, 10.1364/OPTICA.419236]
[10]  
Levoy M., 1996, Computer Graphics Proceedings. SIGGRAPH '96, P31, DOI 10.1145/237170.237199