Validation of Physics-Based Image Systems Simulation With 3-D Scenes

被引:10
作者
Lyu, Zheng [1 ]
Goossens, Thomas [1 ]
Wandell, Brian [1 ]
Farrell, Joyce [1 ]
机构
[1] Stanford Univ, Stanford Ctr Image Syst Engn, Stanford, CA 94305 USA
关键词
Cameras; Computational modeling; Lenses; Systems simulation; Software; Optics; Imaging; Computer graphics; end-to-end simulation; image systems; optics; physically based ray tracing; sensor;
D O I
10.1109/JSEN.2022.3199699
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Image systems simulation software can accelerate innovation by reducing many of the time-consuming and expensive steps in designing, building, and evaluating image systems. To realize this potential, it is necessary to build trust in physics-based end-to-end image systems simulations. Toward this goal, we describe and experimentally validate an end-to-end physics-based image systems simulation of a digital camera. The simulation models the spectral radiance of 3-D scenes, the formation of the spectral irradiance by multielement optics, and the conversion of the irradiance to digital values (DVs) by the image sensor. We quantify the accuracy of the simulation by comparing real and simulated images of a precisely constructed, 3-D high-dynamic range (HDR) test scene.
引用
收藏
页码:19400 / 19410
页数:11
相关论文
共 58 条
[21]   Digital camera simulation [J].
Farrell, Joyce E. ;
Catrysse, Peter B. ;
Wandell, Brian A. .
APPLIED OPTICS, 2012, 51 (04) :A80-A90
[22]   Virtual Worlds as Proxy for Multi-Object Tracking Analysis [J].
Gaidon, Adrien ;
Wang, Qiao ;
Cabon, Yohann ;
Vig, Eleonora .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :4340-4349
[23]   General framework for infrared sensor modeling [J].
Garnier, C ;
Collorec, R ;
Flifla, J ;
Rousee, F .
INFRARED IMAGING SYSTEMS: DESIGN, ANALYSIS, MODELING, AND TESTING IX, 1998, 3377 :59-70
[24]   Infrared sensor modeling for realistic thermal image synthesis [J].
Garnier, C ;
Collorec, R ;
Flifla, J ;
Mouclier, C ;
Rousée, F .
ICASSP '99: 1999 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, PROCEEDINGS VOLS I-VI, 1999, :3513-3516
[25]   Ray-transfer functions for camera simulation of 3D scenes with hidden lens design [J].
Goossens, Thomas ;
Lyu, Zheng ;
Ko, Jamyuen ;
Wan, Gordon C. ;
Farrell, Joyce ;
Wandell, Brian .
OPTICS EXPRESS, 2022, 30 (13) :24031-24047
[26]  
Goral C. M., 1984, Computers & Graphics, V18, P213
[27]   Characterization and simulation of optical sensors [J].
Grapinet, M. ;
De Souza, Ph. ;
Smal, J. -C. ;
Blosseville, J. -M. .
ACCIDENT ANALYSIS AND PREVENTION, 2013, 60 :344-352
[28]  
Gruyer D, 2012, 2012 IEEE INTELLIGENT VEHICLES SYMPOSIUM (IV), P969, DOI 10.1109/IVS.2012.6232260
[29]  
Hossain Sabir, 2019, [The Journal of Korea Robotics Society, 로봇학회 논문지], V14, P122
[30]   CAIAS Simulator: Self-driving Vehicle Simulator for AI Research [J].
Hossain, Sabir ;
Fayjie, Abdur R. ;
Doukhi, Oualid ;
Lee, Deok-jin .
INTELLIGENT COMPUTING & OPTIMIZATION, 2019, 866 :187-195