Adaptive Structured-Light 3D Surface Imaging with Cross-Domain Learning

被引:0
作者
Li, Xinsheng [1 ,2 ]
Feng, Shijie [1 ,2 ]
Chen, Wenwu [1 ,2 ]
Jin, Ziheng [1 ,2 ]
Chen, Qian [1 ,2 ]
Zuo, Chao [1 ,2 ]
机构
[1] Nanjing Univ Sci & Technol, Sch Elect & Opt Engn, Smart Computat Imaging Lab SCILab, Nanjing 210094, Jiangsu, Peoples R China
[2] Jiangsu Key Lab Spectral Imaging & Intelligent Sen, Nanjing 210094, Jiangsu, Peoples R China
基金
中国国家自然科学基金;
关键词
3D imaging; deep learning; fringe analysis; optical metrology; phase measurement; FRINGE PROJECTION; FOURIER-TRANSFORM; SHAPE MEASUREMENT; PROFILOMETRY;
D O I
10.1002/lpor.202401609
中图分类号
O43 [光学];
学科分类号
070207 ; 0803 ;
摘要
The rapid development of artificial intelligence (AI) technology is leading a paradigm shift in optical metrology, from physics- and knowledge-based modeling to data-driven learning. In particular, the integration of structured-light techniques with deep learning has garnered widespread attention and achieved significant success due to its capability to enable single-frame, high-speed, and high-accuracy 3D surface imaging. However, most algorithms based on deep neural networks (DNNs) face a critical challenge: they assume the training and test data are independent and identically distributed, leading to performance degradation when applied across different image domains, especially when test images are acquired from unseen systems and environments. A cross-domain learning framework for adaptive structured-light 3D imaging is proposed to address this challenge. This framework's adaptability is enhanced by a novel mixture-of-experts (MoE) architecture, capable of dynamically synthesizing a network by integrating contributions from multiple expert DNNs. Experimental results demonstrate the method exhibits superior generalization performance across diverse systems and environments over both "specialist" DNNs developed for fixed domains and "generalist" DNNs trained by brute-force approaches. This work offers fresh insights into substantially enhancing the generalization of deep-learning-based structured-light 3D imaging and advances the development of versatile, robust AI-driven optical metrology techniques.
引用
收藏
页数:14
相关论文
共 45 条
[1]   Robust and data-efficient generalization of self-supervised machine learning for diagnostic imaging [J].
Azizi, Shekoofeh ;
Culp, Laura ;
Freyberg, Jan ;
Mustafa, Basil ;
Baur, Sebastien ;
Kornblith, Simon ;
Chen, Ting ;
Tomasev, Nenad ;
Mitrovic, Jovana ;
Strachan, Patricia ;
Mahdavi, S. Sara ;
Wulczyn, Ellery ;
Babenko, Boris ;
Walker, Megan ;
Loh, Aaron ;
Chen, Po-Hsuan Cameron ;
Liu, Yuan ;
Bavishi, Pinal ;
McKinney, Scott Mayer ;
Winkens, Jim ;
Roy, Abhijit Guha ;
Beaver, Zach ;
Ryan, Fiona ;
Krogue, Justin ;
Etemadi, Mozziyar ;
Telang, Umesh ;
Liu, Yun ;
Peng, Lily ;
Corrado, Greg S. ;
Webster, Dale R. ;
Fleet, David ;
Hinton, Geoffrey ;
Houlsby, Neil ;
Karthikesalingam, Alan ;
Norouzi, Mohammad ;
Natarajan, Vivek .
NATURE BIOMEDICAL ENGINEERING, 2023, 7 (06) :756-+
[2]   On the use of deep learning for computational imaging [J].
Barbastathis, George ;
Ozcan, Aydogan ;
Situ, Guohai .
OPTICA, 2019, 6 (08) :921-943
[3]  
Blain J. M., 2019, The complete guide to Blender graphics: computer modeling & animation
[4]   A review of selected topics in interferometric optical metrology [J].
de Groot, Peter J. .
REPORTS ON PROGRESS IN PHYSICS, 2019, 82 (05)
[5]   Fringe-pattern analysis with ensemble deep learning [J].
Feng, Shijie ;
Xiao, Yile ;
Yin, Wei ;
Hu, Yan ;
Li, Yixuan ;
Zuo, Chao ;
Chen, Qian .
ADVANCED PHOTONICS NEXUS, 2023, 2 (03)
[6]   Deep-learning-based fringe-pattern analysis with uncertainty estimation [J].
Feng, Shijie ;
Zuo, Chao ;
Hu, Yan ;
Li, Yixuan ;
Chen, Qian .
OPTICA, 2021, 8 (12) :1507-1510
[7]   Generalized framework for non-sinusoidal fringe analysis using deep learning [J].
Feng, Shijie ;
Zuo, Chao ;
Zhang, Liang ;
Yin, Wei ;
Chen, Qian .
PHOTONICS RESEARCH, 2021, 9 (06) :1084-1098
[8]   Fringe pattern analysis using deep learning [J].
Feng, Shijie ;
Chen, Qian ;
Gu, Guohua ;
Tao, Tianyang ;
Zhang, Liang ;
Hu, Yan ;
Yin, Wei ;
Zuo, Chao .
ADVANCED PHOTONICS, 2019, 1 (02)
[9]   Structured-light 3D surface imaging: a tutorial [J].
Geng, Jason .
ADVANCES IN OPTICS AND PHOTONICS, 2011, 3 (02) :128-160
[10]  
Gsvik K. J., 2003, Optical metrology