Training Deep Neural Networks to Reconstruct Nanoporous Structures From FIB Tomography Images Using Synthetic Training Data

被引:15
作者
Sardhara, Trushal [1 ]
Aydin, Roland C. [2 ]
Li, Yong [3 ]
Piche, Nicolas [4 ]
Gauvin, Raynald [5 ]
Cyron, Christian J. [1 ,2 ]
Ritter, Martin [6 ]
机构
[1] Hamburg Univ Technol, Inst Continuum & Mat Mech, Hamburg, Germany
[2] Helmholtz Zentrum Hereon, Inst Mat Syst Modeling, Geesthacht, Germany
[3] Hamburg Univ Technol, Inst Mat Phys & Technol, Hamburg, Germany
[4] Object Res Syst, Montreal, PQ, Canada
[5] McGill Univ, Dept Min & Mat Engn, Montreal, PQ, Canada
[6] Hamburg Univ Technol, Elect Microscopy Unit, Hamburg, Germany
关键词
electron microscopy; synthetic training data; 3D reconstruction; semantic segmentation; SEM simulation; 3D CNN; 2D CNN with adjacent slices; machine learning; MONTE-CARLO-SIMULATION; SEM IMAGES; X-RAY; ELECTRON; SEGMENTATION; PROGRAM; NOISE;
D O I
10.3389/fmats.2022.837006
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
Focused ion beam (FIB) tomography is a destructive technique used to collect three-dimensional (3D) structural information at a resolution of a few nanometers. For FIB tomography, a material sample is degraded by layer-wise milling. After each layer, the current surface is imaged by a scanning electron microscope (SEM), providing a consecutive series of cross-sections of the three-dimensional material sample. Especially for nanoporous materials, the reconstruction of the 3D microstructure of the material, from the information collected during FIB tomography, is impaired by the so-called shine-through effect. This effect prevents a unique mapping between voxel intensity values and material phase (e.g., solid or void). It often substantially reduces the accuracy of conventional methods for image segmentation. Here we demonstrate how machine learning can be used to tackle this problem. A bottleneck in doing so is the availability of sufficient training data. To overcome this problem, we present a novel approach to generate synthetic training data in the form of FIB-SEM images generated by Monte Carlo simulations. Based on this approach, we compare the performance of different machine learning architectures for segmenting FIB tomography data of nanoporous materials. We demonstrate that two-dimensional (2D) convolutional neural network (CNN) architectures processing a group of adjacent slices as input data as well as 3D CNN perform best and can enhance the segmentation performance significantly.
引用
收藏
页数:12
相关论文
共 32 条
[1]  
[Anonymous], 1998, Numerical Recipes in C
[2]  
Cicek Ozgun, 2016, Medical Image Computing and Computer-Assisted Intervention - MICCAI 2016. 19th International Conference. Proceedings: LNCS 9901, P424, DOI 10.1007/978-3-319-46723-8_49
[3]  
Ciresan D., 2012, P ADV NEUR INF PROC, P2843
[4]   Simulated SEM Images for Resolution Measurement [J].
Cizmar, P. ;
Vladar, A. E. ;
Ming, B. ;
Postek, M. T. .
SCANNING, 2008, 30 (05) :381-391
[5]  
Fager C, 2020, MICROSC MICROANAL, V26, P837, DOI [10.1017/S1431927620001592, 10.1017/51431927620001592]
[6]   Reconstruction of highly porous structures from FIB-SEM using a deep neural network trained on synthetic images [J].
Fend, C. ;
Moghiseh, A. ;
Redenbach, C. ;
Schladitz, K. .
JOURNAL OF MICROSCOPY, 2021, 281 (01) :16-27
[7]   Win X-ray: A new Monte Carlo program that computes X-ray spectra obtained with a scanning electron microscope [J].
Gauvin, R ;
Lifshin, E ;
Demers, H ;
Horny, P ;
Campbell, H .
MICROSCOPY AND MICROANALYSIS, 2006, 12 (01) :49-64
[8]   MC X-Ray, a New Monte Carlo Program for Quantitative X-Ray Microanalysis of Real Materials [J].
Gauvin, Raynald ;
Michaud, Pierre .
MICROSCOPY AND MICROANALYSIS, 2009, 15 :488-489
[9]   Rich feature hierarchies for accurate object detection and semantic segmentation [J].
Girshick, Ross ;
Donahue, Jeff ;
Darrell, Trevor ;
Malik, Jitendra .
2014 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2014, :580-587
[10]  
Goldstein J.I., 2017, Scanning Electron Microscopy and X-Ray Microanalysis