Semantic Segmentation for Noisy and Limited Wafer Transmission Electron Microscope Images

被引:0
作者
Jo, Yongwon [1 ]
Bae, Jinsoo [1 ]
Cho, Hansam [1 ]
Roh, Heejoong [2 ]
Kim, Kyunghye [2 ]
Jo, Munki [2 ]
Tae, Jaeung [2 ]
Kim, Seoung Bum [1 ]
机构
[1] Korea Univ, Dept Ind & Management Engn, Seoul 02841, South Korea
[2] SK Hynix, Icheon 17336, South Korea
关键词
Semiconductor device modeling; Semantic segmentation; Image segmentation; Transmission electron microscopy; Semiconductor device measurement; Noise; Data augmentation; Wafer transmission electron microscope image; semantic segmentation; transfer learning; data augmentation; object boundary; DEFECT CLASSIFICATION; NEURAL-NETWORK;
D O I
10.1109/TSM.2024.3396423
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
Semantic segmentation for automated measurement in semiconductor manufacturing, specifically with wafer transmission electron microscopy (TEM) images, poses significant challenges because of the difficulty of acquisition, prevalent noise, and ambiguous object boundaries. However, prior studies focused on broadening the application of semantic segmentation for automated measurement without considering the specific intricacies of TEM images. In this study, we propose a wafer TEM images-specific semantic segmentation and transfer learning (WTEM-SST) framework to address these issues. The proposed WTEM-SST involves a pre-training stage, wafer TEM-specific data augmentation methods, and a boundary-focused loss function. The pre-training stage addresses the difficulty of collecting and annotating wafer TEM images, followed by fine-tuning for process-specific segmentation models. Our data augmentation techniques mitigate challenges related to limited training samples, lots of noise, and unclear boundaries. The boundary-focused loss makes the model more precise in boundary recognition during fine-tuning. We demonstrate that WTEM-SST outperforms conventional segmentation models, with our studies highlighting the effectiveness of the three components in WTEM-SST.
引用
收藏
页码:345 / 354
页数:10
相关论文
共 47 条
[1]   Grid-distortion on nonrectangular grids [J].
Arad, N .
COMPUTER AIDED GEOMETRIC DESIGN, 1998, 15 (05) :475-493
[2]   Application of deep-learning based techniques for automatic metrology on scanning and transmission electron microscopy images [J].
Baderot, J. ;
Grould, M. ;
Misra, D. ;
Clement, N. ;
Hallal, A. ;
Martinez, S. ;
Foucher, J. .
JOURNAL OF VACUUM SCIENCE & TECHNOLOGY B, 2022, 40 (05)
[3]   SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation [J].
Badrinarayanan, Vijay ;
Kendall, Alex ;
Cipolla, Roberto .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2017, 39 (12) :2481-2495
[4]   BLIND RESTORATION OF IMAGES DEGRADED WITH MIXED POISSON-GAUSSIAN NOISE WITH APPLICATION IN TRANSMISSION ELECTRON MICROSCOPY [J].
Bajic, Buda ;
Lindblad, Joakim ;
Sladoje, Natasa .
2016 IEEE 13TH INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING (ISBI), 2016, :123-127
[5]   A Systematic Review of Deep Learning for Silicon Wafer Defect Recognition [J].
Batool, Uzma ;
Shapiai, Mohd Ibrahim ;
Tahir, Muhammad ;
Ismail, Zool Hilmi ;
Zakaria, Noor Jannah ;
Elfakharany, Ahmed .
IEEE ACCESS, 2021, 9 :116572-116593
[6]   Albumentations: Fast and Flexible Image Augmentations [J].
Buslaev, Alexander ;
Iglovikov, Vladimir I. ;
Khvedchenya, Eugene ;
Parinov, Alex ;
Druzhinin, Mikhail ;
Kalinin, Alexandr A. .
INFORMATION, 2020, 11 (02)
[7]   Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation [J].
Chen, Liang-Chieh ;
Zhu, Yukun ;
Papandreou, George ;
Schroff, Florian ;
Adam, Hartwig .
COMPUTER VISION - ECCV 2018, PT VII, 2018, 11211 :833-851
[8]   Convolutional Neural Network for Wafer Surface Defect Classification and the Detection of Unknown Defect Class [J].
Cheon, Sejune ;
Lee, Hankang ;
Kim, Chang Ouk ;
Lee, Seok Hyung .
IEEE TRANSACTIONS ON SEMICONDUCTOR MANUFACTURING, 2019, 32 (02) :163-170
[9]   Xception: Deep Learning with Depthwise Separable Convolutions [J].
Chollet, Francois .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :1800-1807
[10]   Randaugment: Practical automated data augmentation with a reduced search space [J].
Cubuk, Ekin D. ;
Zoph, Barret ;
Shlens, Jonathon ;
Le, Quoc, V .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW 2020), 2020, :3008-3017