A soft scanning electron microscopy for efficient segmentation of alloy microstructures based on a new self-supervised pre-training deep learning network

被引:0
作者
Zhang, Jinhan [1 ]
Yu, Jingtai [1 ]
Wei, Xiaoran [2 ]
Zhou, Kun [1 ]
Niu, Weifei [3 ]
Wei, Yushun [3 ]
Zhao, Cong [3 ]
Chen, Gang [1 ]
Jin, Fengmin [1 ]
Song, Kai [1 ,4 ]
机构
[1] Tianjin Univ, Sch Chem Engn & Technol, Tianjin 300072, Peoples R China
[2] Tianjin Univ, Coll Intelligence & Comp, Tianjin 300072, Peoples R China
[3] Tianjin Special Equipment Emergency & Accid Invest, Tianjin 300192, Peoples R China
[4] Tianjin Key Lab Chem Proc Safety & Equipment Techn, Tianjin 300350, Peoples R China
关键词
Self-supervised learning; Scanning electron microscopy; Microstructural feature; Alloy; Optical microscopy; Image segmentation; Deep-learning; Computer vision; IMAGE SEGMENTATION;
D O I
10.1016/j.matchar.2024.114532
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
To provide an on-site metallographic segmentation using only optical microscopy images, sSEM-Net, a soft scanning electron microscopy network, is developed based on a self-supervised pre-training deep learning framework. During model training, only a sparse collection of SEM images is necessary for annotation assistance. By integrating CNN and Transformer, sSEM-Net efficiently utilizes global context information while mitigating data dependency and computational resource constraints. Using only readily available optical microscopy images as input, sSEM-Net achieves metallographic segmentation comparable to SEM images, catering to rapid and costeffective industrial needs. This methodology leverages non-destructive inspection attributes, catering to rapid and cost-sensitive industrial requirements. The efficacy of the proposed sSEM-Net is demonstrated through metallographic structure analysis of TC4 titanium alloy, with potential extensions to other alloy types.
引用
收藏
页数:10
相关论文
共 50 条
  • [41] Deep Learning Based Instance Segmentation of Titanium Dioxide Particles in the Form of Agglomerates in Scanning Electron Microscopy
    Monchot, Paul
    Coquelin, Loic
    Guerroudj, Khaled
    Feltin, Nicolas
    Delvallee, Alexandra
    Crouzier, Loic
    Fischer, Nicolas
    NANOMATERIALS, 2021, 11 (04)
  • [42] Self-supervised learning based transformer and convolution hybrid network for one-shot organ segmentation
    Wang, Bo
    Li, Qian
    You, Zheng
    NEUROCOMPUTING, 2023, 527 : 1 - 12
  • [43] An Effective Representation Learning Approach: The Integrated Self-Supervised Pre-Training Models of StyleGAN2-ADA and DINO for Colon Polyp Images
    Kim, Jong-Yeup
    Tangriberganov, Gayrat
    Jung, Woochul
    Kim, Dae Sung
    Koo, Hoon Sup
    Lee, Suehyun
    Kim, Sun Moon
    IEEE ACCESS, 2023, 11 : 143628 - 143634
  • [44] Ultrasound carotid plaque segmentation via image reconstruction-based self-supervised learning with limited training labels
    Zhou, Ran
    Ou, Yanghan
    Fang, Xiaoyue
    Azarpazhooh, M. Reza
    Gan, Haitao
    Ye, Zhiwei
    Spence, J. David
    Xu, Xiangyang
    Fenster, Aaron
    MATHEMATICAL BIOSCIENCES AND ENGINEERING, 2023, 20 (02) : 1617 - 1636
  • [45] ProSE-Pero: Peroxisomal Protein Localization Identification Model Based on Self-Supervised Multi-Task Language Pre-Training Model
    Sui, Jianan
    Chen, Jiazi
    Chen, Yuehui
    Iwamori, Naoki
    Sun, Jin
    FRONTIERS IN BIOSCIENCE-LANDMARK, 2023, 28 (12):
  • [46] DSSNet: A Deep Sequential Sleep Network for Self-Supervised Representation Learning Based on Single-Channel EEG
    Chang, Shuohua
    Yang, Zhihong
    You, Yuyang
    Guo, Xiaoyu
    IEEE SIGNAL PROCESSING LETTERS, 2022, 29 : 2143 - 2147
  • [47] Classification of Helicobacter Pylori infection based on deep convolutional neural network with visual attention and self-supervised learning for endoscopic images
    Jian G.-Z.
    Lin G.-S.
    Wang C.-M.
    Yan S.-L.
    Multimedia Tools and Applications, 2023, 82 (24) : 37731 - 37754
  • [48] A deep learning-based method for segmentation and quantitative characterization of microstructures in weathering steel from sequential scanning electron microscope images
    Bing Han
    Wei-hao Wan
    Dan-dan Sun
    Cai-chang Dong
    Lei Zhao
    Hai-zhou Wang
    Journal of Iron and Steel Research International, 2022, 29 : 836 - 845
  • [49] A deep learning-based method for segmentation and quantitative characterization of microstructures in weathering steel from sequential scanning electron microscope images
    Han, Bing
    Wan, Wei-hao
    Sun, Dan-dan
    Dong, Cai-chang
    Zhao, Lei
    Wang, Hai-zhou
    JOURNAL OF IRON AND STEEL RESEARCH INTERNATIONAL, 2022, 29 (05) : 836 - 845
  • [50] OrchidNet: A Self-Supervised Learning-Based Efficient Multiscale Feature Fusion Convolutional Neural Network With a Lightweight Architecture for Orchid Classification
    Hu, Wu-Chih
    Chen, Liang-Bi
    Huang, Xiang-Rui
    Huang, Guan-Zhi
    IEEE INTERNET OF THINGS JOURNAL, 2025, 12 (05): : 5859 - 5875