A soft scanning electron microscopy for efficient segmentation of alloy microstructures based on a new self-supervised pre-training deep learning network

被引:0
作者
Zhang, Jinhan [1 ]
Yu, Jingtai [1 ]
Wei, Xiaoran [2 ]
Zhou, Kun [1 ]
Niu, Weifei [3 ]
Wei, Yushun [3 ]
Zhao, Cong [3 ]
Chen, Gang [1 ]
Jin, Fengmin [1 ]
Song, Kai [1 ,4 ]
机构
[1] Tianjin Univ, Sch Chem Engn & Technol, Tianjin 300072, Peoples R China
[2] Tianjin Univ, Coll Intelligence & Comp, Tianjin 300072, Peoples R China
[3] Tianjin Special Equipment Emergency & Accid Invest, Tianjin 300192, Peoples R China
[4] Tianjin Key Lab Chem Proc Safety & Equipment Techn, Tianjin 300350, Peoples R China
关键词
Self-supervised learning; Scanning electron microscopy; Microstructural feature; Alloy; Optical microscopy; Image segmentation; Deep-learning; Computer vision; IMAGE SEGMENTATION;
D O I
10.1016/j.matchar.2024.114532
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
To provide an on-site metallographic segmentation using only optical microscopy images, sSEM-Net, a soft scanning electron microscopy network, is developed based on a self-supervised pre-training deep learning framework. During model training, only a sparse collection of SEM images is necessary for annotation assistance. By integrating CNN and Transformer, sSEM-Net efficiently utilizes global context information while mitigating data dependency and computational resource constraints. Using only readily available optical microscopy images as input, sSEM-Net achieves metallographic segmentation comparable to SEM images, catering to rapid and costeffective industrial needs. This methodology leverages non-destructive inspection attributes, catering to rapid and cost-sensitive industrial requirements. The efficacy of the proposed sSEM-Net is demonstrated through metallographic structure analysis of TC4 titanium alloy, with potential extensions to other alloy types.
引用
收藏
页数:10
相关论文
共 50 条
  • [21] Intra-modality masked image modeling: A self-supervised pre-training method for brain tumor segmentation
    Qi, Liangce
    Shi, Weili
    Miao, Yu
    Li, Yonghui
    Feng, Guanyuan
    Jiang, Zhengang
    BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2024, 95
  • [22] Self-supervised pseudo multi-class pre-training for unsupervised anomaly detection and segmentation in medical images
    Tian, Yu
    Liu, Fengbei
    Pang, Guansong
    Chen, Yuanhong
    Liu, Yuyuan
    Verjans, Johan W.
    Singh, Rajvinder
    Carneiro, Gustavo
    MEDICAL IMAGE ANALYSIS, 2023, 90
  • [23] Self-mentoring: A new deep learning pipeline to train a self-supervised U-net for few-shot learning of bio-artificial capsule segmentation
    Deleruyelle, Arnaud
    Versari, Cristian
    Klein, John
    COMPUTERS IN BIOLOGY AND MEDICINE, 2023, 152
  • [24] Prediction of recurrence-free survival in lung adenocarcinoma based on self-supervised pre-training and multi-task learning
    Hu L.
    Xia W.
    Li Q.
    Gao X.
    Shengwu Yixue Gongchengxue Zazhi/Journal of Biomedical Engineering, 2024, 41 (02): : 205 - 212
  • [25] Less is More: Selective reduction of CT data for self-supervised pre-training of deep learning models with contrastive learning improves downstream classification performance
    Wolf, Daniel
    Payer, Tristan
    Lisson, Catharina Silvia
    Lisson, Christoph Gerhard
    Beer, Meinrad
    Götz, Michael
    Ropinski, Timo
    Computers in Biology and Medicine, 2024, 183
  • [26] A Semi-Supervised Multi-Region Segmentation Framework of Bladder Wall and Tumor with Wall-Enhanced Self-Supervised Pre-Training
    Wei, Jie
    Zheng, Yao
    Huang, Dong
    Liu, Yang
    Xu, Xiaopan
    Lu, Hongbing
    BIOENGINEERING-BASEL, 2024, 11 (12):
  • [27] Generic network for domain adaptation based on self-supervised learning and deep clustering
    Baffour, Adu Asare
    Qin, Zhen
    Geng, Ji
    Ding, Yi
    Deng, Fuhu
    Qin, Zhiguang
    NEUROCOMPUTING, 2022, 476 : 126 - 136
  • [28] GMIM: Self-supervised pre-training for 3D medical image segmentation with adaptive and hierarchical masked image modeling
    Qi L.
    Jiang Z.
    Shi W.
    Qu F.
    Feng G.
    Computers in Biology and Medicine, 2024, 176
  • [29] Efficient Staining-Invariant Nuclei Segmentation Approach Using Self-Supervised Deep Contrastive Network
    Abdel-Nasser, Mohamed
    Singh, Vivek Kumar
    Mohamed, Ehab Mahmoud
    DIAGNOSTICS, 2022, 12 (12)
  • [30] Learning Consistent Semantic Representation for Chest X-ray via Anatomical Localization in Self-Supervised Pre-Training
    Chu, Surong
    Ren, Xueting
    Ji, Guohua
    Zhao, Juanjuan
    Shi, Jinwei
    Wei, Yangyang
    Pei, Bo
    Qiang, Yan
    IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2025, 29 (03) : 2100 - 2112