A soft scanning electron microscopy for efficient segmentation of alloy microstructures based on a new self-supervised pre-training deep learning network

被引:0
作者
Zhang, Jinhan [1 ]
Yu, Jingtai [1 ]
Wei, Xiaoran [2 ]
Zhou, Kun [1 ]
Niu, Weifei [3 ]
Wei, Yushun [3 ]
Zhao, Cong [3 ]
Chen, Gang [1 ]
Jin, Fengmin [1 ]
Song, Kai [1 ,4 ]
机构
[1] Tianjin Univ, Sch Chem Engn & Technol, Tianjin 300072, Peoples R China
[2] Tianjin Univ, Coll Intelligence & Comp, Tianjin 300072, Peoples R China
[3] Tianjin Special Equipment Emergency & Accid Invest, Tianjin 300192, Peoples R China
[4] Tianjin Key Lab Chem Proc Safety & Equipment Techn, Tianjin 300350, Peoples R China
关键词
Self-supervised learning; Scanning electron microscopy; Microstructural feature; Alloy; Optical microscopy; Image segmentation; Deep-learning; Computer vision; IMAGE SEGMENTATION;
D O I
10.1016/j.matchar.2024.114532
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
To provide an on-site metallographic segmentation using only optical microscopy images, sSEM-Net, a soft scanning electron microscopy network, is developed based on a self-supervised pre-training deep learning framework. During model training, only a sparse collection of SEM images is necessary for annotation assistance. By integrating CNN and Transformer, sSEM-Net efficiently utilizes global context information while mitigating data dependency and computational resource constraints. Using only readily available optical microscopy images as input, sSEM-Net achieves metallographic segmentation comparable to SEM images, catering to rapid and costeffective industrial needs. This methodology leverages non-destructive inspection attributes, catering to rapid and cost-sensitive industrial requirements. The efficacy of the proposed sSEM-Net is demonstrated through metallographic structure analysis of TC4 titanium alloy, with potential extensions to other alloy types.
引用
收藏
页数:10
相关论文
共 50 条
  • [31] Attention based morphological guided deep learning network for neuron segmentation in electron microscopy
    Imani, Maryam
    Zehtabian, Amin
    JOURNAL OF SUPERCOMPUTING, 2024, 80 (10) : 14272 - 14294
  • [32] BTSwin-Unet: 3D U-shaped Symmetrical Swin Transformer-based Network for Brain Tumor Segmentation with Self-supervised Pre-training
    Junjie Liang
    Cihui Yang
    Jingting Zhong
    Xiaoli Ye
    Neural Processing Letters, 2023, 55 : 3695 - 3713
  • [33] BTSwin-Unet: 3D U-shaped Symmetrical Swin Transformer-based Network for Brain Tumor Segmentation with Self-supervised Pre-training
    Liang, Junjie
    Yang, Cihui
    Zhong, Jingting
    Ye, Xiaoli
    NEURAL PROCESSING LETTERS, 2023, 55 (04) : 3695 - 3713
  • [34] HANDLING SEVERE DATA IMBALANCE IN CHEST X-RAY IMAGE CLASSIFICATION WITH TRANSFER LEARNING USING SWAV SELF-SUPERVISED PRE-TRAINING
    Muljo, Hery Harjono
    Pardamean, Bens
    Elwirehardja, Gregorius Natanael
    Hidayat, Alam Ahmad
    Sudigyo, Digdo
    Rahutomo, Reza
    Cenggoro, Tjeng Wawan
    COMMUNICATIONS IN MATHEMATICAL BIOLOGY AND NEUROSCIENCE, 2023,
  • [35] Small and Strong: Power Line Segmentation Network in Real Time Based on Self-supervised Learning
    Chen M.
    Wang Y.
    Dai Y.
    Yan Y.
    Qi D.
    Zhongguo Dianji Gongcheng Xuebao/Proceedings of the Chinese Society of Electrical Engineering, 2022, 42 (04): : 1365 - 1374
  • [36] W2V-BERT: COMBINING CONTRASTIVE LEARNING AND MASKED LANGUAGE MODELING FOR SELF-SUPERVISED SPEECH PRE-TRAINING
    Chung, Yu-An
    Zhang, Yu
    Han, Wei
    Chiu, Chung-Cheng
    Qin, James
    Pang, Ruoming
    Wu, Yonghui
    2021 IEEE AUTOMATIC SPEECH RECOGNITION AND UNDERSTANDING WORKSHOP (ASRU), 2021, : 244 - 250
  • [37] Pre-training Question Embeddings for Improving Knowledge Tracing with Self-supervised Bi-graph Co-contrastive Learning
    Wang, Wentao
    Ma, Huifang
    Zhao, Yan
    Li, Zhixin
    ACM TRANSACTIONS ON KNOWLEDGE DISCOVERY FROM DATA, 2024, 18 (04)
  • [38] Thyroid ultrasound diagnosis improvement via multi-view self-supervised learning and two-stage pre-training
    Wang, Jian
    Yang, Xin
    Jia, Xiaohong
    Xue, Wufeng
    Chen, Rusi
    Chen, Yanlin
    Zhu, Xiliang
    Liu, Lian
    Cao, Yan
    Zhou, Jianqiao
    Ni, Dong
    Gu, Ning
    COMPUTERS IN BIOLOGY AND MEDICINE, 2024, 171
  • [39] A Universal Feature Extractor Based on Self-Supervised Pre-Training for Fault Diagnosis of Rotating Machinery under Limited Data
    Yan, Zitong
    Liu, Hongmei
    Tao, Laifa
    Ma, Jian
    Cheng, Yujie
    AEROSPACE, 2023, 10 (08)
  • [40] Automated pancreatic segmentation and fat fraction evaluation based on a self-supervised transfer learning network
    Zhang, Gaofeng
    Zhan, Qian
    Gao, Qingyu
    Mao, Kuanzheng
    Yang, Panpan
    Gao, Yisha
    Wang, Lijia
    Song, Bin
    Chen, Yufei
    Bian, Yun
    Shao, Chengwei
    Lu, Jianping
    Ma, Chao
    COMPUTERS IN BIOLOGY AND MEDICINE, 2024, 170