Relevant input data for crack feature segmentation with deep learning on SEM imagery and topography data

Fractography plays a critical role in failure analysis of engineering components and has a considerable importance for safety investigations. Usually, the interpretation of fracture surfaces is done by experts with the help of literature and experimental data, that requires a lot of experience. The use of deep learning (DL) with neural networks in failure analysis becomes more and more relevant with the rapidly developing possibilities. Especially, the modern network architectures can assist fractographers in determining various fracture features on SEM images of the fracture surfaces. The basis for the best possible evaluation is the understanding of the influence of the input data used for training deep neural networks (DNN). Therefore, this study discusses the influence of the selection of the input data used for the prediction quality of these networks in order to take this into account for future data acquisition. Specimens of various metallic materials were subjected to fatigue cracking experiment under laboratory conditions. The fractured surfaces were then imaged using various modes or detectors (such as SE, BSE and topography) in SEM, and those captured images were used to create a training data set. The relevance of the individual data for the quality of the prediction is determined by a specific combination of the different detector data. For the training, the well-established architecture of a UNet-ResNet34 with a fixed set of hyperparameters is used. It has been found in this present study that the combination of all input data significantly increases the prediction accuracy, whereby even the combination of SE and BSE data provides considerable advantages over the exclusive use of SE images.