From 2D projections to the 3D rotation matrix: an attempt for finding a machine learning approach for the efficient evaluation of mechanical joining elements in X-ray computed tomography volume data

被引:1
|
作者
Schromm, T. M. [1 ]
Grosse, C. U. [1 ]
机构
[1] Tech Univ Munich, Chair Nondestruct Testing, Franz Langinger Str 10, D-81245 Munich, Germany
来源
SN APPLIED SCIENCES | 2023年 / 5卷 / 01期
关键词
Non-destructive testing; X-ray; Computed tomography; Mechanical joining; Rivets; Machine learning; Rotation; SELECTION;
D O I
10.1007/s42452-022-05220-8
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
Destructive and predominantly manual procedures are commonly used in the automotive industry for the testing of mechanical joints, such as rivets or screws. Combining X-ray computed tomography (CT) and machine learning (ML) bears the potential of a non-destructive and largely automated methodology. Assuming the desired result is a comprehensible and documentable evaluation, three basic steps need to be automatized: First, a joint must be detected and identified as such in a CT scan of the joined parts. Second, the detected region containing the joint is rotated to a predefined orientation. Third, key measures in cross-sections from the newly oriented joint are dimensioned and documented. This work deals only with the second step, the rotation. On the one hand, we present a methodology for creating a well-curated data set for the contextual machine learning application. On the other, we evaluate its performance on the well-known ResNet50. More concretely, we investigate if it is possible for a deep convolutional neural network (CNN) to learn the respective rotation matrix from three volume projections that are perpendicular to each other. Two scenarios are investigated: In one scenario we assume that future data that is presented to the network has similar rivet demographics to historic data. We therefore do not employ hold-out sets for the network evaluation. In the other scenario we assume the opposite and therefore evaluating the networks performance with hold-out sets. We show that from a machine learning point of view, a CNN like ResNet50 is well able to learn this relationship with acceptable accuracy. In most cases the validation loss dropped below 0.1 after only a couple of epochs. In one particular case, we even reached both mean and median errors lower than 0.2 for approximately 80% of the entire test set of 1600 examples using our methodology. From an application point of view, however, these low test set errors should be treated with caution since small deviations from the intended rotation matrix can cause volume warping and translation. In another case, in which we used a hold-out set, only a fraction of the median errors were below 0.2.
引用
收藏
页数:16
相关论文
共 32 条
  • [31] 3D HAND BONES AND TISSUE ESTIMATION FROM A SINGLE 2D X-RAY IMAGE VIA A TWO-STREAM DEEP NEURAL NETWORK
    Huang, Wanlin
    Wu, Wenhui
    Gong, Yuanhao
    2023 IEEE 20TH INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING, ISBI, 2023,
  • [32] Quantitative observation of the foraging tunnels in Sitka spruce and Japanese cypress caused by the drywood termite Incisitermes minor (Hagen) by 2D and 3D X-ray computer tomography (CT)
    Choi, BaekYong
    Himmi, S. Khoirul
    Yoshimura, Tsuyoshi
    HOLZFORSCHUNG, 2017, 71 (06) : 535 - 542