Non-Contact Vibro-Acoustic Object Recognition Using Laser Doppler Vibrometry and Convolutional Neural Networks

被引:4
作者
Darwish, Abdel [1 ]
Halkon, Benjamin [1 ]
Oberst, Sebastian [1 ]
机构
[1] Univ Technol Sydney, Ctr Audio Acoust & Vibrat, Ultimo, NSW 2007, Australia
关键词
vibratory response; vibro-acoustic classification; acoustic fingerprint; non-contact excitation; transfer learning; deep learning;
D O I
10.3390/s22239360
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Laser Doppler vibrometers (LDVs) have been widely adopted due to their large number of benefits in comparison to traditional contacting vibration transducers. Their high sensitivity, among other unique characteristics, has also led to their use as optical microphones, where the measurement of object vibration in the vicinity of a sound source can act as a microphone. Recent work enabling full correction of LDV measurement in the presence of sensor head vibration unlocks new potential applications, including integration within autonomous vehicles (AVs). In this paper, the common AV challenge of object classification is addressed by presenting and evaluating a novel, non-contact vibro-acoustic object recognition technique. This technique utilises a custom set-up involving a synchronised loudspeaker and scanning LDV to simultaneously remotely solicit and record responses to a periodic chirp excitation in various objects. The 864 recorded signals per object were pre-processed into spectrograms of various forms, which were used to train a ResNet-18 neural network via transfer learning to accurately recognise the objects based only on their vibro-acoustic characteristics. A five-fold cross-validation optimisation approach is described, through which the effects of data set size and pre-processing type on classification accuracy are assessed. A further assessment of the ability of the CNN to classify never-before-seen objects belonging to groups of similar objects on which it has been trained is then described. In both scenarios, the CNN was able to obtain excellent classification accuracy of over 99.7%. The work described here demonstrates the significant promise of such an approach as a viable non-contact object recognition technique suitable for various machine automation tasks, for example, defect detection in production lines or even loose rock identification in underground mines.
引用
收藏
页数:20
相关论文
共 44 条
  • [1] A Review of Deep Learning Based Methods for Acoustic Scene Classification
    Abesser, Jakob
    [J]. APPLIED SCIENCES-BASEL, 2020, 10 (06):
  • [2] [Anonymous], 2020, ImageNette
  • [3] A review of vibration-based damage detection in civil structures: From traditional methods to Machine Learning and Deep Learning applications
    Avci, Onur
    Abdeljaber, Osama
    Kiranyaz, Serkan
    Hussein, Mohammed
    Gabbouj, Moncef
    Inman, Daniel J.
    [J]. MECHANICAL SYSTEMS AND SIGNAL PROCESSING, 2021, 147
  • [4] Brink A., 2007, P 4 INT SEMINAR DEEP
  • [5] Laser Doppler Vibrometry: Development of advanced solutions answering to technology's needs
    Castellini, P.
    Martarelli, M.
    Tomasini, E. P.
    [J]. MECHANICAL SYSTEMS AND SIGNAL PROCESSING, 2006, 20 (06) : 1265 - 1285
  • [6] Chen CL, 2016, 2016 IEEE INTERNATIONAL CONFERENCE ON SIMULATION, MODELING, AND PROGRAMMING FOR AUTONOMOUS ROBOTS (SIMPAR), P43, DOI 10.1109/SIMPAR.2016.7862373
  • [7] Machine-Learning-Based Methods for Acoustic Emission Testing: A Review
    Ciaburro, Giuseppe
    Iannace, Gino
    [J]. APPLIED SCIENCES-BASEL, 2022, 12 (20):
  • [8] Improving Smart Cities Safety Using Sound Events Detection Based on Deep Neural Network Algorithms
    Ciaburro, Giuseppe
    Iannace, Gino
    [J]. INFORMATICS-BASEL, 2020, 7 (03):
  • [9] Courville S.W., 2019, Lunar and Planetary Science Conference, V39, P697
  • [10] Speckle noise attenuation in orbital laser vibrometer seismology
    Courville, Samuel W.
    Sava, Paul C.
    [J]. ACTA ASTRONAUTICA, 2020, 172 : 16 - 32