Windy events detection in big bioacoustics datasets using a pre-trained Convolutional Neural Network

被引:0
|
作者
Terranova, Francesca [1 ]
Betti, Lorenzo [2 ]
Ferrario, Valeria [1 ,3 ]
Friard, Olivier [1 ]
Ludynia, Katrin [4 ,5 ]
Petersen, Gavin Sean [4 ]
Mathevon, Nicolas [6 ,7 ,8 ]
Reby, David [6 ,7 ]
Favaro, Livio [1 ,9 ]
机构
[1] Univ Turin, Dept Life Sci & Syst Biol, Turin, Italy
[2] Cent European Univ, Dept Network & Data Sci, Vienna, Austria
[3] Chester Zoo, Caughall Rd, Chester, England
[4] Southern African Fdn Conservat Coastal Birds SANCC, Cape Town, South Africa
[5] Univ Western Cape, Dept Biodivers & Conservat Biol, Robert Sobukwe Rd, Bellville, South Africa
[6] Univ St Etienne, ENES Bioacoust Res Lab, CRNL, CNRS,Inserm, St Etienne, France
[7] Inst Univ France, Minist Higher Educ Res & Innovat, 1 rue Descartes, Paris, France
[8] PSL Univ, Ecole Prat Hautes Etud, CHArt lab, Paris, France
[9] Stn Zool Anton Dohrn, Naples, Italy
关键词
Bioacoustics; Deep learning; Ecoacoustics; Passive Acoustic Monitoring; Soundscape ecology; Wind-noise; ACOUSTIC INDEXES; TEMPERATE; KAPPA;
D O I
10.1016/j.scitotenv.2024.174868
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
Passive Acoustic Monitoring (PAM), which involves using autonomous record units for studying wildlife behaviour and distribution, often requires handling big acoustic datasets collected over extended periods. While these data offer invaluable insights about wildlife, their analysis can present challenges in dealing with geophonic sources. A major issue in the process of detection of target sounds is represented by wind-induced noise. This can lead to false positive detections, i.e., energy peaks due to wind gusts misclassified as biological sounds, or false negative, i.e., the wind noise masks the presence of biological sounds. Acoustic data dominated by wind noise makes the analysis of vocal activity unreliable, thus compromising the detection of target sounds and, subsequently, the interpretation of the results. Our work introduces a straightforward approach for detecting recordings affected by windy events using a pre-trained convolutional neural network. This process facilitates identifying wind-compromised data. We consider this dataset pre-processing crucial for ensuring the reliable use of PAM data. We implemented this preprocessing by leveraging YAMNet, a deep learning model for sound classification tasks. We evaluated YAMNet as-is ability to detect wind-induced noise and tested its performance in a Transfer Learning scenario by using our annotated data from the Stony Point Penguin Colony in South Africa. While the classification of YAMNet as-is achieved a precision of 0.71, and recall of 0.66, those metrics strongly improved after the training on our annotated dataset, reaching a precision of 0.91, and recall of 0.92, corresponding to a relative increment of >28 %. Our study demonstrates the promising application of YAMNet in the bioacoustics and ecoacoustics fields, addressing the need for wind-noise-free acoustic data. We released an open-access code that, combined with the efficiency and peak performance of YAMNet, can be used on standard laptops for a broad user base.
引用
收藏
页数:12
相关论文
共 50 条
  • [21] Scanned ECG Arrhythmia Classification Using a Pre-trained Convolutional Neural Network as a Feature Extractor
    Aldosari, Hanadi
    Coenen, Frans
    Lip, Gregory Y. H.
    Zheng, Yalin
    ARTIFICIAL INTELLIGENCE XXXIX, AI 2022, 2022, 13652 : 64 - 80
  • [22] Practical Consideration in using Pre-Trained Convolutional Neural Network (CNN) for Finger Vein Biometric
    Safie, Sairul Izwan
    Khalid, Puteri Zarina Megat
    COMMUNICATIONS ON PURE AND APPLIED ANALYSIS, 2023, 19 (02) : 163 - 175
  • [23] Diagnosing Cervical Cell Images Using Pre-trained Convolutional Neural Network as Feature Extractor
    Hyeon, Jonghwan
    Choi, Ho-Jin
    Lee, Byung Doo
    Lee, Kap No
    2017 IEEE INTERNATIONAL CONFERENCE ON BIG DATA AND SMART COMPUTING (BIGCOMP), 2017, : 390 - 393
  • [24] Practical Consideration in using Pre-Trained Convolutional Neural Network (CNN) for Finger Vein Biometric
    Safie, Sairul Izwan
    Khalid, Puteri Zarina Megat
    INTERNATIONAL JOURNAL OF ONLINE AND BIOMEDICAL ENGINEERING, 2023, 19 (02) : 163 - 175
  • [25] Classification of Pistachio Varieties Using Pre-trained Architectures and a Proposed Convolutional Neural Network Model
    Idress, Khaled Adil Dawood
    Oztekin, Yesim Benal
    Gadalla, Omsalma Alsadig Adam
    Baitu, Geofrey Prudence
    15TH INTERNATIONAL CONGRESS ON AGRICULTURAL MECHANIZATION AND ENERGY IN AGRICULTURE, ANKAGENG 2023, 2024, 458 : 148 - 163
  • [26] Automated Classification of Urinary Cells: Using Convolutional Neural Network Pre-trained on Lung Cells
    Teramoto, Atsushi
    Michiba, Ayano
    Kiriyama, Yuka
    Sakurai, Eiko
    Shiroki, Ryoichi
    Tsukamoto, Tetsuya
    APPLIED SCIENCES-BASEL, 2023, 13 (03):
  • [27] Abnormality Detection in Cardiac Signals using Pseudo Wigner-Ville Distribution with Pre-trained Convolutional Neural Network
    Zulfiqar, Manahil
    Butt, Muhammad Fasih Uddin
    Ramay, Asma
    Shafi, Imran
    2019 13TH INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING AND COMMUNICATION SYSTEMS (ICSPCS), 2019,
  • [28] Classification of Deepfake Videos Using Pre-trained Convolutional Neural Networks
    Masood, MomMa
    Nawaz, Marriam
    Javed, Ali
    Nazir, Tahira
    Mehmood, Awais
    Mahum, Rabbia
    2021 INTERNATIONAL CONFERENCE ON DIGITAL FUTURES AND TRANSFORMATIVE TECHNOLOGIES (ICODT2), 2021,
  • [29] Automatic variogram inference using pre-trained Convolutional Neural Networks
    Karim, Mokdad
    Behrang, Koushavand
    Jeff, Boisvert
    APPLIED COMPUTING AND GEOSCIENCES, 2025, 25
  • [30] Classification of Freshwater Zooplankton by Pre-trained Convolutional Neural Network in Underwater Microscopy
    Hong, Song
    Mehdi, Syed Raza
    Huang, Hui
    Shahani, Kamran
    Zhang, Yangfang
    Junaidullah
    Raza, Kazim
    Khan, Mushtaq Ali
    INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2020, 11 (07) : 252 - 258