TinyChirp: Bird Song Recognition Using TinyML Models on Low-power Wireless Acoustic Sensors

被引:2
作者
Huang, Z. [1 ]
Tousnakhoff, A. [1 ]
Kozyr, P. [2 ]
Rehausen, R. [3 ]
Biessmann, F. [2 ,5 ]
Lachlan, R. [4 ]
Adjih, C. [6 ]
Baccelli, E. [1 ,6 ]
机构
[1] Free Univ Berlin, Berlin, Germany
[2] Berlin Univ Appl Sci, Berlin, Germany
[3] Woks Audio GmbH, Berlin, Germany
[4] Royal Holloway Univ London, Egham, England
[5] Einstein Ctr Digital Future, Berlin, Germany
[6] INRIA, Paris, France
来源
2024 IEEE 5TH INTERNATIONAL SYMPOSIUM ON THE INTERNET OF SOUNDS, IS2 2024 | 2024年
关键词
TinyML; Microcontroller; Acoustic Sensors; Machine Learning; CLASSIFICATION;
D O I
10.1109/IS262782.2024.10704131
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Monitoring biodiversity at scale is challenging. Detecting and identifying species in fine grained taxonomies requires highly accurate machine learning (ML) methods. Training such models requires large high quality data sets. And deploying these models to low power devices requires novel compression techniques and model architectures. While species classification methods have profited from novel data sets and advances in ML methods, in particular neural networks, deploying these state-of-the-art models to low power devices remains difficult. Here we present a comprehensive empirical comparison of various tinyML neural network architectures and compression techniques for species classification. We focus on the example of bird song detection, and more concretely on a data set curated for studying the corn bunting bird species. We publish the data set along with all the code and experiments of this study. In our experiments we comparatively evaluate predictive performance, memory and time complexity of spectrogram-based methods and of more recent approaches operating directly on the raw audio signal. Our results demonstrate that TinyChirp our approach can robustly detect individual bird species with precisions over 0.98 and reduce energy consumption compared to state-of-the-art, such that an autonomous recording unit lifetime on a single battery charge is extended from 2 weeks to 8 weeks, almost an entire season.
引用
收藏
页码:74 / 83
页数:10
相关论文
共 50 条
[1]   End-to-end environmental sound classification using a 1D convolutional neural network [J].
Abdoli, Sajjad ;
Cardinal, Patrick ;
Koerich, Alessandro Lameiras .
EXPERT SYSTEMS WITH APPLICATIONS, 2019, 136 :252-263
[2]   Smart Buildings: Water Leakage Detection Using TinyML [J].
Atanane, Othmane ;
Mourhir, Asmaa ;
Benamar, Nabil ;
Zennaro, Marco .
SENSORS, 2023, 23 (22)
[3]   RIOT: An Open Source Operating System for Low-End Embedded Devices in the IoT [J].
Baccelli, Emmanuel ;
Gundogan, Cenk ;
Hahm, Oliver ;
Kietzmann, Peter ;
Lenders, Martine S. ;
Petersen, Hauke ;
Schleiser, Kaspar ;
Schmidt, Thomas C. ;
Waehlisch, Matthias .
IEEE INTERNET OF THINGS JOURNAL, 2018, 5 (06) :4428-4440
[4]  
Banbury C.R., 2020, arXiv, DOI 10.48550/arXiv.2003.04821
[5]  
Banbury Colby., 2021, Mlperf tiny benchmark
[6]  
Bormann C., 2014, TERMINOLOGY CONSTRAI, DOI [10.17487/rfc7228, DOI 10.17487/RFC7228]
[7]  
Busia P, 2024, Arxiv, DOI arXiv:2402.10748
[8]  
Chen TQ, 2018, PROCEEDINGS OF THE 13TH USENIX SYMPOSIUM ON OPERATING SYSTEMS DESIGN AND IMPLEMENTATION, P579
[9]   Reducing Energy Consumption and Health Hazards of Electric Liquid Mosquito Repellents through TinyML [J].
Choi, Inyeop ;
Kim, Hyogon .
SENSORS, 2022, 22 (17)
[10]   Birdsong Detection at the Edge with Deep Learning [J].
Disabato, Simone ;
Canonaco, Giuseppe ;
Flikkema, Paul G. ;
Roveri, Manuel ;
Alippi, Cesare .
2021 IEEE INTERNATIONAL CONFERENCE ON SMART COMPUTING (SMARTCOMP 2021), 2021, :9-16