Soundscape segregation based on visual analysis and discriminating features

被引:12
作者
Dias, Fabio Felix [1 ]
Pedrini, Helio [2 ]
Minghim, Rosane [1 ,3 ]
机构
[1] Univ Sao Paulo, Inst Ciencias Matemat & Comp, Av Trabalhador Sao Carlense 400, BR-13566590 Sao Carlos, SP, Brazil
[2] Univ Estadual Campinas, Inst Comp, Av Albert Einstein 1251, BR-13083852 Campinas, SP, Brazil
[3] Univ Coll Cork, Sch Comp Sci & Informat Technol, Cork, Ireland
基金
巴西圣保罗研究基金会;
关键词
Acoustic features; Spectrogram image; Image descriptors; Deep learning; Information visualization; ACOUSTIC INDEXES; CLASSIFICATION; DIVERSITY; SCALE; VISUALIZATION; RECORDINGS;
D O I
10.1016/j.ecoinf.2020.101184
中图分类号
Q14 [生态学(生物生态学)];
学科分类号
071012 ; 0713 ;
摘要
The distinction of landscapes based on their sound patterns is useful for several analyses. For instance, comparisons of audio files from different periods enable the detection of changes over time in a particular habitat, signaling events of importance, such as modifications in the balance between species and presence of new ones. The handling of a large number of different sound recordings in wild environments also reduces the set of sounds to be examined. However, the current efforts towards soundscape interpretation do not provide enough elements for researchers to automatically split soundscape datasets with degrees of similarity, thus requiring users' feedback for the grouping of highly related recordings. This work introduces a strategy for the exploration and analysis of soundscapes that highlights data characteristics related to differences and similarities among distinct soundscapes. It is based on a visual and numerical evaluation of feature spaces and was applied to three feature sets, namely acoustic indices and measurements, images from audio spectrograms depicted by classic features, and the same images depicted by features automatically generated by Deep Learning techniques. The results indicate that certain combinations of acoustic indices and measurements perform well for the discrimination task, although other feature sets have not been discarded. In addition, visual techniques were able to assist this type of analysis.
引用
收藏
页数:13
相关论文
共 70 条
[1]  
[Anonymous], 2011, DIGITAL IMAGE PROCES
[2]  
[Anonymous], 1978, MULTIDIMENSIONAL SCA
[3]  
[Anonymous], 2015, INTERACTIVE DATA VIS
[4]  
[Anonymous], 2014, UNDERSTANDING MACHIN, DOI DOI 10.1017/CBO9781107298019
[5]  
Mezquida DA, 2009, SPAN J AGRIC RES, V7, P824
[6]   Multi-trophic invasion resistance in Hawaii: Bioacoustics, field surveys, and airborne remote sensing [J].
Boelman, Natalie T. ;
Asner, Gregory P. ;
Hart, Patrick J. ;
Martin, Roberta E. .
ECOLOGICAL APPLICATIONS, 2007, 17 (08) :2137-2144
[7]   Guidelines for the use of acoustic indices in environmental research [J].
Bradfer-Lawrence, Tom ;
Gardner, Nick ;
Bunnefeld, Lynsey ;
Bunnefeld, Nils ;
Willis, Stephen G. ;
Dent, Daisy H. .
METHODS IN ECOLOGY AND EVOLUTION, 2019, 10 (10) :1796-1807
[8]   Acoustic classification of multiple simultaneous bird species: A multi-instance multi-label approach [J].
Briggs, Forrest ;
Lakshminarayanan, Balaji ;
Neal, Lawrence ;
Fern, Xiaoli Z. ;
Raich, Raviv ;
Hadley, Sarah J. K. ;
Hadley, Adam S. ;
Betts, Matthew G. .
JOURNAL OF THE ACOUSTICAL SOCIETY OF AMERICA, 2012, 131 (06) :4640-4650
[9]   Automatic rain and cicada chorus filtering of bird acoustic data [J].
Brown, Alexander ;
Garg, Saurabh ;
Montgomery, James .
APPLIED SOFT COMPUTING, 2019, 81
[10]  
Chi EH., 2002, FRAMEWORK VISUALIZAT