Soundscape segregation based on visual analysis and discriminating features

被引:12
作者
Dias, Fabio Felix [1 ]
Pedrini, Helio [2 ]
Minghim, Rosane [1 ,3 ]
机构
[1] Univ Sao Paulo, Inst Ciencias Matemat & Comp, Av Trabalhador Sao Carlense 400, BR-13566590 Sao Carlos, SP, Brazil
[2] Univ Estadual Campinas, Inst Comp, Av Albert Einstein 1251, BR-13083852 Campinas, SP, Brazil
[3] Univ Coll Cork, Sch Comp Sci & Informat Technol, Cork, Ireland
基金
巴西圣保罗研究基金会;
关键词
Acoustic features; Spectrogram image; Image descriptors; Deep learning; Information visualization; ACOUSTIC INDEXES; CLASSIFICATION; DIVERSITY; SCALE; VISUALIZATION; RECORDINGS;
D O I
10.1016/j.ecoinf.2020.101184
中图分类号
Q14 [生态学(生物生态学)];
学科分类号
071012 ; 0713 ;
摘要
The distinction of landscapes based on their sound patterns is useful for several analyses. For instance, comparisons of audio files from different periods enable the detection of changes over time in a particular habitat, signaling events of importance, such as modifications in the balance between species and presence of new ones. The handling of a large number of different sound recordings in wild environments also reduces the set of sounds to be examined. However, the current efforts towards soundscape interpretation do not provide enough elements for researchers to automatically split soundscape datasets with degrees of similarity, thus requiring users' feedback for the grouping of highly related recordings. This work introduces a strategy for the exploration and analysis of soundscapes that highlights data characteristics related to differences and similarities among distinct soundscapes. It is based on a visual and numerical evaluation of feature spaces and was applied to three feature sets, namely acoustic indices and measurements, images from audio spectrograms depicted by classic features, and the same images depicted by features automatically generated by Deep Learning techniques. The results indicate that certain combinations of acoustic indices and measurements perform well for the discrimination task, although other feature sets have not been discarded. In addition, visual techniques were able to assist this type of analysis.
引用
收藏
页数:13
相关论文
共 70 条
[41]   Least square projection: A fast high-precision multidimensional projection technique and its application to document mapping [J].
Paulovich, Fernando V. ;
Nonato, Luis Gustavo ;
Minghim, Rosane ;
Levkowitz, Haim .
IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2008, 14 (03) :564-575
[42]   On lines and planes of closest fit to systems of points in space. [J].
Pearson, Karl .
PHILOSOPHICAL MAGAZINE, 1901, 2 (7-12) :559-572
[43]   Modeling acoustic diversity using soundscape recordings and LIDAR-derived metrics of vertical forest structure in a neotropical rainforest [J].
Pekin, Burak K. ;
Jung, Jinha ;
Villanueva-Rivera, Luis J. ;
Pijanowski, Bryan C. ;
Ahumada, Jorge A. .
LANDSCAPE ECOLOGY, 2012, 27 (10) :1513-1522
[44]  
Penatti O.A. B., 2009, Estudo comparativo de descritores para recuperacao de imagens por conteudo na web
[45]   Revealing the ecological content of long-duration audio-recordings of the environment through clustering and visualisation [J].
Phillips, Yvonne F. ;
Towsey, Michael ;
Roe, Paul .
PLOS ONE, 2018, 13 (03)
[46]   A new methodology to infer the singing activity of an avian community: The Acoustic Complexity Index (ACI) [J].
Pieretti, N. ;
Farina, A. ;
Morri, D. .
ECOLOGICAL INDICATORS, 2011, 11 (03) :868-873
[47]   What is soundscape ecology? An introduction and overview of an emerging new science [J].
Pijanowski, Bryan C. ;
Farina, Almo ;
Gage, Stuart H. ;
Dumyahn, Sarah L. ;
Krause, Bernie L. .
LANDSCAPE ECOLOGY, 2011, 26 (09) :1213-1232
[48]   Soundscape Ecology: The Science of Sound in the Landscape [J].
Pijanowski, Bryan C. ;
Villanueva-Rivera, Luis J. ;
Dumyahn, Sarah L. ;
Farina, Almo ;
Krause, Bernie L. ;
Napoletano, Brian M. ;
Gage, Stuart H. ;
Pieretti, Nadia .
BIOSCIENCE, 2011, 61 (03) :203-216
[49]   A Visualization Framework for Feature Investigation in Soundscape Recordings [J].
Reis, Clausius Duque G. ;
Santos, Thalisson Nobre ;
Oliveira, Maria Cristina F. .
2018 22ND INTERNATIONAL CONFERENCE INFORMATION VISUALISATION (IV), 2018, :490-497
[50]  
Righini Roberta, 2020, Biodiversity (Ottawa), V21, P4, DOI 10.1080/14888386.2019.1696229