Birdsong classification based on multi-feature fusion

被引:19
|
作者
Yan, Na [1 ]
Chen, Aibin [1 ,3 ]
Zhou, Guoxiong [1 ]
Zhang, Zhiqiang [2 ]
Liu, Xiangyong [4 ]
Wang, Jianwu [5 ]
Liu, Zhihua [1 ]
Chen, Wenjie [1 ]
机构
[1] Cent South Univ Forestry & Technol, Coll Comp & Informat Engn, Inst Artificial Intelligence Applicat, Changsha, Peoples R China
[2] Cent South Univ Forestry & Technol, Coll Forestry, Wildlife Conservat & Utilizat Lab, Changsha, Peoples R China
[3] Cent South Univ Forestry & Technol, Coll Life Sci & Technol, Hunan Prov Key Lab Urban Forest Ecol, Changsha, Peoples R China
[4] Hunan Zixing Artificial Intelligence Res Acad, Hunan Zixing, Peoples R China
[5] HuangFengQiao State Owned Forest Farm, Youxian Cty, Hunan, Peoples R China
关键词
Birdsong classification; Acoustic feature; Feature fusion; 3DCNN-LSTM; NEURAL-NETWORKS; RECOGNITION; SOUNDS; MFCC;
D O I
10.1007/s11042-021-11396-9
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The classification of birdsong has very important signification to monitor the bird population in the habitats. Aiming at the birdsong dataset with complex and diverse audio background, this paper attempts to introduce an acoustic feature for voice and music analysis: Chroma. It is spliced and fused with the commonly used birdsong features, Log-Mel Spectrogram (LM) and Mel Frequency Cepstrum Coefficient (MFCC), to enrich the representational capacity of single feature; At the same time, in view of the characteristic that birdsong has continuous and dynamic changes in time, a 3DCNN-LSTM combined model is proposed as a classifier to make the network more sensitive to the birdsong information that changes with time. In this paper, we selected four bird audio data from the Xeno-Canto website to evaluate how LM, MFCC and Chroma were fused to maximize the birdsong audio information. The experimental results show that the LM-MFCC-C feature combination achieves the best result of 97.9% mean average precision (mAP) in the experiment.
引用
收藏
页码:36529 / 36547
页数:19
相关论文
共 50 条
  • [21] An Image Classification Method Based On Multi-feature Fusion and Multi-kernel SVM
    Xiang, Zixi
    Lv, Xueqiang
    Zhang, Kai
    2014 SEVENTH INTERNATIONAL SYMPOSIUM ON COMPUTATIONAL INTELLIGENCE AND DESIGN (ISCID 2014), VOL 2, 2014,
  • [22] Hyperspectral Image Classification Based on Dense Pyramidal Convolution and Multi-Feature Fusion
    Zhang, Junsan
    Zhao, Li
    Jiang, Hongzhao
    Shen, Shigen
    Wang, Jian
    Zhang, Peiying
    Zhang, Wei
    Wang, Leiquan
    REMOTE SENSING, 2023, 15 (12)
  • [23] Multilingual Pretrained based Multi-feature Fusion Model for English Text Classification
    Zhang, Ruijuan
    COMPUTER SCIENCE AND INFORMATION SYSTEMS, 2025, 22 (01) : 133 - 152
  • [24] Point Cloud Classification Based on Offset Attention Mechanism and Multi-Feature Fusion
    Tian S.
    Song L.
    Zhao K.
    Huanan Ligong Daxue Xuebao/Journal of South China University of Technology (Natural Science), 2024, 52 (01): : 100 - 109
  • [25] A Multi-Feature Fusion Based on Transfer Learning for Chicken Embryo Eggs Classification
    Huang, Lvwen
    He, Along
    Zhai, Mengqun
    Wang, Yuxi
    Bai, Ruige
    Nie, Xiaolin
    SYMMETRY-BASEL, 2019, 11 (05):
  • [26] Research on Long Text Classification Model Based on Multi-Feature Weighted Fusion
    Yue, Xi
    Zhou, Tao
    He, Lei
    Li, Yuxia
    APPLIED SCIENCES-BASEL, 2022, 12 (13):
  • [27] Research on arrhythmia classification algorithm based on adaptive multi-feature fusion network
    Huang, Mengmeng
    Jiang, Mingfeng
    Li, Yang
    He, Xiaoyu
    Wang, Zefeng
    Wu, Yongquan
    Ke, Wei
    Shengwu Yixue Gongchengxue Zazhi/Journal of Biomedical Engineering, 2025, 42 (01): : 49 - 56
  • [28] HSRRS Classification Method Based on Deep Transfer Learning And Multi-Feature Fusion
    Wang, Ziteng
    Li, Zhaojie
    Wang, Yu
    Li, Wenmei
    Yang, Jie
    Ohtsuki, Tomoaki
    2021 IEEE 94TH VEHICULAR TECHNOLOGY CONFERENCE (VTC2021-FALL), 2021,
  • [29] Classification of Thyroid Standard Planes in Ultrasound Images based on Multi-feature Fusion
    Wang, Jing
    Liu, Peizhong
    PROCEEDINGS OF 2019 IEEE 13TH INTERNATIONAL CONFERENCE ON ANTI-COUNTERFEITING, SECURITY, AND IDENTIFICATION (IEEE-ASID'2019), 2019, : 75 - 79
  • [30] A Classification Approach for University English Teaching Resources Based on Multi-Feature Fusion
    Liu Y.
    Applied Mathematics and Nonlinear Sciences, 2024, 9 (01)