Automated wildlife image classification: An active learning tool for ecological applications

被引:13
作者
Bothmann, Ludwig [1 ,2 ]
Wimmer, Lisa [1 ,2 ]
Charrakh, Omid [3 ]
Weber, Tobias [1 ,2 ]
Edelhoff, Hendrik [4 ]
Peters, Wibke [4 ,5 ]
Nguyen, Hien [4 ]
Benjamin, Caryl [6 ]
Menzel, Annette [6 ,7 ]
机构
[1] Ludwig Maximilians Univ Munchen, Dept Stat, Ludwigstr 33, D-80539 Munich, Germany
[2] Munich Ctr Machine Learning MCML, Ludwigstr 33, D-80539 Munich, Germany
[3] Ludwig Maximilians Univ Munchen, Munich Ctr Math Philosophy MCMP, Ludwigstr 31, D-80539 Munich, Germany
[4] Bavarian State Inst Forestry LWF, Wildlife Biol & Management Res Unit, Hans Carl von Carlowitz Pl 1, D-85354 Freising Weihenstephan, Germany
[5] Tech Univ Munich, Wildlife Biol & Management Unit, Hans Carl von Carlowitz Pl 2, D-85354 Freising Weihenstephan, Germany
[6] Tech Univ Munich, TUM Sch Life Sci, Ecoclimatol, Hans Carl von Carlowitz Pl 2, D-85354 Freising Weihenstephan, Germany
[7] TUM Inst Adv Study, Lichtenbergstr 2, D-85748 Garching, Germany
关键词
Active learning; Deep learning; European animal species; Hyperparameter tuning; Object detection; Wildlife image classification; CAMERA TRAPS; IDENTIFICATION;
D O I
10.1016/j.ecoinf.2023.102231
中图分类号
Q14 [生态学(生物生态学)];
学科分类号
071012 ; 0713 ;
摘要
Wildlife camera trap images are being used extensively to investigate animal abundance, habitat associations, and behavior, which is complicated by the fact that experts must first classify the images to retrieve relevant information. Artificial intelligence systems can take over this task but usually need a large number of already labeled training images to achieve sufficient performance. This requirement necessitates human expert labor and poses a particular challenge for projects with few cameras or short durations. We propose a label-efficient learning strategy that enables researchers with small or medium-sized image databases to leverage the potential of modern machine learning, thus freeing crucial resources for subsequent analyses.Our methodological proposal is twofold: On the one hand, we improve current strategies of combining object detection and image classification by tuning the hyperparameters of both models. On the other hand, we provide an active learning system that allows training deep learning models very efficiently in terms of required manually labeled training images. We supply a software package that enables researchers to use these methods without specific programming skills and thereby ensure the broad applicability of the proposed framework in ecological practice.We show that our tuning strategy improves predictive performance, emphasizing that tuning can and must be done separately for a new data set. We demonstrate how the active learning pipeline reduces the amount of pre labeled data needed to achieve specific predictive performance and that it is especially valuable for improving out-of-sample predictive performance.We conclude that the combination of tuning and active learning increases the predictive performance of automated image classifiers substantially. Furthermore, we argue that our work can broadly impact the community through the ready-to-use software package provided. Finally, the publication of our models tailored to European wildlife data enriches existing model bases mostly trained on data from Africa and North America.
引用
收藏
页数:14
相关论文
共 46 条
  • [1] Abadi M, 2016, PROCEEDINGS OF OSDI'16: 12TH USENIX SYMPOSIUM ON OPERATING SYSTEMS DESIGN AND IMPLEMENTATION, P265
  • [2] Auer D., 2021, INFORMATIK 2021, P547
  • [3] Beery S., 2019, ARXIV
  • [4] Recognition in Terra Incognita
    Beery, Sara
    Van Horn, Grant
    Perona, Pietro
    [J]. COMPUTER VISION - ECCV 2018, PT XVI, 2018, 11220 : 472 - 489
  • [5] Hyperparameter optimization: Foundations, algorithms, best practices, and open challenges
    Bischl, Bernd
    Binder, Martin
    Lang, Michel
    Pielok, Tobias
    Richter, Jakob
    Coors, Stefan
    Thomas, Janek
    Ullmann, Theresa
    Becker, Marc
    Boulesteix, Anne-Laure
    Deng, Difan
    Lindauer, Marius
    [J]. WILEY INTERDISCIPLINARY REVIEWS-DATA MINING AND KNOWLEDGE DISCOVERY, 2023, 13 (02)
  • [6] A computer-assisted system for photographic mark-recapture analysis
    Bolger, Douglas T.
    Morrison, Thomas A.
    Vance, Bennet
    Lee, Derek
    Farid, Hany
    [J]. METHODS IN ECOLOGY AND EVOLUTION, 2012, 3 (05): : 813 - 822
  • [7] Hyperparameter tuning of convolutional neural networks for building construction image classification
    Carvalho Ottoni, Andre Luiz
    Novo, Marcela Silva
    Costa, Dayana Bastos
    [J]. VISUAL COMPUTER, 2023, 39 (03) : 847 - 861
  • [8] Chen GB, 2014, IEEE IMAGE PROC, P858, DOI 10.1109/ICIP.2014.7025172
  • [9] Chollet F., 2015, About us
  • [10] Xception: Deep Learning with Depthwise Separable Convolutions
    Chollet, Francois
    [J]. 30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, : 1800 - 1807