3D dataset generation using virtual reality for forest biodiversity

被引:0
作者
Fol, Cyprien R. [1 ]
Shi, Nianfang [2 ]
Overney, Normand [1 ]
Murtiyoso, Arnadi [1 ]
Remondino, Fabio [3 ]
Griess, Verena C. [1 ]
机构
[1] Swiss Fed Inst Technol, Inst Terr Ecosyst, Dept Environm Syst Sci, Forest Resources Management, Zurich, Switzerland
[2] Swiss Fed Inst Technol, Dept Civil Environm & Geomat Engn, Zurich, Switzerland
[3] Bruno Kessler Fdn FBK, 3D Opt Metrol Unit 3DOM, Trento, Italy
关键词
Virtual reality; forest biodiversity; automatic segmentation; training dataset generation; tree point cloud; INVENTORY;
D O I
10.1080/17538947.2024.2422984
中图分类号
P9 [自然地理学];
学科分类号
0705 ; 070501 ;
摘要
While forest biodiversity faces a concerning decline, modern technology presents promising avenues for mitigation. However, a critical gap persists in reconciling ecological knowledge with the technical expertise required to use state-of-the-art technologies in 3D data classification. Currently, one main issue is the scarcity of 3D datasets for biodiversity, particularly within the context of machine learning applications. Unlike the straightforward classification of human-made structures, forest environments are uniquely intricate and nuanced due to its inherently complex nature. This study addresses this challenge by introducing a fully automated pipeline for tree stem 3D point cloud segmentation, focussing on a biodiversity indicator: tree-related microhabitats (TreMs). Furthermore, our research advances the field by demonstrating that machine learning models trained with labels generated by our proposed virtual reality (VR) method, Labelling Flora, yield predictions statistically similar to the traditional desktop-based labelling methods. This implies that existing 3D datasets could be augmented using the more rapid approach of VR labelling. Additionally, the findings of this paper demonstrate the potential integration of VR and immersive technology into the 3D labelling workflow, facilitating a quicker and more intuitive labelling process. This could empower users, who are non-familiar with 3D modelling, to contribute their expertise to the segmentation process.
引用
收藏
页数:17
相关论文
共 44 条
[1]  
Agrawal Dhruv, 2022, P 2022 EUR C COMP CO, DOI [10.35490/EC3.2022.174, DOI 10.35490/EC3.2022.174]
[2]   PointXR: A toolbox for visualization and subjective evaluation of point clouds in virtual reality [J].
Alexiou, Evangelos ;
Yang, Nanyang ;
Ebrahimi, Touradj .
2020 TWELFTH INTERNATIONAL CONFERENCE ON QUALITY OF MULTIMEDIA EXPERIENCE (QOMEX), 2020,
[3]   Tree species classification from complex laser scanning data in Mediterranean forests using deep learning [J].
Allen, Matthew J. ;
Grieve, Stuart W. D. ;
Owen, Harry J. F. ;
Lines, Emily R. .
METHODS IN ECOLOGY AND EVOLUTION, 2023, 14 (07) :1657-1667
[4]  
Antonelli A., 2023, State of the World's Plants and Fungi 2023, DOI [10.34885/wnwn-6s63, DOI 10.34885/WNWN-6S63]
[5]   Large-scale interactive object segmentation with human annotators [J].
Benenson, Rodrigo ;
Popov, Stefan ;
Ferrari, Vittorio .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :11692-11701
[6]   Individual tree volume estimation with terrestrial laser scanning: Evaluating reconstructive and allometric approaches [J].
Bornand, Aline ;
Rehush, Nataliia ;
Morsdorf, Felix ;
Thurig, Esther ;
Abegg, Meinrad .
AGRICULTURAL AND FOREST METEOROLOGY, 2023, 341
[7]  
Butler Rita, 2020, Field Guide to Tree-Related Microhabitats. Descriptions and Size Limits for Their Inventory
[8]  
Dal Corso Alessandro, 2017, Virtual Reality Inspection and Painting with Measured BRDFs, DOI [10.1145/3139468.3139472, DOI 10.1145/3139468.3139472]
[9]  
Doula Achref, 2022, Immersive-Labeler: Immersive Annotation of Large-Scale 3D Point Clouds in Virtual Reality, DOI [10.1145/3532719.3543249, DOI 10.1145/3532719.3543249]
[10]   TERRESTRIAL 3D MAPPING OF FORESTS: GEOREFERENCING CHALLENGES AND SENSORS COMPARISONS [J].
Fol, C. R. ;
Murtiyoso, A. ;
Kukenbrink, D. ;
Remondino, F. ;
Griess, V. C. .
2ND GEOBENCH WORKSHOP ON EVALUATION AND BENCHMARKING OF SENSORS, SYSTEMS AND GEOSPATIAL DATA IN PHOTOGRAMMETRY AND REMOTE SENSING, VOL. 48-1, 2023, :55-61