Accelerated forest modeling from tree canopy point clouds via deep learning

被引:1
作者
Xu, Jiabo [1 ]
Zhang, Zhili [1 ]
Hu, Xiangyun [1 ,2 ]
Ke, Tao [1 ,2 ]
机构
[1] Wuhan Univ, Sch Remote Sensing & Informat Engn, Wuhan 430079, Hubei, Peoples R China
[2] Wuhan Univ, Hubei Luojia Lab, Wuhan 430079, Hubei, Peoples R China
关键词
Canopy point cloud; Tree modeling; Deep learning; Procedural models; Graph neural network; Forest reconstruction; VIRTUAL CLIMBING PLANTS;
D O I
10.1016/j.jag.2024.104074
中图分类号
TP7 [遥感技术];
学科分类号
081102 ; 0816 ; 081602 ; 083002 ; 1404 ;
摘要
Rapid generation of tree models from point clouds of tree canopies holds wide-ranging applications in the field of earth sciences, including forest ecology research, environmental monitoring, and forest management. Traditional tree modeling methods rely on procedural models to simulate tree growth, which are timeconsuming due to their extensive manual parameterization. Furthermore, existing deep learning methods struggle to generate visually realistic tree models because of the complex branch structures and specific natural patterns of trees. To address these challenges, this paper proposes a novel deep learning-based method for rapidly generating tree models that align with the shape of the tree canopy. Different from traditional methods, we use deep neural networks to build branch graphs for generating tree models. Our method consists of two main steps: i) the 3D coordinates of each tree node are generated from the canopy point cloud by the designed node coordinate generation network; ii) a graph neural network is proposed to predict node attributes and the adjacency relationship between nodes. To form the tree structure, the discrete nodes are connected by using the minimum spanning tree algorithm combined with the adjacency relationship. The attributes of the node include width, whether it is a leaf node, and leaf node size, which are used for subsequent construction of the tree's mesh. To validate the effectiveness of our proposed method, a large-scale dataset containing 10 forests with 3216 tree canopies is constructed and open sourced for the study of generating tree models from point clouds of tree canopies. Experimental results demonstrate our method's efficiency in generating tree models quickly (reducing the average canopy-to-tree reconstruction time from 7 min to less than 0.5 s) while preserving visual authenticity and accurately matching tree canopy shapes, making it suitable for a wide range of forest reconstructions.
引用
收藏
页数:16
相关论文
共 50 条
  • [1] Tree Classification in Complex Forest Point Clouds Based on Deep Learning
    Zou, Xinhuai
    Cheng, Ming
    Wang, Cheng
    Xia, Yan
    Li, Jonathan
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2017, 14 (12) : 2360 - 2364
  • [2] Efficient tree modeling from airborne LiDAR point clouds
    Hu, Shaojun
    Li, Zhengrong
    Zhang, Zhiyi
    He, Dongjian
    Wimmer, Michael
    COMPUTERS & GRAPHICS-UK, 2017, 67 : 1 - 13
  • [3] DEEP LEARNING FOR FOREST CANOPY HEIGHT ESTIMATION FROM SAR
    Mahesh, Ragini Bal
    Haensch, Ronny
    IGARSS 2023 - 2023 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, 2023, : 5672 - 5675
  • [4] Modeling Fabric-Type Actuator Using Point Clouds by Deep Learning
    Peng, Yanhong
    Yamaguchi, Hiroki
    Funabora, Yuki
    Doki, Shinji
    IEEE ACCESS, 2022, 10 : 94363 - 94375
  • [5] Using Synthetic Tree Data in Deep Learning-Based Tree Segmentation Using LiDAR Point Clouds
    Bryson, Mitch
    Wang, Feiyu
    Allworth, James
    REMOTE SENSING, 2023, 15 (09)
  • [6] Tree Species Classification from UAV Canopy Images with Deep Learning Models
    Huang, Yunmei
    Ou, Botong
    Meng, Kexin
    Yang, Baijian
    Carpenter, Joshua
    Jung, Jinha
    Fei, Songlin
    REMOTE SENSING, 2024, 16 (20)
  • [7] Tree Completion Net: A Novel Vegetation Point Clouds Completion Model Based on Deep Learning
    Ge, Binfu
    Chen, Shengyi
    He, Weibing
    Qiang, Xiaoyong
    Li, Jingmei
    Teng, Geer
    Huang, Fang
    REMOTE SENSING, 2024, 16 (20)
  • [8] Deep Learning-Based Automation of Scan-to-BIM with Modeling Objects from Occluded Point Clouds
    Park, Junwoo
    Kim, Jaehong
    Lee, Dongyeop
    Jeong, Kwangbok
    Lee, Jaewook
    Kim, Hakpyeong
    Hong, Taehoon
    JOURNAL OF MANAGEMENT IN ENGINEERING, 2022, 38 (04)
  • [9] A joint deep learning network of point clouds and multiple views for roadside object classification from lidar point clouds
    Fang, Lina
    You, Zhilong
    Shen, Guixi
    Chen, Yiping
    Li, Jianrong
    ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2022, 193 : 115 - 136
  • [10] TREE SPECIES CLASSIFICATION OF POINT CLOUDS FROM DIFFERENT LASER SENSORS USING THE POINTNET plus plus DEEP LEARNING METHOD
    Liu, Bingjie
    Huang, Huaguo
    Chen, Shuxin
    Tian, Xin
    Ren, Min
    IGARSS 2023 - 2023 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, 2023, : 1565 - 1568