Multistage strategy for ground point filtering on large-scale datasets

被引:0
作者
Paredes, Diego Teijeiro [1 ]
Lopez, Margarita Amor [1 ]
Bujan, Sandra [2 ]
Richter, Rico [3 ]
Doellner, Juergen [3 ]
机构
[1] Univ A Coruna, Fac Informat, Dept Ingn Comp, Comp Arquitecture Grp,CITIC,Lab 1 2, Campus Elvina s-n, La Coruna 15071, Spain
[2] Univ Leon, Dept Tecnol Minera Topog & Estruct, Leon, Spain
[3] Univ Potsdam, Hasso Plattner Inst, Fac Digital Engn, Potsdam, Germany
关键词
LiDAR point clouds; Landscape identification; Ground filtering; Apache spark; LIDAR DATA; CLASSIFICATION; CLOUD; SEGMENTATION; EXTRACTION; ALGORITHMS;
D O I
10.1007/s11227-024-06406-0
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Ground point filtering on national-level datasets is a challenge due to the presence of multiple types of landscapes. This limitation does not simply affect to individual users, but it is in particular relevant for those national institutions in charge of providing national-level Light Detection and Ranging (LiDAR) point clouds. Each type of landscape is typically better filtered by different filtering algorithms or parameters; therefore, in order to get the best quality classification, the LiDAR point cloud should be divided by the landscape before running the filtering algorithms. Despite the fact that the manual segmentation and identification of the landscapes can be very time intensive, only few studies have addressed this issue. In this work, we present a multistage approach to automate the identification of the type of landscape using several metrics extracted from the LiDAR point cloud, matching the best filtering algorithms in each type of landscape. An additional contribution is presented, a parallel implementation for distributed memory systems, using Apache Spark, that can achieve up to 34x\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$34\times$$\end{document} of speedup using 12 compute nodes.
引用
收藏
页码:25974 / 26001
页数:28
相关论文
共 50 条
  • [31] Develop and implement unsupervised learning through hybrid FFPA clustering in large-scale datasets
    Somase, Kiran Pandurang
    Imambi, S. Sagar
    SOFT COMPUTING, 2021, 25 (01) : 277 - 290
  • [32] Automatic segmentation of large-scale CT image datasets for detailed body composition analysis
    Nouman Ahmad
    Robin Strand
    Björn Sparresäter
    Sambit Tarai
    Elin Lundström
    Göran Bergström
    Håkan Ahlström
    Joel Kullberg
    BMC Bioinformatics, 24
  • [33] Automated ground filtering of LiDAR and UAS point clouds with metaheuristics
    Yilmaz, Volkan
    OPTICS AND LASER TECHNOLOGY, 2021, 138
  • [34] Comparative Analysis of Skew-Join Strategies for Large-Scale Datasets with MapReduce and Spark
    Phan, Anh-Cang
    Phan, Thuong-Cang
    Cao, Hung-Phi
    Trieu, Thanh-Ngoan
    APPLIED SCIENCES-BASEL, 2022, 12 (13):
  • [35] Retrieval From and Understanding of Large-Scale Multi-modal Medical Datasets: A Review
    Mueller, Henning
    Unay, Devrim
    IEEE TRANSACTIONS ON MULTIMEDIA, 2017, 19 (09) : 2093 - 2104
  • [36] Synchronization clustering based on central force optimization and its extension for large-scale datasets
    Hang, Wenlong
    Choi, Kup-Sze
    Wang, Shitong
    KNOWLEDGE-BASED SYSTEMS, 2017, 118 : 31 - 44
  • [37] FFS-VA: A Fast Filtering System for Large-scale Video Analytics
    Zhang, Chen
    Cao, Qiang
    Jiang, Hong
    Zhang, Wenhui
    Li, Jingjun
    Yao, Jie
    PROCEEDINGS OF THE 47TH INTERNATIONAL CONFERENCE ON PARALLEL PROCESSING, 2018,
  • [38] Large-Scale Accurate Reconstruction of Buildings Employing Point Clouds Generated from UAV Imagery
    Malihi, Shirin
    Zoej, Mohammad Javad Valadan
    Hahn, Michael
    REMOTE SENSING, 2018, 10 (07):
  • [39] Large-Scale ALS Point Cloud Segmentation via Projection-Based Context Embedding
    Dai, Hengming
    Hu, Xiangyun
    Zhang, Jinming
    Shu, Zhen
    Xu, Jiabo
    Du, Juan
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62 : 1 - 16
  • [40] A Survey on Processing of Large-Scale 3D Point Cloud
    Liu, Xinying
    Meng, Weiliang
    Guo, Jianwei
    Zhang, Xiaopeng
    E-LEARNING AND GAMES, 2016, 9654 : 267 - 279