Multistage strategy for ground point filtering on large-scale datasets

被引:0
作者
Paredes, Diego Teijeiro [1 ]
Lopez, Margarita Amor [1 ]
Bujan, Sandra [2 ]
Richter, Rico [3 ]
Doellner, Juergen [3 ]
机构
[1] Univ A Coruna, Fac Informat, Dept Ingn Comp, Comp Arquitecture Grp,CITIC,Lab 1 2, Campus Elvina s-n, La Coruna 15071, Spain
[2] Univ Leon, Dept Tecnol Minera Topog & Estruct, Leon, Spain
[3] Univ Potsdam, Hasso Plattner Inst, Fac Digital Engn, Potsdam, Germany
关键词
LiDAR point clouds; Landscape identification; Ground filtering; Apache spark; LIDAR DATA; CLASSIFICATION; CLOUD; SEGMENTATION; EXTRACTION; ALGORITHMS;
D O I
10.1007/s11227-024-06406-0
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Ground point filtering on national-level datasets is a challenge due to the presence of multiple types of landscapes. This limitation does not simply affect to individual users, but it is in particular relevant for those national institutions in charge of providing national-level Light Detection and Ranging (LiDAR) point clouds. Each type of landscape is typically better filtered by different filtering algorithms or parameters; therefore, in order to get the best quality classification, the LiDAR point cloud should be divided by the landscape before running the filtering algorithms. Despite the fact that the manual segmentation and identification of the landscapes can be very time intensive, only few studies have addressed this issue. In this work, we present a multistage approach to automate the identification of the type of landscape using several metrics extracted from the LiDAR point cloud, matching the best filtering algorithms in each type of landscape. An additional contribution is presented, a parallel implementation for distributed memory systems, using Apache Spark, that can achieve up to 34x\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$34\times$$\end{document} of speedup using 12 compute nodes.
引用
收藏
页码:25974 / 26001
页数:28
相关论文
共 50 条
  • [41] A Multistage Very Large-Scale Neighborhood Search for the Vehicle Routing Problem with Soft Time Windows
    Mouthuy, Sebastien
    Massen, Florence
    Deville, Yves
    Van Hentenryck, Pascal
    TRANSPORTATION SCIENCE, 2015, 49 (02) : 223 - 238
  • [42] Distributed learning strategy based on chips for classification with large-scale dataset
    Yang, Bo
    Su, Xiaohong
    Wang, Yadong
    INTERNATIONAL JOURNAL OF PATTERN RECOGNITION AND ARTIFICIAL INTELLIGENCE, 2007, 21 (05) : 899 - 920
  • [43] FNNS: An Effective Feedforward Neural Network Scheme with Random Weights for Processing Large-Scale Datasets
    Zhang, Zhao
    Feng, Feng
    Huang, Tingting
    APPLIED SCIENCES-BASEL, 2022, 12 (23):
  • [44] RETRACTED: Large-Scale Textual Datasets and Deep Learning for the Prediction of Depressed Symptoms (Retracted Article)
    Chakraborty, Sudeshna
    Mahdi, Hussain Falih
    Al-Abyadh, Mohammed Hasan Ali
    Pant, Kumud
    Sharma, Aditi
    Ahmadi, Fardin
    COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE, 2022, 2022
  • [45] GROUND FILTERING LiDAR DATA BASED ON MULTI-SCALE ANALYSIS OF HEIGHT DIFFERENCE THRESHOLD
    Rashidi, Pejman
    Rastiveis, Heidar
    ISPRS INTERNATIONAL JOINT CONFERENCES OF THE 2ND GEOSPATIAL INFORMATION RESEARCH (GI RESEARCH 2017); THE 4TH SENSORS AND MODELS IN PHOTOGRAMMETRY AND REMOTE SENSING (SMPR 2017); THE 6TH EARTH OBSERVATION OF ENVIRONMENTAL CHANGES (EOEC 2017), 2017, 42-4 (W4): : 225 - 229
  • [46] GaitRec, a large-scale ground reaction force dataset of healthy and impaired gait
    Horsak, Brian
    Slijepcevic, Djordje
    Raberger, Anna-Maria
    Schwab, Caterine
    Worisch, Marianne
    Zeppelzauer, Matthias
    SCIENTIFIC DATA, 2020, 7 (01)
  • [47] Particle filtering methods for stochastic optimization with application to large-scale empirical risk minimization
    Liu, Bin
    KNOWLEDGE-BASED SYSTEMS, 2020, 193
  • [48] Fuzzy Filtering in Large-Scale Prediction of Intrinsically Disordered Regions of Proteins on Apache Spark
    Malysiak-Mrozek, Bozena
    Bozek, Lukasz
    Mrozek, Dariusz
    2021 IEEE CONGRESS ON EVOLUTIONARY COMPUTATION (CEC 2021), 2021, : 1020 - 1027
  • [49] Resources Allocation for Large-Scale Dynamic Spectrum Access System Using Particle Filtering
    Ben Ghorbel, Mahdi
    Khalfi, Bassem
    Hamdaoui, Bechir
    Guizani, Mohsen
    2014 GLOBECOM WORKSHOPS (GC WKSHPS), 2014, : 219 - 224
  • [50] Context-Aware Network for Semantic Segmentation Toward Large-Scale Point Clouds in Urban Environments
    Liu, Chun
    Zeng, Doudou
    Akbar, Akram
    Wu, Hangbin
    Jia, Shoujun
    Xu, Zeran
    Yue, Han
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60