Point-Cloud Instance Segmentation for Spinning Laser Sensors

被引:0
作者
Casado-Coscolla, Alvaro [1 ,2 ]
Sanchez-Belenguer, Carlos [1 ]
Wolfart, Erik [1 ]
Sequeira, Vitor [1 ]
机构
[1] European Commission, Joint Research Centre (JRC), Via Enrico Fermi 2749, Ispra
[2] Instituto Universitario de Automática e Informática Industrial, Universitat Politècnica de València, Camí de Vera, València
关键词
3D data mining; 3D instance segmentation; deep learning; LiDAR;
D O I
10.3390/jimaging10120325
中图分类号
学科分类号
摘要
In this paper, we face the point-cloud segmentation problem for spinning laser sensors from a deep-learning (DL) perspective. Since the sensors natively provide their measurements in a 2D grid, we directly use state-of-the-art models designed for visual information for the segmentation task and then exploit the range information to ensure 3D accuracy. This allows us to effectively address the main challenges of applying DL techniques to point clouds, i.e., lack of structure and increased dimensionality. To the best of our knowledge, this is the first work that faces the 3D segmentation problem from a 2D perspective without explicitly re-projecting 3D point clouds. Moreover, our approach exploits multiple channels available in modern sensors, i.e., range, reflectivity, and ambient illumination. We also introduce a novel data-mining pipeline that enables the annotation of 3D scans without human intervention. Together with this paper, we present a new public dataset with all the data collected for training and evaluating our approach, where point clouds preserve their native sensor structure and where every single measurement contains range, reflectivity, and ambient information, together with its associated 3D point. As experimental results show, our approach achieves state-of-the-art results both in terms of performance and inference time. Additionally, we provide a novel ablation test that analyses the individual and combined contributions of the different channels provided by modern laser sensors. © 2024 by the authors.
引用
收藏
相关论文
共 50 条
  • [41] JS']JSMNet: Improving Indoor Point Cloud Semantic and Instance Segmentation through Self-Attention and Multiscale Fusion
    Xu, Shuochen
    Zhang, Zhenxin
    GEOSPATIAL WEEK 2023, VOL. 48-1, 2023, : 195 - 201
  • [42] Point Instance Segmentation Considering Feature Enhancement for Lane Detection
    Zhao, Bin
    Li, Xiang
    Li, Hewei
    Chen, Chen
    Ren, Yangang
    Duan, Jingliang
    2022 41ST CHINESE CONTROL CONFERENCE (CCC), 2022, : 6793 - 6799
  • [43] DenseKPNET: Dense Kernel Point Convolutional Neural Networks for Point Cloud Semantic Segmentation
    Li, Yong
    Li, Xu
    Zhang, Zhenxin
    Shuang, Feng
    Lin, Qi
    Jiang, Jincheng
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [44] Point Cloud Validation: On the Impact of Laser Scanning Technologies on the Semantic Segmentation for BIM Modeling and Evaluation
    De Geyter, Sam
    Vermandere, Jelle
    De Winter, Heinder
    Bassier, Maarten
    Vergauwen, Maarten
    REMOTE SENSING, 2022, 14 (03)
  • [45] Point cloud semantic segmentation with adaptive spatial structure graph transformer
    Han, Ting
    Chen, Yiping
    Ma, Jin
    Liu, Xiaoxue
    Zhang, Wuming
    Zhang, Xinchang
    Wang, Huajuan
    INTERNATIONAL JOURNAL OF APPLIED EARTH OBSERVATION AND GEOINFORMATION, 2024, 133
  • [46] Instance and semantic segmentation of point clouds of large metallic truss bridges
    Lamas, Daniel
    Justo, Andre
    Soilan, Mario
    Cabaleiro, Manuel
    Riveiro, Belen
    AUTOMATION IN CONSTRUCTION, 2023, 151
  • [47] Key Points Estimation and Point Instance Segmentation Approach for Lane Detection
    Ko, Yeongmin
    Lee, Younkwan
    Azam, Shoaib
    Munir, Farzeen
    Jeon, Moongu
    Pedrycz, Witold
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2022, 23 (07) : 8949 - 8958
  • [48] Towards synthesized training data for semantic segmentation of mobile laser scanning point clouds: Generating level crossings from real and synthetic point cloud samples
    Uggla, Gustaf
    Horemuz, Milan
    AUTOMATION IN CONSTRUCTION, 2021, 130
  • [49] Addressing LiDAR overlap for Diameter at Breast Height estimation using a Point-Cloud Processing Software
    Zaragosa, Gio P.
    Paringit, Enrico C.
    Ibanez, Carlyn Ann G.
    Faelga, Regine Anne G.
    Argamosa, Reginald Jay L.
    Posilero, Mark Anthony V.
    Tandoc, Fe Andrea M.
    Malabanan, Matthew V.
    LIDAR REMOTE SENSING FOR ENVIRONMENTAL MONITORING XV, 2016, 9879
  • [50] Tree Instance Segmentation in Urban 3D Point Clouds Using a Coarse-to-Fine Algorithm Based on Semantic Segmentation
    Burmeister, Josafat-Mattias
    Richter, Rico
    Reder, Stefan
    Mund, Jan-Peter
    Doellner, Jurgen
    19TH 3D GEOINFO CONFERENCE 2024, VOL. 10-4, 2024, : 79 - 86