Point-Cloud Instance Segmentation for Spinning Laser Sensors

被引:0
作者
Casado-Coscolla, Alvaro [1 ,2 ]
Sanchez-Belenguer, Carlos [1 ]
Wolfart, Erik [1 ]
Sequeira, Vitor [1 ]
机构
[1] European Commission, Joint Research Centre (JRC), Via Enrico Fermi 2749, Ispra
[2] Instituto Universitario de Automática e Informática Industrial, Universitat Politècnica de València, Camí de Vera, València
关键词
3D data mining; 3D instance segmentation; deep learning; LiDAR;
D O I
10.3390/jimaging10120325
中图分类号
学科分类号
摘要
In this paper, we face the point-cloud segmentation problem for spinning laser sensors from a deep-learning (DL) perspective. Since the sensors natively provide their measurements in a 2D grid, we directly use state-of-the-art models designed for visual information for the segmentation task and then exploit the range information to ensure 3D accuracy. This allows us to effectively address the main challenges of applying DL techniques to point clouds, i.e., lack of structure and increased dimensionality. To the best of our knowledge, this is the first work that faces the 3D segmentation problem from a 2D perspective without explicitly re-projecting 3D point clouds. Moreover, our approach exploits multiple channels available in modern sensors, i.e., range, reflectivity, and ambient illumination. We also introduce a novel data-mining pipeline that enables the annotation of 3D scans without human intervention. Together with this paper, we present a new public dataset with all the data collected for training and evaluating our approach, where point clouds preserve their native sensor structure and where every single measurement contains range, reflectivity, and ambient information, together with its associated 3D point. As experimental results show, our approach achieves state-of-the-art results both in terms of performance and inference time. Additionally, we provide a novel ablation test that analyses the individual and combined contributions of the different channels provided by modern laser sensors. © 2024 by the authors.
引用
收藏
相关论文
共 50 条
  • [31] 3D Point Cloud Semantic Augmentation: Instance Segmentation of 360° Panoramas by Deep Learning Techniques
    Karara, Ghizlane
    Hajji, Rafika
    Poux, Florent
    REMOTE SENSING, 2021, 13 (18)
  • [32] A Convolutional Neural Network for Point Cloud Instance Segmentation in Cluttered Scene Trained by Synthetic Data Without Color
    Xu, Yajun
    Arai, Shogo
    Tokuda, Fuyuki
    Kosuge, Kazuhiro
    IEEE ACCESS, 2020, 8 : 70262 - 70269
  • [33] Mask-MCNet: Instance Segmentation in 3D Point Cloud of Intra-oral Scans
    Zanjani, Farhad Ghazvinian
    Moin, David Anssari
    Claessen, Frank
    Cherici, Teo
    Parinussa, Sarah
    Pourtaherian, Arash
    Zinger, Svitlana
    de With, Peter H. N.
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2019, PT V, 2019, 11768 : 128 - 136
  • [34] Semantic Segmentation of Lidar Point Cloud in Rural Area
    Bayu, Azady
    Wibisono, Ari
    Wisesa, Hanif Arief
    Intizhami, Naili Suri
    Jatmiko, Wisnu
    Gamal, Ahmad
    2019 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATION, NETWORKS AND SATELLITE (COMNETSAT), 2019, : 73 - 78
  • [35] A Multiscale Deep Feature for the Instance Segmentation of Water Leakages in Tunnel Using MLS Point Cloud Intensity Images
    Liu, Shuang
    Sun, Haili
    Zhang, Zhenxin
    Li, Yuqi
    Zhong, Ruofei
    Li, Jincheng
    Chen, Siyun
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [36] A Boundary-Based Ground-Point Filtering Method for Photogrammetric Point-Cloud Data
    Ayazi, Seyed Mohammad
    SaadatSeresht, Mohammad
    PHOTOGRAMMETRIC ENGINEERING AND REMOTE SENSING, 2022, 88 (09) : 583 - 591
  • [37] Pedestrian Detection from Sparse Point-Cloud using 3DCNN
    Tatebe, Yoshiki
    Deguchi, Daisuke
    Kawanishi, Yasutomo
    Ide, Ichiro
    Murase, Hiroshi
    Sakai, Utsushi
    2018 INTERNATIONAL WORKSHOP ON ADVANCED IMAGE TECHNOLOGY (IWAIT), 2018,
  • [38] Point attention network for point cloud semantic segmentation
    Ren, Dayong
    Wu, Zhengyi
    Li, Jiawei
    Yu, Piaopiao
    Guo, Jie
    Wei, Mingqiang
    Guo, Yanwen
    SCIENCE CHINA-INFORMATION SCIENCES, 2022, 65 (09)
  • [39] JS']JSMNet: Improving Indoor Point Cloud Semantic and Instance Segmentation through Self-Attention and Multiscale Fusion
    Xu, Shuochen
    Zhang, Zhenxin
    GEOSPATIAL WEEK 2023, VOL. 48-1, 2023, : 195 - 201
  • [40] IDENTIFYING ROADSIDE OBJECTS IN MOBILE LASER SCANNING DATA USING IMAGE-BASED POINT CLOUD SEGMENTATION
    Uggla, Gustaf
    Horemuz, Milan
    JOURNAL OF INFORMATION TECHNOLOGY IN CONSTRUCTION, 2020, 25 : 545 - 560