SEMANTIC SEGMENTATION OF INDOOR POINT CLOUDS USING CONVOLUTIONAL NEURAL NETWORK

被引:14
作者
Babacan, K. [1 ]
Chen, L. [1 ]
Sohn, G. [1 ]
机构
[1] York Univ Toronto, Dept Earth & Space Sci & Engn, N York, ON M3J 1P3, Canada
来源
4TH INTERNATIONAL GEOADVANCES WORKSHOP - GEOADVANCES 2017: ISPRS WORKSHOP ON MULTI-DIMENSIONAL & MULTI-SCALE SPATIAL DATA MODELING | 2017年 / 4-4卷 / W4期
关键词
Indoor Modelling; Semantic Segmentation; Mobile Laser; Point Cloud; Deep Learning; Convolutional Neural Network; 3D RECONSTRUCTION;
D O I
10.5194/isprs-annals-IV-4-W4-101-2017
中图分类号
P9 [自然地理学];
学科分类号
0705 ; 070501 ;
摘要
As Building Information Modelling (BIM) thrives, geometry becomes no longer sufficient; an ever increasing variety of semantic information is needed to express an indoor model adequately. On the other hand, for the existing buildings, automatically generating semantically enriched BIM from point cloud data is in its infancy. The previous research to enhance the semantic content rely on frameworks in which some specific rules and/or features that are hand coded by specialists. These methods immanently lack generalization and easily break in different circumstances. On this account, a generalized framework is urgently needed to automatically and accurately generate semantic information. Therefore we propose to employ deep learning techniques for the semantic segmentation of point clouds into meaningful parts. More specifically, we build a volumetric data representation in order to efficiently generate the high number of training samples needed to initiate a convolutional neural network architecture. The feedforward propagation is used in such a way to perform the classification in voxel level for achieving semantic segmentation. The method is tested both for a mobile laser scanner point cloud, and a larger scale synthetically generated data. We also demonstrate a case study, in which our method can be effectively used to leverage the extraction of planar surfaces in challenging cluttered indoor environments.
引用
收藏
页码:101 / 108
页数:8
相关论文
共 50 条
[31]   A Category-Contrastive Guided-Graph Convolutional Network Approach for the Semantic Segmentation of Point Clouds [J].
Wang, Xuzhe ;
Yang, Juntao ;
Kang, Zhizhong ;
Du, Junjian ;
Tao, Zhaotong ;
Qiao, Dan .
IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2023, 16 :3715-3729
[32]   Application of semantic segmentation based on convolutional neural network in medical images [J].
Wu Y. ;
Lin L. ;
Wang J. ;
Wu S. .
Shengwu Yixue Gongchengxue Zazhi/Journal of Biomedical Engineering, 2020, 37 (03) :533-540
[33]   Generalized Sparse Convolutional Neural Networks for Semantic Segmentation of Point Clouds Derived from Tri-Stereo Satellite Imagery [J].
Bachhofner, Stefan ;
Loghin, Ana-Maria ;
Otepka, Johannes ;
Pfeifer, Norbert ;
Hornacek, Michael ;
Siposova, Andrea ;
Schmidinger, Niklas ;
Hornik, Kurt ;
Schiller, Nikolaus ;
Kaehler, Olaf ;
Hochreiter, Ronald .
REMOTE SENSING, 2020, 12 (08)
[34]   Deep convolutional neural networks for semantic segmentation of cracks [J].
Wang, Jia-Ji ;
Liu, Yu-Fei ;
Nie, Xin ;
Mo, Y. L. .
STRUCTURAL CONTROL & HEALTH MONITORING, 2022, 29 (01)
[35]   Point attention network for point cloud semantic segmentation [J].
Ren, Dayong ;
Wu, Zhengyi ;
Li, Jiawei ;
Yu, Piaopiao ;
Guo, Jie ;
Wei, Mingqiang ;
Guo, Yanwen .
SCIENCE CHINA-INFORMATION SCIENCES, 2022, 65 (09)
[36]   Point attention network for point cloud semantic segmentation [J].
Dayong Ren ;
Zhengyi Wu ;
Jiawei Li ;
Piaopiao Yu ;
Jie Guo ;
Mingqiang Wei ;
Yanwen Guo .
Science China Information Sciences, 2022, 65
[37]   A geometry-aware attention network for semantic segmentation of MLS point clouds [J].
Wan, Jie ;
Xu, Yongyang ;
Qiu, Qinjun ;
Xie, Zhong .
INTERNATIONAL JOURNAL OF GEOGRAPHICAL INFORMATION SCIENCE, 2023, 37 (01) :138-161
[38]   Semantic segmentation of multimodal point clouds from the railway context [J].
Dibari, P. ;
Nitti, M. ;
Maglietta, R. ;
Castellano, G. ;
Dimauro, G. ;
Reno, V .
MULTIMODAL SENSING AND ARTIFICIAL INTELLIGENCE: TECHNOLOGIES AND APPLICATIONS II, 2021, 11785
[39]   On the contextual aspects of using deep convolutional neural network for semantic image segmentation [J].
Wang, Chunlai ;
Mauch, Lukas ;
Saxena, Mehul Manoj ;
Yang, Bin .
JOURNAL OF ELECTRONIC IMAGING, 2018, 27 (05)
[40]   Automated semantic segmentation of industrial point clouds using ResPointNet plus [J].
Yin, Chao ;
Wang, Boyu ;
Gan, Vincent J. L. ;
Wang, Mingzhu ;
Cheng, Jack C. P. .
AUTOMATION IN CONSTRUCTION, 2021, 130