PiPCS: Perspective Independent Point Cloud Simplifier for Complex 3D Indoor Scenes

被引:0
作者
Ebrahimi, Ali [1 ]
Czarnuch, Stephen [1 ,2 ]
机构
[1] Mem Univ Newfoundland, Fac Engn & Appl Sci, Dept Elect & Comp Engn, St John, NF A1C 5S7, Canada
[2] Mem Univ Newfoundland, Fac Med, Discipline Emergency Med, St John, NF A1C 5S7, Canada
来源
IEEE ACCESS | 2024年 / 12卷
基金
加拿大自然科学与工程研究理事会;
关键词
Three-dimensional displays; Point cloud compression; Image color analysis; Computational modeling; Adaptation models; Lighting; Computer vision; Indoor environment; 3D background subtraction; 3D foreground segmentation; 3D indoor scene perception; indoor point cloud simplification; indoor point cloud preprocessing; point cloud size reduction; REAL-TIME TRACKING; BACKGROUND SUBTRACTION; OPTIMIZATION APPROACH; NEURAL-NETWORKS; OBJECT MAPS; SEGMENTATION; DEPTH; SEPARATION; EFFICIENT; GRADIENT;
D O I
10.1109/ACCESS.2024.3452633
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The emergence of commercially accessible depth sensors has driven the widespread adoption of 3D data, offering substantial benefits across diverse applications, ranging from human activity recognition to augmented reality. However, indoor environments present significant challenges for 3D computer vision applications, particularly in cluttered and dynamic scenes where background bounding surfaces hinder the detection and analysis of foreground objects. We introduce a novel perspective-independent point cloud simplifier (PiPCS) for complex 3D indoor scenes. PiPCS streamlines 3D computer vision workflows by contextually segmenting and subtracting background bounding surfaces and preserving segmented foreground objects within indoor scenes, effectively reducing the size of indoor point clouds and enhancing 3D indoor scene perception. Methodologically, we use estimated surface normals to intelligently divide an input point cloud into distinct zones, which are then split into multiple distinct parallel clusters. Next, we find the largest plane in each cluster and sort the fitted planes within each zone based on their distance along the zone's normal vector to identify the bounding surfaces. Finally, we segment the 3D background, simplify the point cloud by employing a voxel-based background subtraction technique, and segment 3D foreground objects via a cluster-based segmentation approach. We evaluated PiPCS on the Stanford S3DIS dataset and our own challenging dataset, achieving average values of 97.08% for specificity and 91.27% for F1 score on the S3DIS dataset and size reductions averaging 74.11% overall. Our experimental and evaluation results demonstrate that PiPCS robustly simplifies and reduces the size of unorganized indoor point clouds.
引用
收藏
页码:126983 / 127006
页数:24
相关论文
共 50 条
  • [31] Efficient 3D Mapping and Modelling of Indoor Scenes with the Microsoft HoloLens: A Survey
    Weinmann, Martin
    Wursthorn, Sven
    Weinmann, Michael
    Huebner, Patrick
    PFG-JOURNAL OF PHOTOGRAMMETRY REMOTE SENSING AND GEOINFORMATION SCIENCE, 2021, 89 (04): : 319 - 333
  • [32] Preprocessing and Transmission for 3D Point Cloud Data
    Wang, Zunran
    Yang, Chenguang
    Ju, Zhaojie
    Li, Zhijun
    Su, Chun-Yi
    INTELLIGENT ROBOTICS AND APPLICATIONS, ICIRA 2017, PT I, 2017, 10462 : 438 - 449
  • [33] Defect Characterization on Complex Shape Aeronautical Parts via 3D Point Cloud Processing
    Dzakovic, Marija
    Jovancevic, Igor
    Dosljak, Velibor
    Orteu, Jean-Jose
    2024 13TH MEDITERRANEAN CONFERENCE ON EMBEDDED COMPUTING, MECO 2024, 2024, : 218 - 222
  • [34] Performance and Challenges of 3D Object Detection Methods in Complex Scenes for Autonomous Driving
    Wang, Ke
    Zhou, Tianqiang
    Li, Xingcan
    Ren, Fan
    IEEE TRANSACTIONS ON INTELLIGENT VEHICLES, 2023, 8 (02): : 1699 - 1716
  • [35] Point Cloud Quality Assessment via 3D Edge Similarity Measurement
    Lu, Zian
    Huang, Hailiang
    Zeng, Huanqiang
    Hou, Junhui
    Ma, Kai-Kuang
    IEEE SIGNAL PROCESSING LETTERS, 2022, 29 : 1804 - 1808
  • [36] Recurrent Diffusion for 3D Point Cloud Generation From a Single Image
    Zhou, Yan
    Ye, Dewang
    Zhang, Huaidong
    Xu, Xuemiao
    Sun, Huajie
    Xu, Yewen
    Liu, Xiangyu
    Zhou, Yuexia
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2025, 34 : 1753 - 1765
  • [37] iBA: Backdoor Attack on 3D Point Cloud via Reconstructing Itself
    Bian, Yuhao
    Tian, Shengjing
    Liu, Xiuping
    IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY, 2024, 19 : 7994 - 8008
  • [38] Linking Points With Labels in 3D: A Review of Point Cloud Semantic Segmentation
    Xie, Yuxing
    Tian, Jiaojiao
    Zhu, Xiao Xiang
    IEEE GEOSCIENCE AND REMOTE SENSING MAGAZINE, 2020, 8 (04) : 38 - 59
  • [39] QBB: Quantile-Based Binarization of 3D Point Cloud Descriptors
    Varga, Daniel
    Szalai-Gindl, Janos Mark
    Ambrus-Dobai, Marton
    Laki, Sandor
    IEEE ACCESS, 2022, 10 : 67839 - 67850
  • [40] Quality Judgment of 3D Face Point Cloud Based on Feature Fusion
    Gao, Gong
    Liu, Hong
    Yang, Hongyu
    IEEE ACCESS, 2022, 10 : 106513 - 106519