PiPCS: Perspective Independent Point Cloud Simplifier for Complex 3D Indoor Scenes

被引:0
|
作者
Ebrahimi, Ali [1 ]
Czarnuch, Stephen [1 ,2 ]
机构
[1] Mem Univ Newfoundland, Fac Engn & Appl Sci, Dept Elect & Comp Engn, St John, NF A1C 5S7, Canada
[2] Mem Univ Newfoundland, Fac Med, Discipline Emergency Med, St John, NF A1C 5S7, Canada
来源
IEEE ACCESS | 2024年 / 12卷
基金
加拿大自然科学与工程研究理事会;
关键词
Three-dimensional displays; Point cloud compression; Image color analysis; Computational modeling; Adaptation models; Lighting; Computer vision; Indoor environment; 3D background subtraction; 3D foreground segmentation; 3D indoor scene perception; indoor point cloud simplification; indoor point cloud preprocessing; point cloud size reduction; REAL-TIME TRACKING; BACKGROUND SUBTRACTION; OPTIMIZATION APPROACH; NEURAL-NETWORKS; OBJECT MAPS; SEGMENTATION; DEPTH; SEPARATION; EFFICIENT; GRADIENT;
D O I
10.1109/ACCESS.2024.3452633
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The emergence of commercially accessible depth sensors has driven the widespread adoption of 3D data, offering substantial benefits across diverse applications, ranging from human activity recognition to augmented reality. However, indoor environments present significant challenges for 3D computer vision applications, particularly in cluttered and dynamic scenes where background bounding surfaces hinder the detection and analysis of foreground objects. We introduce a novel perspective-independent point cloud simplifier (PiPCS) for complex 3D indoor scenes. PiPCS streamlines 3D computer vision workflows by contextually segmenting and subtracting background bounding surfaces and preserving segmented foreground objects within indoor scenes, effectively reducing the size of indoor point clouds and enhancing 3D indoor scene perception. Methodologically, we use estimated surface normals to intelligently divide an input point cloud into distinct zones, which are then split into multiple distinct parallel clusters. Next, we find the largest plane in each cluster and sort the fitted planes within each zone based on their distance along the zone's normal vector to identify the bounding surfaces. Finally, we segment the 3D background, simplify the point cloud by employing a voxel-based background subtraction technique, and segment 3D foreground objects via a cluster-based segmentation approach. We evaluated PiPCS on the Stanford S3DIS dataset and our own challenging dataset, achieving average values of 97.08% for specificity and 91.27% for F1 score on the S3DIS dataset and size reductions averaging 74.11% overall. Our experimental and evaluation results demonstrate that PiPCS robustly simplifies and reduces the size of unorganized indoor point clouds.
引用
收藏
页码:126983 / 127006
页数:24
相关论文
共 50 条
  • [21] Learning 3D Shape Latent for Point Cloud Completion
    Chen, Zhikai
    Long, Fuchen
    Qiu, Zhaofan
    Yao, Ting
    Zhou, Wengang
    Luo, Jiebo
    Mei, Tao
    IEEE TRANSACTIONS ON MULTIMEDIA, 2024, 26 : 8717 - 8729
  • [22] No-Reference Quality Assessment for 3D Colored Point Cloud and Mesh Models
    Zhang, Zicheng
    Sun, Wei
    Min, Xiongkuo
    Wang, Tao
    Lu, Wei
    Zhai, Guangtao
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2022, 32 (11) : 7618 - 7631
  • [23] A Measurement Model for Aquatic Animals Based on Instance Segmentation and 3D Point Cloud
    He, Zhiqian
    Xu, Xiaoqing
    Luo, Jialu
    Chen, Ziwen
    Song, Weibo
    Cao, Lijie
    Huo, Zhongming
    IEEE ACCESS, 2024, 12 : 156208 - 156223
  • [24] Unsupervised discovery of 3D structural elements for scanned indoor scenes
    Antic, Milos
    Zdesar, Andrej
    Iglesias, Jose Antonio
    Sanchis, Araceli
    Skrjanc, Igor
    APPLIED SOFT COMPUTING, 2025, 170
  • [25] Deep learning based 3D target detection for indoor scenes
    Liu, Ying
    Jiang, Du
    Xu, Chao
    Sun, Ying
    Jiang, Guozhang
    Tao, Bo
    Tong, Xiliang
    Xu, Manman
    Li, Gongfa
    Yun, Juntong
    APPLIED INTELLIGENCE, 2023, 53 (09) : 10218 - 10231
  • [26] LinK3D: Linear Keypoints Representation for 3D LiDAR Point Cloud
    Cui, Yunge
    Zhang, Yinlong
    Dong, Jiahua
    Sun, Haibo
    Chen, Xieyuanli
    Zhu, Feng
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2024, 9 (03) : 2128 - 2135
  • [27] Points2Sound: from mono to binaural audio using 3D point cloud scenes
    Lluis, Francesc
    Chatziioannou, Vasileios
    Hofmann, Alex
    EURASIP JOURNAL ON AUDIO SPEECH AND MUSIC PROCESSING, 2022, 2022 (01)
  • [28] Imperceptible Transfer Attack and Defense on 3D Point Cloud Classification
    Liu, Daizong
    Hu, Wei
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (04) : 4727 - 4746
  • [29] Rethinking Masked Representation Learning for 3D Point Cloud Understanding
    Wang, Chuxin
    Zha, Yixin
    He, Jianfeng
    Yang, Wenfei
    Zhang, Tianzhu
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2025, 34 : 247 - 262
  • [30] An Adaptive Invariant EKF for Map-Aided Localization Using 3D Point Cloud
    Tao, Zhongxing
    Xue, Jianru
    Wang, Di
    Li, Gengxin
    Fang, Jianwu
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2022, 23 (12) : 24057 - 24070