Semantic Segmentation of 3D Point Cloud to Virtually Manipulate Real Living Space

被引：9

作者：

Ishikawa, Yuki ^{[1
]}

Hachiuma, Ryo ^{[1
]}

Ienaga, Naoto ^{[1
]}

Kuno, Wakaba ^{[1
]}

Sugiura, Yuta ^{[1
]}

Saito, Hideo ^{[1
]}

机构：

[1] Keio Univ, Yokohama, Kanagawa, Japan

来源：

2019 12TH ASIA PACIFIC WORKSHOP ON MIXED AND AUGMENTED REALITY (APMAR) | 2019年

关键词：

furniture arrangement; semantic segmentation; virtual reality;

D O I：

10.1109/apmar.2019.8709156

中图分类号：

TP301 [理论、方法];

学科分类号：

081202 ;

摘要：

This paper presents a method for the virtual manipulation of real living space using semantic segmentation of a 3D point cloud captured in the real world. We applied PointNet to segment each piece of furniture from the point cloud of a real indoor environment captured by moving a RGBD camera. For semantic segmentation, we focused on local geometric information not used in PointNet, and we proposed a method to refine the class probability of labels attached to each point in PointNet's output. The effectiveness of our method was experimentally confirmed. We then created 3D models of real-world furniture using a point cloud with corrected labels, and we virtually manipulated real living space using Dollhouse VR, a layout system.

引用

页码：63 / 69

页数：7

共 50 条

[21] A Depth Image Fusion Network for 3D Point Cloud Semantic Segmentation
Wang, Zhou
Jia, Zixi
Lyu, Ao
Wang, Yating
Sun, Changsheng
Liu, Yongxin
2019 9TH IEEE ANNUAL INTERNATIONAL CONFERENCE ON CYBER TECHNOLOGY IN AUTOMATION, CONTROL, AND INTELLIGENT SYSTEMS (IEEE-CYBER 2019), 2019, : 849 - 853
[22] Improving Point Cloud Semantic Segmentation by Learning 3D Object Detection
Unal, Ozan
Van Gool, Luc
Dai, Dengxin
2021 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION WACV 2021, 2021, : 2949 - 2958
[23] Semantic segmentation of 3D point cloud based on contextual attention CNN
Yang J.
Dang J.
Tongxin Xuebao/Journal on Communications, 2020, 41 (07): : 195 - 203
[24] Annotation Tool and Urban Dataset for 3D Point Cloud Semantic Segmentation
Ibrahim, Muhammad
Akhtar, Naveed
Wise, Michael
Mian, Ajmal
IEEE ACCESS, 2021, 9 : 35984 - 35996
[25] Rethinking Few-shot 3D Point Cloud Semantic Segmentation
An, Zhaochong
Sun, Guolei
Liu, Yun
Liu, Fayao
Wu, Zongwei
Wang, Dan
Van Gool, Luc
Belongie, Serge
2024 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2024, 2024, : 3996 - 4006
[26] 3D Point Cloud Semantic Segmentation Through Functional Data Analysis
De La Fuente, Manuel Oviedo
Cabo, Carlos
Roca-Pardinas, Javier
Loudermilk, E. Louise
Ordonez, Celestino
JOURNAL OF AGRICULTURAL BIOLOGICAL AND ENVIRONMENTAL STATISTICS, 2024, 29 (04) : 723 - 744
[27] Joint Semantic and Instance Segmentation in 3D Point Cloud Based on Transformer
Liu, Suyi
Wu, Chengdong
Xu, Fang
Wang, Juxiang
Chi, Jianning
Yu, Xiaosheng
2023 35TH CHINESE CONTROL AND DECISION CONFERENCE, CCDC, 2023, : 4074 - 4080
[28] 3d indoor point cloud semantic segmentation using image and voxel
Yeom S.-S.
Ha J.-E.
Ha, Jong-Eun (jeha@seoultech.ac.kr), 1600, Institute of Control, Robotics and Systems (27): : 1000 - 1007
[29] SHREC 2020: 3D point cloud semantic segmentation for street scenes
Ku, Tao
Veltkamp, Remco C.
Boom, Bas
Duque-Arias, David
Velasco-Forero, Santiago
Deschaud, Jean-Emmanuel
Goulette, Francois
Marcotegui, Beatriz
Ortega, Sebastian
Trujillo, Agustin
Pablo Suarez, Jose
Miguel Santana, Jose
Ramirez, Cristian
Akadas, Kiran
Gangisetty, Shankar
COMPUTERS & GRAPHICS-UK, 2020, 93 : 13 - 24
[30] Real-time reconstructing of orchard obstacles by fusing semantic segmentation and 3D point cloud analysis
Lin, Guichao
Xu, Yao
Zeng, Wenyong
Wang, Minglong
Yin, Ruihan
Ding, Lixing
Zhu, Lixue
Nongye Gongcheng Xuebao/Transactions of the Chinese Society of Agricultural Engineering, 2024, 40 (16): : 180 - 187

← 1 2 3 4 5 →