Mask-MCNet: Tooth instance segmentation in 3D point clouds of intra-oral scans

被引:36
|
作者
Zanjani, Farhad Ghazvinian [1 ]
Pourtaherian, Arash [1 ]
Zinger, Svitlana [1 ]
Moin, David Anssari [2 ]
Claessen, Frank [2 ]
Cherici, Teo [2 ]
Parinussa, Sarah [2 ]
de With, Peter H. N. [1 ]
机构
[1] Eindhoven Univ Technol, NL-5612 AJ Eindhoven, Netherlands
[2] Promaton Co Ltd, NL-1076 GR Amsterdam, Netherlands
关键词
Deep learning; 3D point cloud; Instance object segmentation; Intra-oral scan;
D O I
10.1016/j.neucom.2020.06.145
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Computational dentistry uses computerized methods and mathematical models for dental image analysis. One of the fundamental problems in computational dentistry is accurate tooth instance segmentation in high-resolution mesh data of intra-oral scans (IOS). This paper presents a new computational model based on deep neural networks, called Mask-MCNet, for end-to-end learning of tooth instance segmentation in 3D point cloud data of IOS. The proposed Mask-MCNet localizes each tooth instance by predicting its 3D bounding box and simultaneously segments the points that belong to each individual tooth instance. The proposed model processes the input raw 3D point cloud in its original spatial resolution without employing a voxelization or down-sampling technique. Such a characteristic preserves the finely detailed context in data like fine curvatures in the border between adjacent teeth and leads to a highly accurate segmentation as required for clinical practice (e.g. orthodontic planning). The experiments show that the Mask-MCNet outperforms state-of-the-art models by achieving 98% Intersection over Union (IoU) score on tooth instance segmentation which is very close to human expert performance. (c) 2021 The Authors. Published by Elsevier B.V. This is an open access article under the CC BY-NC-ND license (http://creativecommons.org/licenses/by-nc-nd/4.0/).
引用
收藏
页码:286 / 298
页数:13
相关论文
共 32 条
  • [21] Learning local contextual features for 3D point clouds semantic segmentation by attentive kernel convolution
    Tong, Guofeng
    Shao, Yuyuan
    Peng, Hao
    VISUAL COMPUTER, 2024, 40 (02) : 831 - 847
  • [22] Mining local geometric structure for large-scale 3D point clouds semantic segmentation
    Shao, Yuyuan
    Tong, Guofeng
    Peng, Hao
    NEUROCOMPUTING, 2022, 500 : 191 - 202
  • [23] Learning local contextual features for 3D point clouds semantic segmentation by attentive kernel convolution
    Guofeng Tong
    Yuyuan Shao
    Hao Peng
    The Visual Computer, 2024, 40 (2) : 831 - 847
  • [24] A Prior Level Fusion Approach for the Semantic Segmentation of 3D Point Clouds Using Deep Learning
    Ballouch, Zouhair
    Hajji, Rafika
    Poux, Florent
    Kharroubi, Abderrazzaq
    Billen, Roland
    REMOTE SENSING, 2022, 14 (14)
  • [25] Sparse 3D Point Clouds Segmentation Considering 2D Image Feature Extraction with Deep Learning
    Li, Yusheng
    Tian, Yong
    Tian, Jiandong
    ELEVENTH INTERNATIONAL CONFERENCE ON DIGITAL IMAGE PROCESSING (ICDIP 2019), 2019, 11179
  • [26] DEEP LEARNING-BASED ROAD SEGMENTATION OF 3D POINT CLOUDS FOR ASSISTING ROAD ALIGNMENT PARAMETERIZATION
    Soilan, M.
    Tardy, H.
    Gonzalez-Aguileral, D.
    XXIV ISPRS CONGRESS IMAGING TODAY, FORESEEING TOMORROW, COMMISSION II, 2022, 43-B2 : 283 - 290
  • [27] Boosting plant-part segmentation of cucumber plants by enriching incomplete 3D point clouds with spectral data
    Boogaard, Frans P.
    van Henten, Eldert J.
    Kootstra, Gert
    BIOSYSTEMS ENGINEERING, 2021, 211 (211) : 167 - 182
  • [28] Semantic Segmentation of 3D Tooth Model Based on GCNN for CBCT Simulated Mouth Scan Point Cloud Data
    Zhang Y.
    Yu Z.
    He B.
    Jisuanji Fuzhu Sheji Yu Tuxingxue Xuebao/Journal of Computer-Aided Design and Computer Graphics, 2020, 32 (07): : 1162 - 1170
  • [29] 3D Semantic Segmentation of Large-Scale Point-Clouds in Urban Areas Using Deep Learning
    Lowphansirikul, Chakri
    Kim, Kyoung-Sook
    Vinayaraj, Poliyapram
    Tuarob, Suppawong
    2019 11TH INTERNATIONAL CONFERENCE ON KNOWLEDGE AND SMART TECHNOLOGY (KST), 2019, : 238 - 243
  • [30] 3D Semantic Segmentation for High-resolution Aerial Survey Derived Point Clouds using Deep Learning (Demonstration)
    Xiu, Haoyi
    Vinayaraj, Poliyapram
    Kim, Kyoung-Sook
    Nakarnural, Ryosuke
    Yan, Wanglin
    26TH ACM SIGSPATIAL INTERNATIONAL CONFERENCE ON ADVANCES IN GEOGRAPHIC INFORMATION SYSTEMS (ACM SIGSPATIAL GIS 2018), 2018, : 588 - 591