Mask-MCNet: Tooth instance segmentation in 3D point clouds of intra-oral scans

被引:36
|
作者
Zanjani, Farhad Ghazvinian [1 ]
Pourtaherian, Arash [1 ]
Zinger, Svitlana [1 ]
Moin, David Anssari [2 ]
Claessen, Frank [2 ]
Cherici, Teo [2 ]
Parinussa, Sarah [2 ]
de With, Peter H. N. [1 ]
机构
[1] Eindhoven Univ Technol, NL-5612 AJ Eindhoven, Netherlands
[2] Promaton Co Ltd, NL-1076 GR Amsterdam, Netherlands
关键词
Deep learning; 3D point cloud; Instance object segmentation; Intra-oral scan;
D O I
10.1016/j.neucom.2020.06.145
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Computational dentistry uses computerized methods and mathematical models for dental image analysis. One of the fundamental problems in computational dentistry is accurate tooth instance segmentation in high-resolution mesh data of intra-oral scans (IOS). This paper presents a new computational model based on deep neural networks, called Mask-MCNet, for end-to-end learning of tooth instance segmentation in 3D point cloud data of IOS. The proposed Mask-MCNet localizes each tooth instance by predicting its 3D bounding box and simultaneously segments the points that belong to each individual tooth instance. The proposed model processes the input raw 3D point cloud in its original spatial resolution without employing a voxelization or down-sampling technique. Such a characteristic preserves the finely detailed context in data like fine curvatures in the border between adjacent teeth and leads to a highly accurate segmentation as required for clinical practice (e.g. orthodontic planning). The experiments show that the Mask-MCNet outperforms state-of-the-art models by achieving 98% Intersection over Union (IoU) score on tooth instance segmentation which is very close to human expert performance. (c) 2021 The Authors. Published by Elsevier B.V. This is an open access article under the CC BY-NC-ND license (http://creativecommons.org/licenses/by-nc-nd/4.0/).
引用
收藏
页码:286 / 298
页数:13
相关论文
共 32 条
  • [1] Mask-MCNet: Instance Segmentation in 3D Point Cloud of Intra-oral Scans
    Zanjani, Farhad Ghazvinian
    Moin, David Anssari
    Claessen, Frank
    Cherici, Teo
    Parinussa, Sarah
    Pourtaherian, Arash
    Zinger, Svitlana
    de With, Peter H. N.
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2019, PT V, 2019, 11768 : 128 - 136
  • [2] Deep Learning Approach to Semantic Segmentation in 3D Point Cloud Intra-oral Scans of Teeth
    Zanjani, Farhad Ghazvinian
    Moin, David Anssari
    Verheij, Bas
    Claessen, Frank
    Cherici, Teo
    Tan, Tao
    de With, Peter H. N.
    INTERNATIONAL CONFERENCE ON MEDICAL IMAGING WITH DEEP LEARNING, VOL 102, 2019, 102 : 557 - 571
  • [3] 3D Tooth Instance Segmentation Learning Objectness and Affinity in Point Cloud
    Tian, Yan
    Zhang, Yujie
    Chen, Wei-Gang
    Liu, Dongsheng
    Wang, Huiyan
    Xu, Huayi
    Han, Jianfeng
    Ge, Yiwen
    ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, 2022, 18 (04)
  • [4] Two experimental methods to integrate intra-oral scans into 3D stereophotogrammetric facial images
    Schobben, Reinout R. P.
    Rangel, Frits A.
    Bruggink, Robin
    Crins-de Koning, Marjolein L. D.
    Bronkhorst, Ewald M.
    Ongkosuwito, Edwin M.
    CLINICAL ORAL INVESTIGATIONS, 2025, 29 (01)
  • [5] DENTALMODELSEG: FULLY AUTOMATED SEGMENTATION OF UPPER AND LOWER 3D INTRA-ORAL SURFACES
    Leclercq, Mathieu
    Ruellas, Antonio
    Gurgel, Marcela
    Yatabe, Marilia
    Bianchi, Jonas
    Cevidanes, Lucia
    Styner, Martin
    Paniagua, Beatriz
    Prieto, Juan Carlos
    2023 IEEE 20TH INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING, ISBI, 2023,
  • [6] Dynamic Convolution for 3D Point Cloud Instance Segmentation
    He, Tong
    Shen, Chunhua
    van den Hengel, Anton
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (05) : 5697 - 5711
  • [7] Point attention network for semantic segmentation of 3D point clouds
    Feng, Mingtao
    Zhang, Liang
    Lin, Xuefei
    Gilani, Syed Zulqarnain
    Mian, Ajmal
    PATTERN RECOGNITION, 2020, 107 (107)
  • [8] Tree Instance Segmentation in Urban 3D Point Clouds Using a Coarse-to-Fine Algorithm Based on Semantic Segmentation
    Burmeister, Josafat-Mattias
    Richter, Rico
    Reder, Stefan
    Mund, Jan-Peter
    Doellner, Jurgen
    19TH 3D GEOINFO CONFERENCE 2024, VOL. 10-4, 2024, : 79 - 86
  • [9] Tooth Defect Segmentation in 3D Mesh Scans Using Deep Learning
    Chen, Hao
    Ge, Yuhao
    Wei, Jiahao
    Xiong, Huimin
    Liu, Zuozhu
    ARTIFICIAL INTELLIGENCE, CICAI 2022, PT III, 2022, 13606 : 180 - 191
  • [10] Graph Transformer for 3D point clouds classification and semantic segmentation
    Zhou, Wei
    Wang, Qian
    Jin, Weiwei
    Shi, Xinzhe
    He, Ying
    COMPUTERS & GRAPHICS-UK, 2024, 124