Accurate estimation of 6-DoF tooth pose in 3D intraoral scans for dental applications using deep learning

被引:0
|
作者
Ding, Wanghui [1 ]
Sun, Kaiwei [2 ]
Yu, Mengfei [1 ]
Lin, Hangzheng [2 ]
Feng, Yang [3 ]
Li, Jianhua [4 ]
Liu, Zuozhu [1 ,2 ]
机构
[1] Zhejiang Univ, Stomatol Hosp, Canc Ctr Zhejiang Univ, Engn Res Ctr Oral Biomat & Devices Zhejiang Prov,S, Hangzhou 310000, Peoples R China
[2] Zhejiang Univ, Univ Illinois, Urbana Champaign Inst, Haining 314400, Peoples R China
[3] Angel Align Inc, Shanghai 200433, Peoples R China
[4] Hangzhou Dent Hosp, Hangzhou 310006, Peoples R China
基金
中国国家自然科学基金;
关键词
Artificial intelligence; Digital dentistry; Deep learning; Orthodontics; Tooth pose; Neural network;
D O I
10.1631/FITEE.2300596
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
A critical step in digital dentistry is to accurately and automatically characterize the orientation and position of individual teeth, which can subsequently be used for treatment planning and simulation in orthodontic tooth alignment. This problem remains challenging because the geometric features of different teeth are complicated and vary significantly, while a reliable large-scale dataset is yet to be constructed. In this paper we propose a novel method for automatic tooth orientation estimation by formulating it as a six-degree-of-freedom (6-DoF) tooth pose estimation task. Regarding each tooth as a three-dimensional (3D) point cloud, we design a deep neural network with a feature extractor backbone and a two-branch estimation head for tooth pose estimation. Our model, trained with a novel loss function on the newly collected large-scale dataset (10 393 patients with 280 611 intraoral tooth scans), achieves an average Euler angle error of only 4.780 degrees-5.979 degrees and a translation L1 error of 0.663 mm on a hold-out set of 2598 patients (77 870 teeth). Comprehensive experiments show that 98.29% of the estimations produce a mean angle error of less than 15 degrees, which is acceptable for many clinical and industrial applications.
引用
收藏
页码:1240 / 1249
页数:10
相关论文
共 50 条
  • [21] 3D Pose Estimation of Robot Arm with RGB Images Based on Deep Learning
    Zhou, Fan
    Chi, Zijing
    Zhuang, Chungang
    Ding, Han
    INTELLIGENT ROBOTICS AND APPLICATIONS, ICIRA 2019, PT IV, 2019, 11743 : 541 - 553
  • [22] Deep Manifold Embedding for 3D Object Pose Estimation
    Ninomiya, Hiroshi
    Kawanishi, Yasutomo
    Deguchi, Daisuke
    Ide, Ichiro
    Murase, Hiroshi
    Kobori, Norimasa
    Nakano, Yusuke
    PROCEEDINGS OF THE 12TH INTERNATIONAL JOINT CONFERENCE ON COMPUTER VISION, IMAGING AND COMPUTER GRAPHICS THEORY AND APPLICATIONS (VISIGRAPP 2017), VOL 5, 2017, : 173 - 178
  • [23] Automatic Tooth Segmentation from 3D Dental Model using Deep Learning: A Quantitative Analysis of what can be learnt from a Single 3D Dental Model
    Jana, Ananya
    Subhas, Hrebesh Molly
    Metaxas, Dimitris
    18TH INTERNATIONAL SYMPOSIUM ON MEDICAL INFORMATION PROCESSING AND ANALYSIS, 2023, 12567
  • [24] Head pose estimation using deep neural networks and 3D point clouds
    Xu, Yuanquan
    Jung, Cheolkon
    Chang, Yakun
    PATTERN RECOGNITION, 2022, 121
  • [25] Deep learning-based real-time 3D human pose estimation
    Zhang, Xiaoyan
    Zhou, Zhengchun
    Han, Ying
    Meng, Hua
    Yang, Meng
    Rajasegarar, Sutharshan
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2023, 119
  • [26] A Comprehensive Study on Deep Learning-Based 3D Hand Pose Estimation Methods
    Chatzis, Theocharis
    Stergioulas, Andreas
    Konstantinidis, Dimitrios
    Dimitropoulos, Kosmas
    Daras, Petros
    APPLIED SCIENCES-BASEL, 2020, 10 (19): : 1 - 27
  • [27] Learning to Augment Poses for 3D Human Pose Estimation in Images and Videos
    Zhang, Jianfeng
    Gong, Kehong
    Wang, Xinchao
    Feng, Jiashi
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (08) : 10012 - 10026
  • [28] Maximum-Margin Structured Learning with Deep Networks for 3D Human Pose Estimation
    Li, Sijin
    Zhang, Weichen
    Chan, Antoni B.
    INTERNATIONAL JOURNAL OF COMPUTER VISION, 2017, 122 (01) : 149 - 168
  • [29] Maximum-Margin Structured Learning with Deep Networks for 3D Human Pose Estimation
    Sijin Li
    Weichen Zhang
    Antoni B. Chan
    International Journal of Computer Vision, 2017, 122 : 149 - 168
  • [30] Assessment of the handcart pushing and pulling safety by using deep learning 3D pose estimation and IoT force sensors
    Vukicevic, Arso M.
    Macuzic, Ivan
    Mijailovic, Nikola
    Peulic, Aleksandar
    Radovic, Milos
    EXPERT SYSTEMS WITH APPLICATIONS, 2021, 183