Accurate estimation of 6-DoF tooth pose in 3D intraoral scans for dental applications using deep learning

被引:0
|
作者
Ding, Wanghui [1 ]
Sun, Kaiwei [2 ]
Yu, Mengfei [1 ]
Lin, Hangzheng [2 ]
Feng, Yang [3 ]
Li, Jianhua [4 ]
Liu, Zuozhu [1 ,2 ]
机构
[1] Zhejiang Univ, Stomatol Hosp, Canc Ctr Zhejiang Univ, Engn Res Ctr Oral Biomat & Devices Zhejiang Prov,S, Hangzhou 310000, Peoples R China
[2] Zhejiang Univ, Univ Illinois, Urbana Champaign Inst, Haining 314400, Peoples R China
[3] Angel Align Inc, Shanghai 200433, Peoples R China
[4] Hangzhou Dent Hosp, Hangzhou 310006, Peoples R China
基金
中国国家自然科学基金;
关键词
Artificial intelligence; Digital dentistry; Deep learning; Orthodontics; Tooth pose; Neural network;
D O I
10.1631/FITEE.2300596
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
A critical step in digital dentistry is to accurately and automatically characterize the orientation and position of individual teeth, which can subsequently be used for treatment planning and simulation in orthodontic tooth alignment. This problem remains challenging because the geometric features of different teeth are complicated and vary significantly, while a reliable large-scale dataset is yet to be constructed. In this paper we propose a novel method for automatic tooth orientation estimation by formulating it as a six-degree-of-freedom (6-DoF) tooth pose estimation task. Regarding each tooth as a three-dimensional (3D) point cloud, we design a deep neural network with a feature extractor backbone and a two-branch estimation head for tooth pose estimation. Our model, trained with a novel loss function on the newly collected large-scale dataset (10 393 patients with 280 611 intraoral tooth scans), achieves an average Euler angle error of only 4.780 degrees-5.979 degrees and a translation L1 error of 0.663 mm on a hold-out set of 2598 patients (77 870 teeth). Comprehensive experiments show that 98.29% of the estimations produce a mean angle error of less than 15 degrees, which is acceptable for many clinical and industrial applications.
引用
收藏
页码:1240 / 1249
页数:10
相关论文
共 50 条
  • [1] NEMA: 6-DoF Pose Estimation Dataset for Deep Learning
    Roman, Philippe Perez de San
    Desbarats, Pascal
    Domenger, Jean-Philippe
    Buendia, Axel
    PROCEEDINGS OF THE 17TH INTERNATIONAL JOINT CONFERENCE ON COMPUTER VISION, IMAGING AND COMPUTER GRAPHICS THEORY AND APPLICATIONS (VISAPP), VOL 4, 2022, : 682 - 690
  • [2] Deep object 6-DoF pose estimation using instance segmentation
    Pujolle, Victor
    Hayashi, Eiji
    PROCEEDINGS OF THE 2020 INTERNATIONAL CONFERENCE ON ARTIFICIAL LIFE AND ROBOTICS (ICAROB2020), 2020, : 241 - 244
  • [3] Towards Deep Learning-based 6D Bin Pose Estimation in 3D Scans
    Gajdosech, Lukas
    Kocur, Viktor
    Stuchlik, Martin
    Hudec, Lukas
    Madaras, Martin
    PROCEEDINGS OF THE 17TH INTERNATIONAL JOINT CONFERENCE ON COMPUTER VISION, IMAGING AND COMPUTER GRAPHICS THEORY AND APPLICATIONS (VISAPP), VOL 4, 2022, : 545 - 552
  • [4] Deep Learning-Based 6-DoF Object Pose Estimation Considering Synthetic Dataset
    Zheng, Tianyu
    Zhang, Chunyan
    Zhang, Shengwen
    Wang, Yanyan
    SENSORS, 2023, 23 (24)
  • [5] Uncalibrated stereo vision with deep learning for 6-DOF pose estimation for a robot arm system
    Abdelaal, Mahmoud
    Farag, Ramy M. A.
    Saad, Mohamed S.
    Bahgat, Ahmed
    Emara, Hassan M.
    El-Dessouki, Ayman
    ROBOTICS AND AUTONOMOUS SYSTEMS, 2021, 145
  • [6] Tooth Defect Segmentation in 3D Mesh Scans Using Deep Learning
    Chen, Hao
    Ge, Yuhao
    Wei, Jiahao
    Xiong, Huimin
    Liu, Zuozhu
    ARTIFICIAL INTELLIGENCE, CICAI 2022, PT III, 2022, 13606 : 180 - 191
  • [7] 6D pose estimation with combined deep learning and 3D vision techniques for a fast and accurate object grasping
    Le, Tuan-Tang
    Le, Trung-Son
    Chen, Yu-Ru
    Vidal, Joel
    Lin, Chyi-Yeu
    ROBOTICS AND AUTONOMOUS SYSTEMS, 2021, 141
  • [8] KVNet: An iterative 3D keypoints voting network for real-time 6-DoF object pose estimation
    Wang, Fei
    Zhang, Xing
    Chen, Tianyue
    Shen, Ze
    Liu, Shangdong
    He, Zhenquan
    NEUROCOMPUTING, 2023, 530 : 11 - 22
  • [9] Accuracy of deep learning-based integrated tooth models by merging intraoral scans and CBCT scans for 3D evaluation of root position during orthodontic treatment
    Suk-Cheol Lee
    Hyeon-Shik Hwang
    Kyungmin Clara Lee
    Progress in Orthodontics, 23
  • [10] Accuracy of deep learning-based integrated tooth models by merging intraoral scans and CBCT scans for 3D evaluation of root position during orthodontic treatment
    Lee, Suk-Cheol
    Hwang, Hyeon-Shik
    Lee, Kyungmin Clara
    PROGRESS IN ORTHODONTICS, 2022, 23 (01)