A Semi-Supervised Transformer-Based Deep Learning Framework for Automated Tooth Segmentation and Identification on Panoramic Radiographs

被引:1
作者
Hao, Jing [1 ]
Wong, Lun M. [2 ]
Shan, Zhiyi [3 ]
Ai, Qi Yong H. [4 ]
Shi, Xieqi [5 ]
Tsoi, James Kit Hon [1 ]
Hung, Kuo Feng [1 ]
机构
[1] Univ Hong Kong, Fac Dent, Appl Oral Sci & Community Dent Care, Hong Kong, Peoples R China
[2] Chinese Univ Hong Kong, Fac Med, Imaging & Intervent Radiol, Hong Kong, Peoples R China
[3] Univ Hong Kong, Fac Dent, Paediat Dent & Orthodont, Hong Kong, Peoples R China
[4] Hong Kong Polytech Univ, Hlth Technol & Informat, Hong Kong, Peoples R China
[5] Univ Bergen, Dept Clin Dent, Sect Oral Maxillofacial Radiol, N-5009 Bergen, Norway
关键词
tooth segmentation; tooth identification; Transformer neural network; semi-supervised learning; deep learning;
D O I
10.3390/diagnostics14171948
中图分类号
R5 [内科学];
学科分类号
1002 ; 100201 ;
摘要
Automated tooth segmentation and identification on dental radiographs are crucial steps in establishing digital dental workflows. While deep learning networks have been developed for these tasks, their performance has been inferior in partially edentulous individuals. This study proposes a novel semi-supervised Transformer-based framework (SemiTNet), specifically designed to improve tooth segmentation and identification performance on panoramic radiographs, particularly in partially edentulous cases, and establish an open-source dataset to serve as a unified benchmark. A total of 16,317 panoramic radiographs (1589 labeled and 14,728 unlabeled images) were collected from various datasets to create a large-scale dataset (TSI15k). The labeled images were divided into training and test sets at a 7:1 ratio, while the unlabeled images were used for semi-supervised learning. The SemiTNet was developed using a semi-supervised learning method with a label-guided teacher-student knowledge distillation strategy, incorporating a Transformer-based architecture. The performance of SemiTNet was evaluated on the test set using the intersection over union (IoU), Dice coefficient, precision, recall, and F1 score, and compared with five state-of-the-art networks. Paired t-tests were performed to compare the evaluation metrics between SemiTNet and the other networks. SemiTNet outperformed other networks, achieving the highest accuracy for tooth segmentation and identification, while requiring minimal model size. SemiTNet's performance was near-perfect for fully dentate individuals (all metrics over 99.69%) and excellent for partially edentulous individuals (all metrics over 93%). In edentulous cases, SemiTNet obtained statistically significantly higher tooth identification performance than all other networks. The proposed SemiTNet outperformed previous high-complexity, state-of-the-art networks, particularly in partially edentulous cases. The established open-source TSI15k dataset could serve as a unified benchmark for future studies.
引用
收藏
页数:13
相关论文
共 50 条
[41]   A Semi-Supervised Modulation Identification in MIMO Systems: A Deep Learning Strategy [J].
Bouchenak, Sofya ;
Merzougui, Rachid ;
Harrou, Fouzi ;
Dairi, Abdelkader ;
Sun, Ying .
IEEE ACCESS, 2022, 10 :76622-76635
[42]   Automatic segmentation of optic disc in retinal fundus images using semi-supervised deep learning [J].
Shaleen Bengani ;
Angel Arul Jothi J. ;
Vadivel S. .
Multimedia Tools and Applications, 2021, 80 :3443-3468
[43]   Automatic segmentation of optic disc in retinal fundus images using semi-supervised deep learning [J].
Bengani, Shaleen ;
Jothi, Angel Arul J. ;
Vadivel, S. .
MULTIMEDIA TOOLS AND APPLICATIONS, 2021, 80 (03) :3443-3468
[44]   Image Recognition and Analysis of Intrauterine Residues Based on Deep Learning and Semi-Supervised Learning [J].
Tao, Tao ;
Liu, Kan ;
Wang, Li ;
Wu, Haiying .
IEEE ACCESS, 2020, 8 :162785-162799
[45]   A transformer-based deep learning framework to predict employee attrition [J].
Li, Wenhui .
PEERJ COMPUTER SCIENCE, 2023, 9
[46]   Semi-Supervised Segmentation of Renal Pathology: An Alternative to Manual Segmentation and Input to Deep Learning Training [J].
Kline, Adrienne ;
Chung, Hyun Jae ;
Rahmani, Waleed ;
Chun, Justin .
2021 43RD ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE & BIOLOGY SOCIETY (EMBC), 2021, :2688-2691
[47]   SVMDformer: A Semi-supervised Vehicular Misbehavior Detection Framework based on Transformer in IoV [J].
Liu, Zhikang ;
Xu, Hongyun ;
Kuang, Yong ;
Li, Feng .
2023 IEEE 43RD INTERNATIONAL CONFERENCE ON DISTRIBUTED COMPUTING SYSTEMS, ICDCS, 2023, :887-897
[48]   A Deep Neural Network Based on ELM for Semi-supervised Learning of Image Classification [J].
Peiju Chang ;
Jiangshe Zhang ;
Junying Hu ;
Zengjie Song .
Neural Processing Letters, 2018, 48 :375-388
[49]   Semi-supervised Deep Learning-based Methods for Indoor Outdoor Detection [J].
Saffar, Illyyne ;
Morel, Marie Line Alberi ;
Singh, Kamal Deep ;
Viho, Cesar .
ICC 2019 - 2019 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC), 2019,
[50]   A Deep Neural Network Based on ELM for Semi-supervised Learning of Image Classification [J].
Chang, Peiju ;
Zhang, Jiangshe ;
Hu, Junying ;
Song, Zengjie .
NEURAL PROCESSING LETTERS, 2018, 48 (01) :375-388