Conquering class imbalances in deep learning-based segmentation of dental radiographs with different loss functions

被引:4
作者
Buettner, Martha [1 ,3 ]
Schneider, Lisa [1 ,3 ]
Krasowski, Aleksander [1 ]
Pitchika, Vinay [2 ]
Krois, Joachim [3 ]
Meyer-Lueckel, Hendrik [4 ]
Schwendicke, Falk [2 ,3 ]
机构
[1] Charite Univ Med Berlin, Dept Oral Diagnost Digital Hlth & Hlth Serv Res, Berlin, Germany
[2] Ludwig Maximilians Univ Munchen, Clin Conservat Dent & Periodontol, Goethestr 70, D-80336 Munich, Germany
[3] ITU WHO Focus Grp AI4Hlth, Geneva, Switzerland
[4] Univ Bern, Zmk Bern, Dept Restorat Prevent & Pediat Dent, Bern, Switzerland
关键词
Artificial intelligence; Deep learning; Computer Vision;
D O I
10.1016/j.jdent.2024.105063
中图分类号
R78 [口腔科学];
学科分类号
1003 ;
摘要
Objective: The imbalanced nature of real-world datasets is an ongoing challenge in the field of machine and deep learning. In medicine and in dentistry, most data samples represent patients not affected by pathologies, and on imagery, pathologic image areas are often smaller than healthy ones. Selecting suitable loss functions during deep learning is essential and may help to overcome the resulting imbalance. We assessed six different loss functions for one exemplary task, tooth structure segmentation on bitewing radiographs, for their performance. Methods: Six different loss functions (Focal Loss, Dice Loss, Tversky Loss and hybrid losses of Cross-Entropy and Dice Loss, Focal and Dice Loss, Focal and Generalized Dice Loss) were compared on a tooth structure segmentation task of 1,625 bitewing radiographs. Training was performed using three different model architectures (UNet, Linknet, DeepLavbV3+) over a 5-fold cross-validation. Tooth structures consisted of the classes (occurrence in% of samples/captures areas measured on pixel level) enamel (100 %/25 %), dentin (100 %/50 %), root canal (100 %/10 %), filling (81 %/8 %) and crown (28 %/5 %). Results: Hybrid loss functions significantly outperformed standalone ones and provided robust results over the different architectures for the classes enamel, dentin, root canal and filling. Specifically, the Dice Focal loss reached high performance to conquer both image level and pixel level class imbalance, respectively. Clinical Significance: In dental use cases it is often important to predict minority classes such as pathologies accurately. Using specific loss function may be an effective strategy to overcome data imbalance when training deep learning models.
引用
收藏
页数:6
相关论文
共 30 条
[11]  
Iakubovskii P., 2019, SEGMENTATION MODELS
[12]   Learning from imbalanced data: open challenges and future directions [J].
Krawczyk B. .
Krawczyk, Bartosz (bartosz.krawczyk@pwr.edu.pl), 1600, Springer Verlag (05) :221-232
[13]   Deep Learning for the Radiographic Detection of Periodontal Bone Loss [J].
Krois, Joachim ;
Ekert, Thomas ;
Meinhold, Leonie ;
Golla, Tatiana ;
Kharbot, Basel ;
Wittemeier, Agnes ;
Doerfer, Christof ;
Schwendicke, Falk .
SCIENTIFIC REPORTS, 2019, 9 (1)
[14]   Detection and diagnosis of dental caries using a deep learning-based convolutional neural network algorithm [J].
Lee, Jae-Hong ;
Kim, Do-Hyung ;
Jeong, Seong-Nyum ;
Choi, Seong-Ho .
JOURNAL OF DENTISTRY, 2018, 77 :106-111
[15]   Focal Loss for Dense Object Detection [J].
Lin, Tsung-Yi ;
Goyal, Priya ;
Girshick, Ross ;
He, Kaiming ;
Dollar, Piotr .
2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, :2999-3007
[16]  
Lodkaew T, 2020, COMM COM INF SC, V1332, P807, DOI 10.1007/978-3-030-63820-7_92
[17]   ON A TEST OF WHETHER ONE OF 2 RANDOM VARIABLES IS STOCHASTICALLY LARGER THAN THE OTHER [J].
MANN, HB ;
WHITNEY, DR .
ANNALS OF MATHEMATICAL STATISTICS, 1947, 18 (01) :50-60
[18]  
McKinlay J, 2010, CHANDOS INF PROF SER, P1, DOI 10.1533/9781780630243
[19]   V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentation [J].
Milletari, Fausto ;
Navab, Nassir ;
Ahmadi, Seyed-Ahmad .
PROCEEDINGS OF 2016 FOURTH INTERNATIONAL CONFERENCE ON 3D VISION (3DV), 2016, :565-571
[20]   Machine Learning with Oversampling and Undersampling Techniques: Overview Study and Experimental Results [J].
Mohammed, Roweida ;
Rawashdeh, Jumanah ;
Abdullah, Malak .
2020 11TH INTERNATIONAL CONFERENCE ON INFORMATION AND COMMUNICATION SYSTEMS (ICICS), 2020, :243-248