Conquering class imbalances in deep learning-based segmentation of dental radiographs with different loss functions

被引:4
作者
Buettner, Martha [1 ,3 ]
Schneider, Lisa [1 ,3 ]
Krasowski, Aleksander [1 ]
Pitchika, Vinay [2 ]
Krois, Joachim [3 ]
Meyer-Lueckel, Hendrik [4 ]
Schwendicke, Falk [2 ,3 ]
机构
[1] Charite Univ Med Berlin, Dept Oral Diagnost Digital Hlth & Hlth Serv Res, Berlin, Germany
[2] Ludwig Maximilians Univ Munchen, Clin Conservat Dent & Periodontol, Goethestr 70, D-80336 Munich, Germany
[3] ITU WHO Focus Grp AI4Hlth, Geneva, Switzerland
[4] Univ Bern, Zmk Bern, Dept Restorat Prevent & Pediat Dent, Bern, Switzerland
关键词
Artificial intelligence; Deep learning; Computer Vision;
D O I
10.1016/j.jdent.2024.105063
中图分类号
R78 [口腔科学];
学科分类号
1003 ;
摘要
Objective: The imbalanced nature of real-world datasets is an ongoing challenge in the field of machine and deep learning. In medicine and in dentistry, most data samples represent patients not affected by pathologies, and on imagery, pathologic image areas are often smaller than healthy ones. Selecting suitable loss functions during deep learning is essential and may help to overcome the resulting imbalance. We assessed six different loss functions for one exemplary task, tooth structure segmentation on bitewing radiographs, for their performance. Methods: Six different loss functions (Focal Loss, Dice Loss, Tversky Loss and hybrid losses of Cross-Entropy and Dice Loss, Focal and Dice Loss, Focal and Generalized Dice Loss) were compared on a tooth structure segmentation task of 1,625 bitewing radiographs. Training was performed using three different model architectures (UNet, Linknet, DeepLavbV3+) over a 5-fold cross-validation. Tooth structures consisted of the classes (occurrence in% of samples/captures areas measured on pixel level) enamel (100 %/25 %), dentin (100 %/50 %), root canal (100 %/10 %), filling (81 %/8 %) and crown (28 %/5 %). Results: Hybrid loss functions significantly outperformed standalone ones and provided robust results over the different architectures for the classes enamel, dentin, root canal and filling. Specifically, the Dice Focal loss reached high performance to conquer both image level and pixel level class imbalance, respectively. Clinical Significance: In dental use cases it is often important to predict minority classes such as pathologies accurately. Using specific loss function may be an effective strategy to overcome data imbalance when training deep learning models.
引用
收藏
页数:6
相关论文
共 30 条
[1]   Machine Learning in Dentistry: A Scoping Review [J].
Arsiwala-Scheppach, Lubaina T. ;
Chaurasia, Akhilanand ;
Mueller, Anne ;
Krois, Joachim ;
Schwendicke, Falk .
JOURNAL OF CLINICAL MEDICINE, 2023, 12 (03)
[2]   CONTROLLING THE FALSE DISCOVERY RATE - A PRACTICAL AND POWERFUL APPROACH TO MULTIPLE TESTING [J].
BENJAMINI, Y ;
HOCHBERG, Y .
JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES B-STATISTICAL METHODOLOGY, 1995, 57 (01) :289-300
[3]   A systematic study of the class imbalance problem in convolutional neural networks [J].
Buda, Mateusz ;
Maki, Atsuto ;
Mazurowski, Maciej A. .
NEURAL NETWORKS, 2018, 106 :249-259
[4]   Impact of Noisy Labels on Dental Deep Learning-Calculus Detection on Bitewing Radiographs [J].
Buettner, Martha ;
Schneider, Lisa ;
Krasowski, Aleksander ;
Krois, Joachim ;
Feldberg, Ben ;
Schwendicke, Falk .
JOURNAL OF CLINICAL MEDICINE, 2023, 12 (09)
[5]  
Chaurasia A, 2017, 2017 IEEE VISUAL COMMUNICATIONS AND IMAGE PROCESSING (VCIP)
[6]   Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation [J].
Chen, Liang-Chieh ;
Zhu, Yukun ;
Papandreou, George ;
Schroff, Florian ;
Adam, Hartwig .
COMPUTER VISION - ECCV 2018, PT VII, 2018, 11211 :833-851
[7]   MULTIPLE COMPARISONS USING RANK SUMS [J].
DUNN, OJ .
TECHNOMETRICS, 1964, 6 (03) :241-&
[8]   Deep Learning for the Radiographic Detection of Apical Lesions [J].
Ekert, Thomas ;
Krois, Joachim ;
Meinhold, Leonie ;
Elhennawy, Karim ;
Emara, Ramy ;
Golla, Tatiana ;
Schwendicke, Falk .
JOURNAL OF ENDODONTICS, 2019, 45 (07) :917-922
[9]   Deep Residual Learning for Image Recognition [J].
He, Kaiming ;
Zhang, Xiangyu ;
Ren, Shaoqing ;
Sun, Jian .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :770-778
[10]   Densely Connected Convolutional Networks [J].
Huang, Gao ;
Liu, Zhuang ;
van der Maaten, Laurens ;
Weinberger, Kilian Q. .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :2261-2269