Ensemble learning methods with single and multi-model deep learning approaches for cephalometric landmark annotation

被引:0
作者
Rashmi, S. [1 ]
Srinath, S. [1 ]
Rakshitha, R. [1 ]
Poornima, B.V. [1 ]
机构
[1] JSS Science and Technology University, Mysuru
来源
Discover Artificial Intelligence | 2024年 / 4卷 / 01期
关键词
Deep Learning; Ensemble Learning; Landmark Annotation; UNet; UNetPlusPlus;
D O I
10.1007/s44163-024-00207-3
中图分类号
学科分类号
摘要
The study explores end-to-end deep learning frameworks and ensemble methods to enhance the accuracy of anatomical landmark identification in cephalometric radiographs, crucial for precise cephalometric analysis and effective orthodontic treatment planning. The methodology is strategically designed to address the complexities and variations in cephalometric images through a dual learning process: building base learners using end-to-end regression approaches and then constructing a meta-learner that ensembles the output of the base models to obtain collective predictions. Two primary approaches are followed to design base learners: an end-to-end single model and a multi-model strategy for localizing landmarks. Additionally, the efficacy of these approaches is examined by implementing two distinct deep architectures, namely UNet and UNetPlusPlus. The combination of the single model and multi-model approach with UNet and UNetPlusPlus results in four base learners, each displaying varying accuracy for different landmarks. To leverage the strengths of these individual models, three ensemble methods are explored, that includes supervised ensembling with XGBoost, unsupervised ensembling with the DBSCAN algorithm, and mathematical aggregation using weighted averaging. The methodology is evaluated on both public and private datasets, comprising 400 and 700 images, respectively. The multi-model approach demonstrates superior performance, achieving the highest detection accuracy of 79.9% (UNet) for the benchmark dataset and 92.8% (UNetPlusPlus) for the private dataset. The ensemble meta-model further boosts accuracy to 83.61% and 95.4%, respectively, reducing mean radial errors by 0.38 mm and 0.33 mm. These results highlight significant improvements in accuracy and error reduction through strategic combinations of deep learning architectures and ensemble techniques demonstrating the ability to significantly enhance cephalometric landmark annotation accuracy, which is critical for the practical applicability of the methodology. © The Author(s) 2024.
引用
收藏
相关论文
共 37 条
  • [31] Ronneberger O., Fischer P., Brox T., U-Net: Convolutional Networks for Biomedical Image Segmentation, (2015)
  • [32] Zhou Z., Rahman Siddiquee M.M., Tajbakhsh N., Liang J., Unet++: A Nested U-Net Architecture for Medical Image Segmentation, pp. 3-11, (2018)
  • [33] Iqball T., Wani M.A., Weighted ensemble model for image classification, Int J Inf Technol, 15, 2, pp. 557-564, (2023)
  • [34] Zheng Y., Et al., Application of transfer learning and ensemble learning in image-level classification for breast histopathology, Intell Med, 3, 2, pp. 115-128, (2023)
  • [35] Chen T., Guestrin C., Xgboost, pp. 785-794, (2016)
  • [36] Ester M., Kriegel H.P., Sander J., Xu X., . A density-based algorithm for discovering clusters in large spatial databases with noise, . in Knowledge Discovery and Data Mining, pp. 226-231, (1996)
  • [37] Lindner C., Cootes T., Fully Automatic Cephalometric Evaluation Using Random Forest Regression-Voting, (2015)