Web-based fully automated cephalometric analysis by deep learning

被引:90
作者
Kim, Hannah [1 ,2 ]
Shim, Eungjune [1 ]
Park, Jungeun [3 ]
Kim, Yoon-Ji [4 ]
Lee, Uilyong [5 ,6 ]
Kim, Youngjun [1 ,2 ]
机构
[1] Korea Inst Sci & Technol, Ctr Bion, 5,Hwarang Ro 14 Gil, Seoul 02792, South Korea
[2] Korea Univ Sci & Technol, KIST Sch, Div Biomed Sci & Technol, 5,Hwarang Ro 14 Gil, Seoul 02792, South Korea
[3] Yonsei Univ, Grad Sch, Dept Orthodont, Coll Dent, 50-1 Yonseiro, Seoul 03722, South Korea
[4] Korea Univ Anam Hosp, Dept Orthodont, 73 Inchon Ro, Seoul 02841, South Korea
[5] Chungang Univ Hosp, Dept Oral & Maxillofacial Surg, 102 Heukseok Ro, Seoul 06973, South Korea
[6] Seoul Natl Univ, Sch Dent, Tooth Bioengn Natl Res Lab, BK21, Daehak Ro 101, Seoul 03080, South Korea
关键词
Fully automated cephalometry; Automated landmark detection; Web-based application; Deep learning; Stacked hourglass network; CONFIGURATION; INDICATOR;
D O I
10.1016/j.cmpb.2020.105513
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Background and Objective: An accurate lateral cephalometric analysis is vital in orthodontic diagnosis. Identification of anatomic landmarks on lateral cephalograms is tedious, and errors may occur depending on the doctor's experience. Several attempts have been made to reduce this time-consuming process by automating the process through machine learning; however, they only dealt with a small amount of data from one institute. This study aims to develop a fully automated cephalometric analysis method using deep learning and a corresponding web-based application that can be used without high-specification hardware. Methods: We built our own dataset comprising 2,075 lateral cephalograms and ground truth positions of 23 landmarks from two institutes and trained a two-stage automated algorithm with a stacked hourglass deep learning model specialized for detecting landmarks in images. Additionally, a web-based application with the proposed algorithm for fully automated cephalometric analysis was developed for better accessibility regardless of the user's computer hardware, which is essential for a deep learning-based method. Results: The algorithm was evaluated with datasets from various devices and institutes, including a widely used open dataset and achieved 1.37 +/- 1.79 mm of point-to-point errors with ground truth positions for 23 cephalometric landmarks. Based on the predicted positions, anatomical types of the subjects were automatically classified and compared with the ground truth, and the automated algorithm achieved a successful classification rate of 88.43%. Conclusions: We expect that this fully automated cephalometric analysis algorithm and the web-based application can be widely used in various medical environments to save time and effort for manual marking and diagnosis. (c) 2020 Elsevier B.V. All rights reserved.
引用
收藏
页数:8
相关论文
共 30 条
[1]   Fully automated quantitative cephalometry using convolutional neural networks [J].
Arik S.Ö. ;
Ibragimov B. ;
Xing L. .
Journal of Medical Imaging, 2017, 4 (01)
[2]   Cascaded Pyramid Network for Multi-Person Pose Estimation [J].
Chen, Yilun ;
Wang, Zhicheng ;
Peng, Yuxiang ;
Zhang, Zhiqiang ;
Yu, Gang ;
Sun, Jian .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :7103-7112
[3]   FSRNet: End-to-End Learning Face Super-Resolution with Facial Priors [J].
Chen, Yu ;
Tai, Ying ;
Liu, Xiaoming ;
Shen, Chunhua ;
Yang, Jian .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :2492-2501
[5]   Heterogeneous Face Attribute Estimation: A Deep Multi-Task Learning Approach [J].
Han, Hu ;
Jain, Anil K. ;
Wang, Fang ;
Shan, Shiguang ;
Chen, Xilin .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2018, 40 (11) :2597-2609
[6]   Deep Learning for Emotion Recognition on Small Datasets Using Transfer Learning [J].
Hong-Wei Ng ;
Viet Dung Nguyen ;
Vonikakis, Vassilios ;
Winkler, Stefan .
ICMI'15: PROCEEDINGS OF THE 2015 ACM INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION, 2015, :443-449
[7]   Large Pose 3D Face Reconstruction from a Single Image via Direct Volumetric CNN Regression [J].
Jackson, Aaron S. ;
Bulat, Adrian ;
Argyriou, Vasileios ;
Tzimiropoulos, Georgios .
2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, :1031-1039
[8]   Joint Fine-Tuning in Deep Neural Networks for Facial Expression Recognition [J].
Jung, Heechul ;
Lee, Sihaeng ;
Yim, Junho ;
Park, Sunjeong ;
Kim, Junmo .
2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2015, :2983-2991