Automated rotator cuff tear classification using 3D convolutional neural network

被引:44
作者
Shim, Eungjune [1 ]
Kim, Joon Yub [2 ]
Yoon, Jong Pil [3 ]
Ki, Se-Young [4 ]
Lho, Taewoo [4 ]
Kim, Youngjun [1 ]
Chung, Seok Won [4 ]
机构
[1] Korea Inst Sci & Technol, Ctr Bion, Seoul 02792, South Korea
[2] Yeson Hosp, Dept Orthoped Surg, Bucheon 14555, South Korea
[3] Kyungpook Natl Univ, Sch Med, Dept Orthopaed Surg, Daegu 41944, South Korea
[4] Konkuk Univ, Dept Orthopaed Surg, Ctr Shoulder & Elbow Surg, Sch Med, Seoul 143729, South Korea
关键词
CANCER;
D O I
10.1038/s41598-020-72357-0
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
Rotator cuff tear (RCT) is one of the most common shoulder injuries. When diagnosing RCT, skilled orthopedists visually interpret magnetic resonance imaging (MRI) scan data. For automated and accurate diagnosis of RCT, we propose a full 3D convolutional neural network (CNN) based method using deep learning. This 3D CNN automatically diagnoses the presence or absence of an RCT, classifies the tear size, and provides 3D visualization of the tear location. To train the 3D CNN, the Voxception-ResNet (VRN) structure was used. This architecture uses 3D convolution filters, so it is advantageous in extracting information from 3D data compared with 2D-based CNNs or traditional diagnosis methods. MRI data from 2,124 patients were used to train and test the VRN-based 3D CNN. The network is trained to classify RCT into five classes (None, Partial, Small, Medium, Large-to-Massive). A 3D class activation map (CAM) was visualized by volume rendering to show the localization and size information of RCT in 3D. A comparative experiment was performed for the proposed method and clinical experts by using randomly selected 200 test set data, which had been separated from training set. The VRN-based 3D CNN outperformed orthopedists specialized in shoulder and general orthopedists in binary accuracy (92.5% vs. 76.4% and 68.2%), top-1 accuracy (69.0% vs. 45.8% and 30.5%), top-1 +/- 1 accuracy (87.5% vs. 79.8% and 71.0%), sensitivity (0.94 vs. 0.86 and 0.90), and specificity (0.90 vs. 0.58 and 0.29). The generated 3D CAM provided effective information regarding the 3D location and size of the tear. Given these results, the proposed method demonstrates the feasibility of artificial intelligence that can assist in clinical RCT diagnosis.Y
引用
收藏
页数:9
相关论文
共 19 条
[1]   Automated detection and classification of the proximal humerus fracture by using deep learning algorithm [J].
Chung, Seok Won ;
Han, Seung Seog ;
Lee, Ji Whan ;
Oh, Kyung-Soo ;
Kim, Na Ra ;
Yoon, Jong Pil ;
Kim, Joon Yub ;
Moon, Sung Hoon ;
Kwon, Jieun ;
Lee, Hyo-Jin ;
Noh, Young-Min ;
Kim, Youngjun .
ACTA ORTHOPAEDICA, 2018, 89 (04) :468-473
[2]  
Deng J, 2009, PROC CVPR IEEE, P248, DOI 10.1109/CVPRW.2009.5206848
[3]   RESULTS OF A 2ND ATTEMPT AT SURGICAL REPAIR OF A FAILED INITIAL ROTATOR-CUFF REPAIR [J].
DEORIO, JK ;
COFIELD, RH .
JOURNAL OF BONE AND JOINT SURGERY-AMERICAN VOLUME, 1984, 66A (04) :563-567
[4]   Automatic Brain Tumor Detection and Segmentation Using U-Net Based Fully Convolutional Networks [J].
Dong, Hao ;
Yang, Guang ;
Liu, Fangde ;
Mo, Yuanhan ;
Guo, Yike .
MEDICAL IMAGE UNDERSTANDING AND ANALYSIS (MIUA 2017), 2017, 723 :506-517
[5]   Dermatologist-level classification of skin cancer with deep neural networks [J].
Esteva, Andre ;
Kuprel, Brett ;
Novoa, Roberto A. ;
Ko, Justin ;
Swetter, Susan M. ;
Blau, Helen M. ;
Thrun, Sebastian .
NATURE, 2017, 542 (7639) :115-+
[6]  
Ettlinger F., 2017, ARXIV170205970
[7]   Development and Validation of a Deep Learning Algorithm for Detection of Diabetic Retinopathy in Retinal Fundus Photographs [J].
Gulshan, Varun ;
Peng, Lily ;
Coram, Marc ;
Stumpe, Martin C. ;
Wu, Derek ;
Narayanaswamy, Arunachalam ;
Venugopalan, Subhashini ;
Widner, Kasumi ;
Madams, Tom ;
Cuadros, Jorge ;
Kim, Ramasamy ;
Raman, Rajiv ;
Nelson, Philip C. ;
Mega, Jessica L. ;
Webster, R. .
JAMA-JOURNAL OF THE AMERICAN MEDICAL ASSOCIATION, 2016, 316 (22) :2402-2410
[8]  
He K., 2017, IEEE INT C COMPUT VI, P2980, DOI [10.1109/ICCV.2017.322, 10.1109/iccv.201, DOI 10.1109/ICCV.2017.322]
[9]  
Hu J., 2020, IEEE Trans. Pattern Anal. Mach. Intell., V42, P2011, DOI DOI 10.1109/TPAMI.2019.2913372
[10]   Densely Connected Convolutional Networks [J].
Huang, Gao ;
Liu, Zhuang ;
van der Maaten, Laurens ;
Weinberger, Kilian Q. .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :2261-2269