Self-Supervised Transfer Learning of Pulmonary Nodule Classification Based on Partially Annotated CT Images

被引:0
作者
Huang H. [1 ]
Peng C. [1 ]
Wu R. [1 ]
Tao J. [2 ]
Zhang J. [2 ]
机构
[1] Key Laboratory of Optoelectronic Technology & Systems, Ministry of Education, Chongqing University, Chongqing
[2] Department of Radiology, Chongqing University Cancer Hospital, Chongqing
来源
Guangxue Xuebao/Acta Optica Sinica | 2020年 / 40卷 / 18期
关键词
Feature extraction; Image processing; Partial annotation; Pulmonary nodule classification; Self-supervised learning; Transfer learning;
D O I
10.3788/AOS202040.1810003
中图分类号
学科分类号
摘要
The process of training a deep learning model requires many annotation samples, even though annotation data is difficult to obtain in the medical field. A self-supervised learning algorithm combined with partial annotation data is proposed as a solution to this problem, in order to improve classification performance of 3D pulmonary nodules. Based on the traditional self-supervised training network structure, a multitask learning network structure is designed to address a large amount of unannotated data and a small amount of annotated data obtained from medical image processing tasks. First, the proposed algorithm trains the unannotated data, and then explores the annotation data to continuously train the model. Thus, this algorithm manages to share partial network structures and parameters between the annotated and unannotated data. Compared to traditional self-supervised learning methods, the proposed algorithm can learn to recognize the discriminant features of pulmonary nodules to ensure the model's capacity to generalize, therefore, model transfer learning can also perform better when applied to the classification of pulmonary nodules. The classification accuracy of the proposed algorithm on LIDC-IDRI dataset is 0.886, and the area under the curve (AUC) is 0.929. The results of the investigation indicate that the proposed algorithm can effectively improve classification performance of pulmonary nodules. © 2020, Chinese Lasers Press. All right reserved.
引用
收藏
相关论文
共 15 条
[1]  
Chen W Q, Zheng R S, Baade P D, Et al., Cancer statistics in China, 2015, CA: a Cancer Journal for Clinicians, 66, 2, pp. 115-132, (1900)
[2]  
Jacobs C, van Rikxoort E M, Scholten E T, Et al., Solid, part-solid, or non-solid: classification of pulmonary nodules in low-dose chest computed tomography by a computer-aided diagnosis system, Investigative Radiology, 50, 3, pp. 168-173, (2015)
[3]  
Feng Y, Yi B S, Wu C Y, Et al., Pulmonary nodule recognition based on three-dimensional convolution neural network, Acta Optica Sinica, 39, 6, (2019)
[4]  
Zhao Q Y, Kong P, Min J Z, Et al., A review of deep learning methods for the detection and classification of pulmonary nodules, Journal of Biomedical Engineering, 36, 6, pp. 1060-1068, (2019)
[5]  
Miao G, Li C F., Detection of pulmonary nodules CT images combined with two-dimensional and three-dimensional convolution neural networks, Laser & Optoelectronics Progress, 55, 5, (2018)
[6]  
Setio A A A, Jacobs C, Gelderblom J, Et al., Automatic detection of large pulmonary solid nodules in thoracic CT images, Medical Physics, 42, 10, pp. 5642-5653, (2015)
[7]  
Chen C H, Chang C K, Tu C Y, Et al., Radiomic features analysis in computed tomography images of lung nodule classification, PLoS One, 13, 2, (2018)
[8]  
Dhara A K, Mukhopadhyay S, Dutta A, Et al., A combination of shape and texture features for classification of pulmonary nodules in lung CT images, Journal of Digital Imaging, 29, 4, pp. 466-475, (2016)
[9]  
Anwar S M, Majid M, Qayyum A, Et al., Medical image analysis using convolutional neural networks: a review, Journal of Medical Systems, 42, 11, pp. 1-13, (2018)
[10]  
Nibali A, He Z, Wollersheim D., Pulmonary nodule classification with deep residual networks, International Journal of Computer Assisted Radiology and Surgery, 12, 10, pp. 1799-1808, (2017)