COVID-19 Infection Segmentation and Severity Assessment Using a Self-Supervised Learning Approach

被引:8
作者
Song, Yao [1 ,2 ]
Liu, Jun [1 ,2 ]
Liu, Xinghua [3 ]
Tang, Jinshan [4 ]
机构
[1] Wuhan Univ Sci & Technol, Sch Comp Sci & Technol, Wuhan 430065, Peoples R China
[2] Hubei Prov Key Lab Intelligent Informat Proc & Re, Wuhan 430065, Peoples R China
[3] Wuhan First Hosp, Wuhan 430030, Peoples R China
[4] George Mason Univ, Coll Hlth & Human Serv, Dept Hlth Adm & Policy, Fairfax, VA 22030 USA
关键词
self-supervised learning; COVID-19; lesion segmentation; SYSTEM;
D O I
10.3390/diagnostics12081805
中图分类号
R5 [内科学];
学科分类号
1002 ; 100201 ;
摘要
Background: Automated segmentation of COVID-19 infection lesions and the assessment of the severity of the infections are critical in COVID-19 diagnosis and treatment. Based on a large amount of annotated data, deep learning approaches have been widely used in COVID-19 medical image analysis. However, the number of medical image samples is generally huge, and it is challenging to obtain enough annotated medical images for training a deep CNN model. Methods: To address these challenges, we propose a novel self-supervised deep learning method for automated segmentation of COVID-19 infection lesions and assessing the severity of infection, which can reduce the dependence on the annotation of the training samples. In the proposed method, first, many unlabeled data are used to pre-train an encoder-decoder model to learn rotation-dependent and rotation-invariant features. Then, a small amount of labeled data is used to fine-tune the pre-trained encoder-decoder for COVID-19 severity classification and lesion segmentation. Results: The proposed methods were tested on two public COVID-19 CT datasets and one self-built dataset. Accuracy, precision, recall, and Fl-score were used to measure classification performance and Dice coefficient was used to measure segmentation performance. For COVID-19 severity classification, the proposed method outperformed other unsupervised feature learning methods by about 7.16% in accuracy. For segmentation, when the amount of labeled data was 100%, the Dice value of the proposed method was 5.58% higher than that of U-Net.; in 70% of the cases, our method was 8.02% higher than U-Net; in 30% of the cases, our method was 11.88% higher than U-Net; and in 10% of the cases, our method was 16.88% higher than U-Net. Conclusions: The proposed method provides better classification and segmentation performance under limited labeled data than other methods.
引用
收藏
页数:17
相关论文
共 55 条
[1]   COVID-19 diagnosis using state-of-the-art CNN architecture features and Bayesian Optimization [J].
Aslan, Muhammet Fatih ;
Sabanci, Kadir ;
Durdu, Akif ;
Unlersen, Muhammed Fahri .
COMPUTERS IN BIOLOGY AND MEDICINE, 2022, 142
[2]   CNN-based transfer learning-BiLSTM network: A novel approach for COVID-19 infection detection [J].
Aslan, Muhammet Fatih ;
Unlersen, Muhammed Fahri ;
Sabanci, Kadir ;
Durdu, Akif .
APPLIED SOFT COMPUTING, 2021, 98
[3]   Self-Supervised Learning for Cardiac MR Image Segmentation by Anatomical Position Prediction [J].
Bai, Wenjia ;
Chen, Chen ;
Tarroni, Giacomo ;
Duan, Jinming ;
Guitton, Florian ;
Petersen, Steffen E. ;
Guo, Yike ;
Matthews, Paul M. ;
Rueckert, Daniel .
MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2019, PT II, 2019, 11765 :541-549
[4]   Interstitial Lung Disease at High Resolution CT after SARS-CoV-2-Related Acute Respiratory Distress Syndrome According to Pulmonary Segmental Anatomy [J].
Baratella, Elisa ;
Ruaro, Barbara ;
Marrocchio, Cristina ;
Starvaggi, Natalia ;
Salton, Francesco ;
Giudici, Fabiola ;
Quaia, Emilio ;
Confalonieri, Marco ;
Cova, Maria Assunta .
JOURNAL OF CLINICAL MEDICINE, 2021, 10 (17)
[5]   Self-supervised learning for medical image analysis using image context restoration [J].
Chen, Liang ;
Bentley, Paul ;
Mori, Kensaku ;
Misawa, Kazunari ;
Fujiwara, Michitaka ;
Rueckert, Daniel .
MEDICAL IMAGE ANALYSIS, 2019, 58
[6]  
Chen T, 2020, PR MACH LEARN RES, V119
[7]   Momentum contrastive learning for few-shot COVID-19 diagnosis from chest CT images [J].
Chen, Xiaocong ;
Yao, Lina ;
Zhou, Tao ;
Dong, Jinming ;
Zhang, Yu .
PATTERN RECOGNITION, 2021, 113
[8]   Learning Rotation-Invariant and Fisher Discriminative Convolutional Neural Networks for Object Detection [J].
Cheng, Gong ;
Han, Junwei ;
Zhou, Peicheng ;
Xu, Dong .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2019, 28 (01) :265-278
[9]   RIFD-CNN: Rotation-Invariant and Fisher Discriminative Convolutional Neural Networks for Object Detection [J].
Cheng, Gong ;
Zhou, Peicheng ;
Han, Junwei .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :2884-2893
[10]   Learning Rotation-Invariant Convolutional Neural Networks for Object Detection in VHR Optical Remote Sensing Images [J].
Cheng, Gong ;
Zhou, Peicheng ;
Han, Junwei .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2016, 54 (12) :7405-7415