Structural Attention Graph Neural Network for Diagnosis and Prediction of COVID-19 Severity

被引:12
作者
Liu, Yanbei [1 ]
Li, Henan [2 ]
Luo, Tao [3 ]
Zhang, Changqing [3 ]
Xiao, Zhitao [1 ]
Wei, Ying [4 ]
Gao, Yaozong [4 ]
Shi, Feng [4 ]
Shan, Fei [5 ]
Shen, Dinggang [6 ,7 ,8 ]
机构
[1] Tiangong Univ, Sch Life Sci, Tianjin 300387, Peoples R China
[2] Tiangong Univ, Sch Elect & Elect Engn, Tianjin 300387, Peoples R China
[3] Tianjin Univ, Coll Intelligence & Comp, Tianjin 300350, Peoples R China
[4] Shanghai United Imaging Intelligence Co Ltd, Dept Res & Dev, Shanghai 200232, Peoples R China
[5] Fudan Univ, Shanghai Publ Hlth Clin Ctr, Dept Radiol, Shanghai 200433, Peoples R China
[6] ShanghaiTech Univ, Sch Biomed Engn, Shanghai 201210, Peoples R China
[7] Shanghai United Imaging Intelligence Co Ltd, Shanghai 200230, Peoples R China
[8] Shanghai Clin Res & Trial Ctr, Shanghai 201210, Peoples R China
基金
中国国家自然科学基金; 中国博士后科学基金;
关键词
COVID-19; Lung; Feature extraction; Multitasking; Computed tomography; Task analysis; Diseases; severity; structural attention mechanism; graph neural network; multi-task learning; REGRESSION; SEGMENTATION; PNEUMONIA;
D O I
10.1109/TMI.2022.3226575
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
With rapid worldwide spread of Coronavirus Disease 2019 (COVID-19), jointly identifying severe COVID-19 cases from mild ones and predicting the conversion time (from mild to severe) is essential to optimize the workflow and reduce the clinician's workload. In this study, we propose a novel framework for COVID-19 diagnosis, termed as Structural Attention Graph Neural Network (SAGNN), which can combine the multi-source information including features extracted from chest CT, latent lung structural distribution, and non-imaging patient information to conduct diagnosis of COVID-19 severity and predict the conversion time from mild to severe. Specifically, we first construct a graph to incorporate structural information of the lung and adopt graph attention network to iteratively update representations of lung segments. To distinguish different infection degrees of left and right lungs, we further introduce a structural attention mechanism. Finally, we introduce demographic information and develop a multi-task learning framework to jointly perform both tasks of classification and regression. Experiments are conducted on a real dataset with 1687 chest CT scans, which includes 1328 mild cases and 359 severe cases. Experimental results show that our method achieves the best classification (e.g., 86.86% in terms of Area Under Curve) and regression (e.g., 0.58 in terms of Correlation Coefficient) performance, compared with other comparison methods.
引用
收藏
页码:557 / 567
页数:11
相关论文
共 60 条
[1]   Graph-Based Deep Learning for Medical Diagnosis and Analysis: Past, Present and Future [J].
Ahmedt-Aristizabal, David ;
Armin, Mohammad Ali ;
Denman, Simon ;
Fookes, Clinton ;
Petersson, Lars .
SENSORS, 2021, 21 (14)
[2]   Multi-task deep learning based CT imaging analysis for COVID-19 pneumonia: Classification and segmentation [J].
Amyar, Amine ;
Modzelewski, Romain ;
Li, Hua ;
Ruan, Su .
COMPUTERS IN BIOLOGY AND MEDICINE, 2020, 126
[3]   CNN-based transfer learning-BiLSTM network: A novel approach for COVID-19 infection detection [J].
Aslan, Muhammet Fatih ;
Unlersen, Muhammed Fahri ;
Sabanci, Kadir ;
Durdu, Akif .
APPLIED SOFT COMPUTING, 2021, 98
[4]  
Bahdanau D, 2016, Arxiv, DOI [arXiv:1409.0473, 10.48550/arXiv.1409.0473,1409.0473, DOI 10.48550/ARXIV.1409.0473,1409.0473]
[5]  
Barstugan M, 2020, Arxiv, DOI [arXiv:2003.09424, 10.48550/arXiv.2003.09424]
[6]   Developing parallel sequential minimal optimization for fast training support vector machine [J].
Cao, L. J. ;
Keerthi, S. S. ;
Ong, C. J. ;
Uvaraj, P. ;
Fu, X. J. ;
Lee, H. P. .
NEUROCOMPUTING, 2006, 70 (1-3) :93-104
[7]  
Chung MS, 2020, EUR RADIOL, V30, P2182, DOI [10.1007/s00330-019-06574-1, 10.1148/radiol.2020200230]
[8]   Interpreting mechanisms of prediction for skin cancer diagnosis using multi-task learning [J].
Coppola, Davide ;
Lee, Hwee Kuan ;
Guan, Cuntai .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW 2020), 2020, :3162-3171
[9]  
Defferrard M, 2016, ADV NEUR IN, V29
[10]   MT-nCov-Net: A Multitask Deep-Learning Framework for Efficient Diagnosis of COVID-19 Using Tomography Scans [J].
Ding, Weiping ;
Abdel-Basset, Mohamed ;
Hawash, Hossam ;
Elkomy, Osama M. .
IEEE TRANSACTIONS ON CYBERNETICS, 2023, 53 (02) :1285-1298