A Dual-Task Mutual Learning Framework for Predicting Post-thrombectomy Cerebral Hemorrhage

被引:0
作者
Jiang, Caiwen [1 ,2 ,3 ]
Wang, Tianyu [5 ]
Xing, Xiaodan [3 ]
Liu, Mianxin [7 ]
Yang, Guang [3 ,8 ,9 ,10 ]
Ding, Zhongxiang [5 ]
Shen, Dinggang [1 ,2 ,4 ,6 ]
机构
[1] ShanghaiTech Univ, Sch Biomed Engn, Shanghai, Peoples R China
[2] ShanghaiTech Univ, State Key Lab Adv Med Mat & Devices, Shanghai, Peoples R China
[3] Imperial Coll London, Bioengn Dept & Imperial X, London, England
[4] Shanghai United Imaging Intelligence Co Ltd, Shanghai, Peoples R China
[5] Westlake Univ, Affiliated Hangzhou Peoples Hosp 1, Dept Radiol, Sch Med, Hangzhou, Peoples R China
[6] Shanghai Clin Res & Trial Ctr, Shanghai 201210, Peoples R China
[7] Shanghai Artificial Intelligence Lab, Shanghai 200232, Peoples R China
[8] Imperial Coll London, Natl Heart & Lung Inst, London, England
[9] Royal Brompton Hosp, Cardiovasc Res Ctr, London, England
[10] Kings Coll London, Sch Biomed Engn & Imaging Sci, London, England
来源
SIMULATION AND SYNTHESIS IN MEDICAL IMAGING, SASHIMI 2024 | 2025年 / 15187卷
基金
中国国家自然科学基金;
关键词
Postoperative cerebral hemorrhage; Prediction of hemorrhage progression; Dual-task mutual learning; Interactive attention;
D O I
10.1007/978-3-031-73281-2_6
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Ischemic stroke is a severe condition caused by the blockage of brain blood vessels, and can lead to the death of brain tissue due to oxygen deprivation. Thrombectomy has become a common treatment choice for ischemic stroke due to its immediate effectiveness. But, it carries the risk of postoperative cerebral hemorrhage. Clinically, multiple CT scans within 0-72 h post-surgery are used to monitor for hemorrhage. However, this approach exposes radiation dose to patients, and may delay the detection of cerebral hemorrhage. To address this dilemma, we propose a novel prediction framework for measuring postoperative cerebral hemorrhage using only the patient's initial CT scan. Specifically, we introduce a dual-task mutual learning framework to takes the initial CT scan as input and simultaneously estimates both the follow-up CT scan and prognostic label to predict the occurrence of postoperative cerebral hemorrhage. Our proposed framework incorporates two attention mechanisms, i.e., self-attention and interactive attention. Specifically, the self-attention mechanism allows the model to focus more on high-density areas in the image, which are critical for diagnosis (i.e., potential hemorrhage areas). The interactive attention mechanism further models the dependencies between the interrelated generation and classification tasks, enabling both tasks to perform better than the case when conducted individually. Validated on clinical data, our method can generate follow-up CT scans better than state-of-the-art methods, and achieves an accuracy of 86.37% in predicting follow-up prognostic labels. Thus, our work thus contributes to the timely screening of post-thrombectomy cerebral hemorrhage, and could significantly reform the clinical process of thrombectomy and other similar operations related to stroke.
引用
收藏
页码:58 / 68
页数:11
相关论文
共 23 条
[1]   Toward Comprehensive Chronic Kidney Disease Prediction Based on Ensemble Deep Learning Models [J].
Alsekait, Deema Mohammed ;
Saleh, Hager ;
Gabralla, Lubna Abdelkareim ;
Alnowaiser, Khaled ;
El-Sappagh, Shaker ;
Sahal, Radhya ;
El-Rashidy, Nora .
APPLIED SCIENCES-BASEL, 2023, 13 (06)
[2]  
Avants BB, 2009, INSIGHT J, P1, DOI DOI 10.54294/UVNHIN
[3]   End to end vision transformer architecture for brain stroke assessment based on multi-slice classification and localization using computed tomography [J].
Ayoub, Muhammad ;
Liao, Zhifang ;
Hussain, Shabir ;
Li, Lifeng ;
Zhang, Chris W. J. ;
Wong, Kelvin K. L. .
COMPUTERIZED MEDICAL IMAGING AND GRAPHICS, 2023, 109
[4]  
Chen J N, 2021, arXiv
[5]  
Chen Z, 2018, PR MACH LEARN RES, V80
[6]   ResViT: Residual Vision Transformers for Multimodal Medical Image Synthesis [J].
Dalmaz, Onat ;
Yurt, Mahmut ;
Cukur, Tolga .
IEEE TRANSACTIONS ON MEDICAL IMAGING, 2022, 41 (10) :2598-2614
[7]   Mechanical thrombectomy in acute ischemic stroke [J].
Derex, L. ;
Cho, T. -H. .
REVUE NEUROLOGIQUE, 2017, 173 (03) :106-113
[8]   GAN-based synthetic medical image augmentation for increased CNN performance in liver lesion classification [J].
Frid-Adar, Maayan ;
Diamant, Idit ;
Klang, Eyal ;
Amitai, Michal ;
Goldberger, Jacob ;
Greenspan, Hayit .
NEUROCOMPUTING, 2018, 321 :321-331
[9]   A Novel Dual-Energy CT Method for Detection and Differentiation of Intracerebral Hemorrhage From Contrast Extravasation in Stroke Patients After Endovascular Thrombectomy Feasibility and First Results [J].
Grkovski, Risto ;
Acu, Leyla ;
Ahmadli, Uzeyir ;
Terziev, Robert ;
Schubert, Tilman ;
Wegener, Susanne ;
Kulcsar, Zsolt ;
Husain, Shakir ;
Alkadhi, Hatem ;
Winklhofer, Sebastian .
CLINICAL NEURORADIOLOGY, 2023, 33 (01) :171-177
[10]   Image prediction of disease progression for osteoarthritis by style-based manifold extrapolation [J].
Han, Tianyu ;
Kather, Jakob Nikolas ;
Pedersoli, Federico ;
Zimmermann, Markus ;
Keil, Sebastian ;
Schulze-Hagen, Maximilian ;
Terwoelbeck, Marc ;
Isfort, Peter ;
Haarburger, Christoph ;
Kiessling, Fabian ;
Kuhl, Christiane ;
Schulz, Volkmar ;
Nebelung, Sven ;
Truhn, Daniel .
NATURE MACHINE INTELLIGENCE, 2022, 4 (11) :1029-+