Explainable attention guided adversarial deep network for 3D radiotherapy dose distribution prediction

被引:29
作者
Li, Huidong [1 ]
Peng, Xingchen [2 ]
Zeng, Jie [1 ]
Xiao, Jianghong [3 ]
Nie, Dong [4 ]
Zu, Chen [5 ]
Wu, Xi [6 ]
Zhou, Jiliu [1 ,6 ]
Wang, Yan [1 ]
机构
[1] Sichuan Univ, Sch Comp Sci, Chengdu, Sichuan, Peoples R China
[2] Sichuan Univ, West China Hosp, Canc Ctr, Dept Radiat Oncol, Chengdu, Sichuan, Peoples R China
[3] Sichuan Univ, West China Hosp, Canc Ctr, Dept Biotherapy, Chengdu, Sichuan, Peoples R China
[4] Univ North Carolina Chapel Hill, Dept Comp Sci, Chapel Hill, NC USA
[5] JDcom, Dept Risk Controlling Res, Beijing, Peoples R China
[6] Chengdu Univ Informat Technol, Sch Comp Sci, Chengdu, Sichuan, Peoples R China
基金
中国国家自然科学基金;
关键词
Radiotherapy treatment; Deep learning; Dose distribution prediction; Cross-task feature fusion; Multi-task learning; INTENSITY-MODULATED RADIOTHERAPY; RECTAL-CANCER; ARC THERAPY; IMRT;
D O I
10.1016/j.knosys.2022.108324
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Radiotherapy is the mainstay treatment for most patients with cancer. During radiotherapy planning, it is essential to generate a clinically acceptable dose distribution map. In practice, dosimetrists need to tweak the planning in an iterative trial-and-error manner according to their experience, making traditional workflow time-consuming and subjective. Although some deep learning-based dose prediction models have been proposed, they always require additional handcrafted features, such as planning target volume (PTV) and organs at risk (OAR) segmentation maps, as network inputs. To overcome these limitations, we propose a multi-task attention adversarial network (MtAA-NET) to automatically complete dose planning using only CT images. In particular, our framework consists of a main dose distribution prediction task to generate a dose map and an auxiliary segmentation task to provide additional anatomical information of the PTV and OAR for the main task, implemented by a shared encoder and two exclusive decoders. To effectively integrate dosimetric and anatomical features, we introduce an attention mechanism embedded cross-task feature fusion (CtFF) module to further fuse the features from different tasks in a deep supervision manner. Note that the generated attention maps reveal the attention of our model in the PTV area of the intermediate features, providing an explainable evaluation of the quality of the predicted dose maps. Experimental results on an inhouse cervical cancer dataset and a public head and neck cancer dataset demonstrate the superiority of the proposed method compared with state-of-the-art methods.(c) 2022 Elsevier B.V. All rights reserved.
引用
收藏
页数:14
相关论文
共 50 条
[31]   Deep learning-based dose prediction for magnetic resonance-guided prostate radiotherapy [J].
Fransson, Samuel ;
Strand, Robin ;
Tilly, David .
MEDICAL PHYSICS, 2024, 51 (11) :8087-8095
[32]   Deep learning-enabled EPID-based 3D dosimetry for dose verification of step-and-shoot radiotherapy [J].
Jia, Mengyu ;
Wu, Yan ;
Yang, Yong ;
Wang, Lei ;
Chuang, Cynthia ;
Han, Bin ;
Xing, Lei .
MEDICAL PHYSICS, 2021, 48 (11) :6810-6819
[33]   ADAPTIVE MULTI-ORGAN LOSS BASED GENERATIVE ADVERSARIAL NETWORK FOR AUTOMATIC DOSE PREDICTION IN RADIOTHERAPY [J].
Cao, Chongyang ;
Xiao, Jianghong ;
Zhan, Bo ;
Peng, Xingchen ;
Wu, Xi ;
Zhou, Jiliu ;
Wang, Yan .
2021 IEEE 18TH INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING (ISBI), 2021, :212-215
[34]   DoseGAN: a generative adversarial network for synthetic dose prediction using attention-gated discrimination and generation [J].
Kearney, Vasant ;
Chan, Jason W. ;
Wang, Tianqi ;
Perry, Alan ;
Descovich, Martina ;
Morin, Olivier ;
Yom, Sue S. ;
Solberg, Timothy D. .
SCIENTIFIC REPORTS, 2020, 10 (01)
[35]   Utilizing pre-determined beam orientation information in dose prediction by 3D fully-connected network for intensity modulated radiotherapy [J].
Yan, Hui ;
Liu, Shoulin ;
Zhang, Jingjing ;
Liu, Jianfei ;
Li, Teng .
QUANTITATIVE IMAGING IN MEDICINE AND SURGERY, 2021, 11 (12) :4742-4752
[36]   Dose distribution correction for the influence of magnetic field using a deep convolutional neural network for online MR-guided adaptive radiotherapy [J].
Kajikawa, Tomohiro ;
Kadoya, Noriyuki ;
Tanaka, Shohei ;
Nemoto, Hikaru ;
Takahashi, Noriyoshi ;
Chiba, Takahito ;
Ito, Kengo ;
Katsuta, Yoshiyuki ;
Dobashi, Suguru ;
Takeda, Ken ;
Yamada, Kei ;
Jingu, Keiichi .
PHYSICA MEDICA-EUROPEAN JOURNAL OF MEDICAL PHYSICS, 2020, 80 :186-192
[37]   Attention 3D U-NET for dose distribution prediction of high-dose-rate brachytherapy of cervical cancer: Direction modulated brachytherapy tandem applicator [J].
Gautam, Suman ;
Osman, Alexander F. I. ;
Richeson, Dylan ;
Gholami, Somayeh ;
Manandhar, Binod ;
Alam, Sharmin ;
Song, William Y. .
MEDICAL PHYSICS, 2024, 51 (08) :5593-5603
[38]   Conformal Prediction for Explainable AI and Lesion Detection in 3D Cranial Ultrasound [J].
Estermann, Flora ;
Kaftandjian, Valerie ;
Guy, Philippe ;
Quetin, Philippe ;
Delachartre, Philippe .
2024 IEEE ULTRASONICS, FERROELECTRICS, AND FREQUENCY CONTROL JOINT SYMPOSIUM, UFFC-JS 2024, 2024,
[39]   ACMTR: Attention-guided, combined multi-scale, transformer reasoning-based network for 3D CT pelvic functional bone marrow segmentation [J].
Zeng, Junying ;
Li, Wanying ;
Zheng, Bin ;
Xiao, Lin ;
Zhang, Xiuping ;
Zhong, Qian ;
Liang, Shufen ;
Wang, Jie ;
Huang, Yuanqiong ;
Qin, Chuanbo .
BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2023, 82
[40]   Improvement of accumulated dose distribution in combined cervical cancer radiotherapy with deep learning-based dose prediction [J].
Fu, Qi ;
Chen, Xinyuan ;
Liu, Yuxiang ;
Zhang, Jingbo ;
Xu, Yingjie ;
Yang, Xi ;
Huang, Manni ;
Men, Kuo ;
Dai, Jianrong .
FRONTIERS IN ONCOLOGY, 2024, 14