Explainable attention guided adversarial deep network for 3D radiotherapy dose distribution prediction

被引:25
|
作者
Li, Huidong [1 ]
Peng, Xingchen [2 ]
Zeng, Jie [1 ]
Xiao, Jianghong [3 ]
Nie, Dong [4 ]
Zu, Chen [5 ]
Wu, Xi [6 ]
Zhou, Jiliu [1 ,6 ]
Wang, Yan [1 ]
机构
[1] Sichuan Univ, Sch Comp Sci, Chengdu, Sichuan, Peoples R China
[2] Sichuan Univ, West China Hosp, Canc Ctr, Dept Radiat Oncol, Chengdu, Sichuan, Peoples R China
[3] Sichuan Univ, West China Hosp, Canc Ctr, Dept Biotherapy, Chengdu, Sichuan, Peoples R China
[4] Univ North Carolina Chapel Hill, Dept Comp Sci, Chapel Hill, NC USA
[5] JDcom, Dept Risk Controlling Res, Beijing, Peoples R China
[6] Chengdu Univ Informat Technol, Sch Comp Sci, Chengdu, Sichuan, Peoples R China
基金
中国国家自然科学基金;
关键词
Radiotherapy treatment; Deep learning; Dose distribution prediction; Cross-task feature fusion; Multi-task learning; INTENSITY-MODULATED RADIOTHERAPY; RECTAL-CANCER; ARC THERAPY; IMRT;
D O I
10.1016/j.knosys.2022.108324
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Radiotherapy is the mainstay treatment for most patients with cancer. During radiotherapy planning, it is essential to generate a clinically acceptable dose distribution map. In practice, dosimetrists need to tweak the planning in an iterative trial-and-error manner according to their experience, making traditional workflow time-consuming and subjective. Although some deep learning-based dose prediction models have been proposed, they always require additional handcrafted features, such as planning target volume (PTV) and organs at risk (OAR) segmentation maps, as network inputs. To overcome these limitations, we propose a multi-task attention adversarial network (MtAA-NET) to automatically complete dose planning using only CT images. In particular, our framework consists of a main dose distribution prediction task to generate a dose map and an auxiliary segmentation task to provide additional anatomical information of the PTV and OAR for the main task, implemented by a shared encoder and two exclusive decoders. To effectively integrate dosimetric and anatomical features, we introduce an attention mechanism embedded cross-task feature fusion (CtFF) module to further fuse the features from different tasks in a deep supervision manner. Note that the generated attention maps reveal the attention of our model in the PTV area of the intermediate features, providing an explainable evaluation of the quality of the predicted dose maps. Experimental results on an inhouse cervical cancer dataset and a public head and neck cancer dataset demonstrate the superiority of the proposed method compared with state-of-the-art methods.(c) 2022 Elsevier B.V. All rights reserved.
引用
收藏
页数:14
相关论文
共 50 条
  • [1] Predicting 3D dose distribution with scale attention network for prostate radiotherapy
    Adabi, Saba
    Tzeng, Tzu-Chi
    Yuan, Yading
    MEDICAL IMAGING 2022: IMAGE-GUIDED PROCEDURES, ROBOTIC INTERVENTIONS, AND MODELING, 2022, 12034
  • [2] A cascade transformer-based model for 3D dose distribution prediction in head and neck cancer radiotherapy
    Gheshlaghi, Tara
    Nabavi, Shahabedin
    Shirzadikia, Samireh
    Moghaddam, Mohsen Ebrahimi
    Rostampour, Nima
    PHYSICS IN MEDICINE AND BIOLOGY, 2024, 69 (04)
  • [3] Attention-aware 3D U-Net convolutional neural network for knowledge-based planning 3D dose distribution prediction of head-and-neck cancer
    Osman, Alexander F., I
    Tamam, Nissren M.
    JOURNAL OF APPLIED CLINICAL MEDICAL PHYSICS, 2022, 23 (07):
  • [4] Deep-neural network approaches for predicting 3D dose distribution in intensity-modulated radiotherapy of the brain tumors
    Irannejad, Maziar
    Abedi, Iraj
    Lonbani, Vida Darbaghi
    Hassanvand, Maryam
    JOURNAL OF APPLIED CLINICAL MEDICAL PHYSICS, 2024, 25 (03):
  • [5] Site-agnostic 3D dose distribution prediction with deep learning neural networks
    Mashayekhi, Maryam
    Tapia, Itzel Ramirez
    Balagopal, Anjali
    Zhong, Xinran
    Barkousaraie, Azar Sadeghnejad
    McBeth, Rafe
    Lin, Mu-Han
    Jiang, Steve
    Dan Nguyen
    MEDICAL PHYSICS, 2022, 49 (03) : 1391 - 1406
  • [6] 3D radiotherapy dose prediction on head and neck cancer patients with a hierarchically densely connected U-net deep learning architecture
    Dan Nguyen
    Jia, Xun
    Sher, David
    Lin, Mu-Han
    Iqbal, Zohaib
    Liu, Hui
    Jiang, Steve
    PHYSICS IN MEDICINE AND BIOLOGY, 2019, 64 (06)
  • [7] 3D DEEP ATTENTION NETWORK FOR SURVIVAL PREDICTION FROM MAGNETIC RESONANCE IMAGES IN GLIOBLASTOMA
    Liu, Zijia
    Sun, Qiuchang
    Bai, Hongmin
    Liang, Chaofeng
    Chen, Yinsheng
    Li, Zhi-Cheng
    2019 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2019, : 1381 - 1384
  • [8] Incorporating dosimetric features into the prediction of 3D VMAT dose distributions using deep convolutional neural network
    Ma, Ming
    Kovalchuk, Nataliya
    Buyyounouski, Mark K.
    Xing, Lei
    Yang, Yong
    PHYSICS IN MEDICINE AND BIOLOGY, 2019, 64 (12)
  • [9] Multi-constraint generative adversarial network for dose prediction in radiotherapy
    Zhan, Bo
    Xiao, Jianghong
    Cao, Chongyang
    Peng, Xingchen
    Zu, Chen
    Zhou, Jiliu
    Wang, Yan
    MEDICAL IMAGE ANALYSIS, 2022, 77
  • [10] CT-Only Radiotherapy: An Exploratory Study for Automatic Dose Prediction on Rectal Cancer Patients Via Deep Adversarial Network
    Cui, Jiaqi
    Jiao, Zhengyang
    Wei, Zhigong
    Hu, Xiaolin
    Wang, Yan
    Xiao, Jianghong
    Peng, Xingchen
    FRONTIERS IN ONCOLOGY, 2022, 12