Automated post-operative brain tumour segmentation: A deep learning model based on transfer learning from pre-operative images

被引:28
作者
Ghaffari, Mina [1 ,2 ]
Samarasinghe, Gihan [2 ,3 ]
Jameson, Michael [3 ]
Aly, Farhannah [3 ,4 ,5 ]
Holloway, Lois [3 ,4 ,5 ]
Chlap, Phillip [2 ,3 ]
Koh, Eng-Siew [3 ,4 ,5 ]
Sowmya, Arcot [2 ]
Oliver, Ruth [1 ]
机构
[1] Macquarie Univ, Engn Sch, Sydney, NSW 2109, Australia
[2] Univ New South Wales, Sch Comp Sci & Engn, Barker St, Kensington, NSW 2052, Australia
[3] Ingham Inst Appl Med Res, 1 Campbell St, Liverpool, NSW 2170, Australia
[4] Liverpool & Macarthur Canc Therapy Ctr, Therry Rd, Campbelltown, NSW 2560, Australia
[5] UNSW, South Western Clin Sch, Liverpool Hosp Locked Bag 7103, Liverpool Bc, NSW 1871, Australia
关键词
Brain tumour segmentation; Multimodal MRI; Deep learning; Densely connected CNN;
D O I
10.1016/j.mri.2021.10.012
中图分类号
R8 [特种医学]; R445 [影像诊断学];
学科分类号
1002 ; 100207 ; 1009 ;
摘要
Automated brain tumour segmentation from post-operative images is a clinically relevant yet challenging problem. In this study, an automated method for segmenting brain tumour into its subregions has been developed. The dataset consists of multimodal post-operative brain scans (T1 MRI, post-Gadolinium T1 MRI, and T2FLAIR images) of 15 patients who were treated with post-operative radiation therapy, along with manual annotations of their tumour subregions. A 3D densely-connected U-net was developed for segmentation of brain tumour regions and extensive experiments were conducted to enhance model accuracy. A model was initially developed using the publicly available BraTS dataset consisting of pre-operative brain scans. This model achieved Dice Scores of 0.90, 0.83 and 0.78 for predicting whole tumour, tumour core, and enhancing tumour subregions when tested on BraTS20 blind validation dataset. The acquired knowledge from BraTS was then transferred to the local dataset. For augmentation purpose, the local dataset was registered to a dataset of MRI brain scans of healthy subjects. To improve the robustness of the model and enhance its accuracy, ensemble learning was used to combine the outputs of all the trained models. Even though the size of the dataset is very small, the final model can segment brain tumours with a high Dice Score of 0.83, 0.77 and 0.60 for whole tumour, tumour core and enhancing core respectively.
引用
收藏
页码:28 / 36
页数:9
相关论文
共 34 条
[1]  
Alessandro Crimi, 2019, LECT NOTES COMPUTER, P327, DOI [10.1007/978-3-030-46640-4, DOI 10.1007/978-3-030-46640-4]
[2]  
ANTs, 2020, ADV NORMALIZATION TO
[3]  
ASCO, 2020, BRAIN TUM STAT
[4]  
brats, 2019, BMULT BRAIN TUM SEGM
[5]  
BraTS, 2020, VAL PHAS LEAD
[6]   S3D-UNet: Separable 3D U-Net for Brain Tumor Segmentation [J].
Chen, Wei ;
Liu, Boqiang ;
Peng, Suting ;
Sun, Jiawei ;
Qiao, Xu .
BRAINLESION: GLIOMA, MULTIPLE SCLEROSIS, STROKE AND TRAUMATIC BRAIN INJURIES, BRAINLES 2018, PT II, 2019, 11384 :358-368
[7]  
conv3d, 2020, CONVERT3D
[8]  
Ghaffari M, LECT NOTES COMPUTER, V2021, P481
[9]   Multimodal brain tumour segmentation using densely connected 3D convolutional neural network [J].
Ghaffari, Mina ;
Sowmya, Arcot ;
Oliver, Ruth ;
Hamey, Len .
2019 DIGITAL IMAGE COMPUTING: TECHNIQUES AND APPLICATIONS (DICTA), 2019, :420-424
[10]   Automated Brain Tumor Segmentation Using Multimodal Brain Scans: A Survey Based on Models Submitted to the BraTS 2012-2018 Challenges [J].
Ghaffari, Mina ;
Sowmya, Arcot ;
Oliver, Ruth .
IEEE REVIEWS IN BIOMEDICAL ENGINEERING, 2020, 13 :156-168