Incorporating the hybrid deformable model for improving the performance of abdominal CT segmentation via multi-scale feature fusion network

被引:43
作者
Liang, Xiaokun [1 ,2 ]
Li, Na [1 ,2 ]
Zhang, Zhicheng [3 ]
Xiong, Jing [1 ]
Zhou, Shoujun [1 ]
Xie, Yaoqin [1 ]
机构
[1] Chinese Acad Sci, Shenzhen Inst Adv Technol, Shenzhen 518055, Guangdong, Peoples R China
[2] Univ Chinese Acad Sci, Shenzhen Coll Adv Technol, Shenzhen 518055, Guangdong, Peoples R China
[3] Stanford Univ, Dept Radiat Oncol, Stanford, CA 94305 USA
基金
中国国家自然科学基金;
关键词
Abdominal CT; Segmentation; Attention U-net; Data augmentation; MULTIORGAN SEGMENTATION; LEARNING FRAMEWORK; IMAGE SEGMENTATION; DATA AUGMENTATION; REGIONS; ORGANS; GAN;
D O I
10.1016/j.media.2021.102156
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Automated multi-organ abdominal Computed Tomography (CT) image segmentation can assist the treatment planning, diagnosis, and improve many clinical workflows' efficiency. The 3-D Convolutional Neural Network (CNN) recently attained state-of-the-art accuracy, which typically relies on supervised training with many manual annotated data. Many methods used the data augmentation strategy with a rigid or affine spatial transformation to alleviate the over-fitting problem and improve the network's robustness. However, the rigid or affine spatial transformation fails to capture the complex voxel-based deformation in the abdomen, filled with many soft organs. We developed a novel Hybrid Deformable Model (HDM), which consists of the inter-and intra-patient deformation for more effective data augmentation to tackle this issue. The inter-patient deformations were extracted from the learning-based deformable registration between different patients, while the intra-patient deformations were formed using the random 3-D Thin-Plate-Spline (TPS) transformation. Incorporating the HDM enabled the network to capture many of the subtle deformations of abdominal organs. To find a better solution and achieve faster convergence for network training, we fused the pre-trained multi-scale features into the a 3-D attention U-Net. We directly compared the segmentation accuracy of the proposed method to the previous techniques on several centers' datasets via cross-validation. The proposed method achieves the average Dice Similarity Coefficient (DSC) 0.852, which outperformed the other state-of-the-art on multi-organ abdominal CT segmentation results. (c) 2021 Published by Elsevier B.V.
引用
收藏
页数:11
相关论文
共 86 条
[1]  
[Anonymous], 2015, INT MICCAI WORKSH ME
[2]  
[Anonymous], 2017, arXiv preprint arXiv:1704.06382
[3]   VoxelMorph: A Learning Framework for Deformable Medical Image Registration [J].
Balakrishnan, Guha ;
Zhao, Amy ;
Sabuncu, Mert R. ;
Guttag, John ;
Dalca, Adrian, V .
IEEE TRANSACTIONS ON MEDICAL IMAGING, 2019, 38 (08) :1788-1800
[4]   Deep Learning Techniques for Automatic MRI Cardiac Multi-Structures Segmentation and Diagnosis: Is the Problem Solved? [J].
Bernard, Olivier ;
Lalande, Alain ;
Zotti, Clement ;
Cervenansky, Frederick ;
Yang, Xin ;
Heng, Pheng-Ann ;
Cetin, Irem ;
Lekadir, Karim ;
Camara, Oscar ;
Gonzalez Ballester, Miguel Angel ;
Sanroma, Gerard ;
Napel, Sandy ;
Petersen, Steffen ;
Tziritas, Georgios ;
Grinias, Elias ;
Khened, Mahendra ;
Kollerathu, Varghese Alex ;
Krishnamurthi, Ganapathy ;
Rohe, Marc-Michel ;
Pennec, Xavier ;
Sermesant, Maxime ;
Isensee, Fabian ;
Jaeger, Paul ;
Maier-Hein, Klaus H. ;
Full, Peter M. ;
Wolf, Ivo ;
Engelhardt, Sandy ;
Baumgartner, Christian F. ;
Koch, Lisa M. ;
Wolterink, Jelmer M. ;
Isgum, Ivana ;
Jang, Yeonggul ;
Hong, Yoonmi ;
Patravali, Jay ;
Jain, Shubham ;
Humbert, Olivier ;
Jodoin, Pierre-Marc .
IEEE TRANSACTIONS ON MEDICAL IMAGING, 2018, 37 (11) :2514-2525
[5]   Fully Convolutional Neural Networks Improve Abdominal Organ Segmentation [J].
Bobo, Meg F. ;
Bao, Shunxing ;
Huo, Yuankai ;
Yao, Yuang ;
Virostko, Jack ;
Plassard, Andrew J. ;
Lyu, Ilwoo ;
Assad, Albert ;
Abramson, Richard G. ;
Hilmes, Melissa A. ;
Landman, Bennett A. .
MEDICAL IMAGING 2018: IMAGE PROCESSING, 2018, 10574
[6]   Biomedical Data Augmentation Using Generative Adversarial Neural Networks [J].
Calimeri, Francesco ;
Marzullo, Aldo ;
Stamile, Claudio ;
Terracina, Giorgio .
ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING, PT II, 2017, 10614 :626-634
[7]   Computational anatomy for multi-organ analysis in medical imaging: A review [J].
Cerrolaza, Juan J. ;
Lopez Picazo, Mirella ;
Humbert, Ludovic ;
Sato, Yoshinobu ;
Rueckert, Daniel ;
Gonzalez Ballester, Miguel Angel ;
Linguraru, Marius George .
MEDICAL IMAGE ANALYSIS, 2019, 56 :44-67
[8]   Automatic multi-resolution shape modeling of multi-organ structures [J].
Cerrolaza, Juan J. ;
Reyes, Mauricio ;
Summers, Ronald M. ;
Gonzalez-Ballester, Miguel Angel ;
Linguraru, Marius George .
MEDICAL IMAGE ANALYSIS, 2015, 25 (01) :11-21
[9]   VoxResNet: Deep voxelwise residual networks for brain segmentation from 3D MR images [J].
Chen, Hao ;
Dou, Qi ;
Yu, Lequan ;
Qin, Jing ;
Heng, Pheng-Ann .
NEUROIMAGE, 2018, 170 :446-455
[10]  
Chen Y, 2019, arXiv