Generalizable Pancreas Segmentation Modeling in CT Imaging via Meta-Learning and Latent-Space Feature Flow Generation

被引:11
作者
Li, Jun [1 ]
Chen, Tao [2 ]
Qian, Xiaohua [1 ]
机构
[1] Shanghai Jiao Tong Univ, Sch Biomed Engn, Shanghai 200030, Peoples R China
[2] Shanghai Jiao Tong Univ, Renji Hosp, Sch Med, Dept Biliary Pancreat Surg, Shanghai 200240, Peoples R China
基金
上海市自然科学基金; 中国国家自然科学基金;
关键词
Image segmentation; Pancreas; Adaptation models; Task analysis; Bioinformatics; Computed tomography; Training; Pancreas segmentation; generalization; meta-learning; feature flow generation; DOMAIN ADAPTATION; CANCER;
D O I
10.1109/JBHI.2022.3207597
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Accurate pancreas segmentation is highly crucial for diagnosing and treating pancreatic diseases. Although CNN has demonstrated promising outcomes, the performance on unseen data can be significantly compromised by the wide appearance-style variations induced by different imaging factors. Thus, we propose a generalizable pancreas segmentation model based on a meta-learning strategy and latent-space feature flow generation method. Our approach enhances the generalizability by systematically reducing the interference from the cluttered background and appearance-style discrepancies through a coarse-to-fine workflow. Specifically, the integrity-preserving coarse segmentation module is designed to adaptively balance the pancreas coverage and segmentation accuracy with the meta-learning strategy for filtering out background clutter. It also enhances the generalization of the coarse model to reasonably-accurate ROIs thereby promoting the stability of fine segmentation. Subsequently, the appearance-style feature flow generation method is developed to generate a series of progressively-varying style-related intermediate representations between two latent spaces. This feature flow effectively models the distribution variations caused by appearance-style discrepancies, and thus enhances the adaptability of the fine model. Our method achieves superior performance on three pancreas datasets and outperforms state-of-the-art generalization methods. Besides, it can be easily integrated into other workflows, leading to a potential paradigm for enhancing generalization performance.
引用
收藏
页码:374 / 385
页数:12
相关论文
共 51 条
[41]   Visualizing and Understanding Convolutional Networks [J].
Zeiler, Matthew D. ;
Fergus, Rob .
COMPUTER VISION - ECCV 2014, PT I, 2014, 8689 :818-833
[42]   Automatic pancreas segmentation based on lightweight DCNN modules and spatial prior propagation [J].
Zhang, Dingwen ;
Zhang, Jiajia ;
Zhang, Qiang ;
Han, Jungong ;
Zhang, Shu ;
Han, Junwei .
PATTERN RECOGNITION, 2021, 114
[43]   Cross-modality deep feature learning for brain tumor segmentation [J].
Zhang, Dingwen ;
Huang, Guohai ;
Zhang, Qiang ;
Han, Jungong ;
Han, Junwei ;
Yu, Yizhou .
PATTERN RECOGNITION, 2021, 110
[44]   Exploring Task Structure for Brain Tumor Segmentation From Multi-Modality MR Images [J].
Zhang, Dingwen ;
Huang, Guohai ;
Zhang, Qiang ;
Han, Jungong ;
Han, Junwei ;
Wang, Yizhou ;
Yu, Yizhou .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 :9032-9043
[45]   Generalizable model-agnostic semantic segmentation via target-specific normalization [J].
Zhang, Jian ;
Qi, Lei ;
Shi, Yinghuan ;
Gao, Yang .
PATTERN RECOGNITION, 2022, 122
[46]   DoDNet: Learning to Segment Multi-Organ and Tumors from Multiple Partially Labeled Datasets [J].
Zhang, Jianpeng ;
Xie, Yutong ;
Xia, Yong ;
Shen, Chunhua .
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, :1195-1204
[47]   Generalizing Deep Learning for Medical Image Segmentation to Unseen Domains via Deep Stacked Transformation [J].
Zhang, Ling ;
Wang, Xiaosong ;
Yang, Dong ;
Sanford, Thomas ;
Harmon, Stephanie ;
Turkbey, Baris ;
Wood, Bradford J. ;
Roth, Holger ;
Myronenko, Andriy ;
Xu, Daguang ;
Xu, Ziyue .
IEEE TRANSACTIONS ON MEDICAL IMAGING, 2020, 39 (07) :2531-2540
[48]   A deep learning framework for pancreas segmentation with multi-atlas registration and 3D level-set [J].
Zhang, Yue ;
Wu, Jiong ;
Liu, Yilong ;
Chen, Yifan ;
Chen, Wei ;
Wu, Ed. X. ;
Li, Chunming ;
Tang, Xiaoying .
MEDICAL IMAGE ANALYSIS, 2021, 68
[49]   Fully Automated Pancreas Segmentation with Two-Stage 3D Convolutional Neural Networks [J].
Zhao, Ningning ;
Tong, Nuo ;
Ruan, Dan ;
Sheng, Ke .
MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2019, PT II, 2019, 11765 :201-209
[50]   V-NAS: Neural Architecture Search for Volumetric Medical Image Segmentation [J].
Zhu, Zhuotun ;
Liu, Chenxi ;
Yang, Dong ;
Yuille, Alan ;
Xu, Daguang .
2019 INTERNATIONAL CONFERENCE ON 3D VISION (3DV 2019), 2019, :240-248