Self-supervised Learning Based on Max-tree Representation for Medical Image Segmentation

被引:0
作者
Tang, Qian [1 ]
Du, Bo [1 ]
Xu, Yongchao [1 ]
机构
[1] Wuhan Univ, Sch Comp Sci, Wuhan, Peoples R China
来源
2022 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN) | 2022年
基金
中国国家自然科学基金;
关键词
Self-supervised Learning; Max-tree; Medical Image Segmentation;
D O I
10.1109/IJCNN55064.2022.9892853
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In recent years, the convolutional neural network(CNN) based deep learning architectures have achieved great success in medical image segmentation. However, CNN usually relies on abundant labeled data for training. At the same time, collecting labeled training data is time-consuming and expensive. Therefore, in addition to the common unsupervised learning methods, a series of self-supervised learning(SSL) methods have been proposed in medical image analysis using a large amount of unlabeled data. These SSL strategies usually extract potential supervised signals by pretext tasks and help the networks learn a way of feature representation. However, the learned feature representations in the pretext tasks are not commonly directly related to downstream tasks like segmentation. We assume that the more pretext tasks help the model learn the structural features of the image, the better the model's performance on the downstream segmentation task will be. In this paper, we propose an SSL strategy based on max-tree representation to extract the image structure information, and the CNN learns this max-tree representation in the pretext task. To the best of our knowledge, we are the first to take the structure information into account in the SSL pretext task. Extensive experiments show that our SSL strategy based on max-tree representation can help the CNN to learn abundant structural information, which is significantly useful for the downstream segmentation task.
引用
收藏
页数:6
相关论文
共 23 条
[1]   The Lung Image Database Consortium, (LIDC) and Image Database Resource Initiative (IDRI): A Completed Reference Database of Lung Nodules on CT Scans [J].
Armato, Samuel G., III ;
McLennan, Geoffrey ;
Bidaut, Luc ;
McNitt-Gray, Michael F. ;
Meyer, Charles R. ;
Reeves, Anthony P. ;
Zhao, Binsheng ;
Aberle, Denise R. ;
Henschke, Claudia I. ;
Hoffman, Eric A. ;
Kazerooni, Ella A. ;
MacMahon, Heber ;
van Beek, Edwin J. R. ;
Yankelevitz, David ;
Biancardi, Alberto M. ;
Bland, Peyton H. ;
Brown, Matthew S. ;
Engelmann, Roger M. ;
Laderach, Gary E. ;
Max, Daniel ;
Pais, Richard C. ;
Qing, David P-Y ;
Roberts, Rachael Y. ;
Smith, Amanda R. ;
Starkey, Adam ;
Batra, Poonam ;
Caligiuri, Philip ;
Farooqi, Ali ;
Gladish, Gregory W. ;
Jude, C. Matilda ;
Munden, Reginald F. ;
Petkovska, Iva ;
Quint, Leslie E. ;
Schwartz, Lawrence H. ;
Sundaram, Baskaran ;
Dodd, Lori E. ;
Fenimore, Charles ;
Gur, David ;
Petrick, Nicholas ;
Freymann, John ;
Kirby, Justin ;
Hughes, Brian ;
Casteele, Alessi Vande ;
Gupte, Sangeeta ;
Sallam, Maha ;
Heath, Michael D. ;
Kuhn, Michael H. ;
Dharaiya, Ekta ;
Burns, Richard ;
Fryd, David S. .
MEDICAL PHYSICS, 2011, 38 (02) :915-931
[2]   Self-Supervised Learning for Cardiac MR Image Segmentation by Anatomical Position Prediction [J].
Bai, Wenjia ;
Chen, Chen ;
Tarroni, Giacomo ;
Duan, Jinming ;
Guitton, Florian ;
Petersen, Steffen E. ;
Guo, Yike ;
Matthews, Paul M. ;
Rueckert, Daniel .
MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2019, PT II, 2019, 11765 :541-549
[3]  
Chen T., 2020, ICML
[4]   Unsupervised Visual Representation Learning by Context Prediction [J].
Doersch, Carl ;
Gupta, Abhinav ;
Efros, Alexei A. .
2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2015, :1422-1430
[5]  
Gidaris S., 2018, INT C LEARN REPR ICL
[6]  
Grill Jean-Bastien, 2020, P INT C MACH LEARN
[7]  
He K., 2021, CoRR
[8]   Momentum Contrast for Unsupervised Visual Representation Learning [J].
He, Kaiming ;
Fan, Haoqi ;
Wu, Yuxin ;
Xie, Saining ;
Girshick, Ross .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2020), 2020, :9726-9735
[9]   Deep Residual Learning for Image Recognition [J].
He, Kaiming ;
Zhang, Xiangyu ;
Ren, Shaoqing ;
Sun, Jian .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :770-778
[10]   Rotation-Oriented Collaborative Self-Supervised Learning for Retinal Disease Diagnosis [J].
Li, Xiaomeng ;
Hu, Xiaowei ;
Qi, Xiaojuan ;
Yu, Lequan ;
Zhao, Wei ;
Heng, Pheng-Ann ;
Xing, Lei .
IEEE TRANSACTIONS ON MEDICAL IMAGING, 2021, 40 (09) :2284-2294