Breast Cancer Histopathology Images Classification Through Multi-View Augmented Contrastive Learning and Pre-Learning Knowledge Distillation

被引:2
作者
Si, Jialong [1 ]
Jia, Wei [1 ,2 ]
Jiang, Haifeng [3 ]
机构
[1] Ningxia Univ, Sch Informat Engn, Yinchuan 750021, Ningxia, Peoples R China
[2] Ningxia Key Lab Artificial Intelligence & Informat, Yinchuan 750021, Peoples R China
[3] Ningxia Med Univ, Gen Hosp, Dept Pathol, Yinchuan 750021, Peoples R China
基金
中国国家自然科学基金;
关键词
Breast cancer; Histopathology; Feature extraction; Self-supervised learning; Computational modeling; Knowledge transfer; Knowledge representation; Knowledge discovery; Contrast resolution; Image classification; Biomedical imaging; Knowledge distillation; contrastive learning; breast cancer histopathology image; global feature; local feature; ATTENTION; STATISTICS;
D O I
10.1109/ACCESS.2024.3366185
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Breast cancer is one of the most common malignant tumors in women, and accurate classification of benign and malignant breast cancer histopathology images is critical for diagnosis and treatment. Knowledge distillation techniques have recently received considerable attention for enabling cost-effective image classification of breast cancer histopathology images. However, there are still challenges, including the inefficient extraction of global and local features from breast cancer histopathology images by the teacher network, and the over-prioritization of feature fusion within the same encoder layer, which tends to neglect valuable information from adjacent encoder layers during knowledge extraction. To address these challenges, we propose a method that combines multi-view augmented contrastive learning and pre-learning knowledge distillation. Multi-view augmented contrastive learning improves the ability of the teacher network to extract global and local features. Pre-learning knowledge distillation merges features from adjacent encoder layers of the teacher network, reducing feature loss between these layers. Empirical experiments demonstrate the effectiveness of our proposed method in classifying histopathology images of benign and malignant breast cancer, achieving excellent results on the BreakHis dataset. These results confirm our method as an effective tool for the classification of benign and malignant breast cancer histopathology images.
引用
收藏
页码:25359 / 25371
页数:13
相关论文
共 43 条
[1]   Variational Information Distillation for Knowledge Transfer [J].
Ahn, Sungsoo ;
Hu, Shell Xu ;
Damianou, Andreas ;
Lawrence, Neil D. ;
Dai, Zhenwen .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :9155-9163
[2]   Big Self-Supervised Models Advance Medical Image Classification [J].
Azizi, Shekoofeh ;
Mustafa, Basil ;
Ryan, Fiona ;
Beaver, Zachary ;
Freyberg, Jan ;
Deaton, Jonathan ;
Loh, Aaron ;
Karthikesalingam, Alan ;
Kornblith, Simon ;
Chen, Ting ;
Natarajan, Vivek ;
Norouzi, Mohammad .
2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, :3458-3468
[3]   An innovative medical image synthesis based on dual GAN deep neural networks for improved segmentation quality [J].
Beji, Ahmed ;
Blaiech, Ahmed Ghazi ;
Said, Mourad ;
Ben Abdallah, Asma ;
Bedoui, Mohamed Hedi .
APPLIED INTELLIGENCE, 2023, 53 (03) :3381-3397
[4]   Distilling Knowledge via Knowledge Review [J].
Chen, Pengguang ;
Liu, Shu ;
Zhao, Hengshuang ;
Jia, Jiaya .
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, :5006-5015
[5]  
Chen T, 2020, PR MACH LEARN RES, V119
[6]  
Garg S., 2022, P IEEE BOMB SECT SIG, P1
[7]   Breast Cancer Statistics, 2022 [J].
Giaquinto, Angela N. ;
Sung, Hyuna ;
Miller, Kimberly D. ;
Kramer, Joan L. ;
Newman, Lisa A. ;
Minihan, Adair ;
Jemal, Ahmedin ;
Siegel, Rebecca L. .
CA-A CANCER JOURNAL FOR CLINICIANS, 2022, 72 (06) :524-541
[8]   Knowledge Distillation: A Survey [J].
Gou, Jianping ;
Yu, Baosheng ;
Maybank, Stephen J. ;
Tao, Dacheng .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 2021, 129 (06) :1789-1819
[9]   Causal knowledge fusion for 3D cross-modality cardiac image segmentation [J].
Guo, Saidi ;
Liu, Xiujian ;
Zhang, Heye ;
Lin, Qixin ;
Xu, Lei ;
Shi, Changzheng ;
Gao, Zhifan ;
Guzzo, Antonella ;
Fortino, Giancarlo .
INFORMATION FUSION, 2023, 99
[10]   Momentum Contrast for Unsupervised Visual Representation Learning [J].
He, Kaiming ;
Fan, Haoqi ;
Wu, Yuxin ;
Xie, Saining ;
Girshick, Ross .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2020), 2020, :9726-9735