Deep learning for head and neck semi-supervised semantic segmentation

被引:3
作者
Luan, Shunyao [1 ,2 ]
Ding, Yi [2 ]
Shao, Jiakang [1 ]
Zou, Bing [3 ]
Yu, Xiao [4 ]
Qin, Nannan [5 ]
Zhu, Benpeng [1 ]
Wei, Wei [2 ]
Xue, Xudong [2 ]
机构
[1] Huazhong Univ Sci & Technol, Sch Integrated Circuits, Lab Optoelect, Wuhan, Peoples R China
[2] Huazhong Univ Sci & Technol, Hubei Canc Hosp, TongJi Med Coll, Dept Radiat Oncol, Wuhan, Hubei, Peoples R China
[3] Nanchang Univ, Affiliated Hosp 2, Dept Oncol, Nanchang, Peoples R China
[4] Univ Sci & Technol China, Affiliated Hosp USTC 1, Dept Radiat Oncol, Div Life Sci & Med, Hefei, Peoples R China
[5] Bengbu Med Coll, Affiliated Hosp 1, Bengbu, Peoples R China
关键词
radiation therapy; semi-supervised semantic segmentation; domain shift; confirmation bias; deep learning; ORGANS; RISK; IMAGES;
D O I
10.1088/1361-6560/ad25c2
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
Objective. Radiation therapy (RT) represents a prevalent therapeutic modality for head and neck (H&N) cancer. A crucial phase in RT planning involves the precise delineation of organs-at-risks (OARs), employing computed tomography (CT) scans. Nevertheless, the manual delineation of OARs is a labor-intensive process, necessitating individual scrutiny of each CT image slice, not to mention that a standard CT scan comprises hundreds of such slices. Furthermore, there is a significant domain shift between different institutions' H&N data, which makes traditional semi-supervised learning strategies susceptible to confirmation bias. Therefore, effectively using unlabeled datasets to support annotated datasets for model training has become a critical issue for preventing domain shift and confirmation bias. Approach. In this work, we proposed an innovative cross-domain orthogon-based-perspective consistency (CD-OPC) strategy within a two-branch collaborative training framework, which compels the two sub-networks to acquire valuable features from unrelated perspectives. More specifically, a novel generative pretext task cross-domain prediction (CDP) was designed for learning inherent properties of CT images. Then this prior knowledge was utilized to promote the independent learning of distinct features by the two sub-networks from identical inputs, thereby enhancing the perceptual capabilities of the sub-networks through orthogon-based pseudo-labeling knowledge transfer. Main results. Our CD-OPC model was trained on H&N datasets from nine different institutions, and validated on the four local intuitions' H&N datasets. Among all datasets CD-OPC achieved more advanced performance than other semi-supervised semantic segmentation algorithms. Significance. The CD-OPC method successfully mitigates domain shift and prevents network collapse. In addition, it enhances the network's perceptual abilities, and generates more reliable predictions, thereby further addressing the confirmation bias issue.
引用
收藏
页数:20
相关论文
共 50 条
  • [1] Semi-Supervised Learning for Semantic Segmentation of Emphysema With Partial Annotations
    Peng, Liying
    Lin, Lanfen
    Hu, Hongjie
    Zhang, Yue
    Li, Huali
    Iwamoto, Yutaro
    Han, Xian-Hua
    Chen, Yen-Wei
    IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2020, 24 (08) : 2327 - 2336
  • [2] Lidar-Camera Semi-Supervised Learning for Semantic Segmentation
    Caltagirone, Luca
    Bellone, Mauro
    Svensson, Lennart
    Wahde, Mattias
    Sell, Raivo
    SENSORS, 2021, 21 (14)
  • [3] Semi-Supervised Semantic Segmentation With Region Relevance
    Chen, Rui
    Chen, Tao
    Wang, Qiong
    Yao, Yazhou
    2023 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO, ICME, 2023, : 852 - 857
  • [4] Information Transfer in Semi-Supervised Semantic Segmentation
    Wu, Jiawei
    Fan, Haoyi
    Li, Zuoyong
    Liu, Guang-Hai
    Lin, Shouying
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34 (02) : 1174 - 1185
  • [5] Semantic Segmentation of seafloor images in Philippines based on semi-supervised learning
    Wang, Shulei
    Mizuno, Katsunori
    Tabeta, Shigeru
    Kei, Terayama
    2023 IEEE UNDERWATER TECHNOLOGY, UT, 2023,
  • [6] Revisiting Consistency for Semi-Supervised Semantic Segmentation
    Grubisic, Ivan
    Orsic, Marin
    Segvic, Sinisa
    SENSORS, 2023, 23 (02)
  • [7] PRCL: Probabilistic Representation Contrastive Learning for Semi-Supervised Semantic Segmentation
    Xie, Haoyu
    Wang, Changqi
    Zhao, Jian
    Liu, Yang
    Dan, Jun
    Fu, Chong
    Sun, Baigui
    INTERNATIONAL JOURNAL OF COMPUTER VISION, 2024, 132 (10) : 4343 - 4361
  • [8] Reciprocal Learning for Semi-supervised Segmentation
    Zeng, Xiangyun
    Huang, Rian
    Zhong, Yuming
    Sun, Dong
    Han, Chu
    Lin, Di
    Ni, Dong
    Wang, Yi
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2021, PT II, 2021, 12902 : 352 - 361
  • [9] Semantic and Generalized Entropy Loss Functions for Semi-Supervised Deep Learning
    Gajowniczek, Krzysztof
    Liang, Yitao
    Friedman, Tal
    Zabkowski, Tomasz
    van den Broeck, Guy
    ENTROPY, 2020, 22 (03)
  • [10] S5Mars: Semi-Supervised Learning for Mars Semantic Segmentation
    Zhang, Jiahang
    Lin, Lilang
    Fan, Zejia
    Wang, Wenjing
    Liu, Jiaying
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62 : 1 - 15