Semantic Decomposition Network With Contrastive and Structural Constraints for Dental Plaque Segmentation

被引:9
作者
Shi, Jian [1 ]
Sun, Baoli [1 ]
Ye, Xinchen [1 ]
Wang, Zhihui [1 ]
Luo, Xiaolong [2 ]
Liu, Jin [2 ]
Gao, Heli [2 ]
Li, Haojie [1 ]
机构
[1] Dalian Univ Technol, DUT RU Int Sch Informat Sci & Engn, Key Lab Ubiquitous Network & Serv Software Liaonin, Dalian 116024, Liaoning, Peoples R China
[2] Shanghai Shanda Dent Clin, Shanghai 201315, Peoples R China
基金
中国国家自然科学基金;
关键词
Dentistry; Image segmentation; Teeth; Semantics; Task analysis; Medical diagnostic imaging; Shape; Dental plaque segmentation; semantic decomposition; contrastive constraint; structural constraint; IMAGE; ATTENTION;
D O I
10.1109/TMI.2022.3221529
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Segmenting dental plaque from images of medical reagent staining provides valuable information for diagnosis and the determination of follow-up treatment plan. However, accurate dental plaque segmentation is a challenging task that requires identifying teeth and dental plaque subjected to semantic-blur regions (i.e., confused boundaries in border regions between teeth and dental plaque) and complex variations of instance shapes, which are not fully addressed by existing methods. Therefore, we propose a semantic decomposition network (SDNet) that introduces two single-task branches to separately address the segmentation of teeth and dental plaque and designs additional constraints to learn category-specific features for each branch, thus facilitating the semantic decomposition and improving the performance of dental plaque segmentation. Specifically, SDNet learns two separate segmentation branches for teeth and dental plaque in a divide-and-conquer manner to decouple the entangled relation between them. Each branch that specifies a category tends to yield accurate segmentation. To help these two branches better focus on category-specific features, two constraint modules are further proposed: 1) contrastive constraint module (CCM) to learn discriminative feature representations by maximizing the distance between different category representations, so as to reduce the negative impact of semantic-blur regions on feature extraction; 2) structural constraint module (SCM) to provide complete structural information for dental plaque of various shapes by the supervision of an boundary-aware geometric constraint. Besides, we construct a large-scale open-source Stained Dental Plaque Segmentation dataset (SDPSeg), which provides high-quality annotations for teeth and dental plaque. Experimental results on SDPSeg datasets show SDNet achieves state-of-the-art performance.
引用
收藏
页码:935 / 946
页数:12
相关论文
共 62 条
  • [11] Chen T, 2020, PR MACH LEARN RES, V119
  • [12] Exploring Simple Siamese Representation Learning
    Chen, Xinlei
    He, Kaiming
    [J]. 2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 15745 - 15753
  • [13] Channel-Unet: A Spatial Channel-Wise Convolutional Neural Network for Liver and Tumors Segmentation
    Chen, Yilong
    Wang, Kai
    Liao, Xiangyun
    Qian, Yinling
    Wang, Qiong
    Yuan, Zhiyong
    Heng, Pheng-Ann
    [J]. FRONTIERS IN GENETICS, 2019, 10
  • [14] Learning to Predict Crisp Boundaries
    Deng, Ruoxi
    Shen, Chunhua
    Liu, Shengjun
    Wang, Huibing
    Liu, Xinru
    [J]. COMPUTER VISION - ECCV 2018, PT VI, 2018, 11210 : 570 - 586
  • [15] Deng-Ping Fan, 2020, Medical Image Computing and Computer Assisted Intervention - MICCAI 2020. 23rd International Conference. Proceedings. Lecture Notes in Computer Science (LNCS 12266), P263, DOI 10.1007/978-3-030-59725-2_26
  • [16] Dosovitskiy A, 2021, INT C LEARN REPR ICL
  • [17] Inf-Net: Automatic COVID-19 Lung Infection Segmentation From CT Images
    Fan, Deng-Ping
    Zhou, Tao
    Ji, Ge-Peng
    Zhou, Yi
    Chen, Geng
    Fu, Huazhu
    Shen, Jianbing
    Shao, Ling
    [J]. IEEE TRANSACTIONS ON MEDICAL IMAGING, 2020, 39 (08) : 2626 - 2637
  • [18] Grill Jean-Bastien, 2020, P 34 INT C NEUR INF
  • [19] CE-Net: Context Encoder Network for 2D Medical Image Segmentation
    Gu, Zaiwang
    Cheng, Jun
    Fu, Huazhu
    Zhou, Kang
    Hao, Huaying
    Zhao, Yitian
    Zhang, Tianyang
    Gao, Shenghua
    Liu, Jiang
    [J]. IEEE TRANSACTIONS ON MEDICAL IMAGING, 2019, 38 (10) : 2281 - 2292
  • [20] Semi-supervised Contrastive Learning for Label-Efficient Medical Image Segmentation
    Hu, Xinrong
    Zeng, Dewen
    Xu, Xiaowei
    Shi, Yiyu
    [J]. MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2021, PT II, 2021, 12902 : 481 - 490