Semantic Decomposition Network With Contrastive and Structural Constraints for Dental Plaque Segmentation

被引:9
作者
Shi, Jian [1 ]
Sun, Baoli [1 ]
Ye, Xinchen [1 ]
Wang, Zhihui [1 ]
Luo, Xiaolong [2 ]
Liu, Jin [2 ]
Gao, Heli [2 ]
Li, Haojie [1 ]
机构
[1] Dalian Univ Technol, DUT RU Int Sch Informat Sci & Engn, Key Lab Ubiquitous Network & Serv Software Liaonin, Dalian 116024, Liaoning, Peoples R China
[2] Shanghai Shanda Dent Clin, Shanghai 201315, Peoples R China
基金
中国国家自然科学基金;
关键词
Dentistry; Image segmentation; Teeth; Semantics; Task analysis; Medical diagnostic imaging; Shape; Dental plaque segmentation; semantic decomposition; contrastive constraint; structural constraint; IMAGE; ATTENTION;
D O I
10.1109/TMI.2022.3221529
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Segmenting dental plaque from images of medical reagent staining provides valuable information for diagnosis and the determination of follow-up treatment plan. However, accurate dental plaque segmentation is a challenging task that requires identifying teeth and dental plaque subjected to semantic-blur regions (i.e., confused boundaries in border regions between teeth and dental plaque) and complex variations of instance shapes, which are not fully addressed by existing methods. Therefore, we propose a semantic decomposition network (SDNet) that introduces two single-task branches to separately address the segmentation of teeth and dental plaque and designs additional constraints to learn category-specific features for each branch, thus facilitating the semantic decomposition and improving the performance of dental plaque segmentation. Specifically, SDNet learns two separate segmentation branches for teeth and dental plaque in a divide-and-conquer manner to decouple the entangled relation between them. Each branch that specifies a category tends to yield accurate segmentation. To help these two branches better focus on category-specific features, two constraint modules are further proposed: 1) contrastive constraint module (CCM) to learn discriminative feature representations by maximizing the distance between different category representations, so as to reduce the negative impact of semantic-blur regions on feature extraction; 2) structural constraint module (SCM) to provide complete structural information for dental plaque of various shapes by the supervision of an boundary-aware geometric constraint. Besides, we construct a large-scale open-source Stained Dental Plaque Segmentation dataset (SDPSeg), which provides high-quality annotations for teeth and dental plaque. Experimental results on SDPSeg datasets show SDNet achieves state-of-the-art performance.
引用
收藏
页码:935 / 946
页数:12
相关论文
共 62 条
  • [1] Alonso I, 2021, Arxiv, DOI arXiv:2104.13415
  • [2] [Anonymous], 2015, P 3 INT C LEARNING R
  • [3] Bachman P, 2019, ADV NEUR IN, V32
  • [4] SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation
    Badrinarayanan, Vijay
    Kendall, Alex
    Cipolla, Roberto
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2017, 39 (12) : 2481 - 2495
  • [5] Towards automatic polyp detection with a polyp appearance model
    Bernal, J.
    Sanchez, J.
    Vilarino, F.
    [J]. PATTERN RECOGNITION, 2012, 45 (09) : 3166 - 3182
  • [6] WM-DOVA maps for accurate polyp highlighting in colonoscopy: Validation vs. saliency maps from physicians
    Bernal, Jorge
    Javier Sanchez, F.
    Fernandez-Esparrach, Gloria
    Gil, Debora
    Rodriguez, Cristina
    Vilarino, Fernando
    [J]. COMPUTERIZED MEDICAL IMAGING AND GRAPHICS, 2015, 43 : 99 - 111
  • [7] Scale-invariant heat kernel signatures for non-rigid shape recognition
    Bronstein, Michael M.
    Kokkinos, Iasonas
    [J]. 2010 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2010, : 1704 - 1711
  • [8] Chaitanya Krishna, 2020, ADV NEUR IN, V33
  • [9] Chen J., 2021, arXiv, DOI DOI 10.48550/ARXIV.2102.04306
  • [10] DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs
    Chen, Liang-Chieh
    Papandreou, George
    Kokkinos, Iasonas
    Murphy, Kevin
    Yuille, Alan L.
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2018, 40 (04) : 834 - 848