CPP-Net: Context-Aware Polygon Proposal Network for Nucleus Segmentation

被引:23
作者
Chen, Shengcong [1 ,2 ,3 ]
Ding, Changxing [4 ,5 ,6 ,7 ]
Liu, Minfeng [8 ]
Cheng, Jun [9 ]
Tao, Dacheng [10 ,11 ]
机构
[1] South China Univ Technol, Sch Elect & Informat Engn, Guangzhou 510006, Guangdong, Peoples R China
[2] Nanjing Univ Sci & Technol, Jiangsu Key Lab Image & Video Understanding Social, Nanjing 210094, Peoples R China
[3] Nanjing Univ Sci & Technol, Key Lab Intelligent Percept, Syst High Dimens Informat Minist Educ, Nanjing 210094, Peoples R China
[4] South China Univ Technol, Sch Elect & Informat Engn, Guangzhou 510006, Guangdong, Peoples R China
[5] Nanjing Univ Sci & Technol, Jiangsu Key Lab Image & Video Understanding Social, Nanjing 210094, Peoples R China
[6] Nanjing Univ Sci & Technol, Key Lab IntelligentPercept, Syst High Dimens Informat Minist ofEducat, Nanjing 210094, Peoples R China
[7] Pazhou Lab, Guangzhou 510330, Guangdong, Peoples R China
[8] Southern Med Univ, Nanfang Hosp, Guangzhou 510515, Guangdong, Peoples R China
[9] Inst Infocomm Res, Agcy Sci Technol & Res, Singapore 138632, Singapore
[10] JD Explore Acad, JDcom, Beijing 100176, Peoples R China
[11] Univ Sydney, Digital Sci Initiat, Sydney, NSW 2008, Australia
基金
中国国家自然科学基金;
关键词
Nucleus segmentation; instance segmentation; contextual information; perceptual loss; INSTANCE SEGMENTATION; MICROSCOPY; IMAGES;
D O I
10.1109/TIP.2023.3237013
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Nucleus segmentation is a challenging task due to the crowded distribution and blurry boundaries of nuclei. Recent approaches represent nuclei by means of polygons to differentiate between touching and overlapping nuclei and have accordingly achieved promising performance. Each polygon is represented by a set of centroid-to-boundary distances, which are in turn predicted by features of the centroid pixel for a single nucleus. However, using the centroid pixel alone does not provide sufficient contextual information for robust prediction and thus degrades the segmentation accuracy. To handle this problem, we propose a Context-aware Polygon Proposal Network (CPP-Net) for nucleus segmentation. First, we sample a point set rather than one single pixel within each cell for distance prediction. This strategy substantially enhances contextual information and thereby improves the robustness of the prediction. Second, we propose a Confidence-based Weighting Module, which adaptively fuses the predictions from the sampled point set. Third, we introduce a novel Shape-Aware Perceptual (SAP) loss that constrains the shape of the predicted polygons. Here, the SAP loss is based on an additional network that is pre-trained by means of mapping the centroid probability map and the pixel-to-boundary distance maps to a different nucleus representation. Extensive experiments justify the effectiveness of each component in the proposed CPP-Net. Finally, CPP-Net is found to achieve state-of-the-art performance on three publicly available databases, namely DSB2018, BBBC06, and PanNuke.
引用
收藏
页码:980 / 994
页数:15
相关论文
共 61 条
  • [1] High-throughput analysis of multispectral images of breast cancer tissue
    Adiga, Umesh
    Malladi, Ravikanth
    Fernandez-Gonzalez, Rodrigo
    de Solorzano, Carlos Ortiz
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2006, 15 (08) : 2259 - 2268
  • [2] Unsupervised cell nucleus segmentation with active contours
    Bamford, P
    Lovell, B
    [J]. SIGNAL PROCESSING, 1998, 71 (02) : 203 - 213
  • [3] Integrated profiling of three dimensional cell culture models and 3D microscopy
    Bilgin, Cemal Cagatay
    Kim, Sun
    Leung, Elle
    Chang, Hang
    Parvin, Bahram
    [J]. BIOINFORMATICS, 2013, 29 (23) : 3087 - 3093
  • [4] Microscopy-Based High-Content Screening
    Boutros, Michael
    Heigwer, Florian
    Laufer, Christina
    [J]. CELL, 2015, 163 (06) : 1314 - 1325
  • [5] Nucleus segmentation across imaging experiments: the 2018 Data Science Bowl
    Caicedo, Juan C.
    Goodman, Allen
    Karhohs, Kyle W.
    Cimini, Beth A.
    Ackerman, Jeanelle
    Haghighi, Marzieh
    Heng, CherKeng
    Becker, Tim
    Minh Doan
    McQuin, Claire
    Rohban, Mohammad
    Singh, Shantanu
    Carpenter, Anne E.
    [J]. NATURE METHODS, 2019, 16 (12) : 1247 - +
  • [6] A flexible and robust approach for segmenting cell nuclei from 2D microscopy images using supervised learning and template matching
    Chen, Cheng
    Wang, Wei
    Ozolek, John A.
    Rohde, Gustavo K.
    [J]. CYTOMETRY PART A, 2013, 83A (05) : 495 - 507
  • [7] DCAN: Deep Contour-Aware Networks for Accurate Gland Segmentation
    Chen, Hao
    Qi, Xiaojuan
    Yu, Lequan
    Heng, Pheng-Ann
    [J]. 2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, : 2487 - 2496
  • [8] Instance Segmentation of Biomedical Images with an Object-Aware Embedding Learned with Local Constraints
    Chen, Long
    Strauch, Martin
    Merhof, Dorit
    [J]. MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2019, PT I, 2019, 11764 : 451 - 459
  • [9] Deng J, 2009, PROC CVPR IEEE, P248, DOI 10.1109/CVPRW.2009.5206848
  • [10] A convolutional neural network segments yeast microscopy images with high accuracy
    Dietler, Nicola
    Minder, Matthias
    Gligorovski, Vojislav
    Economou, Augoustina Maria
    Joly, Denis Alain Henri Lucien
    Sadeghi, Ahmad
    Chan, Chun Hei Michael
    Kozinski, Mateusz
    Weigert, Martin
    Bitbol, Anne-Florence
    Rahi, Sahand Jamal
    [J]. NATURE COMMUNICATIONS, 2020, 11 (01)