Position-based anchor optimization for point supervised dense nuclei detection

被引:27
作者
Yao, Jieru [1 ]
Han, Longfei [2 ,3 ]
Guo, Guangyu [1 ]
Zheng, Zhaohui [4 ]
Cong, Runmin [5 ]
Huang, Xiankai [6 ]
Ding, Jin [4 ]
Yang, Kaihui [7 ]
Zhang, Dingwen [1 ,3 ,4 ]
Han, Junwei [3 ]
机构
[1] Northwestern Polytech Univ, Sch Automat, Brain & Artificial Intelligence Lab, Xian 710072, Shaanxi, Peoples R China
[2] Beijing Technol & Business Univ, Sch Comp Sci, Beijing 100048, Peoples R China
[3] Hefei Comprehens Natl Sci Ctr, Hefei 230088, Anhui, Peoples R China
[4] Fourth Mil Med Univ, Xijing Hosp, Dept Clin Immunol, Xian 710032, Shaanxi, Peoples R China
[5] Shandong Univ, Sch Control Sci & Engn, Jinan 250100, Shandong, Peoples R China
[6] Beijing Technol & Business Univ, Beijing 100048, Peoples R China
[7] Nanchang Univ, Sch Software, Nanchang 330031, Jiangxi, Peoples R China
基金
国家重点研发计划; 中国国家自然科学基金;
关键词
Cancer histopathology image; Dense nuclei detection; Point-supervised learning; Morphology-based pseudo label; Position-based anchor optimization; OBJECT DETECTION; SEGMENTATION; ANNOTATION; NETWORK;
D O I
10.1016/j.neunet.2023.12.006
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Nuclei detection is one of the most fundamental and challenging problems in histopathological image analysis, which can localize nuclei to provide effective computer-aided cancer diagnosis, treatment decision, and prognosis. The fully-supervised nuclei detector requires a large number of nuclei annotations on high-resolution digital images, which is time-consuming and needs human annotators with professional knowledge. In recent years, weakly-supervised learning has attracted significant attention in reducing the labeling burden. However, detecting dense nuclei of complex crowded distribution and diverse appearances remains a challenge. To solve this problem, we propose a novel point-supervised dense nuclei detection framework that introduces position -based anchor optimization to complete morphology-based pseudo-label supervision. Specifically, we first generate cellular-level pseudo labels (CPL) for the detection head via a morphology-based mechanism, which can help to build a baseline point-supervised detection network. Then, considering the crowded distribution of the dense nuclei, we propose a mechanism called Position-based Anchor-quality Estimation (PAE), which utilizes the positional deviation between an anchor and its corresponding point label to suppress low-quality detections far from each nucleus. Finally, to better handle the diverse appearances of nuclei, an Adaptive Anchor Selector (AAS) operation is proposed to automatically select positive and negative anchors according to morphological and positional statistical characteristics of nuclei. We conduct comprehensive experiments on two widely used benchmarks, MO and Lizard, using ResNet50 and PVTv2 as backbones. The results demonstrate that the proposed approach has superior capacity compared with other state-of-the-art methods. In particularly, in dense nuclei scenarios, our method can achieve 95.1% performance of the fully-supervised approach.
引用
收藏
页码:159 / 170
页数:12
相关论文
共 72 条
[1]   Finding Berries: Segmentation and Counting of Cranberries using Point Supervision and Shape Priors [J].
Akiva, Peri ;
Dana, Kristin ;
Oudemans, Peter ;
Mars, Michael .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW 2020), 2020, :219-228
[2]   Improved Automatic Detection and Segmentation of Cell Nuclei in Histopathology Images [J].
Al-Kofahi, Yousef ;
Lassoued, Wiem ;
Lee, William ;
Roysam, Badrinath .
IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING, 2010, 57 (04) :841-852
[3]   What's the Point: Semantic Segmentation with Point Supervision [J].
Bearman, Amy ;
Russakovsky, Olga ;
Ferrari, Vittorio ;
Fei-Fei, Li .
COMPUTER VISION - ECCV 2016, PT VII, 2016, 9911 :549-565
[4]   Microscopy analysis neural network to solve detection, enumeration and segmentation from image-level annotations [J].
Bilodeau, Anthony ;
Delmas, Constantin V. L. ;
Parent, Martin ;
De Koninck, Paul ;
Durand, Audrey ;
Lavoie-Cardinal, Flavie .
NATURE MACHINE INTELLIGENCE, 2022, 4 (05) :455-+
[5]   Soft-NMS - Improving Object Detection With One Line of Code [J].
Bodla, Navaneeth ;
Singh, Bharat ;
Chellappa, Rama ;
Davis, Larry S. .
2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, :5562-5570
[6]   Clinical-grade computational pathology using weakly supervised deep learning on whole slide images [J].
Campanella, Gabriele ;
Hanna, Matthew G. ;
Geneslaw, Luke ;
Miraflor, Allen ;
Silva, Vitor Werneck Krauss ;
Busam, Klaus J. ;
Brogi, Edi ;
Reuter, Victor E. ;
Klimstra, David S. ;
Fuchs, Thomas J. .
NATURE MEDICINE, 2019, 25 (08) :1301-+
[7]   Points as Queries: Weakly Semi-supervised Object Detection by Points [J].
Chen, Liangyu ;
Yang, Tong ;
Zhang, Xiangyu ;
Zhang, Wei ;
Sun, Jian .
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, :8819-8828
[8]   Point-to-Box Network for Accurate Object Detection via Single Point Supervision [J].
Chen, Pengfei ;
Yu, Xuehui ;
Han, Xumeng ;
Hassan, Najmul ;
Wang, Kai ;
Li, Jiachen ;
Zhao, Jian ;
Shi, Humphrey ;
Han, Zhenjun ;
Ye, Qixiang .
COMPUTER VISION, ECCV 2022, PT IX, 2022, 13669 :51-67
[9]  
Chen Z, 2023, Arxiv, DOI [arXiv:2205.08534, DOI 10.48550/ARXIV.2205.08534]
[10]   Weakly Supervised Histopathology Image Segmentation With Sparse Point Annotations [J].
Chen, Zhe ;
Chen, Zhao ;
Liu, Jingxin ;
Zheng, Qiang ;
Zhu, Yuang ;
Zuo, Yanfei ;
Wang, Zhaoyu ;
Guan, Xiaosong ;
Wang, Yue ;
Li, Yuan .
IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2021, 25 (05) :1673-1685