GRAB-Net: Graph-Based Boundary-Aware Network for Medical Point Cloud Segmentation

被引:19
作者
Liu, Yifan [1 ]
Li, Wuyang [2 ]
Liu, Jie [2 ]
Chen, Hui [3 ]
Yuan, Yixuan [1 ]
机构
[1] Chinese Univ Hong Kong, Dept Elect Engn, Hong Kong, Peoples R China
[2] City Univ Hong Kong, Dept Elect Engn, Hong Kong, Peoples R China
[3] Univ Hong Kong, Fac Dent, Hong Kong, Peoples R China
关键词
Point cloud segmentation; graph-based framework; boundary-aware segmentation;
D O I
10.1109/TMI.2023.3265000
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Point cloud segmentation is fundamental in many medical applications, such as aneurysm clipping and orthodontic planning. Recent methods mainly focus on designing powerful local feature extractors and generally overlook the segmentation around the boundaries between objects, which is extremely harmful to the clinical practice and degenerates the overall segmentation performance. To remedy this problem, we propose a GRAph-based Boundary-aware Network (GRAB-Net) with three paradigms, Graph-based Boundary-perception Module (GBM), Outer-boundary Context-assignment Module (OCM), and Inner-boundary Feature-rectification Module (IFM), for medical point cloud segmentation. Aiming to improve the segmentation performance around boundaries, GBM is designed to detect boundaries and interchange complementary information inside semantic and boundary features in the graph domain, where semantics-boundary correlations are modelled globally and informative clues are exchanged by graph reasoning. Furthermore, to reduce the context confusion that degenerates the segmentation performance outside the boundaries, OCM is proposed to construct the contextual graph, where dissimilar contexts are assigned to points of different categories guided by geometrical landmarks. In addition, we advance IFM to distinguish ambiguous features inside boundaries in a contrastive manner, where boundary-aware contrast strategies are proposed to facilitate the discriminative representation learning. Extensive experiments on two public datasets, IntrA and 3DTeethSeg, demonstrate the superiority of our method over state-of-the-art methods.
引用
收藏
页码:2776 / 2786
页数:11
相关论文
共 44 条
[1]   Virtual Reality Cerebral Aneurysm Clipping Simulation With Real-Time Haptic Feedback [J].
Alaraj, Ali ;
Luciano, Cristian J. ;
Bailey, Daniel P. ;
Elsenousi, Abdussalam ;
Roitberg, Ben Z. ;
Bernardo, Antonio ;
Banerjee, P. Pat ;
Charbel, Fady T. .
OPERATIVE NEUROSURGERY, 2015, 11 (01) :52-58
[2]  
Carion N, 2020, Img Proc Comp Vis Re, V12346, P213, DOI 10.1007/978-3-030-58452-8_13
[3]  
Cheng B, 2021, ADV NEUR IN, V34
[4]   Boundary IoU: Improving Object-Centric Image Segmentation Evaluation [J].
Cheng, Bowen ;
Girshick, Ross ;
Dollar, Piotr ;
Berg, Alexander C. ;
Kirillov, Alexander .
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, :15329-15337
[5]   (AF)2-S3Net: Attentive Feature Fusion with Adaptive Feature Selection for Sparse Semantic Segmentation Network [J].
Cheng, Ran ;
Razani, Ryan ;
Taghavi, Ehsan ;
Li, Enxu ;
Liu, Bingbing .
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, :12542-12551
[6]   TSegNet: An efficient and accurate tooth segmentation network on 3D dental model [J].
Cui, Zhiming ;
Li, Changjian ;
Chen, Nenglun ;
Wei, Guodong ;
Chen, Runnan ;
Zhou, Yuanfeng ;
Shen, Dinggang ;
Wang, Wenping .
MEDICAL IMAGE ANALYSIS, 2021, 69
[7]   Shape Completion using 3D-Encoder-Predictor CNNs and Shape Synthesis [J].
Dai, Angela ;
Qi, Charles Ruizhongtai ;
Niessner, Matthias .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :6545-6554
[8]   Boundary-Aware Feature Propagation for Scene Segmentation [J].
Ding, Henghui ;
Jiang, Xudong ;
Liu, Ai Qun ;
Thalmann, Nadia Magnenat ;
Wang, Gang .
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, :6818-6828
[9]  
Dosovitskiy A, 2021, Arxiv, DOI arXiv:2010.11929
[10]   SCF-Net: Learning Spatial Contextual Features for Large-Scale Point Cloud Segmentation [J].
Fan, Siqi ;
Dong, Qiulei ;
Zhu, Fenghua ;
Lv, Yisheng ;
Ye, Peijun ;
Wang, Fei-Yue .
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, :14499-14508