PointAS: an attention based sampling neural network for visual perception

被引:4
作者
Qiu, Bozhi [1 ]
Li, Sheng [1 ]
Wang, Lei [1 ,2 ]
机构
[1] Xijing Univ, Sch Elect Informat, Xian, Peoples R China
[2] Shaanxi Huanghe Grp Co LTD, Xian, Peoples R China
基金
中国国家自然科学基金;
关键词
PointAS; point cloud data; neural network; data sampling; attention;
D O I
10.3389/fncom.2024.1340019
中图分类号
Q [生物科学];
学科分类号
07 ; 0710 ; 09 ;
摘要
Harnessing the remarkable ability of the human brain to recognize and process complex data is a significant challenge for researchers, particularly in the domain of point cloud classification-a technology that aims to replicate the neural structure of the brain for spatial recognition. The initial 3D point cloud data often suffers from noise, sparsity, and disorder, making accurate classification a formidable task, especially when extracting local information features. Therefore, in this study, we propose a novel attention-based end-to-end point cloud downsampling classification method, termed as PointAS, which is an experimental algorithm designed to be adaptable to various downstream tasks. PointAS consists of two primary modules: the adaptive sampling module and the attention module. Specifically, the attention module aggregates global features with the input point cloud data, while the adaptive module extracts local features. In the point cloud classification task, our method surpasses existing downsampling methods by a significant margin, allowing for more precise extraction of edge data points to capture overall contour features accurately. The classification accuracy of PointAS consistently exceeds 80% across various sampling ratios, with a remarkable accuracy of 75.37% even at ultra-high sampling ratios. Moreover, our method exhibits robustness in experiments, maintaining classification accuracies of 72.50% or higher under different noise disturbances. Both qualitative and quantitative experiments affirm the efficacy of our approach in the sampling classification task, providing researchers with a more accurate method to identify and classify neurons, synapses, and other structures, thereby promoting a deeper understanding of the nervous system.
引用
收藏
页数:16
相关论文
共 21 条
[1]   DGCNN: A convolutional neural network over large-scale labeled graphs [J].
Anh Viet Phan ;
Minh Le Nguyen ;
Yen Lam Hoang Nguyen ;
Lam Thu Bui .
NEURAL NETWORKS, 2018, 108 :533-543
[2]  
Dayan P., 2005, Theoretical neuroscience: computational and mathematical modeling of neural systems
[3]   The farthest point strategy for progressive image sampling [J].
Eldar, Y ;
Lindenbaum, M ;
Porat, M ;
Zeevi, YY .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 1997, 6 (09) :1305-1315
[4]  
Guo GD, 2003, LECT NOTES COMPUT SC, V2888, P986
[5]   SampleNet: Differentiable Point Cloud Sampling [J].
Lang, Itai ;
Manor, Asaf ;
Avidan, Shai .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2020), 2020, :7575-7585
[6]  
Li Y., 2018, 32 C NEUR INF PROC S
[7]   APSNet: Toward Adaptive Point Sampling for Efficient 3D Action Recognition [J].
Liu, Jiaheng ;
Guo, Jinyang ;
Xu, Dong .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2022, 31 :5287-5302
[8]   Multiview convolutional neural networks for lung nodule classification [J].
Liu, Kui ;
Kang, Guixia .
INTERNATIONAL JOURNAL OF IMAGING SYSTEMS AND TECHNOLOGY, 2017, 27 (01) :12-22
[9]  
Marr D., 1982, Vision. A computational investigation into the human representation and processing of visual information
[10]  
Moenning C., 2003, FAST MARCHING FARTHE