Optimized Scalable and Learnable Binary Quantization Network for LiDAR Point Cloud

被引:1
作者
Zhao Zhi [1 ]
Ma Yanxin [2 ]
Xu Ke [1 ]
Wan Jianwei [1 ]
机构
[1] Natl Univ Def Technol, Coll Elect Sci, Changsha 410073, Hunan, Peoples R China
[2] Natl Univ Def Technol, Coll Meteorol & Oceanog, Changsha 410073, Hunan, Peoples R China
关键词
measurement; LiDAR; point clouds; learnable algorithm; binary quantization; genetic algorithm;
D O I
10.3788/AOS202242.1212005
中图分类号
O43 [光学];
学科分类号
070207 ; 0803 ;
摘要
To solve the time-consuming and storage problems of the LiDAR point cloud deep learning network models in the deployment of embedded devices on the mobile terminal, a learnable binary quantization network model for LiDAR point clouds is proposed. The model refers to the idea of feature-based knowledge distillation and transfers the statistical feature knowledge of each layer of the full-precision network to the binary quantization network, which greatly improves quantification accuracy. A genetic-algorithm based learnable optimization algorithm for scale factor recovery of binary quantization is proposed, which searches for the initial optimal layerwise scale recovery factor, and greatly reduces amount of network parameters through network self-learning. A statistical adaptive pooling loss minimization algorithm is proposed, including quantitative network self-adjustment and full-precision network transferring adjustment, which solves the problem of greater pooling information loss of quantitative networks. Experimental results show that the proposed algorithm achieves larger compression ratio and speedup ratio while obtaining high precision. Theoretically, it can compress PointNet by 23 times and accelerate it by 35 times at least or more, and also achieves good scalability for other mainstream point cloud deep networks.
引用
收藏
页数:19
相关论文
共 30 条
[1]  
[Anonymous], 2015, PROC CVPR IEEE, DOI DOI 10.1109/CVPR.2015.7298801
[2]   3D Semantic Parsing of Large-Scale Indoor Spaces [J].
Armeni, Iro ;
Sener, Ozan ;
Zamir, Amir R. ;
Jiang, Helen ;
Brilakis, Ioannis ;
Fischer, Martin ;
Savarese, Silvio .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :1534-1543
[3]  
Bishop C., 2006, Pattern Recognition and Machine Learning
[4]  
Chang Angel X, 2015, Technical Report
[5]  
Courbariaux M, 2015, ADV NEUR IN, V28
[6]   SYQ: Learning Symmetric Quantization For Efficient Deep Neural Networks [J].
Faraone, Julian ;
Fraser, Nicholas ;
Blott, Michaela ;
Leong, Philip H. W. .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :4300-4309
[7]   Differentiable Soft Quantization: Bridging Full-Precision and Low-Bit Neural Networks [J].
Gong, Ruihao ;
Liu, Xianglong ;
Jiang, Shenghu ;
Li, Tianxiang ;
Hu, Peng ;
Lin, Jiazhen ;
Yu, Fengwei ;
Yan, Junjie .
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, :4851-4860
[8]   Deep Learning for 3D Point Clouds: A Survey [J].
Guo, Yulan ;
Wang, Hanyun ;
Hu, Qingyong ;
Liu, Hao ;
Liu, Li ;
Bennamoun, Mohammed .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2021, 43 (12) :4338-4364
[9]  
Hubara M, 2016, P NEURAL INFORM PROC, P1
[10]  
Li R B, 2022, ACTA OPT SIN, V42