AMS-Net: An Attention-Based Multi-Scale Network for Classification of 3D Terracotta Warrior Fragments

被引:7
作者
Liu, Jie [1 ]
Cao, Xin [1 ]
Zhang, Pingchuan [2 ]
Xu, Xueli [1 ]
Liu, Yangyang [1 ]
Geng, Guohua [1 ]
Zhao, Fengjun [1 ]
Li, Kang [1 ]
Zhou, Mingquan [1 ]
机构
[1] Northwest Univ, Sch Informat Sci & Technol, Xian 710068, Shaanxi, Peoples R China
[2] Henan Inst Sci & Technol, Sch Informat Engn, Xinxiang 453003, Henan, Peoples R China
基金
中国国家自然科学基金;
关键词
self-attention; multi-scale; deep neural networks; point cloud classification; Terracotta Warrior fragments;
D O I
10.3390/rs13183713
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
As an essential step in the restoration of Terracotta Warriors, the results of fragments classification will directly affect the performance of fragments matching and splicing. However, most of the existing methods are based on traditional technology and have low accuracy in classification. A practical and effective classification method for fragments is an urgent need. In this case, an attention-based multi-scale neural network named AMS-Net is proposed to extract significant geometric and semantic features. AMS-Net is a hierarchical structure consisting of a multi-scale set abstraction block (MS-BLOCK) and a fully connected (FC) layer. MS-BLOCK consists of a local-global layer (LGLayer) and an improved multi-layer perceptron (IMLP). With a multi-scale strategy, LGLayer can parallel extract the local and global features from different scales. IMLP can concatenate the high-level and low-level features for classification tasks. Extensive experiments on the public data set (ModelNet40/10) and the real-world Terracotta Warrior fragments data set are conducted. The accuracy results with normal can achieve 93.52% and 96.22%, respectively. For real-world data sets, the accuracy is best among the existing methods. The robustness and effectiveness of the performance on the task of 3D point cloud classification are also investigated. It proves that the proposed end-to-end learning network is more effective and suitable for the classification of the Terracotta Warrior fragments.
引用
收藏
页数:22
相关论文
共 51 条
[11]  
Huang Z.T., 2020, P INT C COMP VIS PAT
[12]  
Kampel M, 2000, INT C PATT RECOG, P771, DOI 10.1109/ICPR.2000.903031
[13]  
[康馨月 Kang Xinyue], 2015, [图学学报, Journal of Graphics], V36, P551
[14]   Computerized morphological classification of ceramics [J].
Karasik, Avshalom ;
Smilansky, Uzy .
JOURNAL OF ARCHAEOLOGICAL SCIENCE, 2011, 38 (10) :2644-2657
[15]   Escape from Cells: Deep Kd-Networks for the Recognition of 3D Point Cloud Models [J].
Klokov, Roman ;
Lempitsky, Victor .
2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, :863-872
[16]   ImageNet Classification with Deep Convolutional Neural Networks [J].
Krizhevsky, Alex ;
Sutskever, Ilya ;
Hinton, Geoffrey E. .
COMMUNICATIONS OF THE ACM, 2017, 60 (06) :84-90
[17]   SO-Net: Self-Organizing Network for Point Cloud Analysis [J].
Li, Jiaxin ;
Chen, Ben M. ;
Lee, Gim Hee .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :9397-9406
[18]  
Li YY, 2018, ADV NEUR IN, V31
[19]  
Liu Y., 2012, THESIS CHANGAN U XIA
[20]   Remote Sensing-Based Dynamic Monitoring of Immovable Cultural Relics, from Environmental Factors to the Protected Cultural Site: A Case Study of the Shunji Bridge [J].
Liu, Yanzhen ;
Tang, Yunwei ;
Jing, Linhai ;
Chen, Fulong ;
Wang, Ping .
SUSTAINABILITY, 2021, 13 (11)