AMS-Net: An Attention-Based Multi-Scale Network for Classification of 3D Terracotta Warrior Fragments

被引:7
作者
Liu, Jie [1 ]
Cao, Xin [1 ]
Zhang, Pingchuan [2 ]
Xu, Xueli [1 ]
Liu, Yangyang [1 ]
Geng, Guohua [1 ]
Zhao, Fengjun [1 ]
Li, Kang [1 ]
Zhou, Mingquan [1 ]
机构
[1] Northwest Univ, Sch Informat Sci & Technol, Xian 710068, Shaanxi, Peoples R China
[2] Henan Inst Sci & Technol, Sch Informat Engn, Xinxiang 453003, Henan, Peoples R China
基金
中国国家自然科学基金;
关键词
self-attention; multi-scale; deep neural networks; point cloud classification; Terracotta Warrior fragments;
D O I
10.3390/rs13183713
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
As an essential step in the restoration of Terracotta Warriors, the results of fragments classification will directly affect the performance of fragments matching and splicing. However, most of the existing methods are based on traditional technology and have low accuracy in classification. A practical and effective classification method for fragments is an urgent need. In this case, an attention-based multi-scale neural network named AMS-Net is proposed to extract significant geometric and semantic features. AMS-Net is a hierarchical structure consisting of a multi-scale set abstraction block (MS-BLOCK) and a fully connected (FC) layer. MS-BLOCK consists of a local-global layer (LGLayer) and an improved multi-layer perceptron (IMLP). With a multi-scale strategy, LGLayer can parallel extract the local and global features from different scales. IMLP can concatenate the high-level and low-level features for classification tasks. Extensive experiments on the public data set (ModelNet40/10) and the real-world Terracotta Warrior fragments data set are conducted. The accuracy results with normal can achieve 93.52% and 96.22%, respectively. For real-world data sets, the accuracy is best among the existing methods. The robustness and effectiveness of the performance on the task of 3D point cloud classification are also investigated. It proves that the proposed end-to-end learning network is more effective and suitable for the classification of the Terracotta Warrior fragments.
引用
收藏
页数:22
相关论文
共 51 条
[1]  
Bian Y., 2017, ARXIV170803805
[2]  
Brock A., 2016, ARXIV160804236V0423
[3]  
Christoph R., 2016, P ADV NEUR INF PROC, P3468
[4]   Shape Completion using 3D-Encoder-Predictor CNNs and Shape Synthesis [J].
Dai, Angela ;
Qi, Charles Ruizhongtai ;
Niessner, Matthias .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :6545-6554
[5]   Cassifying fragments of terracotta warriors using template-based partial matching [J].
Du, Guoguang ;
Zhou, Mingquan ;
Yin, Congli ;
Wu, Zhongke ;
Shui, Wuyang .
MULTIMEDIA TOOLS AND APPLICATIONS, 2018, 77 (15) :19171-19191
[6]   Classification of 3D Terracotta Warrior Fragments Based on Deep Learning and Template Guidance [J].
Gao, Hongjuan ;
Geng, Guohua .
IEEE ACCESS, 2020, 8 :4086-4098
[7]   Simplification method for 3D Terracotta Warrior fragments based on local structure and deep neural networks [J].
Geng, Guohua ;
Liu, Jie ;
Cao, Xin ;
Liu, Yangyang ;
Zhou, Wei ;
Zhao, Fengjun ;
Su, Linzhi ;
Li, Kang ;
Zhou, Mingquan .
JOURNAL OF THE OPTICAL SOCIETY OF AMERICA A-OPTICS IMAGE SCIENCE AND VISION, 2020, 37 (11) :1711-1720
[8]   Par3DNet: Using 3DCNNs for Object Recognition on Tridimensional Partial Views [J].
Gomez-Donoso, Francisco ;
Escalona, Felix ;
Cazorla, Miguel .
APPLIED SCIENCES-BASEL, 2020, 10 (10)
[9]   A New Method of Gold Foil Damage Detection in Stone Carving Relics Based on Multi-Temporal 3D LiDAR Point Clouds [J].
Hou, Miaole ;
Li, Shukun ;
Jiang, Lili ;
Wu, Yuhua ;
Hu, Yungang ;
Yang, Su ;
Zhang, Xuedong .
ISPRS INTERNATIONAL JOURNAL OF GEO-INFORMATION, 2016, 5 (05)
[10]   Multi-Scale Local Context Embedding for LiDAR Point Cloud Classification [J].
Huang, Rong ;
Hong, Danfeng ;
Xu, Yusheng ;
Yao, Wei ;
Stilla, Uwe .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2020, 17 (04) :721-725