Named Entity Recognition for Drone Forensic Using BERT and DistilBERT

被引:9
作者
Silalahi, Swardiantara [1 ]
Ahmad, Tohari [1 ]
Studiawan, Hudan [1 ]
机构
[1] Inst Teknol Sepuluh Nopember, Dept Informat, Surabaya, Indonesia
来源
2022 INTERNATIONAL CONFERENCE ON DATA SCIENCE AND ITS APPLICATIONS (ICODSA) | 2022年
关键词
drone forensic; named entity recognition; transformers neural network; network infrastructure; BERT; DistilBERT;
D O I
10.1109/ICoDSA55874.2022.9862916
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The increase in UAV usage and popularity in many fields opens new opportunities and challenges. Many business sectors are benefiting from the UAV device employment. The wide range of drone implementation is varied, from business purposes to crime. Hence, further mechanisms are needed to deal with drone crime and attacks both administratively and technically. From a technical view, the security protocol is needed to keep the drone safe from various logical or physical attacks. In case a drone experiences incidents, a forensic protocol is needed to perform analysis and investigation to uncover the incident, understand the attack behavior, and mitigate the incident risk. Among the existing drone forensic research efforts, there is limited attempt to utilize specific drone artifacts to perform forensic analysis. Therefore, this paper investigates the potential of NER (Named Entity Recognition) as an initial step to perform information extraction from drone flight logs data. We use Transformers-based techniques to perform NER and assist the forensic investigation. BERT and DistilBERT pre-trained models are fine-tuned using the annotated data and get the F1 scores of 98.63% and of 95.9%, respectively.
引用
收藏
页码:53 / 58
页数:6
相关论文
共 50 条
[41]   Chinese Named Entity Recognition Method in History and Culture Field Based on BERT [J].
Liu, Shuang ;
Yang, Hui ;
Li, Jiayi ;
Kolmanic, Simon .
INTERNATIONAL JOURNAL OF COMPUTATIONAL INTELLIGENCE SYSTEMS, 2021, 14 (01)
[42]   Analyzing the Performance of Sentiment Analysis using BERT, DistilBERT, and RoBERTa [J].
Joshy, Archa ;
Sundar, Sumod .
2022 IEEE INTERNATIONAL POWER AND RENEWABLE ENERGY CONFERENCE, IPRECON, 2022,
[43]   A Novel Named Entity Recognition Scheme for Steel E-Commerce Platforms Using a Lite BERT [J].
Chen, Maojian ;
Luo, Xiong ;
Shen, Hailun ;
Huang, Ziyang ;
Peng, Qiaojuan .
CMES-COMPUTER MODELING IN ENGINEERING & SCIENCES, 2021, 129 (01) :47-63
[44]   FinBERT–MRC: Financial Named Entity Recognition Using BERT Under the Machine Reading Comprehension Paradigm [J].
Yuzhe Zhang ;
Hong Zhang .
Neural Processing Letters, 2023, 55 :7393-7413
[45]   ChineseCTRE: A Model for Geographical Named Entity Recognition and Correction Based on Deep Neural Networks and the BERT Model [J].
Zhang, Wei ;
Meng, Jingtao ;
Wan, Jianhua ;
Zhang, Chengkun ;
Zhang, Jiajun ;
Wang, Yuanyuan ;
Xu, Liuchang ;
Li, Fei .
ISPRS INTERNATIONAL JOURNAL OF GEO-INFORMATION, 2023, 12 (10)
[46]   Enhanced Chinese named entity recognition with multi-granularity BERT adapter and efficient global pointer [J].
Lei Zhang ;
Pengfei Xia ;
Xiaoxuan Ma ;
Chengwei Yang ;
Xin Ding .
Complex & Intelligent Systems, 2024, 10 :4473-4491
[47]   Enhanced Chinese named entity recognition with multi-granularity BERT adapter and efficient global pointer [J].
Zhang, Lei ;
Xia, Pengfei ;
Ma, Xiaoxuan ;
Yang, Chengwei ;
Ding, Xin .
COMPLEX & INTELLIGENT SYSTEMS, 2024, 10 (03) :4473-4491
[48]   Recognition of Animal Drug Pathogenicity Named Entity Based on Att-Aux-BERT-BiLSTM-CRF [J].
Yang L. ;
Zhang T. ;
Zheng L. ;
Tian L. .
Nongye Jixie Xuebao/Transactions of the Chinese Society for Agricultural Machinery, 2022, 53 (03) :294-300
[49]   A Multi-Task BERT-BiLSTM-AM-CRF Strategy for Chinese Named Entity Recognition [J].
Tang, Xiaoyong ;
Huang, Yong ;
Xia, Meng ;
Long, Chengfeng .
NEURAL PROCESSING LETTERS, 2023, 55 (02) :1209-1229
[50]   BERT-based tourism named entity recognition: making use of social media for travel recommendations [J].
Fudholi, Dhomas Hatta ;
Zahra, Annisa ;
Rani, Septia ;
Huda, Sheila Nurul ;
Paputungan, Irving Vitra ;
Zukhri, Zainudin .
PEERJ COMPUTER SCIENCE, 2023, 9