Named Entity Recognition for Drone Forensic Using BERT and DistilBERT

被引:8
|
作者
Silalahi, Swardiantara [1 ]
Ahmad, Tohari [1 ]
Studiawan, Hudan [1 ]
机构
[1] Inst Teknol Sepuluh Nopember, Dept Informat, Surabaya, Indonesia
来源
2022 INTERNATIONAL CONFERENCE ON DATA SCIENCE AND ITS APPLICATIONS (ICODSA) | 2022年
关键词
drone forensic; named entity recognition; transformers neural network; network infrastructure; BERT; DistilBERT;
D O I
10.1109/ICoDSA55874.2022.9862916
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The increase in UAV usage and popularity in many fields opens new opportunities and challenges. Many business sectors are benefiting from the UAV device employment. The wide range of drone implementation is varied, from business purposes to crime. Hence, further mechanisms are needed to deal with drone crime and attacks both administratively and technically. From a technical view, the security protocol is needed to keep the drone safe from various logical or physical attacks. In case a drone experiences incidents, a forensic protocol is needed to perform analysis and investigation to uncover the incident, understand the attack behavior, and mitigate the incident risk. Among the existing drone forensic research efforts, there is limited attempt to utilize specific drone artifacts to perform forensic analysis. Therefore, this paper investigates the potential of NER (Named Entity Recognition) as an initial step to perform information extraction from drone flight logs data. We use Transformers-based techniques to perform NER and assist the forensic investigation. BERT and DistilBERT pre-trained models are fine-tuned using the annotated data and get the F1 scores of 98.63% and of 95.9%, respectively.
引用
收藏
页码:53 / 58
页数:6
相关论文
共 50 条
  • [21] Research on Named Entity Recognition Method Based on BERT Model
    Xie, Shaopeng
    2024 IEEE 10TH INTERNATIONAL CONFERENCE ON BIG DATA COMPUTING SERVICE AND MACHINE LEARNING APPLICATIONS, BIGDATASERVICE 2024, 2024, : 92 - 96
  • [22] Based on BERT-wwm for Agricultural Named Entity Recognition
    Huang, Qiang
    Tao, Youzhi
    Wu, Zongyuan
    Marinello, Francesco
    AGRONOMY-BASEL, 2024, 14 (06):
  • [23] SELF-ATTENTION BASED DARKNET NAMED ENTITY RECOGNITION WITH BERT METHODS
    Chen, Yuxuan
    Guo, Yubin
    Jiang, Hong
    Ding, Jianwei
    Chen, Zhouguo
    INTERNATIONAL JOURNAL OF INNOVATIVE COMPUTING INFORMATION AND CONTROL, 2021, 17 (06): : 1973 - 1988
  • [24] Chinese Named Entity Recognition Based on BERT and Lightweight Feature Extraction Model
    Yang, Ruisen
    Gan, Yong
    Zhang, Chenfang
    INFORMATION, 2022, 13 (11)
  • [25] NAMED ENTITY RECOGNITION IN THANGKA FIELD BASED ON BERT-BiLSTM-CRF-a
    Guo, Xiaoran
    Cheng, Sujie
    Wang, Weilan
    UNIVERSITY POLITEHNICA OF BUCHAREST SCIENTIFIC BULLETIN SERIES C-ELECTRICAL ENGINEERING AND COMPUTER SCIENCE, 2021, 83 (01): : 161 - 174
  • [26] Improving Thai Named Entity Recognition Performance Using BERT Transformer on Deep Networks
    Praechanya, Nittha
    Sornil, Ohm
    PROCEEDINGS OF 2021 6TH INTERNATIONAL CONFERENCE ON MACHINE LEARNING TECHNOLOGIES (ICMLT 2021), 2021, : 177 - 183
  • [27] Named entity recognition of agricultural based entity-level masking BERT and BiLSTM-CRF
    Wei Z.
    Song L.
    Hu X.
    Chen N.
    Nongye Gongcheng Xuebao/Transactions of the Chinese Society of Agricultural Engineering, 2022, 38 (15): : 195 - 203
  • [28] Named Entity Recognition Method for Power Equipment Based on BERT-BiLSTM-CRF
    Hu, Jiangyi
    Yang, Wenqing
    Yang, Huafei
    Wei, Shanming
    Sun, Zhen
    2022 IEEE INTL CONF ON DEPENDABLE, AUTONOMIC AND SECURE COMPUTING, INTL CONF ON PERVASIVE INTELLIGENCE AND COMPUTING, INTL CONF ON CLOUD AND BIG DATA COMPUTING, INTL CONF ON CYBER SCIENCE AND TECHNOLOGY CONGRESS (DASC/PICOM/CBDCOM/CYBERSCITECH), 2022, : 694 - 699
  • [29] Named Entity Recognition of BERT-BiLSTM-CRF Combined with Self-attention
    Xu, Lei
    Li, Shuang
    Wang, Yuchen
    Xu, Lizhen
    WEB INFORMATION SYSTEMS AND APPLICATIONS (WISA 2021), 2021, 12999 : 556 - 564
  • [30] Named entity recognition in the food field based on BERT and Adversarial training
    Dong, Zhe
    Shao, RuoQi
    Chen, YuLiang
    Chen, JiaWei
    PROCEEDINGS OF THE 33RD CHINESE CONTROL AND DECISION CONFERENCE (CCDC 2021), 2021, : 2219 - 2226