Named Entity Recognition for Drone Forensic Using BERT and DistilBERT

被引:8
作者
Silalahi, Swardiantara [1 ]
Ahmad, Tohari [1 ]
Studiawan, Hudan [1 ]
机构
[1] Inst Teknol Sepuluh Nopember, Dept Informat, Surabaya, Indonesia
来源
2022 INTERNATIONAL CONFERENCE ON DATA SCIENCE AND ITS APPLICATIONS (ICODSA) | 2022年
关键词
drone forensic; named entity recognition; transformers neural network; network infrastructure; BERT; DistilBERT;
D O I
10.1109/ICoDSA55874.2022.9862916
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The increase in UAV usage and popularity in many fields opens new opportunities and challenges. Many business sectors are benefiting from the UAV device employment. The wide range of drone implementation is varied, from business purposes to crime. Hence, further mechanisms are needed to deal with drone crime and attacks both administratively and technically. From a technical view, the security protocol is needed to keep the drone safe from various logical or physical attacks. In case a drone experiences incidents, a forensic protocol is needed to perform analysis and investigation to uncover the incident, understand the attack behavior, and mitigate the incident risk. Among the existing drone forensic research efforts, there is limited attempt to utilize specific drone artifacts to perform forensic analysis. Therefore, this paper investigates the potential of NER (Named Entity Recognition) as an initial step to perform information extraction from drone flight logs data. We use Transformers-based techniques to perform NER and assist the forensic investigation. BERT and DistilBERT pre-trained models are fine-tuned using the annotated data and get the F1 scores of 98.63% and of 95.9%, respectively.
引用
收藏
页码:53 / 58
页数:6
相关论文
共 50 条
  • [31] Using Pre-trained Deeply Contextual Model BERT for Russian Named Entity Recognition
    Mukhin, Eugeny
    [J]. ANALYSIS OF IMAGES, SOCIAL NETWORKS AND TEXTS (AIST 2019), 2020, 1086 : 167 - 173
  • [32] Named entity recognition in human nutrition and health domain using rule and BERT-FLAT
    Zheng L.
    Ren L.
    [J]. 1600, Chinese Society of Agricultural Engineering (37): : 211 - 218
  • [33] A Named Entity Recognition Approach for Electronic Medical Records Using BERT Semantic Enhancement and BiLSTM
    Lai, Xuewei
    Jie, Qingqing
    [J]. INTERNATIONAL JOURNAL ON SEMANTIC WEB AND INFORMATION SYSTEMS, 2023, 19 (01)
  • [34] Aviation-BERT-NER: Named Entity Recognition for Aviation Safety Reports
    Chandra, Chetan
    Ojima, Yuga
    Bendarkar, Mayank V.
    Mavris, Dimitri N.
    [J]. AEROSPACE, 2024, 11 (11)
  • [35] KGNER: Improving Chinese Named Entity Recognition by BERT Infused with the Knowledge Graph
    Hu, Weiwei
    He, Liang
    Ma, Hanhan
    Wang, Kai
    Xiao, Jingfeng
    [J]. APPLIED SCIENCES-BASEL, 2022, 12 (15):
  • [36] A BERT-Span model for Chinese named entity recognition in rehabilitation medicine
    Zhong, Jinhong
    Xuan, Zhanxiang
    Wang, Kang
    Cheng, Zhou
    [J]. PEERJ COMPUTER SCIENCE, 2023, 9
  • [37] Chinese agricultural diseases named entity recognition based on BERT-CRF
    Zhang, Suoxiang
    Zhao, Ming
    [J]. 2020 5TH INTERNATIONAL CONFERENCE ON MECHANICAL, CONTROL AND COMPUTER ENGINEERING (ICMCCE 2020), 2020, : 1144 - 1147
  • [38] Can BERT Dig It? Named Entity Recognition for Information Retrieval in the Archaeology Domain
    Brandsen, Alex
    Verberne, Suzan
    Lambers, Karsten
    Wansleeben, Milco
    [J]. ACM JOURNAL ON COMPUTING AND CULTURAL HERITAGE, 2022, 15 (03):
  • [39] Geotechnical Named Entity Recognition Based on BERT-BiGRU-CRF Model
    Quanyu W.
    Li Z.
    Tu Z.
    Chen G.
    Hu J.
    Chen J.
    Chen J.
    Lv G.
    [J]. Diqiu Kexue - Zhongguo Dizhi Daxue Xuebao/Earth Science - Journal of China University of Geosciences, 2023, 48 (08): : 3137 - 3150
  • [40] Chinese Named Entity Recognition Method in History and Culture Field Based on BERT
    Shuang Liu
    Hui Yang
    Jiayi Li
    Simon Kolmanič
    [J]. International Journal of Computational Intelligence Systems, 14