A malicious network traffic detection model based on bidirectional temporal convolutional network with multi-head self-attention mechanism

被引:8
|
作者
Cai, Saihua [1 ,2 ]
Xu, Han [1 ]
Liu, Mingjie [1 ]
Chen, Zhilin [1 ]
Zhang, Guofeng [3 ]
机构
[1] Jiangsu Univ, Sch Comp Sci & Commun Engn, Zhenjiang 212013, Peoples R China
[2] Jiangsu Univ, Jiangsu Key Lab Secur Technol Ind Cyberspace, Zhenjiang 212013, Peoples R China
[3] Taishan Univ, Sch Informat Sci & Technol, Tai An 271000, Peoples R China
基金
中国国家自然科学基金;
关键词
Malicious network traffic detection; Bidirectional temporal convolutional network; Multi -head self -attention mechanism; Cross -entropy loss function; Deep learning;
D O I
10.1016/j.cose.2023.103580
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The increasingly frequent network intrusions have brought serious impacts to the production and life, thus malicious network traffic detection has received more and more attention in recent years. However, the traditional rule matching-based and machine learning-based malicious network traffic detection methods have the problems of relying on human experience as well as low detection efficiency. The continuous development of deep learning technology provides new ideas to solve malicious network traffic detection, and the deep learning models are also widely used in the field of malicious network traffic detection. Compared with other deep learning models, bidirectional temporal convolutional network (BiTCN) has achieved better detection results due to its ability to obtain bidirectional semantic features of network traffic, but it does not consider the different meanings as well as different importance of different subsequence segments in network traffic sequences; In addition, the loss function used in BiTCN is the negative log likelihood function, which may lead to overfitting problems when facing multi-classification problems and data imbalance problems. To solve these problems, this paper proposes a malicious network traffic detection model based on BiTCN and multi-head self-attention (MHSA) mechanism, namely BiTCN_MHSA, it innovatively uses the MHSA mechanism to assign different weights to different subsequences of network traffic, thus making the model more focused on the characteristics of malicious network traffic as well as improving the efficiency of processing global network traffic; Moreover, it also changes its loss function to a cross-entropy loss function to penalize misclassification more severely, thereby speeding up the convergence. Finally, extensive experiments are conduced to evaluate the efficiency of proposed BiTCN_MHSA model on two public network traffic, the experimental results verify that the proposed BiTCN_MHSA model outperforms six state-of-the-arts in precision, recall, F1-measure and accuracy.
引用
收藏
页数:17
相关论文
共 50 条
  • [11] Text summarization based on multi-head self-attention mechanism and pointer network
    Dong Qiu
    Bing Yang
    Complex & Intelligent Systems, 2022, 8 : 555 - 567
  • [12] Epilepsy detection based on multi-head self-attention mechanism
    Ru, Yandong
    An, Gaoyang
    Wei, Zheng
    Chen, Hongming
    PLOS ONE, 2024, 19 (06):
  • [13] MSSTGCN: Multi-Head Self-Attention and Spatial-Temporal Graph Convolutional Network for Multi-Scale Traffic Flow Prediction
    Zong, Xinlu
    Yu, Fan
    Chen, Zhen
    Xia, Xue
    CMC-COMPUTERS MATERIALS & CONTINUA, 2025, 82 (02): : 3517 - 3537
  • [14] Joint extraction of entities and relations based on character graph convolutional network and Multi-Head Self-Attention Mechanism
    Meng, Zhao
    Tian, Shengwei
    Yu, Long
    Lv, Yalong
    JOURNAL OF EXPERIMENTAL & THEORETICAL ARTIFICIAL INTELLIGENCE, 2021, 33 (02) : 349 - 362
  • [15] A Network Intrusion Detection Model Based on BiLSTM with Multi-Head Attention Mechanism
    Zhang, Jingqi
    Zhang, Xin
    Liu, Zhaojun
    Fu, Fa
    Jiao, Yihan
    Xu, Fei
    ELECTRONICS, 2023, 12 (19)
  • [16] Personalized multi-head self-attention network for news recommendation
    Zheng, Cong
    Song, Yixuan
    NEURAL NETWORKS, 2025, 181
  • [17] A Model for Sea Ice Segmentation based on Feature Pyramid Network and Multi-head Self-attention
    Xu, Yuanxiang
    Feng, Yuan
    Song, Shengyu
    Liu, Jiahao
    PROCEEDINGS OF THE 2024 27 TH INTERNATIONAL CONFERENCE ON COMPUTER SUPPORTED COOPERATIVE WORK IN DESIGN, CSCWD 2024, 2024, : 97 - 102
  • [18] ViolenceNet: Dense Multi-Head Self-Attention with Bidirectional Convolutional LSTM for Detecting Violence
    Rendon-Segador, Fernando J.
    Alvarez-Garcia, Juan A.
    Enriquez, Fernando
    Deniz, Oscar
    ELECTRONICS, 2021, 10 (13)
  • [19] Multi-Head Spatiotemporal Attention Graph Convolutional Network for Traffic Prediction
    Oluwasanmi, Ariyo
    Aftab, Muhammad Umar
    Qin, Zhiguang
    Sarfraz, Muhammad Shahzad
    Yu, Yang
    Rauf, Hafiz Tayyab
    SENSORS, 2023, 23 (08)
  • [20] Intelligent Micro-Kick Detection Using a Multi-Head Self-Attention Network
    Zhang, Dezhi
    Sun, Weifeng
    Dai, Yongshou
    Wang, Dongyue
    Guo, Yanliang
    Gong, Chentao
    PROCESSES, 2025, 13 (02)