Hybrid semantics-based vulnerability detection incorporating a Temporal Convolutional Network and Self-attention Mechanism

被引:5
|
作者
Chen, Jinfu [1 ,2 ]
Wang, Weijia [1 ,2 ]
Liu, Bo [1 ,2 ]
Cai, Saihua [1 ,2 ]
Towey, Dave [3 ]
Wang, Shengran [1 ,2 ]
机构
[1] Jiangsu Univ, Sch Comp Sci & Commun Engn, Zhenjiang 212013, Peoples R China
[2] Jiangsu Univ, Jiangsu Key Lab Secur Technol Ind Cyberspace, Zhenjiang 212013, Peoples R China
[3] Univ Nottingham Ningbo China, Sch Comp Sci, Ningbo 315100, Zhejiang, Peoples R China
基金
中国国家自然科学基金;
关键词
Deep learning; Software vulnerability detection; Temporal Convolutional Network; Self-attention Mechanism; Source-code picturization; Feature fusion;
D O I
10.1016/j.infsof.2024.107453
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Context: Desirable characteristics in vulnerability -detection (VD) systems (VDSs) include both good detection capability (high accuracy, low false positive rate, low false negative rate, etc.) and low time overheads. The widely used VDSs based on models such as Recurrent Neural Networks (RNNs) have some problems, such as low time efficiency, failing to learn the vulnerability features better, and insufficient amounts of vulnerability features. Therefore, it is very important to construct an automatic detection model with high detection accuracy. Objective: This paper reports on training based on the source code to analyze and learn from the code's patterns and structures by deep -learning techniques to generate an efficient VD model that does not require manual feature design. Method: We propose a software VD model based on multi -feature fusion and deep neural networks called AIdetectorX-SP. It first uses a Temporal Convolutional Network (TCN) and adds a Self -attention Mechanism (SaM) to the TCN to build a model for extracting vulnerability logic features, then transforms the source code into an image input to a Convolutional Neural Network (CNN) to extract structural and semantic information. Finally, we use feature -fusion technology to design and implement an improved deep -learning -based VDS, called AIdetectorX Sequence with Picturization (AIdetectorX-SP). Results: We report on experiments conducted using publicly -available and widely -used datasets to evaluate the effectiveness of AIdetectorX-SP, with results indicating that AIdetectorX-SP is an effective VDS; that the combination of TCN and SaM can effectively extract vulnerability logic features; and that the pictorial code can extract code structure features, which can further improve the VD capability. Conclusion: In this paper, we propose a novel detection model for software vulnerability based on TCNs, SaM, and software picturization. The proposed model solves some shortcomings and limitations of existing VDSs, and obtains a high software -VD accuracy with a high degree of stability.
引用
收藏
页数:16
相关论文
共 50 条
  • [21] SCVD-SA: A Smart Contract Vulnerability Detection Method based on Hybrid Deep Learning Model and Self-attention Mechanism
    Wang, Dongjie
    Chen, Jinfu
    Cai, Saihua
    Feng, Qiaowei
    Chen, Yuhao
    Hu, Xinyi
    2024 IEEE INTERNATIONAL CONFERENCE ON SOFTWARE ANALYSIS, EVOLUTION AND REENGINEERING-COMPANION, SANER-C 2024, 2024, : 207 - 214
  • [22] Improved Lane Detection Method Based on Convolutional Neural Network Using Self-attention Distillation
    Zhang, Xinyu
    Huang, He
    Meng, Weiming
    Luo, Dean
    SENSORS AND MATERIALS, 2020, 32 (12) : 4505 - 4516
  • [23] Remaining Useful Life Prediction of Bearings Based on Multi-head Self-attention Mechanism, Multi-scale Temporal Convolutional Network and Convolutional Neural Network
    Wei, Hao
    Gu, Yu
    Zhang, Qinghua
    2023 35TH CHINESE CONTROL AND DECISION CONFERENCE, CCDC, 2023, : 3027 - 3032
  • [24] Compound Convolutional and Self-Attention Network for Session-Based Recommendation
    Xiao, Yan
    Huo, Lin
    Computer Engineering and Applications, 2023, 59 (10) : 104 - 113
  • [25] Unsupervised GAN-Based Intrusion Detection System Using Temporal Convolutional Networks and Self-Attention
    de Araujo-Filho, Paulo Freitas
    Naili, Mohamed
    Kaddoum, Georges
    Fapi, Emmanuel Thepie
    Zhu, Zhongwen
    IEEE TRANSACTIONS ON NETWORK AND SERVICE MANAGEMENT, 2023, 20 (04): : 4951 - 4963
  • [26] Self-Attention Graph Residual Convolutional Network for Event Detection with dependency relations
    Liu, Haozhe
    Xu, Ning
    Liu, Anan
    FINDINGS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, EMNLP 2021, 2021, : 302 - 311
  • [27] Self-Attention based Automated Vulnerability Detection with Effective Data Representation
    Wu, Tongshuai
    Chen, Liwei
    Du, Gewangzi
    Zhu, Chenguang
    Shi, Gang
    19TH IEEE INTERNATIONAL SYMPOSIUM ON PARALLEL AND DISTRIBUTED PROCESSING WITH APPLICATIONS (ISPA/BDCLOUD/SOCIALCOM/SUSTAINCOM 2021), 2021, : 892 - 899
  • [28] Micro LED defect detection with self-attention mechanism-based neural network
    Zhong, Zebang
    Li, Cheng
    Chen, Meiyun
    Wu, Heng
    Kiyoshi, Takamasu
    DIGITAL SIGNAL PROCESSING, 2024, 149
  • [29] Image Deblurring Algorithm Incorporating Self-Attention Mechanism
    Yu, Tingting
    Lv, Qiang
    Huang, Zhen
    Su, Zhang
    Wang, Xiangli
    INTERNATIONAL JOURNAL OF PATTERN RECOGNITION AND ARTIFICIAL INTELLIGENCE, 2025,
  • [30] Spatio-Temporal Topology Routing Algorithm for Opportunistic Network Based on Self-attention Mechanism
    Wu, Xiaorui
    Xu, Gang
    Hao, Xinyu
    Huang, Baoqi
    Bai, Xiangyu
    ALGORITHMS AND ARCHITECTURES FOR PARALLEL PROCESSING, ICA3PP 2021, PT I, 2022, 13155 : 147 - 161