Efficient Anomaly Detection for Edge Clouds: Mitigating Data and Resource Constraints

被引:0
|
作者
Forough, Javad [1 ]
Haddadi, Hamed [2 ]
Bhuyan, Monowar [1 ]
Elmroth, Erik [1 ]
机构
[1] Umea Univ, Dept Comp Sci, S-90187 Umea, Sweden
[2] Imperial Coll London, Dept Comp, London SW7 2AZ, England
来源
IEEE ACCESS | 2024年 / 12卷
关键词
Anomaly detection; data constraints; edge clouds; knowledge distillation; resource constraints; transfer learning;
D O I
10.1109/ACCESS.2024.3492815
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Anomaly detection plays a vital role in ensuring the security and reliability of edge clouds, which are decentralized computing environments with limited resources. However, the unique challenges of limited computing power and lack of edge-related labeled training data pose significant obstacles to effective supervised anomaly detection. In this paper, we propose an innovative approach that leverages transfer learning to address the lack of relevant labeled data and knowledge distillation to increase computational efficiency and achieve accurate anomaly detection on edge clouds. Our approach exploits transfer learning by utilizing knowledge from a pre-trained model and adapting it for anomaly detection on edge clouds. This enables the model to benefit from the learned features and patterns from related tasks such as network intrusion detection, resulting in improved detection accuracy. Additionally, we utilize knowledge distillation to distill the knowledge from the previously mentioned high-capacity model, known as the teacher model, into a more compact student model. This distillation process enhances the student model's computational efficiency while retaining its detection power. Evaluations conducted on our developed real-world edge cloud testbed show that, with the same amount of edge cloud's labeled dataset, our approach maintains high accuracy while significantly reducing the model's detection time to almost half for non-sequential models, from 81.11 mu s to 44.34 mu s on average. For sequential models, it reduces the detection time to nearly a third of the baseline model's, from 331.54 mu s to 113.86 mu s on average. These improvements make our approach exceptionally practical for real-time anomaly detection on edge clouds.
引用
收藏
页码:171897 / 171910
页数:14
相关论文
共 50 条
  • [1] Virtualization Technology Blending for resource-efficient edge clouds
    Valsamas, Polychronis
    Skaperas, Sotiris
    Mamatas, Lefteris
    Contreras, Luis M.
    COMPUTER NETWORKS, 2023, 225
  • [2] Efficient resource allocation and dimensioning of media edge clouds infrastructure
    Abdallah Jarray
    Ahmed Karmouch
    Javier Salazar
    Jocelyne Elias
    Ahmed Mehaoua
    Faisal Zaman
    Journal of Cloud Computing, 6
  • [3] Efficient resource allocation and dimensioning of media edge clouds infrastructure
    Jarray, Abdallah
    Karmouch, Ahmed
    Salazar, Javier
    Elias, Jocelyne
    Mehaoua, Ahmed
    Zaman, Faisal
    JOURNAL OF CLOUD COMPUTING-ADVANCES SYSTEMS AND APPLICATIONS, 2017, 6
  • [4] A Novel Anomaly Detection Approach for Mitigating Web-based Attacks against Clouds
    Zhang, Simin
    Li, Bo
    Li, Jianxin
    Zhang, Mingming
    Chen, Yang
    2015 IEEE 2ND INTERNATIONAL CONFERENCE ON CYBER SECURITY AND CLOUD COMPUTING (CSCLOUD), 2015, : 289 - 294
  • [5] Efficient stochastic scheduling for highly complex resource placement in edge clouds
    Wei, Wei
    Wang, Qi
    Yang, Weidong
    Mu, Yashuang
    JOURNAL OF NETWORK AND COMPUTER APPLICATIONS, 2022, 202
  • [6] Anomaly Detection in Resource Constrained Environments With Streaming Data
    Jain, Prarthi
    Jain, Seemandhar
    Zaiane, Osmar R.
    Srivastava, Abhishek
    IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTATIONAL INTELLIGENCE, 2022, 6 (03): : 649 - 659
  • [7] An efficient data structure for network anomaly detection
    Fan, Jieyan
    Wu, Dapeng
    Lu, Kejie
    Nucci, Antonio
    SECURITY AND COMMUNICATION NETWORKS, 2008, 1 (02) : 107 - 124
  • [8] Anomaly Detection In IaaS Clouds
    Doelitzscher, Frank
    Knahl, Martin
    Reich, Christoph
    Clarke, Nathan
    2013 IEEE FIFTH INTERNATIONAL CONFERENCE ON CLOUD COMPUTING TECHNOLOGY AND SCIENCE (CLOUDCOM), VOL 1, 2013, : 387 - 394
  • [9] Anomaly Detection on the Edge
    Schneible, Joseph
    Lu, Alex
    MILCOM 2017 - 2017 IEEE MILITARY COMMUNICATIONS CONFERENCE (MILCOM), 2017, : 678 - 682
  • [10] Anomaly Detection in Multibeam Bathymetric Point Clouds Integrating Prior Constraints With Geostatistical Prediction
    Cui, Xiaodong
    Chang, Bingtao
    Zhang, Shuhang
    He, Jinchen
    Zhi, Zhiyang
    Zhang, Wuming
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2024, 17 : 17903 - 17916