A Lightweight Concept Drift Detection and Adaptation Framework for IoT Data Streams

被引:66
|
作者
Yang L. [1 ]
Shami A. [1 ]
机构
[1] Western University, Ontario
来源
IEEE Internet of Things Magazine | 2021年 / 4卷 / 02期
关键词
Anomaly detection - Data Analytics;
D O I
10.1109/IOTM.0001.2100012
中图分类号
学科分类号
摘要
In recent years, with the increasing popularity of 'Smart Technology', the number of Internet of Things (IoT) devices and systems have surged significantly. Various IoT services and functionalities are based on the analytics of IoT streaming data. However, IoT data analytics faces concept drift challenges due to the dynamic nature of IoT systems and the ever-changing patterns of IoT data streams. In this article, we propose an adaptive IoT streaming data analytics framework for anomaly detection use cases based on optimized LightGBM and concept drift adaptation. A novel drift adaptation method named Optimized Adaptive and Sliding Windowing (OASW) is proposed to adapt to the pattern changes of online IoT data streams. Experiments on two public datasets show the high accuracy and efficiency of our proposed adaptive LightGBM model compared against other state-of-the-art approaches. The proposed adaptive LightGBM model can perform continuous learning and drift adaptation on IoT data streams without human intervention. © 2018 IEEE.
引用
收藏
页码:96 / 101
页数:5
相关论文
共 50 条
  • [21] CONCEPT DRIFT AND EVOLUTION DETECTION IN FUSION DIAGNOSIS WITH EVOLVING DATA STREAMS
    Abdolsamadi, Amirmahyar
    Wang, Pingfeng
    PROCEEDINGS OF THE ASME INTERNATIONAL DESIGN ENGINEERING TECHNICAL CONFERENCES AND COMPUTERS AND INFORMATION IN ENGINEERING CONFERENCE, 2017, VOL 2A, 2017,
  • [22] SACCOS: A Semi-Supervised Framework for Emerging Class Detection and Concept Drift Adaption Over Data Streams
    Gao, Yang
    Chandra, Swarup
    Li, Yifan
    Khan, Latifur
    Bhavani, Thuraisingham
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2022, 34 (03) : 1416 - 1426
  • [23] Concept Drift Adaptation Techniques in Distributed Environment for Real-World Data Streams
    Mehmood, Hassan
    Kostakos, Panos
    Cortes, Marta
    Anagnostopoulos, Theodoros
    Pirttikangas, Susanna
    Gilman, Ekaterina
    SMART CITIES, 2021, 4 (01): : 349 - 371
  • [24] Lightweight Anomaly Detection Framework for IoT
    Beasley, Bianca Tagliaro
    O'Mahony, George D.
    Quintana, Sergi Gomez
    Temko, Andriy
    Popovici, Emanuel
    2020 31ST IRISH SIGNALS AND SYSTEMS CONFERENCE (ISSC), 2020, : 159 - 164
  • [25] Concept Drift and Anomaly Detection in Graph Streams
    Zambon, Daniele
    Alippi, Cesare
    Livi, Lorenzo
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2018, 29 (11) : 5592 - 5605
  • [26] ENSEMBLE ALGORITHM FOR DATA STREAMS WITH CONCEPT DRIFT
    Tase, R. O. R.
    Cabrera, A. V.
    Naranjo, D. L. O.
    Diaz, A. A. O.
    Blanco, I. F.
    HOLOS, 2016, 32 (02) : 24 - 36
  • [27] On Fuzzy Clustering of Data Streams with Concept Drift
    Jaworski, Maciej
    Duda, Piotr
    Pietruczuk, Lena
    ARTIFICIAL INTELLIGENCE AND SOFT COMPUTING, PT II, 2012, 7268 : 82 - 91
  • [28] AUC Estimation and Concept Drift Detection for Imbalanced Data Streams with Multiple Classes
    Wang, Shuo
    Minku, Leandro L.
    2020 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2020,
  • [29] Concept Drift Detection in Streams of Labelled Data Using the Restricted Boltzmann Machine
    Jaworski, Maciej
    Duda, Piotr
    Rutkowski, Leszek
    2018 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2018,
  • [30] A novel concept drift detection method in data streams using ensemble classifiers
    Dehghan, Mahdie
    Beigy, Hamid
    ZareMoodi, Poorya
    INTELLIGENT DATA ANALYSIS, 2016, 20 (06) : 1329 - 1350