SwinIoT: A Hierarchical Transformer-Based Framework for Behavioral Anomaly Detection in IoT-Driven Smart Cities

被引:1
作者
Mancy, H. [1 ,3 ]
Naith, Qamar H. [2 ]
机构
[1] Prince Sattam bin Abdulaziz Univ, Coll Comp Engn & Sci, Dept Comp Sci, Al Kharj 11942, Saudi Arabia
[2] Univ Jeddah, Coll Comp Sci & Engn, Dept Software Engn, Jeddah 21959, Saudi Arabia
[3] Al Azhar Univ, Fac Sci Girls, Dept Math, Cairo 11651, Egypt
关键词
Internet of Things; Anomaly detection; Transformers; Feature extraction; Smart cities; Real-time systems; Monitoring; Computational modeling; Computer architecture; Public security; Behavioral detection; swin transformer; IoT anomaly detection; edge computing; smart city surveillance; real-time machine learning; INTERNET; ANALYTICS; THINGS;
D O I
10.1109/ACCESS.2025.3551207
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Internet of Things (IoT) devices become more and more important because they are useful in different applications, for example, traffic monitoring, public safety, and environmental management. However, the vastness and diversity of IoT data and the requirement for real-time decision-making create a big challenge for anomaly detection frameworks. In this work, we propose SwinIoT, a new framework with hierarchical and windowed attention mechanisms of Swin Transformer that is especially good for the purpose of behavioral anomaly detection in IoT settings. SwinIoT would solve important problems of class imbalance, noisy data, and heterogeneous devices through the introduction of custom attention models embedding real-time optimizations. The proposed framework was benchmarked on nine datasets such as ARAS, CASAS, WESAD, and UCF Crime compared to the above-mentioned state-of-the-art algorithms like Active Learning-Based Anomaly Detection, Deep Support Vector Data Description (DSVDD), Deep Support Vector Data Description Contractive Autoencoder (DSVDD-CAE), and Federated Principal Component Analysis (FedPCA). It is proven to be better than the above algorithms by attaining up to 96% accuracy, 97% Mean Average Precision (mAP) , and excellent Area Under the Receiver Operating Characteristic curve (AUC-ROC) as well as Precision-Recall (PR) metrics, especially in low-resource and unbalanced data scenarios. The results indicate the potential of SwinIoT in scalable and accurate anomaly detection to the development of safer, smarter cities, ensuring reliability and security in critical systems.
引用
收藏
页码:48758 / 48774
页数:17
相关论文
共 39 条
[1]   Robust Anomaly Detection in IoT Networks using Deep SVDD and Contractive Autoencoder [J].
Aktar, Sharmin ;
Nur, Abdullah Yasin .
18TH ANNUAL IEEE INTERNATIONAL SYSTEMS CONFERENCE, SYSCON 2024, 2024,
[2]   ARAS Human Activity Datasets In Multiple Homes with Multiple Residents [J].
Alemdar, Hande ;
Ertan, Halil ;
Incel, Ozlem Durmaz ;
Ersoy, Cem .
PROCEEDINGS OF THE 2013 7TH INTERNATIONAL CONFERENCE ON PERVASIVE COMPUTING TECHNOLOGIES FOR HEALTHCARE AND WORKSHOPS (PERVASIVEHEALTH 2013), 2013, :232-235
[3]   Machine Learning Approaches for Anomaly Detection in IoT: An Overview and Future Research Directions [J].
Alghanmi, Nusaybah ;
Alotaibi, Reem ;
Buhari, Seyed M. .
WIRELESS PERSONAL COMMUNICATIONS, 2022, 122 (03) :2309-2324
[4]   SwinAnomaly: Real-Time Video Anomaly Detection Using Video Swin Transformer and SORT [J].
Bajgoti, Arpit ;
Gupta, Rishik ;
Balaji, Prasanalakshmi ;
Dwivedi, Rinky ;
Siwach, Meena ;
Gupta, Deepak .
IEEE ACCESS, 2023, 11 :111093-111105
[5]  
Banos O., 2012, UCI Machine Learning Repository
[6]   A Tiny Transformer-Based Anomaly Detection Framework for IoT Solutions [J].
Barbieri, Luca ;
Brambilla, Mattia ;
Stefanutti, Mario ;
Romano, Ciro ;
De Carlo, Niccolo ;
Roveri, Manuel .
IEEE OPEN JOURNAL OF SIGNAL PROCESSING, 2023, 4 :462-478
[7]   IoT anomaly detection methods and applications: A survey [J].
Chatterjee, Ayan ;
Ahmed, Bestoun S. .
INTERNET OF THINGS, 2022, 19
[8]   CASAS: A Smart Home in a Box [J].
Cook, Diane J. ;
Crandall, Aaron S. ;
Thomas, Brian L. ;
Krishnan, Narayanan C. .
COMPUTER, 2013, 46 (07) :62-69
[9]   Sensor-Based Datasets for Human Activity Recognition - A Systematic Review of Literature [J].
De-La-Hoz-Franco, Emiro ;
Ariza-Colpas, Paola ;
Medina Quero, Javier ;
Espinilla, Macarena .
IEEE ACCESS, 2018, 6 :59192-59210
[10]   A Survey of AI-Based Anomaly Detection in IoT and Sensor Networks [J].
DeMedeiros, Kyle ;
Hendawi, Abdeltawab ;
Alvarez, Marco .
SENSORS, 2023, 23 (03)