Resource allocation for content distribution in IoT edge cloud computing environments using deep reinforcement learning

被引:1
作者
Neelakantan, Puligundla [1 ]
Gangappa, Malige [1 ]
Rajasekar, Mummalaneni [2 ]
Kumar, Talluri Sunil [2 ]
Reddy, Gali Suresh [3 ]
机构
[1] VNR Vignana Jyothi Inst Engn & Technol, Comp Sci & Engn Dept, Hyderabad, India
[2] VNR Vignana Jyothi Inst Engn & Technol, Cyber Secur & Artificial Intelligence & Data Sci D, Comp Sci & Engn Data Sci, Hyderabad, India
[3] VNR Vignana Jyothi Inst Engn & Technol, Dept Informat Technol, Hyderabad, India
关键词
Cloud computing; resource allocation; Internet of things; deep Q network; reinforcement Learning; ARCHITECTURE; FRAMEWORK; SECURITY;
D O I
10.3233/JHS-230165
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This study presents a novel approach to optimize resource allocation, aiming to boost the efficiency of content distribution in Internet of Things (IoT) edge cloud computing environments. The proposed method termed the Caching-based Deep Q-Network (CbDQN) framework, dynamically allocates computational and storage resources across edge devices and cloud servers. Despite its need for increased storage capacity, the high cost of edge computing, and the inherent limitations of wireless networks connecting edge devices, the CbDQN strategy addresses these challenges. By considering constraints such as limited bandwidth and potential latency issues, it ensures efficient data transfer without compromising performance. The method focuses on mitigating inefficient resource usage, particularly crucial in cloud-based edge computing environments where resource costs are usage-based. To overcome these issues, the CbDQN method efficiently distributes limited resources, optimizing efficiency, minimizing costs, and enhancing overall performance. The approach improves content delivery, reduces latency, and minimizes network congestion. The simulation results substantiate the efficacy of the suggested method in optimizing resource utilization and enhancing system performance, showcasing its potential to address challenges associated with content spreading in IoT edge cloud calculating situations. Our proposed approach evaluated metrics achieves high values of Accuracy is 99.85%, Precision at 99.85%, specificity is 99.82%, sensitivity is 99.82%, F-score is 99.82% and AUC is 99.82%.
引用
收藏
页码:409 / 426
页数:18
相关论文
共 35 条
[1]   Fog Computing Advancement: Concept, Architecture, Applications, Advantages, and Open Issues [J].
Abdali, Taj-Aldeen Naser ;
Hassan, Rosilah ;
Aman, Azana Hafizah Mohd ;
Quang Ngoc Nguyen .
IEEE ACCESS, 2021, 9 :75961-75980
[2]   Task offloading and resource allocation algorithm based on deep reinforcement learning for distributed AI execution tasks in IoT edge computing environments [J].
Aghapour, Zahra ;
Sharifian, Saeed ;
Taheri, Hassan .
COMPUTER NETWORKS, 2023, 223
[3]   DeepEdge: A New QoE-Based Resource Allocation Framework Using Deep Reinforcement Learning for Future Heterogeneous Edge-IoT Applications [J].
AlQerm, Ismail ;
Pan, Jianli .
IEEE TRANSACTIONS ON NETWORK AND SERVICE MANAGEMENT, 2021, 18 (04) :3942-3954
[4]   Dynamic Task Allocation and Service Migration in Edge-Cloud IoT System Based on Deep Reinforcement Learning [J].
Chen, Yan ;
Sun, Yanjing ;
Wang, Chenyang ;
Taleb, Tarik .
IEEE INTERNET OF THINGS JOURNAL, 2022, 9 (18) :16742-16757
[5]   Deep Reinforcement Learning-Based Resource Allocation for Content Distribution in IoT-Edge-Cloud Computing Environments [J].
Cui, Tongke ;
Yang, Ruopeng ;
Fang, Chao ;
Yu, Shui .
SYMMETRY-BASEL, 2023, 15 (01)
[6]   Artificial neural networks for resources optimization in energetic environment [J].
D'Angelo, Gianni ;
Palmieri, Francesco ;
Robustelli, Antonio .
SOFT COMPUTING, 2022, 26 (04) :1779-1792
[7]  
DAngelo G., 2023, 2023 INT C COMP SCI, P191
[8]   Toward a mixed reality domain model for time-Sensitive applications using IoE infrastructure and edge computing (MRIoEF) [J].
Elawady, Mohamed ;
Sarhan, Amany ;
Alshewimy, Mahmoud A. M. .
JOURNAL OF SUPERCOMPUTING, 2022, 78 (08) :10656-10689
[9]   Deep-Reinforcement-Learning-Based Resource Allocation for Content Distribution in Fog Radio Access Networks [J].
Fang, Chao ;
Xu, Hang ;
Yang, Yihui ;
Hu, Zhaoming ;
Tu, Shanshan ;
Ota, Kaoru ;
Yang, Zheng ;
Dong, Mianxiong ;
Han, Zhu ;
Yu, F. Richard ;
Liu, Yunjie .
IEEE INTERNET OF THINGS JOURNAL, 2022, 9 (18) :16874-16883
[10]   Blockchain for Edge of Things: Applications, Opportunities, and Challenges [J].
Gadekallu, Thippa Reddy ;
Pham, Quoc-Viet ;
Nguyen, Dinh C. ;
Maddikunta, Praveen Kumar Reddy ;
Deepa, N. ;
Prabadevi, B. ;
Pathirana, Pubudu N. ;
Zhao, Jun ;
Hwang, Won-Joo .
IEEE INTERNET OF THINGS JOURNAL, 2022, 9 (02) :964-988