HA-A2C: Hard Attention and Advantage Actor-Critic for Addressing Latency Optimization in Edge Computing

被引:1
作者
Yang, Jing [1 ]
Lu, Jialin [1 ]
Zhou, Xu [1 ]
Li, Shaobo [1 ]
Xiong, Chuanyue
Hu, Jianjun [2 ]
机构
[1] Guizhou Univ, State Key Lab Publ Big Data, Guiyang 550025, Peoples R China
[2] Univ South Carolina, Dept Comp Sci & Engn, Columbia, SC 29201 USA
来源
IEEE TRANSACTIONS ON GREEN COMMUNICATIONS AND NETWORKING | 2025年 / 9卷 / 01期
基金
中国国家自然科学基金;
关键词
Task analysis; Processor scheduling; Servers; Optimal scheduling; Resource management; Dynamic scheduling; Delays; Edge computing; hard attention; resource scheduling; deep reinforcement learning; delay optimization; RESOURCE-ALLOCATION; EFFICIENT; MANAGEMENT; FRAMEWORK; INTERNET; STRATEGY;
D O I
10.1109/TGCN.2024.3409390
中图分类号
TN [电子技术、通信技术];
学科分类号
0809 ;
摘要
Due to the rapid development of the IoT and data-driven applications, low-latency task scheduling methods that quickly respond to user tasks has become a significant challenge for edge servers. However, the existing task scheduling strategies do not overcome the impact of factors such as task characteristics, resource availability, and network conditions on delays. Meanwhile, the cross-regional maldistribution of edge servers is obvious, and the edge servers are either idle or overloaded. To address these issues, we propose a low-latency edge scheduling strategy based on the Hard Attention Mechanism and Advantage Actor-Critic (HA-A2C). The core element of this method is the adoption of a hard attention mechanism, which reduces computing complexity and increases efficiency. Effective attention allocation during the resource allocation process further reduces job completion time. Additionally, the deep reinforcement learning method is employed to enhance task dynamic scheduling capabilities, thereby reducing scheduling delays. The HA-A2C approach reduces task latency by approximately 40% compared to the DQN method. Consequently, the intelligent allocation of task resources achieved by integrating the hard attention technique significantly reduces task scheduling time in edge environments.
引用
收藏
页码:207 / 217
页数:11
相关论文
共 53 条
[1]   A heuristic scheduling approach for fog-cloud computing environment with stationary IoT devices [J].
Aburukba, Raafat O. ;
Landolsi, Taha ;
Omer, Dalia .
JOURNAL OF NETWORK AND COMPUTER APPLICATIONS, 2021, 180
[2]   Emerging Edge Computing Technologies for Distributed IoT Systems [J].
Alnoman, Ali ;
Sharma, Shree Krishna ;
Ejaz, Waleed ;
Anpalagan, Alagan .
IEEE NETWORK, 2019, 33 (06) :140-147
[3]   Deep reinforcement learning for solving resource constrained project scheduling problems with resource disruptions [J].
Cai, Hongxia ;
Bian, Yunqi ;
Liu, Lilan .
ROBOTICS AND COMPUTER-INTEGRATED MANUFACTURING, 2024, 85
[4]   A novel dynamic multi-objective task scheduling optimization based on Dueling DQN and PER [J].
Chraibi, Amine ;
Ben Alla, Said ;
Touhafi, Abdellah ;
Ezzati, Abdellah .
JOURNAL OF SUPERCOMPUTING, 2023, 79 (18) :21368-21423
[5]   Resource Management for Intelligent Vehicular Edge Computing Networks [J].
Duan, Wei ;
Gu, Xiaohui ;
Wen, Miaowen ;
Ji, Yancheng ;
Ge, Jianhua ;
Zhang, Guoan .
IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2022, 23 (07) :9797-9808
[6]   Deep Multiagent Reinforcement-Learning-Based Resource Allocation for Internet of Controllable Things [J].
Gu, Bo ;
Zhang, Xu ;
Lin, Ziqi ;
Alazab, Mamoun .
IEEE INTERNET OF THINGS JOURNAL, 2021, 8 (05) :3066-3074
[7]   Comparative analysis of task level heuristic scheduling algorithms in cloud computing [J].
Hamid, Laiba ;
Jadoon, Asmara ;
Asghar, Hassan .
JOURNAL OF SUPERCOMPUTING, 2022, 78 (11) :12931-12949
[8]   Resource Management in Fog/Edge Computing: A Survey on Architectures, Infrastructure, and Algorithms [J].
Hong, Cheol-Ho ;
Varghese, Blesson .
ACM COMPUTING SURVEYS, 2019, 52 (05)
[9]   Energy-efficient scheduling based on task prioritization in mobile fog computing [J].
Hosseini, Entesar ;
Nickray, Mohsen ;
Ghanbari, Shamsollah .
COMPUTING, 2023, 105 (01) :187-215
[10]   Edge Intelligence for Real-Time Data Analytics in an IoT-Based Smart Metering System [J].
Hu, Hailin ;
Tang, Liangrui .
IEEE NETWORK, 2020, 34 (05) :68-74