HA-A2C: Hard Attention and Advantage Actor-Critic for Addressing Latency Optimization in Edge Computing

被引:1
作者
Yang, Jing [1 ]
Lu, Jialin [1 ]
Zhou, Xu [1 ]
Li, Shaobo [1 ]
Xiong, Chuanyue
Hu, Jianjun [2 ]
机构
[1] Guizhou Univ, State Key Lab Publ Big Data, Guiyang 550025, Peoples R China
[2] Univ South Carolina, Dept Comp Sci & Engn, Columbia, SC 29201 USA
来源
IEEE TRANSACTIONS ON GREEN COMMUNICATIONS AND NETWORKING | 2025年 / 9卷 / 01期
基金
中国国家自然科学基金;
关键词
Task analysis; Processor scheduling; Servers; Optimal scheduling; Resource management; Dynamic scheduling; Delays; Edge computing; hard attention; resource scheduling; deep reinforcement learning; delay optimization; RESOURCE-ALLOCATION; EFFICIENT; MANAGEMENT; FRAMEWORK; INTERNET; STRATEGY;
D O I
10.1109/TGCN.2024.3409390
中图分类号
TN [电子技术、通信技术];
学科分类号
0809 ;
摘要
Due to the rapid development of the IoT and data-driven applications, low-latency task scheduling methods that quickly respond to user tasks has become a significant challenge for edge servers. However, the existing task scheduling strategies do not overcome the impact of factors such as task characteristics, resource availability, and network conditions on delays. Meanwhile, the cross-regional maldistribution of edge servers is obvious, and the edge servers are either idle or overloaded. To address these issues, we propose a low-latency edge scheduling strategy based on the Hard Attention Mechanism and Advantage Actor-Critic (HA-A2C). The core element of this method is the adoption of a hard attention mechanism, which reduces computing complexity and increases efficiency. Effective attention allocation during the resource allocation process further reduces job completion time. Additionally, the deep reinforcement learning method is employed to enhance task dynamic scheduling capabilities, thereby reducing scheduling delays. The HA-A2C approach reduces task latency by approximately 40% compared to the DQN method. Consequently, the intelligent allocation of task resources achieved by integrating the hard attention technique significantly reduces task scheduling time in edge environments.
引用
收藏
页码:207 / 217
页数:11
相关论文
共 53 条
[11]   Market-based dynamic resource allocation in Mobile Edge Computing systems with multi-server and multi-user [J].
Huang, Xiaowen ;
Zhang, Wenjie ;
Yang, Jingmin ;
Yang, Liwei ;
Yeo, Chai Kiat .
COMPUTER COMMUNICATIONS, 2021, 165 (165) :43-52
[12]   Resiliency Assessment of Power Systems Using Deep Reinforcement Learning [J].
Ibrahim, Mariam ;
Alsheikh, Ahmad ;
Elhafiz, Ruba .
COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE, 2022, 2022
[13]   IRATS: A DRL-based intelligent priority and deadline-aware online resource allocation and task scheduling algorithm in a vehicular fog network [J].
Jamil, Bushra ;
Ijaz, Humaira ;
Shojafar, Mohammad ;
Munir, Kashif .
AD HOC NETWORKS, 2023, 141
[14]   K-LZF : An efficient and fair scheduling for Edge Computing servers [J].
Jang, Joonhyouk ;
Jung, Jinman ;
Hong, Jiman .
FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2019, 98 :44-53
[15]   Joint Task Offloading and Resource Allocation for Energy-Constrained Mobile Edge Computing [J].
Jiang, Hongbo ;
Dai, Xingxia ;
Xiao, Zhu ;
Iyengar, Arun .
IEEE TRANSACTIONS ON MOBILE COMPUTING, 2023, 22 (07) :4000-4015
[16]   Edge-computing-driven Internet of Things: A Survey [J].
Kong, Linghe ;
Tan, Jinlin ;
Huang, Junqin ;
Chen, Guihai ;
Wang, Shuaitian ;
Jin, Xi ;
Zeng, Peng ;
Khan, Muhammad ;
Das, Sajal K. .
ACM COMPUTING SURVEYS, 2023, 55 (08)
[17]   Resource and replica management strategy for optimizing financial cost and user experience in edge cloud computing system [J].
Li, Chunlin ;
Bai, Jingpan ;
Chen, Yi ;
Luo, Youlong .
INFORMATION SCIENCES, 2020, 516 :33-55
[18]   Joint Optimization Strategy of Computation Offloading and Resource Allocation in Multi-Access Edge Computing Environment [J].
Li, Huilin ;
Xu, Haitao ;
Zhou, Chengcheng ;
Lu, Xing ;
Han, Zhu .
IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2020, 69 (09) :10214-10226
[19]   Multi-objective deep reinforcement learning for computation offloading in UAV-assisted multi-access edge computing ✩ [J].
Liu, Xu ;
Chai, Zheng-Yi ;
Li, Ya-Lun ;
Cheng, Yan-Yang ;
Zeng, Yue .
INFORMATION SCIENCES, 2023, 642
[20]   Edge Computing Framework for Cooperative Video Processing in Multimedia IoT Systems [J].
Long, Changchun ;
Cao, Yang ;
Jiang, Tao ;
Zhang, Qian .
IEEE TRANSACTIONS ON MULTIMEDIA, 2018, 20 (05) :1126-1139