Age of Information Cost Minimization with No Buffers, Random Arrivals and Unreliable Channels: A PCL-Indexability Analysis

被引:1
作者
Nino-Mora, Jose [1 ]
机构
[1] Carlos III Univ Madrid, Dept Stat, Getafe 28903, Spain
关键词
Age of Information; scheduling; Markov decision models; nonlinear costs; random packet arrivals; unreliable channels; restless bandits; Whittle index; partial conservation laws; INDEX POLICY; RESTLESS; ALLOCATION;
D O I
10.3390/math11204394
中图分类号
O1 [数学];
学科分类号
0701 ; 070101 ;
摘要
Over the last decade, the Age of Information has emerged as a key concept and metric for applications where the freshness of sensor-provided data is critical. Limited transmission capacity has motivated research on the design of tractable policies for scheduling information updates to minimize Age of Information cost based on Markov decision models, in particular on the restless multi-armed bandit problem (RMABP). This allows the use of Whittle's popular index policy, which is often nearly optimal, provided indexability (index existence) is proven, which has been recently accomplished in some models. We aim to extend the application scope of Whittle's index policy in a broader AoI scheduling model. We address a model with no buffers incorporating random packet arrivals, unreliable channels, and nondecreasing AoI costs. We use sufficient indexability conditions based on partial conservation laws previously introduced by the author to establish the model's indexability and evaluate its Whittle index in closed form under discounted and average cost criteria. We further use the index formulae to draw insights on how scheduling priority depends on model parameters.
引用
收藏
页数:28
相关论文
共 31 条
[1]  
[Anonymous], 1974, P PROG STAT EUR M ST
[2]   Discounted Age of Information for Networks of Constrained Devices [J].
Badia, Leonardo ;
Munari, Andrea .
2022 20TH MEDITERRANEAN COMMUNICATION AND COMPUTER NETWORKING CONFERENCE (MEDCOMNET), 2022,
[3]  
Bertsekas D.P, 2005, Dynamic Programming and Optimal Control
[4]   Scheduling Algorithms for Minimizing Age of Information in Wireless Broadcast Networks with Random Arrivals [J].
Hsu, Yu-Pin ;
Modiano, Eytan ;
Duan, Lingjie .
IEEE TRANSACTIONS ON MOBILE COMPUTING, 2020, 19 (12) :2903-2915
[5]  
Jhunjhunwala PR, 2018, INT CO SIG PROC COMM, P222, DOI 10.1109/SPCOM.2018.8724448
[6]   Scheduling Policies for Minimizing Age of Information in Broadcast Wireless Networks [J].
Kadota, Igor ;
Sinha, Abhishek ;
Uysal-Biyikoglu, Elif ;
Singh, Rahul ;
Modiano, Eytan .
IEEE-ACM TRANSACTIONS ON NETWORKING, 2018, 26 (06) :2637-2650
[7]  
Kaul S., 2011, 2011 8th Annual IEEE Communications Society Conference on Sensor, Mesh and Ad Hoc Communications and Networks (SECON 2011), P350, DOI 10.1109/SAHCN.2011.5984917
[8]  
Kaul S, 2012, IEEE INFOCOM SER, P2731, DOI 10.1109/INFCOM.2012.6195689
[9]  
Klimov G. P., 1974, Theory of Probability and Its Applications, V19, P532, DOI 10.1137/1119060
[10]   Age of information: A new concept, metric, and tool [J].
Kosta A. ;
Pappas N. ;
Angelakis V. .
2017, Now Publishers Inc (12) :162-259