A Deep Reinforcement Learning Approach for Backscatter-Assisted Relay Communications

被引:10
作者
Anh, Tran The [1 ]
Luong, Nguyen Cong [2 ]
Niyato, Dusit [1 ]
机构
[1] Nanyang Technol Univ, Sch Comp Sci & Engn, Singapore, Singapore
[2] Phenikaa Univ, Fac Comp Sci, Hanoi 12116, Vietnam
关键词
Backscatter; relay; energy harvesting; DDPG;
D O I
10.1109/LWC.2020.3024214
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
A backscatter-assisted relaying network (BRN) has been recently proposed to improve data rate, transmission range, and energy efficiency of D2D communications. In the BRN, as a D2D transmitter actively transmits data to a receiver in its time slot, other D2D transmitters can act as relays, i.e., helpers, through backscattering signal from the D2D transmitter to the receiver. This passive relay method has shown to be effective in terms of diversity gain. However, this impairs energy harvesting by the helpers and thus degrades their active data transmission performance. Therefore, the problem in the BRN is to optimize backscatter relaying policies, i.e., reflection coefficients, for the helpers to maximize the total network throughput over time slots. Finding the optimal decisions is generally challenging as energy in batteries, i.e., energy states, of the helpers and communication channels are dynamic and uncertain. In this letter, we propose to adopt the Deep Deterministic Policy Gradient (DDPG) algorithm to determine the optimal reflection coefficients of the helpers. The simulation results show that the proposed DRL scheme significantly improves the throughput performance.
引用
收藏
页码:166 / 169
页数:4
相关论文
共 4 条
  • [1] [Anonymous], 2015, COMPUTER SCI
  • [2] Exploiting Backscatter-Aided Relay Communications With Hybrid Access Model in Device-to-Device Networks
    Gong, Shimin
    Gao, Lin
    Xu, Jing
    Guo, Yuanxiong
    Dinh Thai Hoang
    Niyato, Dusit
    [J]. IEEE TRANSACTIONS ON COGNITIVE COMMUNICATIONS AND NETWORKING, 2019, 5 (04) : 835 - 848
  • [3] Backscatter Relay Communications Powered by Wireless Energy Beamforming
    Gong, Shimin
    Huang, Xiaoxia
    Xu, Jing
    Liu, Wei
    Wang, Ping
    Niyato, Dusit
    [J]. IEEE TRANSACTIONS ON COMMUNICATIONS, 2018, 66 (07) : 3187 - 3200
  • [4] Li J., 2018, P IEEE GLOBECOM, P1