Energy Efficiency Maximization in RIS-Assisted SWIPT Networks With RSMA: A PPO-Based Approach

This paper investigates reconfigurable intelligent surface (RIS)-assisted simultaneous wireless information and power transfer (SWIPT) networks with rate splitting multiple access (RSMA). An energy efficiency (EE) maximization problem is formulated subject to the power budget at the transmitter and the quality of service (QoS) requirements of both information communication and energy harvesting, where the beamforming vectors, the power splitting (PS) ratios, the common message rates, and the discrete phase shifts are jointly optimized. To tackle the non-convex problem with both discrete and continuous variables, a deep reinforcement learning-based approach is proposed with the proximal policy optimization (PPO) framework. Different from traditional optimization approaches which optimizes the beamforming vectors and phase shifts separately and alternatively, our proposed PPO-based approach optimizes all the variables in unison. Besides, to perform beamforming design in action space, the beamforming vectors for the common stream and the private stream are respectively designed based on the maximum-ratio transmission and the zero forcing to enhance both energy and information transmission. To evaluate the performance of the PPO-based approach, a successive convex approximation (SCA) and Dinkelbach's method based solution scheme (named SCA-D scheme) is also presented. Simulation results show that the system EE obtained by the proposed PPO-based approach is close to that obtained by the SCA-D scheme while outperforming various benchmarks. The RSMA contributes to the EE of the system greatly compared with traditional scheme. As for the case of time-varying channels, the proposed PPO-based approach is with much smaller running time by only sacrificing a slight EE performance compared with the SCA-D scheme.