Improper Gaussian Signaling for Downlink NOMA Systems With Imperfect Successive Interference Cancellation

Non-orthogonal multiple access (NOMA) exhibits superiority in spectrum efficiency which is particularly essential in the Internet of Things (IoT) system involving massive number of device connections. This paper addresses the achievable rate improvement for the downlink NOMA system, in the context of imperfect successive interference cancellation (SIC), by means of the improper Gaussian signaling (IGS) technique. We investigate a basic scenario where the strong user transmits the conventional proper data, while the weak user adopts an improper signaling scheme. The users' data rates are first formulated in terms of the impropriety degree of the IGS, under residual interference introduced by the imperfect SIC. In this way, analytical expressions for the best improper transmission can be characterized by jointly optimizing the user's power and the impropriety degree, where their sufficient and necessary conditions are provided. When the strong user transmits with its maximum power, the IGS scheme always increases the achievable rate of the strong user while the weak user may also benefit. When the weak user transmits with its maximum power, such a scheme enables us optimize the achievable rate of the strong user under various levels of channel-to-noise ratios (CNR) and imperfect SIC. Finally, when both the users are imposed by quality of service (QoS) constraints, a Q-learning based solution is proposed to maximize their sum rate. Simulations on the downlink NOMA system support the analysis.