New Mean-Squared-Error Filter Design Method for Multiple-Input Multiple-Output Amplify-and-Forward Relay Systems with a Non-negligible Direct Link

In this paper, we propose a new mean-squared-error (MSE) minimizing transceiver design method for multiple-input multiple-output amplify-and-forward relay systems with a non-negligible source-to-destination direct link. In earlier works, the direct link has not been fully exploited nor have optimal solutions been presented in analytical forms. Motivated by these weaknesses, we investigated a new source-relay-destination filter design method. To address the difficulties resulting from multiple power constraints and the power allocation between two precoders at the source node, we formulated the MSE minimization problem by introducing a regularizing factor. From the Karush-Kuhn-Tucker conditions of the individual transceiver optimization problem, semi-closed form filter solutions for source, relay, and destination were derived. Then, resorting to the proposed iterative joint optimizing algorithm, a local optimal point was accessible. Through numerical simulations, the efficacy of the proposed method was illustrated, and it was observed that only a few iterations the MSE performances of the proposed method surpass those of conventional schemes.