In this paper, a novel multiple information security system based on wavelet transform and Yang-Gu mixture amplitude-phase retrieval algorithm is proposed. In this method, four color images are independently single level 2-D discrete wavelet transformed. A single color image constructed by fusing LL sub-bands of four color images is separated into R, G, and B channels. The amplitude of each channel and corresponding chaotic spiral phase function (CSPF) are, respectively, exploited as an input function and a phase function in Yang-Gu mixture amplitude-phase retrieval algorithm in gyrator transform domain. The detectable retrieved amplitude is obtained by one-way binary phase modulation, which is more convenient for key management, storage, and transmission. The decryption keys are generated by executing binary phase modulation to CSPF. The parameters (initial value, bifurcation parameter, chosen integer, order, wavelength, focal length, and radius) of CSPF are used as decryption keys. Consequently, the proposed asymmetric system is protected by multiple-decryption keys and it can avoid various types of attacks. The proposed method can be implemented by using optoelectronic setup. Numerical simulation results prove the security and feasibility of the strategy.