Autoencoder-based intra prediction with auxiliary feature

A set of autoencoders is trained to perform intra prediction for block-based video coding. Each autoencoder consists of an encoding network and a decoding network. Both encoding network and decoding networks are jointly optimized and integrated into the state-of-the-art VVC reference software VTM-11.0 as an additional intra prediction mode. The simulation is conducted under common test conditions with all intra configurations and the test results show 1.55%, 1.04%, and 0.99% of Y, U, V components Bjontegaard-Delta bit rate saving compared to VTM-11.0 anchor, respectively. The overall relative decoding running time of proposed autoencoder-based intra prediction mode on top of VTM-11.0 are 408% compared to VTM-11.0.