Image set face recognition based on extended low rank recovery and collaborative representation

In the real-world face recognition problems, the collected query set images often suffer serious disturbances. To address the problem, we propose an image set face recognition method based on extended low rank recovery and collaborative representation. By exploiting a Frobenius norm term, an extended low rank representation model is firstly developed to remove all possible disturbances from the query set and reconstruct the rank-one query set. To improve the computational efficiency, a compact and discriminative dictionary is learned from the large gallery set, and the closed form solutions for both the dictionary atom and the coding coefficient are straightway derived. The final classification is performed by using any frame in the reconstructed query set instead of using the whole set, which can further improve the running efficiency. Extensive experiments are conducted on the benchmark Honda/USCD and Youtube Celebrities database to verify that the proposed method outperforms significantly the state-of-the-art methods in terms of robustness and efficiency.