Learning Latent Semantic Attributes for Zero-Shot Object Detection

Zero-shot Object Detection (ZSD) aims to locate and classify instances of unseen categories. Existing methods focus on learning the mapping from visual space to semantic space, while the learning of discriminative representations for ZSD has not gained enough attention. In this paper, we demonstrate the necessity to learn discriminative semantic representations for ZSD, and propose a new end-to-end framework for this task. Our framework is able to learn discriminative semantic representations in an augmented space introduced for both user-defined and latent attributes, and refine the user-defined attributes with the help of unseen and external classes. The proposed method is extensively evaluated on two challenging ZSD datasets, and the experimental results show that our method significantly outperforms several existing methods.