In recommendation systems, the grey-sheep problem refers to users with unique preferences and tastes that make it difficult to develop accurate profiles. That is, the similarity search approach typically followed during the recommendation process fails to yield good results. Most research does not focus on such users and thus fails to cater to more exotic tastes and emerging trends, leading to a subsequent loss in revenue and marketing opportunities. One suggested solution is to use one-class classification to generate a prediction list for these users, where decision boundaries are learned that distinguish between normal and grey-sheep users. In this paper, we present the grey-sheep one-class recommendation (GSOR) framework designed to create accurate prediction models while taking both regular and grey-sheep users into account. In addition, we introduce a novel grey-sheep movie recommendation benchmark to be used by current and future researchers. When evaluating our GSOR framework against this benchmark, our results indicate the value of combining cluster analysis, outlier detection, and one-class learning to generate relevant and timely recommendation lists from data sets that contain grey sheep users. Specifically, by employing one-class decision tree algorithms, our GSOR framework was able to outperform traditional collaborative filtering-based recommendation systems in both accuracy and model construction time. Furthermore, we report that having grey-sheep users in the system often had a positive impact on the learning and recommendation processes.