Context-based Image Semantic Similarity

In this work we propose Context-based Image Similarity, a scheme for discovering and evaluating image similarity in terms of the associated groups of concepts. Several semantic proximity/similarity among image concepts and different concept ontology - WordNet Distance, Wikipedia Distance, Flickr Distance, Confidence, Normalized Google Distance (NGD), Pointwise Mutual Information (PMI) and PMING, have been considered as elementary metrics for the context. Comparing to Content Based Image Retrieval (CBIR), which measures the image content similarities by low level features, the proposed Context-based Image Similarity outperformed CBIR in measuring the deep concept similarity and relationship of images. Experimental results, obtained in the domain of images semantic similarity using search engine based tag similarity, show the adequacy of the proposed approach in order to reflect the collective notion of semantic similarity.