Generalized Relevance Models for Automatic Image Annotation

被引:0
作者
Lu, Zhiwu [1 ]
Ip, Horace H. S. [1 ]
机构
[1] City Univ Hong Kong, Dept Comp Sci, Kowloon, Hong Kong, Peoples R China
来源
ADVANCES IN MULTIMEDIA INFORMATION PROCESSING - PCM 2009 | 2009年 / 5879卷
关键词
Automatic image annotation; relevance model keyword propagation; Markov models; OBJECT RECOGNITION;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper presents a generalized relevance model for automatic image annotation through kat ning the correlations between images and annotation keywords Unlike previous relevance models, the proposed model call perforin keyword propagation not, only from the training images to the test ones but also among the test images We further give a convergence analysis of the iterative algorithm inspired by the proposed model Moreover, our spatial Markov kernel is used to define the inter-image relations for the estimation of the joint probability of observing an image with possible annotation keywords This kernel was originally designed rot image classification; and here we apply it to image annotation The main advantage of using our spatial Markov kernel is that we can capture the intra-image context, based on 2D Markov models, which is different from the traditional bag-of-words methods Experiments on two standard image databases demonstrate that the proposed model outperforms the state-of-the-art annotation models
引用
收藏
页码:245 / 255
页数:11
相关论文
共 22 条
[1]   Latent Dirichlet allocation [J].
Blei, DM ;
Ng, AY ;
Jordan, MI .
JOURNAL OF MACHINE LEARNING RESEARCH, 2003, 3 (4-5) :993-1022
[2]   CBSA: Content-based soft annotation for multimodal image retrieval using Bayes point machines [J].
Chang, E ;
Goh, K ;
Sychay, G ;
Wu, G .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2003, 13 (01) :26-38
[3]  
Duygulu P, 2002, LECT NOTES COMPUT SC, V2353, P97
[4]  
Feng SL, 2004, PROC CVPR IEEE, P1002
[5]  
Gao Y., 2006, MULTI-MEDIA '06, P901
[6]  
Golub G.H., 2013, Matrix Computations, Vfourth, DOI DOI 10.56021/9781421407944
[7]   Unsupervised learning by probabilistic latent semantic analysis [J].
Hofmann, T .
MACHINE LEARNING, 2001, 42 (1-2) :177-196
[8]  
Jeon J., 2003, Proceedings of the 26th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, P119, DOI DOI 10.1145/860435.860459
[9]  
LAVIENKO V, 2004, ADV NEURAL INFORM PR, V16
[10]  
Lazebnik S., 2006, P IEEE COMP SOC C CO, V2, P2169, DOI 10.1109/CVPR.2006.68