Interactive image retrieval using constraints

被引:10
作者
Jian, Meng [1 ]
Jung, Cheolkon [1 ]
Shen, Yanbo [1 ]
Liu, Juan [1 ]
机构
[1] Xidian Univ, Minist Educ, Key Lab Intelligent Percept & Image Understanding, Xian 710071, Peoples R China
基金
中国国家自然科学基金;
关键词
Active learning; Adaptive constraint propagation; Interactive image retrieval; Pairwise constraints; Relevance feedback; Seed propagation; MEAN SHIFT;
D O I
10.1016/j.neucom.2015.02.040
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The proper use of constraints improves the data clustering performance. In this paper, we propose a novel interactive image retrieval framework using constraints. First, we extract the user's region of interest (ROI) from queries by simple user interaction using adaptive constraints-based seed propagation (ACSP), and obtain initial retrieval results based on the ROI. Then, we improve the retrieval results by active learning from the user's relevance feedback using ACSP. Since ACSP is very effective in propagating the user's interactive information of constraints by employing a kernel learning strategy, it successfully learns the correlation between low-level image features and high-level semantics from the ROI and relevance feedbacks. Experimental results demonstrate that the proposed framework remarkably improves the image retrieval performance by ACSP-based constraint propagation in terms of both effectiveness and efficiency. (C) 2015 Elsevier B.V. All rights reserved.
引用
收藏
页码:210 / 219
页数:10
相关论文
共 37 条
[1]   Learning Nonsparse Kernels by Self-Organizing Maps for Structured Data [J].
Aiolli, Fabio ;
Da San Martino, Giovanni ;
Hagenbuchner, Markus ;
Sperduti, Alessandro .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 2009, 20 (12) :1938-1949
[2]  
[Anonymous], 2012, P 20 ACM INT C MULT
[3]   Trademark image retrieval using an integrated shape descriptor [J].
Anuar, Fatahiyah Mohd ;
Setchi, Rossitza ;
Lai, Yu-kun .
EXPERT SYSTEMS WITH APPLICATIONS, 2013, 40 (01) :105-121
[4]   Label Propagation in Video Sequences [J].
Badrinarayanan, Vijay ;
Galasso, Fabio ;
Cipolla, Roberto .
2010 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2010, :3265-3272
[5]  
Belkin N., 2009, P SIGIR 2009 WORKSHO, P7
[6]   Kernel-based object tracking [J].
Comaniciu, D ;
Ramesh, V ;
Meer, P .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2003, 25 (05) :564-577
[7]   Mean shift: A robust approach toward feature space analysis [J].
Comaniciu, D ;
Meer, P .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2002, 24 (05) :603-619
[8]   Image retrieval: Ideas, influences, and trends of the new age [J].
Datta, Ritendra ;
Joshi, Dhiraj ;
Li, Jia ;
Wang, James Z. .
ACM COMPUTING SURVEYS, 2008, 40 (02)
[9]   Mercer kernel-based clustering in feature space [J].
Girolami, M .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 2002, 13 (03) :780-784
[10]   Group-based relevance feedback with support vector machine ensembles [J].
Hoi, CH ;
Lyu, MR .
PROCEEDINGS OF THE 17TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION, VOL 3, 2004, :874-877