Adapting RBF Neural Networks to Multi-Instance Learning

被引:1
作者
Min-Ling Zhang
Zhi-Hua Zhou
机构
[1] Nanjing University,National Laboratory for Novel Software Technology
来源
Neural Processing Letters | 2006年 / 23卷
关键词
content-based image retrieval; Hausdorff distance; machine learning; multi-instance learning; neural networks; principle component analysis; radial basis function; singular value decomposition;
D O I
暂无
中图分类号
学科分类号
摘要
In multi-instance learning, the training examples are bags composed of instances without labels, and the task is to predict the labels of unseen bags through analyzing the training bags with known labels. A bag is positive if it contains at least one positive instance, while it is negative if it contains no positive instance. In this paper, a neural network based multi-instance learning algorithm named RBF-MIP is presented, which is derived from the popular radial basis function (RBF) methods. Briefly, the first layer of an RBF-MIP neural network is composed of clusters of bags formed by merging training bags agglomeratively, where Hausdorff metric is utilized to measure distances between bags and between clusters. Weights of second layer of the RBF-MIP neural network are optimized by minimizing a sum-of-squares error function and worked out through singular value decomposition (SVD). Experiments on real-world multi-instance benchmark data, artificial multi-instance benchmark data and natural scene image database retrieval are carried out. The experimental results show that RBF-MIP is among the several best learning algorithms on multi-instance problems.
引用
收藏
页码:1 / 26
页数:25
相关论文
共 27 条
[1]  
Alphonse E.(2004)Filtering multi-instance problems to reduce dimensionality in relational learning Journal of Intelligent Information Systems 22 23-40
[2]  
Matwin S.(1998)Approximating hyper-rectangles: learning and pseudo-random sets Journal of Computer and System Sciences 57 376-388
[3]  
Auer P.(1998)A note on learning from multiple-instance examples Machine Learning 30 23-29
[4]  
Long P. M.(1977)Maximum likelihood from incomplete data via the EM algorithm Journal of the Royal Statistics Society, Series B 39 1-38
[5]  
Srinivasan A.(1997)Solving the multiple-instance problem with axis-parallel rectangles Artificial Intelligence 89 31-71
[6]  
Blum A.(2001)Agnostic learning of geometric patterns Journal of Computer and System Sciences 62 123-151
[7]  
Kalai A.(2003)Multiple-instance learning of real-valued geometric patterns Annals of Mathematics and Artificial Intelligence 39 259-290
[8]  
Dempster A. P.(1994)Efficient distribution-free learning of probabilistic concepts Journal of Computer and System Sciences 48 464-497
[9]  
Laird N. M.(1998)PAC learning axis-aligned rectangles with respect to product distribution from multiple-instance examples Machine Learning 30 7-21
[10]  
Rubin D. B.(2004)Improve multi-instance neural network through feature selection Neural Processing Letters 19 1-10