Preliminary studyon Wilcoxon learning machines

被引:51
作者
Hsieh, Jer-Guang [1 ,2 ]
Lin, Yih-Lon
Jeng, Jyh-Horng [3 ]
机构
[1] Natl Sun Yat Sen Univ, Dept Elect Engn, Kaohsiung 804, Taiwan
[2] I Shou Univ, Kaohsiung, Kaohsiung Cty, Taiwan
[3] CSIST, Kaohsiung, Taiwan
来源
IEEE TRANSACTIONS ON NEURAL NETWORKS | 2008年 / 19卷 / 02期
关键词
artificial neural network (ANN); kernel-based Wilcoxon regressor (KWR); support vector machine (SVM); Wilcoxon learning machine;
D O I
10.1109/TNN.2007.904035
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
As is well known in statistics, the resulting linear regressors by using the rank-based Wilcoxon approach to linear regression problems are usually robust against (or insensitive to) outliers. This motivates us to introduce in this paper the Wilcoxon approach to the area, of machine learning. Specifically, we investigate four new learning machines, namely Wilcoxon neural network (WNN), Wilcoxon generalized radial basis function network (WGRBFN), Wilcoxon fuzzy neural network (WFNN), and kernel-based Wilcoxon regressor (KWR). These provide alternative learning machines when faced with general nonlinear learning problems. Simple weights updating rules based on gradient descent will be derived. Some numerical examples will be provided to compare the robustness against outliers for various learning machines. Simulation results show that the Wilcoxon learning machines proposed in this paper have good robustness against outliers. We firmly believe that the Wilcoxon approach will provide a promising methodology for many machine learning problems.
引用
收藏
页码:201 / 211
页数:11
相关论文
共 28 条
  • [1] Blake C.L., 1998, UCI machine learning repository
  • [2] Boser B. E., 1992, Proceedings of the Fifth Annual ACM Workshop on Computational Learning Theory, P144, DOI 10.1145/130385.130401
  • [3] LIBSVM: A Library for Support Vector Machines
    Chang, Chih-Chung
    Lin, Chih-Jen
    [J]. ACM TRANSACTIONS ON INTELLIGENT SYSTEMS AND TECHNOLOGY, 2011, 2 (03)
  • [4] The annealing robust backpropagation (ARBP) learning algorithm
    Chuang, CC
    Su, SF
    Hsiao, CC
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS, 2000, 11 (05): : 1067 - 1077
  • [5] Chuang CC, 2004, NEUROCOMPUTING, V56, P123, DOI [10.1016/S0925-2312(03)00436-3, 10.1016/S0925-2312(03 )00436-3]
  • [6] Robust support vector regression networks for function approximation with outliers
    Chuang, CC
    Su, SF
    Jeng, JT
    Hsiao, CC
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS, 2002, 13 (06): : 1322 - 1330
  • [7] Robust TSK fuzzy modeling for function approximation with outliers
    Chuang, CC
    Su, SF
    Chen, SS
    [J]. IEEE TRANSACTIONS ON FUZZY SYSTEMS, 2001, 9 (06) : 810 - 821
  • [8] CORTES C, 1995, MACH LEARN, V20, P273, DOI 10.1023/A:1022627411411
  • [9] Layered Neural Networks with Gaussian Hidden Units as Universal Approximations
    Hartman, Eric J.
    Keeler, James D.
    Kowalski, Jacek M.
    [J]. NEURAL COMPUTATION, 1990, 2 (02) : 210 - 215
  • [10] Hogg R. V., 2005, INTRO MATH STAT