Functional Fuzzy System: A Nonlinear Regression Model and Its Learning Algorithm for Function-on-Function Regression

被引:6
作者
Ge, Dongjiao [1 ]
Zeng, Xiao-Jun [2 ]
机构
[1] Univ Oxford, Dept Engn Sci, Oxford eRes Ctr, Oxford OX1 3QG, England
[2] Univ Manchester, Dept Comp Sci, Manchester M13 9PL, Lancs, England
关键词
Fuzzy systems; Data models; Analytical models; Kernel; Tensors; Splines (mathematics); Linear regression; Function-on-function regression; functional data analysis (FDA); fuzzy systems; nonlinear regression; LINEAR-REGRESSION;
D O I
10.1109/TFUZZ.2021.3050857
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Functional data analysis (FDA) in which each data sample is a function rather than a vector or a matrix has attracted a lot of attention in the statistics community in recent years. However, most of the existing functional data regression works focus on linear models; and there is a lack of research on general nonlinear functional regression models that can fit nonlinear relationships between functional data, especially when the input and output of the models are both functions. Furthermore, in the fuzzy system research domain, there is no fuzzy system approach to FDA so far as we are aware of. To fill in these dual gaps, this article develops the first fuzzy system approach to FDA by proposing a functional fuzzy regression model known as functional fuzzy system (FFS) and its learning method from data. FFS is a general nonlinear functional regression model, which has inputs and outputs are functions in infinite dimensional spaces. Furthermore, constructed with a collection of the "If-Then" fuzzy rules, on the one hand, FFS has a flexible structure, and can model the functional data without model structure assumptions; On the other hand, the fuzzy rule base enables FFS to be an interpretable model. An identification method for FFS is proposed for minimizing the mean squared prediction errors. The proposed FFS is compared with many existing state-of-the-art functional regression models upon benchmark examples using both artificial and real datasets, and shows that FFS is an effective model and can obtain preferable results.
引用
收藏
页码:956 / 967
页数:12
相关论文
共 37 条
[1]   Unsupervised curve clustering using B-splines [J].
Abraham, C ;
Cornillon, PA ;
Matzner-Lober, E ;
Molinari, N .
SCANDINAVIAN JOURNAL OF STATISTICS, 2003, 30 (03) :581-595
[2]   An approach to Online identification of Takagi-Suigeno fuzzy models [J].
Angelov, PP ;
Filev, DP .
IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART B-CYBERNETICS, 2004, 34 (01) :484-498
[3]   Functional linear regression with functional response [J].
Benatia, David ;
Carrasco, Marine ;
Florens, Jean-Pierre .
JOURNAL OF ECONOMETRICS, 2017, 201 (02) :269-291
[4]   Fuzzy systems with defuzzification are universal approximators [J].
Castro, JL ;
Delgado, M .
IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART B-CYBERNETICS, 1996, 26 (01) :149-152
[5]  
Centofanti F, 2020, ARXIV200700529
[6]   ASYMPTOTIC THEORY FOR THE PRINCIPAL COMPONENT ANALYSIS OF A VECTOR RANDOM FUNCTION - SOME APPLICATIONS TO STATISTICAL-INFERENCE [J].
DAUXOIS, J ;
POUSSE, A ;
ROMAIN, Y .
JOURNAL OF MULTIVARIATE ANALYSIS, 1982, 12 (01) :136-154
[7]   SOFMLS: Online Self-Organizing Fuzzy Modified Least-Squares Network [J].
de Jesus Rubio, Jose .
IEEE TRANSACTIONS ON FUZZY SYSTEMS, 2009, 17 (06) :1296-1309
[8]   Classification Using Censored Functional Data [J].
Delaigle, Aurore ;
Hall, Peter .
JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2013, 108 (504) :1269-1283
[9]   Fuzzy Broad Learning System: A Novel Neuro-Fuzzy Model for Regression and Classification [J].
Feng, Shuang ;
Chen, C. L. Philip .
IEEE TRANSACTIONS ON CYBERNETICS, 2020, 50 (02) :414-424
[10]   Regression when both response and predictor are functions [J].
Ferraty, F. ;
Van Keilegom, I. ;
Vieu, P. .
JOURNAL OF MULTIVARIATE ANALYSIS, 2012, 109 :10-28