Applications of fractal-type kernels in Gaussian process regression and support vector machine regression

被引:0
|
作者
Luor, Dah-Chin [1 ]
Liu, Chiao-Wen [2 ]
机构
[1] I Shou Univ, Dept Data Sci & Analyt, Kaohsiung 84001, Taiwan
[2] ROC Naval Acad, Sch Acad Studies, Dept Appl Sci, Kaohsiung 81345, Taiwan
来源
COMPUTATIONAL & APPLIED MATHEMATICS | 2024年 / 43卷 / 08期
关键词
Gaussian process regression; Fractal-type covariance; Support vector regression; Fractal-type kernel; Fractal interpolation;
D O I
10.1007/s40314-024-02952-8
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
A symmetric positive semi-definite kernel defined by fractal interpolation functions is introduced and then applied to Gaussian process(GP) regression and support vector machine(SVM) regression. An example is given using the Crude Oil WTI Futures daily highest prices as the raw data to show the performance of each regression model. We choose a sample subset D & lowast;\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\mathcal {D}<^>*$$\end{document} to build the models and show how well the prediction curve of each model fits the raw data. Optuna is applied in GP regression to estimate the parameters by maximizing the log marginal likelihood. In our results, the maximal log marginal likelihood of GP regression with the fractal-type kernel is larger than that of GP regressions with the Gaussian kernel and the Mat & eacute;rn kernel. On the other hand, we use Optuna to estimate the parameters in SVM regression by minimizing the mean squared error (MSE). Compared with the SVM regression models with the "rbf" kernel and the "poly" kernel in sklearn.svm.SVR, we see that SVM regression with the fractal-type kernel has the smallest MSE, and the prediction curve best fits the raw data.
引用
收藏
页数:12
相关论文
共 50 条
  • [1] Gaussian Process Kernels for Support Vector Regression in Wind Energy Prediction
    de la Pompa, Victor
    Catalina, Alejandro
    Dorronsoro, Jose R.
    INTELLIGENT DATA ENGINEERING AND AUTOMATED LEARNING (IDEAL 2018), PT II, 2018, 11315 : 147 - 154
  • [2] Kinetic profile inference with outlier detection using support vector machine regression and Gaussian process regression
    Kim, Minseok
    Ko, W. H.
    Kwak, Sehyun
    Joung, Semin
    Lee, Wonjun
    Kim, B.
    Kim, D.
    Lee, J. H.
    Sung, Choongki
    Na, Yong-Su
    Ghim, Y. -C.
    NUCLEAR FUSION, 2024, 64 (10)
  • [3] Framelet Kernels With Applications to Support Vector Regression and Regularization Networks
    Zhang, Wei-Feng
    Dai, Dao-Qing
    Yan, Hong
    IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART B-CYBERNETICS, 2010, 40 (04): : 1128 - 1144
  • [4] Determination of reservoir induced earthquake using support vector machine and gaussian process regression
    Pijush Samui
    Dookie Kim
    Applied Geophysics, 2013, 10 : 229 - 234
  • [5] Determination of reservoir induced earthquake using support vector machine and gaussian process regression
    Samui, Pijush
    Kim, Dookie
    APPLIED GEOPHYSICS, 2013, 10 (02) : 229 - 234
  • [6] Support Vector Machine and Gaussian Process Regression based Modeling for Photovoltaic Power Prediction
    Kanwal, Sidra
    Khan, Bilal
    Ali, Sahibzada Muhammad
    Mehmood, Chaudhry Arshad
    Rauf, Muhammad Qasim
    2018 INTERNATIONAL CONFERENCE ON FRONTIERS OF INFORMATION TECHNOLOGY (FIT 2018), 2018, : 117 - 122
  • [7] Comparative Analysis of Support Vector Machine Regression and Gaussian Process Regression in Modeling Hydrogen Production from Waste Effluent
    Hossain, Sk Safdar
    Ayodele, Bamidele Victor
    Ali, Syed Sadiq
    Cheng, Chin Kui
    Mustapa, Siti Indati
    SUSTAINABILITY, 2022, 14 (12)
  • [8] Support vector machine for regression and applications to financial forecasting
    Trafalis, TB
    Ince, H
    IJCNN 2000: PROCEEDINGS OF THE IEEE-INNS-ENNS INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, VOL VI, 2000, : 348 - 353
  • [9] Vulnerability Assessment of Equipment Excited by Disturbances Based on Support Vector Machine and Gaussian Process Regression
    Chen, Yu-hao
    Xie, Yan-zhao
    Ge, Xiao-yu
    Zhou, Yi
    Zhang, Dao-zhong
    Jing, Yan
    Wu, Jian
    Qiu, Ai-ci
    IEEE TRANSACTIONS ON ELECTROMAGNETIC COMPATIBILITY, 2021, 63 (01) : 103 - 110
  • [10] Support vector regression using Mahalanobis kernels
    Kamada, Yuya
    Abe, Shigeo
    ARTIFICIAL NEURAL NETWORKS IN PATTERN RECOGNITION, PROCEEDINGS, 2006, 4087 : 144 - 152