Extended twin parametric margin support vector regression

被引:0
作者
Sahleh, Ali [1 ]
Salahi, Maziar [1 ]
Eskandari, Sadegh [2 ]
Khodamoradi, Tahereh [1 ]
机构
[1] Univ Guilan, Fac Math Sci, Dept Appl Math, Namjoo Blvd, Rasht 41938-33697, Guilan, Iran
[2] Univ Guilan, Fac Math Sci, Dept Comp Sci, Namjoo Blvd, Rasht 41938 33697, Guilan, Iran
关键词
Support vector regression; Twin support vector regression; Hinge-loss function; Stock market prediction; FEATURE-EXTRACTION; CLASSIFICATION; MACHINE;
D O I
10.1007/s12597-024-00829-2
中图分类号
C93 [管理学]; O22 [运筹学];
学科分类号
070105 ; 12 ; 1201 ; 1202 ; 120202 ;
摘要
Support Vector Regression (SVR) and its extensions have demonstrated effectiveness in addressing regression problems, yet they face challenges, including high computational costs for large-scale datasets and sensitivity to outliers. To mitigate these limitations, various techniques such as twin SVR (TWSVR) and robust TWSVR (RTWSVR) have been proposed. However, existing approaches may suffer from issues like alignment of the final regressor with the dataset during the learning processes. In this paper, we introduce an extended twin parametric margin SVR (ETPMSVR) model inspired by the principles of robust geometric TPMSVM (RGTPSVM). The ETPMSVR addresses these challenges by integrating the average of & varepsilon;\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\epsilon$$\end{document}-insensitive upper and lower bounds of the regressor into the objective function and constraints, ensuring alignment with the dataset and hence the final regerssor is found along with two boundary hyperplanes during the training process in a single quadratic programming problem. Additionally, a hinge-loss function is incorporated to enhance robustness against outliers. We derive the dual formulation to improve computational efficiency. Experiments on a diverse range of datasets, 10 UCI datasets and 8 S &P index datasets from financial market, demonstrate the efficacy of the proposed model in comparison to various benchmarks, including TWSVR, RTWSVR, multi-layer perceptron, and long short-term memory network.
引用
收藏
页码:682 / 705
页数:24
相关论文
共 45 条
  • [1] Predicting long-term electricity prices using modified support vector regression method
    Abroun, Mehdi
    Jahangiri, Alireza
    Shamim, Ahmad Ghaderi
    Heidari, Hanif
    [J]. ELECTRICAL ENGINEERING, 2024, 106 (04) : 4103 - 4114
  • [2] Stock Prediction Based on Technical Indicators Using Deep Learning Model
    Agrawal, Manish
    Shukla, Piyush Kumar
    Nair, Rajit
    Nayyar, Anand
    Masud, Mehedi
    [J]. CMC-COMPUTERS MATERIALS & CONTINUA, 2022, 70 (01): : 287 - 304
  • [3] [Anonymous], 2014, CVX MATLAB SOFTWARE, DOI DOI 10.1109/JSAC.2020.3007059
  • [4] Bishop C., 2006, Pattern Recognition and Machine Learning, V2, P5
  • [5] CORTES C, 1995, MACH LEARN, V20, P273, DOI 10.1023/A:1022627411411
  • [6] Demsar J, 2006, J MACH LEARN RES, V7, P1
  • [7] Duda R., 2000, Pattern Classification
  • [8] Online and offline streaming feature selection methods with bat algorithm for redundancy analysis
    Eskandari, S.
    Seifaddini, M.
    [J]. PATTERN RECOGNITION, 2023, 133
  • [9] Robust convex quadratically constrained programs
    Goldfarb, D
    Iyengar, G
    [J]. MATHEMATICAL PROGRAMMING, 2003, 97 (03) : 495 - 515
  • [10] Robust portfolio selection problems
    Goldfarb, D
    Iyengar, G
    [J]. MATHEMATICS OF OPERATIONS RESEARCH, 2003, 28 (01) : 1 - 38