ORFEO: Ordinal classifier and Regressor Fusion for Estimating an Ordinal categorical target

被引:4
作者
Gomez-Orellana, Antonio M. [1 ]
Guijo-Rubio, David [1 ,2 ]
Gutierrez, Pedro A. [1 ]
Hervas-Martinez, Cesar [1 ]
Vargas, Victor M. [1 ]
机构
[1] Univ Cordoba, Dept Comp Sci & Numer Anal, Campus Rabanales,Ctra N-IVa,Km 396, Cordoba 14071, Spain
[2] Univ Alcala, Dept Signal Proc & Commun, Campus Univ,Ctra Madrid-Barcelona Km 33, Alcala De Henares 28805, Spain
关键词
Ordinal classification; Neural networks; Cumulative link models; Short-term prediction; Significant wave height; Flux of energy; Loss functions; SIGNIFICANT WAVE HEIGHT; WIND-SPEED; EVOLUTIONARY; PREDICTION; REANALYSIS; MODELS;
D O I
10.1016/j.engappai.2024.108462
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this paper we present a novel methodology, referenced as ORFEO (Ordinal classifier and Regressor Fusion for Estimating an Ordinal categorical target), to enhance the performance in ordinal classification problems for which the latent variable is observable. ORFEO is an artificial neural network model incorporating two outputs, one for ordinal classification, using the cumulative link model, and one for regression, using a linear model. Both outputs are simultaneously optimised considering a loss function that linearly combines both classification and regression losses. The main motivation behind developing the proposed approach is to enhance the performance of a standard ordinal classifier. This improvement is facilitated by considering the regression output, which allows the model to differentiate between patterns within the same category. The ORFEO model is applied to two problems in the field of marine and ocean engineering: short -term prediction of both significant wave height and flux of energy. Both problems are addressed considering four different coastal zones of the United States of America, using 13 datasets formed by buoys measurements and reanalysis data. A comprehensive comparison against 20 methodologies, including regression and nominal/ordinal classification approaches is performed, by using diverse nominal and ordinal performance metrics. Ranks achieved indicate that ORFEO outperforms all the compared methodologies in terms of all the performance measures, demonstrating the efficacy and robustness of the proposal. Finally, a statistical analysis is conducted, concluding that there are statistically significant differences across ordinal and nominal performance metrics in favour of the proposed ORFEO model.
引用
收藏
页数:18
相关论文
共 57 条
[1]   Direct estimation of prediction intervals for solar and wind regional energy forecasting with deep neural networks [J].
Alcantara, Antonio ;
Galvan, Ines M. ;
Aler, Ricardo .
ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2022, 114
[2]   Ordinal Regression Methods: Survey and Experimental Study [J].
Antonio Gutierrez, Pedro ;
Perez-Ortiz, Maria ;
Sanchez-Monedero, Javier ;
Fernandez-Navarro, Francisco ;
Hervas-Martinez, Cesar .
IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2016, 28 (01) :127-146
[3]   Energy Flux Range Classification by Using a Dynamic Window Autoregressive Model [J].
Antonio Gutierrez, Pedro ;
Carlos Fernandez, Juan ;
Perez-Ortiz, Maria ;
Cornejo-Bueno, Laura ;
Alexandre-Cortizo, Enrique ;
Salcedo-Sanz, Sancho ;
Hervas-Martinez, Cesar .
ADVANCES IN COMPUTATIONAL INTELLIGENCE, PT II, 2015, 9095 :92-102
[4]   Evaluation Measures for Ordinal Regression [J].
Baccianella, Stefano ;
Esuli, Andrea ;
Sebastiani, Fabrizio .
2009 9TH INTERNATIONAL CONFERENCE ON INTELLIGENT SYSTEMS DESIGN AND APPLICATIONS, 2009, :283-287
[5]   An ordinal CNN approach for the assessment of neurological damage in Parkinson's disease patients [J].
Barbero-Gomez, Javier ;
Gutierrez, Pedro-Antonio ;
Vargas, Victor-Manuel ;
Vallejo-Casas, Juan-Antonio ;
Hervas-Martinez, Cesar .
EXPERT SYSTEMS WITH APPLICATIONS, 2021, 182
[6]   Geothermal heat exchanger energy prediction based on time series and monitoring sensors optimization [J].
Baruque, Bruno ;
Porras, Santiago ;
Jove, Esteban ;
Luis Calvo-Rolle, Jose .
ENERGY, 2019, 171 :49-60
[7]  
Brodersen Kay H., 2010, Proceedings of the 2010 20th International Conference on Pattern Recognition (ICPR 2010), P3121, DOI 10.1109/ICPR.2010.764
[8]   ROBUST TESTS FOR EQUALITY OF VARIANCES [J].
BROWN, MB ;
FORSYTHE, AB .
JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 1974, 69 (346) :364-367
[9]   Trend analysis of significant wave height and energy period in southern Italy [J].
Caloiero, T. ;
Aristodemo, F. ;
Ferraro, D. Algieri .
THEORETICAL AND APPLIED CLIMATOLOGY, 2019, 138 (1-2) :917-930
[10]   XGBoost: A Scalable Tree Boosting System [J].
Chen, Tianqi ;
Guestrin, Carlos .
KDD'16: PROCEEDINGS OF THE 22ND ACM SIGKDD INTERNATIONAL CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING, 2016, :785-794