Machine Learning Revolutionizing Performance Evaluation: Recent Developments and Breakthroughs

被引:0
作者
Raja, V. Jagan [1 ]
Dhanamalar, M. [2 ]
Solaimalai, Gautam [3 ]
Rani, D. Leela [4 ]
Deepa, P. [5 ]
Vidhya, R. G. [6 ]
机构
[1] Vel Tech Rangarajan Dr Sagunthala R&D Inst Sci &, Dept CSE, Chennai, Tamil Nadu, India
[2] Kristu Jayanti Coll, Dept Comp Sci, Bangalore, Karnataka, India
[3] US Bank, Atlanta, GA USA
[4] Mohan Babu Univ, Erstwhile Sree Vidyanikethan Engn Coll, Dept ECE, Sch Engn, Tirupati, Andhra Pradesh, India
[5] Panimalar Engn Coll, Dept Comp Sci & Engn, Chennai, Tamil Nadu, India
[6] HKBK Coll Engn, Dept Elect & Commun Engn, Bangalore, Karnataka, India
来源
2ND INTERNATIONAL CONFERENCE ON SUSTAINABLE COMPUTING AND SMART SYSTEMS, ICSCSS 2024 | 2024年
关键词
Machine learning; performance metrics; model evaluation; hyperparameter adjustment; model selection;
D O I
10.1109/ICSCSS60660.2024.10625103
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Machine learning is used in many fields because of its rapid development. To determine their efficacy and suitability for certain activities, these models must be evaluated. This study maps the knowledge domain of machine learning approaches to evaluate performance, revealing its important components. Performance metrics-quantitative measurements of machine learning model performance are examined first. Predictive and generalization metrics include accuracy, precision, recall, F1-score, and area under the ROC curve. Performance evaluation requires understanding these indicators' calculation and interpretation. Cross-validation, holdout validation, k-fold cross-validation, and bootstrapping are examined next. These methods reveal the model's performance on unseen data and reduce overfitting and underfitting. This study also addresses hyperparameter tweaking. Optimizing machine learning model hyperparameters including learning rate, regularization parameters, and network design is crucial to performance. Find the optimal hyperparameter configuration using grid search, random search, and Bayesian optimization. Finally, model selection criteria determine the best model for a task. Performance measurements, complexity, and computational resources help make decisions. This study maps the knowledge domain of using machine learning techniques to performance evaluation, revealing the fundamental features. This knowledge helps researchers and practitioners evaluate machine learning models and make educated real-world judgements.
引用
收藏
页码:780 / 785
页数:6
相关论文
共 17 条
  • [1] Balasubramaniyan S., 2023, 2023 International Conference on Sustainable Communication Networks and Application (ICSCNA), P870, DOI 10.1109/ICSCNA58489.2023.10370467
  • [2] On the platform but will they buy? Predicting customers' purchase behavior using deep learning
    Chaudhuri, Neha
    Gupta, Gaurav
    Vamsi, Vallurupalli
    Bose, Indranil
    [J]. DECISION SUPPORT SYSTEMS, 2021, 149
  • [3] Quantitative Analysis of Qualitative Information From Interviews A Systematic Literature Review
    Fakis, Apostolos
    Hilliam, Rachel
    Stoneley, Helen
    Townend, Michael
    [J]. JOURNAL OF MIXED METHODS RESEARCH, 2014, 8 (02) : 139 - 161
  • [4] Integrating evidence-based thermal satisfaction in energy benchmarking: A data-driven approach for a whole-building evaluation
    Geraldi, Matheus Soares
    Ghisi, Enedir
    [J]. ENERGY, 2022, 244
  • [5] Goud D Shekar, 2022, 2022 INT C COMP POW, P1
  • [6] Hanga Khadijah M., 2022, Computer Science Review, V34, p20D
  • [7] Intraday shelf replenishment decision support for perishable goods
    Huber, Jakob
    Stuckenschmidt, Heiner
    [J]. INTERNATIONAL JOURNAL OF PRODUCTION ECONOMICS, 2021, 231 (231)
  • [8] Artificial intelligence in healthcare operations to enhance treatment outcomes: a framework to predict lung cancer prognosis
    Johnson, Marina
    Albizri, Abdullah
    Simsek, Serhat
    [J]. ANNALS OF OPERATIONS RESEARCH, 2022, 308 (1-2) : 275 - 305
  • [9] Scopus scientific mapping production in industry 4.0 (2011?2018): a bibliometric analysis
    Kipper, Liane Mahlmann
    Furstenau, Leonardo Bertolin
    Hoppe, Daniel
    Frozza, Rejane
    Iepsen, Sandra
    [J]. INTERNATIONAL JOURNAL OF PRODUCTION RESEARCH, 2020, 58 (06) : 1605 - 1627
  • [10] Exploring machine learning: a scientometrics approach using bibliometrix and VOSviewer
    Oyewola, David Opeoluwa
    Dada, Emmanuel Gbenga
    [J]. SN APPLIED SCIENCES, 2022, 4 (05):