The accuracy of machine learning models relies on hyperparameter tuning: student result classification using random forest, randomized search, grid search, bayesian, genetic, and optuna algorithms

Yagyanath Rimal, Navneet Sharma, Abeer Alsadoon

Research output: Contribution to journalArticlepeer-review

Abstract

Hyperparameters play a critical role in analyzing predictive performance in machine learning models. They serve to strike a balance between overfitting and underfitting of research-independent features to prevent extremes. Manual tuning and automated techniques are employed to identify the optimal combination and permutation to achieve the best model performance. This study explores the pursuit of the best fit through various hyperparameters. Following Logistic Regression analysis, this research compared Random Forest, Randomized search, Grid search, Genetic, Bayesian, and Optuna machine learning model tuning for the best accuracy of prediction the student The model accuracy was further assessed using confusion matrices and Receiver Operating Characteristic—Area Under the Curve (ROC-AUC) curves for student grade classification. The genetic algorithm's recommended hyperparameter tuning yielded the highest accuracy (82.5%) and AUC-ROC score (90%) for student result classification. Manual tuning with an estimator of 300, criterion entropy, max features of sqrt, and a minimum sample leaf of 10 achieved an accuracy of 81.1%, which closely resembled the performance randomized search cross-validation algorithm. The default random forest model scored the least accuracy (78%). However, this manual tuning process took a lesser time (3.66 s) to fit the model while grid search CV tuned 941.5 s. Hence, this research made significant contributions to optimizing various machine learning models using a range of hyperparameters for grade classification.

Original languageEnglish
JournalMultimedia Tools and Applications
DOIs
Publication statusE-pub ahead of print - Feb 2024

Fingerprint

Dive into the research topics of 'The accuracy of machine learning models relies on hyperparameter tuning: student result classification using random forest, randomized search, grid search, bayesian, genetic, and optuna algorithms'. Together they form a unique fingerprint.

Cite this