Skip to content

Machine Learning Hyperparameter Optimization (Grid Search and Random Search)

License

Notifications You must be signed in to change notification settings

LeilaZa/HyperParameter-Optimization

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

20 Commits
 
 
 
 
 
 
 
 

Repository files navigation

Search Algorithms for Automated Hyper-Parameter Tuning in Machine Learning (Grid and Random Search Algorithms)

This code provides a simple HPO implementation (Grid and Random search) for machine learning models, as described in the paper "Search Algorithms for AutomatedHyper-Parameter Tuning in Machine Learning".

This paper will help users to improve their machine learning models by optimizing their models' hyper-parameter automatically.

Paper

Search Algorithms for Automated Hyper-Parameter Tuning in Machine Learning paper link

Implementation

Sample code for hyper-parameter optimization implementation for machine learning algorithms is provided in this repository.

Classification problems

Dataset used: MIDFIELD

Machine Learning Models

  • Naive Bayes (NB)
  • Logistic Regression (LR)
  • Decision Tree (DT)
  • Random forest (RF)
  • Support vector machine (SVM)
  • K-nearest neighbor (KNN)
  • Extreme Gradient Boosting (XGBoost)

HPO Methods Leverages

  • Grid search
  • Random search

Requirements

Contact-Info

Please dont hesitate to contact me:

Citation

If this codes helped you in your research, please cite the article:

L. Zahedi, F. G. Mohammadi, S. Rezapour, M. W. Ohland, and M. H.Amini, “Search algorithms for automated hyper-parameter tuning,”The 17th International Conference on Data Science, 2021.