Bayesian Optimization

Machine Learning Optimization

Overview

Sequential optimization of expensive black-box functions using probabilistic surrogate models.

• Introduction
• Surrogate Functions
• Acquisition Functions
  • Expected Improvement
  • Knowledge Gradient
  • Entropy Searching
  • Predictive Entropy Search

References

• Peter Frazier’s A Tutorial on Bayesian Optimization (2018)