Multi-Fidelity Hyperparameter Optimization

This tutorial provides an overview of multi-fidelity HPO algorithms implemented in Syne Tune. Multi-fidelity scheduling is one of the most successful recent ideas used to speed up HPO. You will learn about the differences and relationships between different methods, and how to choose the best approach for your own problems.

Note

In order to run the code in this tutorial, you need to have installed the blackbox-repository dependencies.

• Introduction
• Setting up the Problem
• Synchronous Successive Halving and Hyperband
• Asynchronous Successive Halving
• Model-based Synchronous Hyperband
• Model-based Asynchronous Hyperband
• Comparison of Methods