syne_tune.optimizer.schedulers.multi_fidelity module

class syne_tune.optimizer.schedulers.multi_fidelity.MultiFidelitySchedulerMixin

Bases: object

Declares properties which are required for multi-fidelity schedulers.

property resource_attr: str

Returns:

Name of resource attribute in reported results

property max_resource_level: int

Returns:

Maximum resource level

property rung_levels: List[int]

Returns:

Rung levels (positive int; increasing), may or may not include max_resource_level

property searcher_data: str

Returns:

Relevant only if a model-based searcher is used. Example: For NN tuning and resource_attr == "epoch", we receive a result for each epoch, but not all epoch values are also rung levels. searcher_data determines which of these results are passed to the searcher. As a rule, the more data the searcher receives, the better its fit, but also the more expensive get_config() may become. Choices:

• ”rungs”: Only results at rung levels. Cheapest

• ”all”: All results. Most expensive

• ”rungs_and_last”: Results at rung levels plus last recent one. Not available for all multi-fidelity schedulers

property num_brackets: int

Returns:

Number of brackets (i.e., rung level systems). If the scheduler does not use brackets, it has to return 1