syne_tune.optimizer.schedulers.searchers.bayesopt.gpautograd.mean module

class syne_tune.optimizer.schedulers.searchers.bayesopt.gpautograd.mean.MeanFunction(**kwargs)

Bases: Block

Mean function, parameterizing a surrogate model together with a kernel function.

Note: KernelFunction also inherits from this interface.

param_encoding_pairs()

Returns list of tuples

(param_internal, encoding)

over all Gluon parameters maintained here.

Returns:

List [(param_internal, encoding)]

get_params()

Return type:

Dict[str, Any]

Returns:

Dictionary with hyperparameter values

set_params(param_dict)

Parameters:

param_dict (Dict[str, Any]) – Dictionary with new hyperparameter values

Returns:

class syne_tune.optimizer.schedulers.searchers.bayesopt.gpautograd.mean.ScalarMeanFunction(initial_mean_value=0.0, **kwargs)

Bases: MeanFunction

Mean function defined as a scalar (fitted while optimizing the marginal likelihood).

Parameters:

initial_mean_value – A scalar to initialize the value of the mean

forward(X)

Actual computation of the scalar mean function We compute mean_value * vector_of_ones, whose dimensions are given by the the first column of X

Parameters:

X – input data of size (n,d) for which we want to compute the mean (here, only useful to extract the right dimension)

param_encoding_pairs()

Returns list of tuples

(param_internal, encoding)

over all Gluon parameters maintained here.

Returns:

List [(param_internal, encoding)]

get_mean_value()

set_mean_value(mean_value)

get_params()

Return type:

Dict[str, Any]

Returns:

Dictionary with hyperparameter values

set_params(param_dict)

Parameters:

param_dict (Dict[str, Any]) – Dictionary with new hyperparameter values

Returns:

class syne_tune.optimizer.schedulers.searchers.bayesopt.gpautograd.mean.ZeroMeanFunction(**kwargs)

Bases: MeanFunction

forward(X)

Overrides to implement forward computation using NDArray. Only accepts positional arguments. Parameters ———- *args : list of NDArray

Input tensors.

param_encoding_pairs()

Returns list of tuples

(param_internal, encoding)

over all Gluon parameters maintained here.

Returns:

List [(param_internal, encoding)]

get_params()

Return type:

Dict[str, Any]

Returns:

Dictionary with hyperparameter values

set_params(param_dict)

Parameters:

param_dict (Dict[str, Any]) – Dictionary with new hyperparameter values

Returns: