nerva_tensorflow.weight_initializers

Weight and bias initialization helpers for linear layers.

Functions

set_bias_normal(b[, mean, std])	Normal (Gaussian) initialization with given mean and std.
set_bias_uniform(b[, a, b_])	Uniform initialization within [a, b).
set_bias_zero(b)	Set all bias values to zero.
set_layer_weights(layer, text)	Initialize a layer's parameters according to a named scheme.
set_weights_he_normal(W)	He / Kaiming normal initialization (for ReLU).
set_weights_he_uniform(W)	He / Kaiming uniform initialization (for ReLU).
set_weights_normal(W[, mean, std])	Normal (Gaussian) initialization with given mean and std.
set_weights_uniform(W[, a, b])	Uniform initialization within [a, b).
set_weights_xavier_normal(W)	Xavier / Glorot normal initialization.
set_weights_xavier_uniform(W)	Xavier / Glorot uniform initialization.
set_weights_zero(W)	Initialize weights to zero.

nerva_tensorflow.weight_initializers.set_bias_zero(b: tensorflow.Tensor)

Set all bias values to zero.

nerva_tensorflow.weight_initializers.set_bias_uniform(b: tensorflow.Tensor, a: float = 0.0, b_: float = 1.0)

Uniform initialization within [a, b).

nerva_tensorflow.weight_initializers.set_bias_normal(b: tensorflow.Tensor, mean: float = 0.0, std: float = 1.0)

Normal (Gaussian) initialization with given mean and std.

nerva_tensorflow.weight_initializers.set_weights_uniform(W: tensorflow.Tensor, a: float = 0.0, b: float = 1.0)

Uniform initialization within [a, b).

nerva_tensorflow.weight_initializers.set_weights_normal(W: tensorflow.Tensor, mean: float = 0.0, std: float = 1.0)

Normal (Gaussian) initialization with given mean and std.

nerva_tensorflow.weight_initializers.set_weights_xavier_uniform(W: tensorflow.Tensor)

Xavier / Glorot uniform initialization.

nerva_tensorflow.weight_initializers.set_weights_xavier_normal(W: tensorflow.Tensor)

Xavier / Glorot normal initialization.

nerva_tensorflow.weight_initializers.set_weights_he_normal(W: tensorflow.Tensor)

He / Kaiming normal initialization (for ReLU).

nerva_tensorflow.weight_initializers.set_weights_he_uniform(W: tensorflow.Tensor)

He / Kaiming uniform initialization (for ReLU).

nerva_tensorflow.weight_initializers.set_weights_zero(W: tensorflow.Tensor)

Initialize weights to zero.

nerva_tensorflow.weight_initializers.set_layer_weights(layer, text: str)

Initialize a layer’s parameters according to a named scheme.