inferno.extensions.initializers package

Submodules

inferno.extensions.initializers.base module

class inferno.extensions.initializers.base.Initializer[source]

Bases: object

Base class for all initializers.

VALID_LAYERS = {'Conv1d', 'Linear', 'Embedding', 'ConvTranspose1d', 'Conv2d', 'Bilinear', 'Conv3d', 'ConvTranspose2d', 'ConvTranspose3d'}
call_on_bias(tensor)[source]
call_on_tensor(tensor)[source]
call_on_weight(tensor)[source]
classmethod initializes_bias()[source]
classmethod initializes_weight()[source]
class inferno.extensions.initializers.base.Initialization(weight_initializer=None, bias_initializer=None)[source]

Bases: inferno.extensions.initializers.base.Initializer

call_on_bias(tensor)[source]
call_on_weight(tensor)[source]
class inferno.extensions.initializers.base.WeightInitFunction(init_function, *init_function_args, **init_function_kwargs)[source]

Bases: inferno.extensions.initializers.base.Initializer

call_on_weight(tensor)[source]
class inferno.extensions.initializers.base.BiasInitFunction(init_function, *init_function_args, **init_function_kwargs)[source]

Bases: inferno.extensions.initializers.base.Initializer

call_on_bias(tensor)[source]
class inferno.extensions.initializers.base.TensorInitFunction(init_function, *init_function_args, **init_function_kwargs)[source]

Bases: inferno.extensions.initializers.base.Initializer

call_on_tensor(tensor)[source]

inferno.extensions.initializers.presets module

class inferno.extensions.initializers.presets.Constant(constant)[source]

Bases: inferno.extensions.initializers.base.Initializer

Initialize with a constant.

call_on_tensor(tensor)[source]
class inferno.extensions.initializers.presets.NormalWeights(mean=0.0, stddev=1.0, sqrt_gain_over_fan_in=None)[source]

Bases: inferno.extensions.initializers.base.Initializer

Initialize weights with random numbers drawn from the normal distribution at mean and stddev.

call_on_weight(tensor)[source]
compute_fan_in(tensor)[source]
class inferno.extensions.initializers.presets.SELUWeightsZeroBias[source]

Bases: inferno.extensions.initializers.base.Initialization

class inferno.extensions.initializers.presets.ELUWeightsZeroBias[source]

Bases: inferno.extensions.initializers.base.Initialization

class inferno.extensions.initializers.presets.OrthogonalWeightsZeroBias(orthogonal_gain=1.0)[source]

Bases: inferno.extensions.initializers.base.Initialization

class inferno.extensions.initializers.presets.KaimingNormalWeightsZeroBias(relu_leakage=0)[source]

Bases: inferno.extensions.initializers.base.Initialization

Module contents