Glorot uniform initializer, also called Xavier uniform initializer.
It draws samples from a uniform distribution within -limit, limit
where limit
is sqrt(6 / (fan_in + fan_out))
where fan_in
is the number of input units in the weight tensor
and fan_out
is the number of output units in the weight tensor.
initializer_glorot_uniform(seed = NULL)
Arguments
seed | Integer used to seed the random generator. |
References
Glorot & Bengio, AISTATS 2010 http://jmlr.org/proceedings/papers/v9/glorot10a/glorot10a.pdf
See also
Other initializers: initializer_constant
,
initializer_glorot_normal
,
initializer_he_normal
,
initializer_he_uniform
,
initializer_identity
,
initializer_lecun_normal
,
initializer_lecun_uniform
,
initializer_ones
,
initializer_orthogonal
,
initializer_random_normal
,
initializer_random_uniform
,
initializer_truncated_normal
,
initializer_variance_scaling
,
initializer_zeros