Glorot normal initializer, also called Xavier normal initializer.
It draws samples from a truncated normal distribution centered on 0
with stddev = sqrt(2 / (fan_in + fan_out))
where fan_in is the number of input units in the weight tensor
and fan_out is the number of output units in the weight tensor.
initializer_glorot_normal(seed = NULL)Arguments
| seed | Integer used to seed the random generator. |
References
Glorot & Bengio, AISTATS 2010 http://jmlr.org/proceedings/papers/v9/glorot10a/glorot10a.pdf
See also
Other initializers: initializer_constant,
initializer_glorot_uniform,
initializer_he_normal,
initializer_he_uniform,
initializer_identity,
initializer_lecun_normal,
initializer_lecun_uniform,
initializer_ones,
initializer_orthogonal,
initializer_random_normal,
initializer_random_uniform,
initializer_truncated_normal,
initializer_variance_scaling,
initializer_zeros