Batch Normalization

Batch Normalization: Normalizes layer inputs using batch statistics to stabilize and accelerate training. Normalizes using batch mean/variance, then scales/shifts with learnable parameters. Reduces internal covariate shift. Allows higher learning rates. Examples include After conv layers, Before activation, Stabilizing deep networks.

In italiano: Batch NormalizationLegge III · Come una rete impara dai dati

Normalizes using batch mean/variance, then scales/shifts with learnable parameters. Reduces internal covariate shift. Allows higher learning rates.

Examples

  • After conv layers
  • Before activation
  • Stabilizing deep networks

Fonti