Group Normalization

Group Normalization: Normalizes by dividing channels into groups and normalizing within each group. Independent of batch size, unlike batch norm. Divides channels into groups. Good for small batches and video tasks. Examples include Small batch training, Video understanding, Object detection.

In italiano: Group NormalizationLegge III · Come una rete impara dai dati

Independent of batch size, unlike batch norm. Divides channels into groups. Good for small batches and video tasks.

Examples

  • Small batch training
  • Video understanding
  • Object detection