Group Normalization
Normalizes by dividing channels into groups and normalizing within each group.
In italiano: Group NormalizationIndependent of batch size, unlike batch norm. Divides channels into groups. Good for small batches and video tasks.
Examples
- Small batch training
- Video understanding
- Object detection