Batch Size
Number of training examples processed together in one forward/backward pass.
In italiano: Batch SizeLarger batches: more stable gradients but more memory. Smaller batches: less memory but noisier gradients. Common: 32, 64, 128, 256.
Examples
- Batch size 32
- Mini-batch training
- Full batch vs mini-batch