SGD (Stochastic Gradient Descent)
/stoʊˈkæstɪk ˈɡreɪdiənt dɪˈsɛnt/
SGD (Stochastic Gradient Descent): A gradient descent variant that updates weights using gradients from a single random training example at a time. SGD is faster and enables online learning but has noisy gradients. The noise can help escape local minima.
In italiano: SGD (Stochastic Gradient Descent)Legge IV · Loss, gradiente e ottimizzatoriSGD is faster and enables online learning but has noisy gradients. The noise can help escape local minima. Mini-batch SGD balances efficiency and gradient quality.
Examples
- Online learning
- Large-scale training
- Escaping local minima