Learning Rate
Learning Rate: Hyperparameter controlling how much to adjust model weights during training. Step size in gradient descent. Too high: unstable training. Too low: slow convergence. Typical values: 0.001, 0.01, 0.1. Examples include Learning rate 0.001, LR too high causes divergence, Adaptive learning rates.
In italiano: Learning RateLegge IV · Loss, gradiente e ottimizzatoriStep size in gradient descent. Too high: unstable training. Too low: slow convergence. Typical values: 0.001, 0.01, 0.1.
Examples
- Learning rate 0.001
- LR too high causes divergence
- Adaptive learning rates
Autovalutazione
Tre domande per verificare la comprensione della voce. Le spiegazioni restano disponibili anche senza JavaScript.