RMSprop
RMSprop: Adaptive learning rate optimization algorithm using moving average of squared gradients. Divides learning rate by exponential moving average of squared gradients. Addresses Adagrad's diminishing learning rates. Good for RNNs and non-stationary problems. Examples include RNN training, Non-convex optimization, Adaptive learning.
In italiano: RMSpropLegge IV · Loss, gradiente e ottimizzatoriDivides learning rate by exponential moving average of squared gradients. Addresses Adagrad's diminishing learning rates. Good for RNNs and non-stationary problems.
Examples
- RNN training
- Non-convex optimization
- Adaptive learning