RMSprop

RMSprop: Adaptive learning rate optimization algorithm using moving average of squared gradients. Divides learning rate by exponential moving average of squared gradients. Addresses Adagrad's diminishing learning rates. Good for RNNs and non-stationary problems. Examples include RNN training, Non-convex optimization, Adaptive learning.

In italiano: RMSpropLegge IV · Loss, gradiente e ottimizzatori

Divides learning rate by exponential moving average of squared gradients. Addresses Adagrad's diminishing learning rates. Good for RNNs and non-stationary problems.

Examples

  • RNN training
  • Non-convex optimization
  • Adaptive learning