Gradient
Gradient: Direction and magnitude of steepest increase in loss function with respect to parameters. Gradients indicate how to adjust weights to reduce loss. Computed via backpropagation. Move in opposite direction (gradient descent). Examples include Weight gradient: -0.5, Gradient flow through network, Vanishing gradients.
In italiano: GradienteLegge IV · Loss, gradiente e ottimizzatoriGradients indicate how to adjust weights to reduce loss. Computed via backpropagation. Move in opposite direction (gradient descent).
Examples
- Weight gradient: -0.5
- Gradient flow through network
- Vanishing gradients