Parameter

Learnable values in a model that are optimized during training (weights and biases).

In italiano: Parametro

Parameters define the model. Number of parameters indicates model capacity. Large models have billions of parameters.

Examples

  • GPT-3: 175B parameters
  • Weight and bias parameters
  • Model size