Perplexity

Perplexity: Measurement of how well a probability model predicts a sample, for evaluating language models. Perplexity = exp(crossentropy). Lower perplexity indicates better prediction. Commonly used for LM evaluation. Examples include Language model evaluation, GPT performance metric, Text generation quality.

In italiano: PerplexityLegge II · Probabilità, softmax e modelli generativi

Perplexity = exp(cross_entropy). Lower perplexity indicates better prediction. Commonly used for LM evaluation.

Examples

  • Language model evaluation
  • GPT performance metric
  • Text generation quality