Perplexity
Perplexity: Measurement of how well a probability model predicts a sample, for evaluating language models. Perplexity = exp(crossentropy). Lower perplexity indicates better prediction. Commonly used for LM evaluation. Examples include Language model evaluation, GPT performance metric, Text generation quality.
In italiano: PerplexityLegge II · Probabilità, softmax e modelli generativiPerplexity = exp(cross_entropy). Lower perplexity indicates better prediction. Commonly used for LM evaluation.
Examples
- Language model evaluation
- GPT performance metric
- Text generation quality