Perplexity
Measurement of how well a probability model predicts a sample, for evaluating language models.
In italiano: PerplexityPerplexity = exp(cross_entropy). Lower perplexity indicates better prediction. Commonly used for LM evaluation.
Examples
- Language model evaluation
- GPT performance metric
- Text generation quality