Top-K Sampling

Text generation technique sampling from only the K most likely next tokens.

In italiano: Top-K Sampling

Restricts sampling to top K tokens by probability. Reduces unlikely tokens while maintaining diversity. Common: K=40-50.

Examples

  • K=50 for balanced generation
  • Diverse text generation
  • Avoiding rare tokens