Top-K Sampling
Top-K Sampling: Text generation technique sampling from only the K most likely next tokens. Restricts sampling to top K tokens by probability. Reduces unlikely tokens while maintaining diversity. Common: K=40-50. Examples include K=50 for balanced generation, Diverse text generation, Avoiding rare tokens.
In italiano: Top-K SamplingLegge II · Probabilità, softmax e modelli generativiRestricts sampling to top K tokens by probability. Reduces unlikely tokens while maintaining diversity. Common: K=40-50.
Examples
- K=50 for balanced generation
- Diverse text generation
- Avoiding rare tokens
Autovalutazione
Tre domande per verificare la comprensione della voce. Le spiegazioni restano disponibili anche senza JavaScript.