Temperature (Sampling)
Temperature (Sampling): Parameter controlling randomness in text generation by scaling logits before softmax. Temperature T divides logits. T < 1 makes distribution sharper (deterministic), T 1 flatter (random). T = 0 is greedy, T = 1 unmodified. Examples include Temperature 0.7 for creative text, Temperature 0.1 for factual, Greedy decoding T=0.
In italiano: Temperature (Sampling)Legge II · Probabilità, softmax e modelli generativiTemperature T divides logits. T < 1 makes distribution sharper (deterministic), T > 1 flatter (random). T = 0 is greedy, T = 1 unmodified.
Examples
- Temperature 0.7 for creative text
- Temperature 0.1 for factual
- Greedy decoding T=0