Beam Search
Beam Search: Decoding algorithm keeping top B most likely sequences at each step. Explores multiple hypotheses simultaneously. Beam width B controls quality-speed tradeoff. Produces more coherent but less diverse outputs. Examples include Beam width 5 for translation, Deterministic decoding, Machine translation.
In italiano: Beam SearchLegge II · Probabilità, softmax e modelli generativiExplores multiple hypotheses simultaneously. Beam width B controls quality-speed tradeoff. Produces more coherent but less diverse outputs.
Examples
- Beam width 5 for translation
- Deterministic decoding
- Machine translation