Beam Search

Beam Search: Decoding algorithm keeping top B most likely sequences at each step. Explores multiple hypotheses simultaneously. Beam width B controls quality-speed tradeoff. Produces more coherent but less diverse outputs. Examples include Beam width 5 for translation, Deterministic decoding, Machine translation.

In italiano: Beam SearchLegge II · Probabilità, softmax e modelli generativi

Explores multiple hypotheses simultaneously. Beam width B controls quality-speed tradeoff. Produces more coherent but less diverse outputs.

Examples

  • Beam width 5 for translation
  • Deterministic decoding
  • Machine translation