Encoder-Decoder

/ɪnˈkoʊdər dɪˈkoʊdər/

An architecture where an encoder processes input into a representation and a decoder generates output from it.

Encoder-decoder architectures are used for sequence-to-sequence tasks. The encoder compresses input into a context vector, the decoder generates output. Common in machine translation and summarization.

Examples

  • Seq2Seq for translation
  • Transformer encoder-decoder
  • VAE (Variational Autoencoder)