Padding mask

Padding mask: A mask excluding padding tokens from operations so they do not affect attention, loss or aggregation. Sequences of different lengths are batch-aligned with padding. An incorrect mask introduces artificial positions into computation. This perspective connects the definition with practical behaviour in artificial intelligence systems.