FlashAttention

FlashAttention: An attention algorithm reducing memory transfers through tiling without materialising the full score matrix. It preserves standard attention results within numerical precision. Benefits mainly come from memory hierarchy and optimised kernels. This perspective connects the definition with practical behaviour in artificial intelligence systems.