Sliding window attention

Sliding window attention: An attention scheme where each token attends only to a local window of nearby positions to reduce long-sequence cost. It limits direct receptive range while later layers propagate information. Global-token combinations retain long-distance paths. This perspective connects the definition with practical behaviour in artificial intelligence systems.