Attention Score
Attention Score: Computed similarity between query and key vectors before softmax normalization in attention. Score = dotproduct(Query, Key) / sqrt(dk). Scaled dot-product prevents gradient issues. Higher scores mean more relevance. Examples include Scaled dot-product attention, Query-key similarity, Attention computation.
In italiano: Attention ScoreLegge III · Come una rete impara dai datiScore = dot_product(Query, Key) / sqrt(d_k). Scaled dot-product prevents gradient issues. Higher scores mean more relevance.
Examples
- Scaled dot-product attention
- Query-key similarity
- Attention computation