705,632 AI resources indexedWorking toward the world’s largest AI resource index.

Self-attention

An attention mechanism that compares positions within the same sequence, helping a model connect relevant parts of an input with each other.

By Dave AI Editorial · Models & architecture