Attention
A mechanism that helps a model weigh relationships between parts of its input. In a language model, it helps connect a word or token with relevant surrounding information.
By Dave AI Editorial · Models & architecture
705,632 AI resources indexedWorking toward the world’s largest AI resource index.
A mechanism that helps a model weigh relationships between parts of its input. In a language model, it helps connect a word or token with relevant surrounding information.
By Dave AI Editorial · Models & architecture