MoE
Mixture of experts
An architecture that routes inputs through selected expert components. It can provide a large total parameter count while using only part of the model for each token.
By Dave AI Editorial · Models & architecture
705,632 AI resources indexedWorking toward the world’s largest AI resource index.
Mixture of experts
An architecture that routes inputs through selected expert components. It can provide a large total parameter count while using only part of the model for each token.
By Dave AI Editorial · Models & architecture